2024-09-13T23:45:18.988 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T23:45:19.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T23:45:19.098 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_22:40:03-rgw-reef-distro-default-smithi/7904474 branch: reef description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_20.04}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904474' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-13_22:40:03-rgw-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: reef ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: e4e227b37858f5109138494e01e5ba1ba7b8ffe8 wait-for-scrub: false ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: e4e227b37858f5109138494e01e5ba1ba7b8ffe8 rgw: ec-data-pool: true frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: e4e227b37858f5109138494e01e5ba1ba7b8ffe8 owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 4285 sha1: e4e227b37858f5109138494e01e5ba1ba7b8ffe8 sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_e4e227b37858f5109138494e01e5ba1ba7b8ffe8/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: e4e227b37858f5109138494e01e5ba1ba7b8ffe8 targets: smithi087.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi173.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_22:40:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T23:45:19.098 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_e4e227b37858f5109138494e01e5ba1ba7b8ffe8/qa; will attempt to use it 2024-09-13T23:45:19.098 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_e4e227b37858f5109138494e01e5ba1ba7b8ffe8/qa/tasks 2024-09-13T23:45:19.099 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T23:45:19.100 INFO:teuthology.task.internal:Checking packages... 2024-09-13T23:45:19.120 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8' 2024-09-13T23:45:19.120 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T23:45:19.120 INFO:teuthology.packaging:ref: None 2024-09-13T23:45:19.120 INFO:teuthology.packaging:tag: None 2024-09-13T23:45:19.120 INFO:teuthology.packaging:branch: reef 2024-09-13T23:45:19.120 INFO:teuthology.packaging:sha1: e4e227b37858f5109138494e01e5ba1ba7b8ffe8 2024-09-13T23:45:19.120 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=reef 2024-09-13T23:45:19.359 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-845-ge4e227b3-1focal 2024-09-13T23:45:19.361 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T23:45:19.368 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T23:45:19.368 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T23:45:19.417 INFO:teuthology.task.internal:Saving configuration 2024-09-13T23:45:19.429 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T23:45:19.449 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T23:45:19.483 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_22:40:03-rgw-reef-distro-default-smithi/7904474', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 23:39:14.268284', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-13T23:45:19.513 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_22:40:03-rgw-reef-distro-default-smithi/7904474', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 23:39:14.266389', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-13T23:45:19.513 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T23:45:19.520 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-13T23:45:19.520 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-13T23:45:19.521 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T23:45:19.614 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff4d3aa3130>, signals=[15]) 2024-09-13T23:45:19.614 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T23:45:19.622 INFO:teuthology.task.internal:Opening connections... 2024-09-13T23:45:19.622 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T23:45:19.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T23:45:19.720 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi173.front.sepia.ceph.com 2024-09-13T23:45:19.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T23:45:19.825 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T23:45:19.832 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2024-09-13T23:45:19.839 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2024-09-13T23:45:19.839 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2024-09-13T23:45:19.887 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Ubuntu" 2024-09-13T23:45:19.887 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-13T23:45:19.887 INFO:teuthology.orchestra.run.smithi087.stdout:ID=ubuntu 2024-09-13T23:45:19.887 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE=debian 2024-09-13T23:45:19.887 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-13T23:45:19.887 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="20.04" 2024-09-13T23:45:19.887 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T23:45:19.888 INFO:teuthology.orchestra.run.smithi087.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T23:45:19.888 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T23:45:19.888 INFO:teuthology.orchestra.run.smithi087.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T23:45:19.888 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_CODENAME=focal 2024-09-13T23:45:19.888 INFO:teuthology.orchestra.run.smithi087.stdout:UBUNTU_CODENAME=focal 2024-09-13T23:45:19.888 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2024-09-13T23:45:19.927 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2024-09-13T23:45:19.937 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2024-09-13T23:45:19.937 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-09-13T23:45:19.986 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="Ubuntu" 2024-09-13T23:45:19.986 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-13T23:45:19.986 INFO:teuthology.orchestra.run.smithi173.stdout:ID=ubuntu 2024-09-13T23:45:19.986 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE=debian 2024-09-13T23:45:19.986 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-13T23:45:19.986 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="20.04" 2024-09-13T23:45:19.986 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T23:45:19.986 INFO:teuthology.orchestra.run.smithi173.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T23:45:19.986 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T23:45:19.987 INFO:teuthology.orchestra.run.smithi173.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T23:45:19.987 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_CODENAME=focal 2024-09-13T23:45:19.987 INFO:teuthology.orchestra.run.smithi173.stdout:UBUNTU_CODENAME=focal 2024-09-13T23:45:19.987 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-09-13T23:45:20.027 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T23:45:20.037 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T23:45:20.068 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T23:45:20.068 DEBUG:teuthology.orchestra.run.smithi087:> test '!' -e /home/ubuntu/cephtest 2024-09-13T23:45:20.070 DEBUG:teuthology.orchestra.run.smithi173:> test '!' -e /home/ubuntu/cephtest 2024-09-13T23:45:20.076 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T23:45:20.110 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T23:45:20.110 DEBUG:teuthology.orchestra.run.smithi087:> test -z $(ls -A /var/lib/ceph) 2024-09-13T23:45:20.123 DEBUG:teuthology.orchestra.run.smithi173:> test -z $(ls -A /var/lib/ceph) 2024-09-13T23:45:20.143 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T23:45:20.221 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T23:45:20.237 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T23:45:20.237 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T23:45:20.237 DEBUG:teuthology.orchestra.run.smithi087:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T23:45:20.238 DEBUG:teuthology.orchestra.run.smithi173:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T23:45:20.242 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:45:20.243 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-09-13T23:45:20.243 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:45:20.244 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2024-09-13T23:45:20.250 INFO:teuthology.orchestra.run.smithi087.stdout:5.4.0-124-generic 2024-09-13T23:45:20.250 INFO:teuthology.task.kernel:Running kernel on smithi087: 5.4.0-124-generic 2024-09-13T23:45:20.250 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get clean 2024-09-13T23:45:20.251 INFO:teuthology.orchestra.run.smithi173.stdout:5.4.0-124-generic 2024-09-13T23:45:20.251 INFO:teuthology.task.kernel:Running kernel on smithi173: 5.4.0-124-generic 2024-09-13T23:45:20.252 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-get clean 2024-09-13T23:45:20.362 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get update 2024-09-13T23:45:20.411 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-get update 2024-09-13T23:45:20.516 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-09-13T23:45:20.633 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T23:45:20.699 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T23:45:20.700 INFO:teuthology.orchestra.run.smithi173.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-09-13T23:45:20.715 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-09-13T23:45:20.749 INFO:teuthology.orchestra.run.smithi173.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-09-13T23:45:20.810 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [812 kB] 2024-09-13T23:45:20.905 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,195 kB] 2024-09-13T23:45:20.946 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [472 kB] 2024-09-13T23:45:20.950 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.3 kB] 2024-09-13T23:45:20.950 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.3 kB] 2024-09-13T23:45:20.950 INFO:teuthology.orchestra.run.smithi087.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,117 kB] 2024-09-13T23:45:20.970 INFO:teuthology.orchestra.run.smithi087.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [436 kB] 2024-09-13T23:45:20.973 INFO:teuthology.orchestra.run.smithi087.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [548 B] 2024-09-13T23:45:20.973 INFO:teuthology.orchestra.run.smithi087.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [1,011 kB] 2024-09-13T23:45:20.980 INFO:teuthology.orchestra.run.smithi087.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [681 kB] 2024-09-13T23:45:20.984 INFO:teuthology.orchestra.run.smithi087.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [213 kB] 2024-09-13T23:45:20.986 INFO:teuthology.orchestra.run.smithi087.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.2 kB] 2024-09-13T23:45:20.986 INFO:teuthology.orchestra.run.smithi087.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-09-13T23:45:20.986 INFO:teuthology.orchestra.run.smithi087.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-09-13T23:45:20.986 INFO:teuthology.orchestra.run.smithi087.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-09-13T23:45:20.999 INFO:teuthology.orchestra.run.smithi087.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-09-13T23:45:21.068 INFO:teuthology.orchestra.run.smithi087.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-09-13T23:45:21.102 INFO:teuthology.orchestra.run.smithi173.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-09-13T23:45:21.180 INFO:teuthology.orchestra.run.smithi173.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [812 kB] 2024-09-13T23:45:21.208 INFO:teuthology.orchestra.run.smithi087.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,030 kB] 2024-09-13T23:45:21.321 INFO:teuthology.orchestra.run.smithi173.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,563 kB] 2024-09-13T23:45:21.452 INFO:teuthology.orchestra.run.smithi087.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,563 kB] 2024-09-13T23:45:21.528 INFO:teuthology.orchestra.run.smithi173.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,195 kB] 2024-09-13T23:45:21.620 INFO:teuthology.orchestra.run.smithi087.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [550 kB] 2024-09-13T23:45:21.633 INFO:teuthology.orchestra.run.smithi087.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-09-13T23:45:21.633 INFO:teuthology.orchestra.run.smithi087.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.6 kB] 2024-09-13T23:45:21.634 INFO:teuthology.orchestra.run.smithi087.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,236 kB] 2024-09-13T23:45:21.721 INFO:teuthology.orchestra.run.smithi173.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [472 kB] 2024-09-13T23:45:21.733 INFO:teuthology.orchestra.run.smithi087.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [453 kB] 2024-09-13T23:45:21.735 INFO:teuthology.orchestra.run.smithi173.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.3 kB] 2024-09-13T23:45:21.736 INFO:teuthology.orchestra.run.smithi173.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.3 kB] 2024-09-13T23:45:21.737 INFO:teuthology.orchestra.run.smithi173.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,117 kB] 2024-09-13T23:45:21.742 INFO:teuthology.orchestra.run.smithi087.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [548 B] 2024-09-13T23:45:21.742 INFO:teuthology.orchestra.run.smithi087.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,230 kB] 2024-09-13T23:45:21.780 INFO:teuthology.orchestra.run.smithi087.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [807 kB] 2024-09-13T23:45:21.788 INFO:teuthology.orchestra.run.smithi173.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,030 kB] 2024-09-13T23:45:21.800 INFO:teuthology.orchestra.run.smithi087.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [295 kB] 2024-09-13T23:45:21.805 INFO:teuthology.orchestra.run.smithi173.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [550 kB] 2024-09-13T23:45:21.808 INFO:teuthology.orchestra.run.smithi087.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [28.0 kB] 2024-09-13T23:45:21.812 INFO:teuthology.orchestra.run.smithi173.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-09-13T23:45:21.812 INFO:teuthology.orchestra.run.smithi173.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.6 kB] 2024-09-13T23:45:21.813 INFO:teuthology.orchestra.run.smithi173.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,236 kB] 2024-09-13T23:45:21.815 INFO:teuthology.orchestra.run.smithi087.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-09-13T23:45:21.815 INFO:teuthology.orchestra.run.smithi087.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-09-13T23:45:21.816 INFO:teuthology.orchestra.run.smithi087.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-09-13T23:45:21.829 INFO:teuthology.orchestra.run.smithi173.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [436 kB] 2024-09-13T23:45:21.838 INFO:teuthology.orchestra.run.smithi173.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [548 B] 2024-09-13T23:45:21.838 INFO:teuthology.orchestra.run.smithi173.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [681 kB] 2024-09-13T23:45:21.861 INFO:teuthology.orchestra.run.smithi173.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [1,011 kB] 2024-09-13T23:45:21.870 INFO:teuthology.orchestra.run.smithi087.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-09-13T23:45:21.870 INFO:teuthology.orchestra.run.smithi087.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-09-13T23:45:21.871 INFO:teuthology.orchestra.run.smithi087.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-09-13T23:45:21.872 INFO:teuthology.orchestra.run.smithi087.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-09-13T23:45:21.888 INFO:teuthology.orchestra.run.smithi173.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [213 kB] 2024-09-13T23:45:21.895 INFO:teuthology.orchestra.run.smithi173.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.2 kB] 2024-09-13T23:45:21.895 INFO:teuthology.orchestra.run.smithi173.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-09-13T23:45:21.895 INFO:teuthology.orchestra.run.smithi173.stdout:Get:24 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-09-13T23:45:21.896 INFO:teuthology.orchestra.run.smithi173.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-09-13T23:45:21.905 INFO:teuthology.orchestra.run.smithi173.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [453 kB] 2024-09-13T23:45:21.912 INFO:teuthology.orchestra.run.smithi173.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [548 B] 2024-09-13T23:45:21.913 INFO:teuthology.orchestra.run.smithi173.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,230 kB] 2024-09-13T23:45:21.953 INFO:teuthology.orchestra.run.smithi087.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-09-13T23:45:21.953 INFO:teuthology.orchestra.run.smithi087.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-09-13T23:45:21.953 INFO:teuthology.orchestra.run.smithi087.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-09-13T23:45:21.968 INFO:teuthology.orchestra.run.smithi173.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [807 kB] 2024-09-13T23:45:21.968 INFO:teuthology.orchestra.run.smithi173.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-09-13T23:45:21.981 INFO:teuthology.orchestra.run.smithi173.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [295 kB] 2024-09-13T23:45:21.986 INFO:teuthology.orchestra.run.smithi173.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [28.0 kB] 2024-09-13T23:45:21.986 INFO:teuthology.orchestra.run.smithi173.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-09-13T23:45:21.987 INFO:teuthology.orchestra.run.smithi173.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-09-13T23:45:21.987 INFO:teuthology.orchestra.run.smithi173.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-09-13T23:45:22.050 INFO:teuthology.orchestra.run.smithi173.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-09-13T23:45:22.050 INFO:teuthology.orchestra.run.smithi173.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-09-13T23:45:22.051 INFO:teuthology.orchestra.run.smithi173.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-09-13T23:45:22.131 INFO:teuthology.orchestra.run.smithi173.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-09-13T23:45:22.131 INFO:teuthology.orchestra.run.smithi173.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-09-13T23:45:22.132 INFO:teuthology.orchestra.run.smithi173.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-09-13T23:45:22.133 INFO:teuthology.orchestra.run.smithi173.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-09-13T23:45:25.109 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 21.8 MB in 3s (7,527 kB/s) 2024-09-13T23:45:26.050 INFO:teuthology.orchestra.run.smithi173.stdout:Fetched 21.8 MB in 4s (6,111 kB/s) 2024-09-13T23:45:26.650 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-09-13T23:45:26.676 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T23:45:26.755 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-09-13T23:45:26.971 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2024-09-13T23:45:26.972 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2024-09-13T23:45:27.175 INFO:teuthology.orchestra.run.smithi087.stdout:The following additional packages will be installed: 2024-09-13T23:45:27.176 INFO:teuthology.orchestra.run.smithi087.stdout: linux-generic linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-13T23:45:27.176 INFO:teuthology.orchestra.run.smithi087.stdout: linux-headers-generic linux-image-5.4.0-195-generic 2024-09-13T23:45:27.176 INFO:teuthology.orchestra.run.smithi087.stdout: linux-modules-5.4.0-195-generic linux-modules-extra-5.4.0-195-generic 2024-09-13T23:45:27.177 INFO:teuthology.orchestra.run.smithi087.stdout:Suggested packages: 2024-09-13T23:45:27.177 INFO:teuthology.orchestra.run.smithi087.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-09-13T23:45:27.177 INFO:teuthology.orchestra.run.smithi087.stdout:Recommended packages: 2024-09-13T23:45:27.177 INFO:teuthology.orchestra.run.smithi087.stdout: thermald 2024-09-13T23:45:27.235 INFO:teuthology.orchestra.run.smithi087.stdout:The following NEW packages will be installed: 2024-09-13T23:45:27.235 INFO:teuthology.orchestra.run.smithi087.stdout: linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-13T23:45:27.235 INFO:teuthology.orchestra.run.smithi087.stdout: linux-image-5.4.0-195-generic linux-modules-5.4.0-195-generic 2024-09-13T23:45:27.236 INFO:teuthology.orchestra.run.smithi087.stdout: linux-modules-extra-5.4.0-195-generic 2024-09-13T23:45:27.237 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages will be upgraded: 2024-09-13T23:45:27.238 INFO:teuthology.orchestra.run.smithi087.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T23:45:27.420 INFO:teuthology.orchestra.run.smithi087.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-09-13T23:45:27.420 INFO:teuthology.orchestra.run.smithi087.stdout:Need to get 77.2 MB of archives. 2024-09-13T23:45:27.420 INFO:teuthology.orchestra.run.smithi087.stdout:After this operation, 381 MB of additional disk space will be used. 2024-09-13T23:45:27.420 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-195-generic amd64 5.4.0-195.215 [15.0 MB] 2024-09-13T23:45:27.637 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2024-09-13T23:45:27.665 DEBUG:teuthology.orchestra.run.smithi173:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T23:45:27.739 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2024-09-13T23:45:27.941 INFO:teuthology.orchestra.run.smithi173.stdout:Building dependency tree... 2024-09-13T23:45:27.941 INFO:teuthology.orchestra.run.smithi173.stdout:Reading state information... 2024-09-13T23:45:28.138 INFO:teuthology.orchestra.run.smithi173.stdout:The following additional packages will be installed: 2024-09-13T23:45:28.139 INFO:teuthology.orchestra.run.smithi173.stdout: linux-generic linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-13T23:45:28.139 INFO:teuthology.orchestra.run.smithi173.stdout: linux-headers-generic linux-image-5.4.0-195-generic 2024-09-13T23:45:28.139 INFO:teuthology.orchestra.run.smithi173.stdout: linux-modules-5.4.0-195-generic linux-modules-extra-5.4.0-195-generic 2024-09-13T23:45:28.140 INFO:teuthology.orchestra.run.smithi173.stdout:Suggested packages: 2024-09-13T23:45:28.140 INFO:teuthology.orchestra.run.smithi173.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-09-13T23:45:28.140 INFO:teuthology.orchestra.run.smithi173.stdout:Recommended packages: 2024-09-13T23:45:28.140 INFO:teuthology.orchestra.run.smithi173.stdout: thermald 2024-09-13T23:45:28.224 INFO:teuthology.orchestra.run.smithi173.stdout:The following NEW packages will be installed: 2024-09-13T23:45:28.224 INFO:teuthology.orchestra.run.smithi173.stdout: linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-13T23:45:28.224 INFO:teuthology.orchestra.run.smithi173.stdout: linux-image-5.4.0-195-generic linux-modules-5.4.0-195-generic 2024-09-13T23:45:28.225 INFO:teuthology.orchestra.run.smithi173.stdout: linux-modules-extra-5.4.0-195-generic 2024-09-13T23:45:28.226 INFO:teuthology.orchestra.run.smithi173.stdout:The following packages will be upgraded: 2024-09-13T23:45:28.226 INFO:teuthology.orchestra.run.smithi173.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T23:45:28.280 INFO:teuthology.orchestra.run.smithi173.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-09-13T23:45:28.280 INFO:teuthology.orchestra.run.smithi173.stdout:Need to get 77.2 MB of archives. 2024-09-13T23:45:28.280 INFO:teuthology.orchestra.run.smithi173.stdout:After this operation, 381 MB of additional disk space will be used. 2024-09-13T23:45:28.280 INFO:teuthology.orchestra.run.smithi173.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-195-generic amd64 5.4.0-195.215 [15.0 MB] 2024-09-13T23:45:28.621 INFO:teuthology.orchestra.run.smithi173.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-195-generic amd64 5.4.0-195.215 [10.5 MB] 2024-09-13T23:45:28.693 INFO:teuthology.orchestra.run.smithi087.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-195-generic amd64 5.4.0-195.215 [10.5 MB] 2024-09-13T23:45:28.714 INFO:teuthology.orchestra.run.smithi173.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-195-generic amd64 5.4.0-195.215 [39.2 MB] 2024-09-13T23:45:28.965 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-195-generic amd64 5.4.0-195.215 [39.2 MB] 2024-09-13T23:45:29.194 INFO:teuthology.orchestra.run.smithi173.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.195.193 [1,900 B] 2024-09-13T23:45:29.194 INFO:teuthology.orchestra.run.smithi173.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.195.193 [2,584 B] 2024-09-13T23:45:29.194 INFO:teuthology.orchestra.run.smithi173.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195 all 5.4.0-195.215 [11.0 MB] 2024-09-13T23:45:29.288 INFO:teuthology.orchestra.run.smithi173.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195-generic amd64 5.4.0-195.215 [1,386 kB] 2024-09-13T23:45:29.298 INFO:teuthology.orchestra.run.smithi173.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.195.193 [2,460 B] 2024-09-13T23:45:29.973 INFO:teuthology.orchestra.run.smithi173.stdout:Fetched 77.2 MB in 1s (72.5 MB/s) 2024-09-13T23:45:30.151 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package linux-modules-5.4.0-195-generic. 2024-09-13T23:45:30.264 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.195.193 [1,900 B] 2024-09-13T23:45:30.264 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.195.193 [2,584 B] 2024-09-13T23:45:30.264 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195 all 5.4.0-195.215 [11.0 MB] 2024-09-13T23:45:30.589 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195-generic amd64 5.4.0-195.215 [1,386 kB] 2024-09-13T23:45:30.605 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.195.193 [2,460 B] 2024-09-13T23:45:31.303 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 77.2 MB in 3s (23.0 MB/s) 2024-09-13T23:45:31.483 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-modules-5.4.0-195-generic. 2024-09-13T23:45:31.888 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-09-13T23:45:31.893 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../0-linux-modules-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T23:45:31.982 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T23:45:33.256 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-09-13T23:45:33.261 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../0-linux-modules-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T23:45:33.356 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T23:45:33.876 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package linux-image-5.4.0-195-generic. 2024-09-13T23:45:33.890 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../1-linux-image-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T23:45:33.990 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T23:45:35.037 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-195-generic. 2024-09-13T23:45:35.052 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T23:45:35.087 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T23:45:35.242 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-image-5.4.0-195-generic. 2024-09-13T23:45:35.255 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../1-linux-image-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T23:45:35.363 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T23:45:36.444 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-195-generic. 2024-09-13T23:45:36.458 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T23:45:36.502 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T23:45:40.082 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../3-linux-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T23:45:40.215 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T23:45:40.565 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T23:45:40.668 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-image-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T23:45:40.996 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package linux-headers-5.4.0-195. 2024-09-13T23:45:41.010 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../5-linux-headers-5.4.0-195_5.4.0-195.215_all.deb ... 2024-09-13T23:45:41.054 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-13T23:45:41.219 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../3-linux-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T23:45:41.345 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T23:45:41.671 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T23:45:41.815 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-image-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T23:45:42.152 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-headers-5.4.0-195. 2024-09-13T23:45:42.166 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../5-linux-headers-5.4.0-195_5.4.0-195.215_all.deb ... 2024-09-13T23:45:42.210 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-13T23:45:46.359 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package linux-headers-5.4.0-195-generic. 2024-09-13T23:45:46.381 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../6-linux-headers-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T23:45:46.450 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T23:45:48.203 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-headers-5.4.0-195-generic. 2024-09-13T23:45:48.226 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../6-linux-headers-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T23:45:48.269 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T23:45:49.257 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T23:45:49.385 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-headers-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T23:45:49.738 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T23:45:50.874 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T23:45:50.936 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T23:45:51.018 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-headers-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T23:45:51.352 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T23:45:52.109 INFO:teuthology.orchestra.run.smithi173.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-195-generic 2024-09-13T23:45:52.109 INFO:teuthology.orchestra.run.smithi173.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-195-generic 2024-09-13T23:45:52.246 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T23:45:52.573 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T23:45:53.423 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-13T23:45:53.549 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-image-generic (5.4.0.195.193) ... 2024-09-13T23:45:53.675 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T23:45:53.818 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-headers-generic (5.4.0.195.193) ... 2024-09-13T23:45:54.136 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-generic (5.4.0.195.193) ... 2024-09-13T23:45:54.269 INFO:teuthology.orchestra.run.smithi087.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-195-generic 2024-09-13T23:45:54.269 INFO:teuthology.orchestra.run.smithi087.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-195-generic 2024-09-13T23:45:54.400 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T23:45:55.240 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T23:45:55.312 INFO:teuthology.orchestra.run.smithi173.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T23:45:55.312 INFO:teuthology.orchestra.run.smithi173.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-195-generic 2024-09-13T23:45:55.577 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-13T23:45:55.703 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-image-generic (5.4.0.195.193) ... 2024-09-13T23:45:55.829 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T23:45:55.972 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-headers-generic (5.4.0.195.193) ... 2024-09-13T23:45:56.098 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-generic (5.4.0.195.193) ... 2024-09-13T23:45:56.233 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T23:45:56.311 INFO:teuthology.orchestra.run.smithi087.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T23:45:56.311 INFO:teuthology.orchestra.run.smithi087.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-195-generic 2024-09-13T23:46:17.255 INFO:teuthology.orchestra.run.smithi173.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T23:46:17.255 INFO:teuthology.orchestra.run.smithi173.stdout:Sourcing file `/etc/default/grub' 2024-09-13T23:46:17.266 INFO:teuthology.orchestra.run.smithi173.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T23:46:17.290 INFO:teuthology.orchestra.run.smithi173.stdout:Generating grub configuration file ... 2024-09-13T23:46:17.575 INFO:teuthology.orchestra.run.smithi173.stdout:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-13T23:46:17.596 INFO:teuthology.orchestra.run.smithi173.stdout:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-13T23:46:17.958 INFO:teuthology.orchestra.run.smithi173.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T23:46:17.970 INFO:teuthology.orchestra.run.smithi173.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T23:46:18.423 INFO:teuthology.orchestra.run.smithi087.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T23:46:18.424 INFO:teuthology.orchestra.run.smithi087.stdout:Sourcing file `/etc/default/grub' 2024-09-13T23:46:18.429 INFO:teuthology.orchestra.run.smithi087.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T23:46:18.449 INFO:teuthology.orchestra.run.smithi087.stdout:Generating grub configuration file ... 2024-09-13T23:46:18.789 INFO:teuthology.orchestra.run.smithi087.stdout:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-13T23:46:18.812 INFO:teuthology.orchestra.run.smithi087.stdout:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-13T23:46:19.194 INFO:teuthology.orchestra.run.smithi087.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T23:46:19.206 INFO:teuthology.orchestra.run.smithi087.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T23:46:20.709 INFO:teuthology.orchestra.run.smithi173.stdout:done 2024-09-13T23:46:21.127 DEBUG:teuthology.orchestra.run.smithi173:> dpkg -s linux-image-generic 2024-09-13T23:46:21.221 INFO:teuthology.orchestra.run.smithi173.stdout:Package: linux-image-generic 2024-09-13T23:46:21.221 INFO:teuthology.orchestra.run.smithi173.stdout:Status: install ok installed 2024-09-13T23:46:21.221 INFO:teuthology.orchestra.run.smithi173.stdout:Priority: optional 2024-09-13T23:46:21.221 INFO:teuthology.orchestra.run.smithi173.stdout:Section: kernel 2024-09-13T23:46:21.221 INFO:teuthology.orchestra.run.smithi173.stdout:Installed-Size: 20 2024-09-13T23:46:21.221 INFO:teuthology.orchestra.run.smithi173.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T23:46:21.221 INFO:teuthology.orchestra.run.smithi173.stdout:Architecture: amd64 2024-09-13T23:46:21.221 INFO:teuthology.orchestra.run.smithi173.stdout:Source: linux-meta 2024-09-13T23:46:21.221 INFO:teuthology.orchestra.run.smithi173.stdout:Version: 5.4.0.195.193 2024-09-13T23:46:21.222 INFO:teuthology.orchestra.run.smithi173.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-13T23:46:21.222 INFO:teuthology.orchestra.run.smithi173.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T23:46:21.222 INFO:teuthology.orchestra.run.smithi173.stdout:Recommends: thermald 2024-09-13T23:46:21.222 INFO:teuthology.orchestra.run.smithi173.stdout:Description: Generic Linux kernel image 2024-09-13T23:46:21.222 INFO:teuthology.orchestra.run.smithi173.stdout: This package will always depend on the latest generic kernel image 2024-09-13T23:46:21.222 INFO:teuthology.orchestra.run.smithi173.stdout: available. 2024-09-13T23:46:21.222 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-195-generic 2024-09-13T23:46:21.222 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T23:46:21.222 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T23:46:21.223 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-13T23:46:21.223 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi173.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T23:46:21.223 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-get clean 2024-09-13T23:46:21.310 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-get update 2024-09-13T23:46:21.446 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T23:46:21.447 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T23:46:21.452 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T23:46:21.470 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T23:46:21.917 INFO:teuthology.orchestra.run.smithi087.stdout:done 2024-09-13T23:46:22.315 DEBUG:teuthology.orchestra.run.smithi087:> dpkg -s linux-image-generic 2024-09-13T23:46:22.364 INFO:teuthology.orchestra.run.smithi087.stdout:Package: linux-image-generic 2024-09-13T23:46:22.365 INFO:teuthology.orchestra.run.smithi087.stdout:Status: install ok installed 2024-09-13T23:46:22.365 INFO:teuthology.orchestra.run.smithi087.stdout:Priority: optional 2024-09-13T23:46:22.365 INFO:teuthology.orchestra.run.smithi087.stdout:Section: kernel 2024-09-13T23:46:22.365 INFO:teuthology.orchestra.run.smithi087.stdout:Installed-Size: 20 2024-09-13T23:46:22.365 INFO:teuthology.orchestra.run.smithi087.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T23:46:22.365 INFO:teuthology.orchestra.run.smithi087.stdout:Architecture: amd64 2024-09-13T23:46:22.365 INFO:teuthology.orchestra.run.smithi087.stdout:Source: linux-meta 2024-09-13T23:46:22.365 INFO:teuthology.orchestra.run.smithi087.stdout:Version: 5.4.0.195.193 2024-09-13T23:46:22.365 INFO:teuthology.orchestra.run.smithi087.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-13T23:46:22.365 INFO:teuthology.orchestra.run.smithi087.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T23:46:22.365 INFO:teuthology.orchestra.run.smithi087.stdout:Recommends: thermald 2024-09-13T23:46:22.366 INFO:teuthology.orchestra.run.smithi087.stdout:Description: Generic Linux kernel image 2024-09-13T23:46:22.366 INFO:teuthology.orchestra.run.smithi087.stdout: This package will always depend on the latest generic kernel image 2024-09-13T23:46:22.366 INFO:teuthology.orchestra.run.smithi087.stdout: available. 2024-09-13T23:46:22.366 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-195-generic 2024-09-13T23:46:22.366 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T23:46:22.366 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T23:46:22.366 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-13T23:46:22.366 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi087.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T23:46:22.366 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get clean 2024-09-13T23:46:22.450 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get update 2024-09-13T23:46:22.581 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T23:46:22.588 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T23:46:22.605 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T23:46:22.700 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T23:46:23.307 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2024-09-13T23:46:23.335 DEBUG:teuthology.orchestra.run.smithi173:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T23:46:23.408 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2024-09-13T23:46:23.620 INFO:teuthology.orchestra.run.smithi173.stdout:Building dependency tree... 2024-09-13T23:46:23.621 INFO:teuthology.orchestra.run.smithi173.stdout:Reading state information... 2024-09-13T23:46:23.858 INFO:teuthology.orchestra.run.smithi173.stdout:linux-image-generic is already the newest version (5.4.0.195.193). 2024-09-13T23:46:23.858 INFO:teuthology.orchestra.run.smithi173.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-09-13T23:46:23.860 DEBUG:teuthology.orchestra.run.smithi173:> dpkg -s linux-image-generic 2024-09-13T23:46:23.883 INFO:teuthology.orchestra.run.smithi173.stdout:Package: linux-image-generic 2024-09-13T23:46:23.883 INFO:teuthology.orchestra.run.smithi173.stdout:Status: install ok installed 2024-09-13T23:46:23.883 INFO:teuthology.orchestra.run.smithi173.stdout:Priority: optional 2024-09-13T23:46:23.883 INFO:teuthology.orchestra.run.smithi173.stdout:Section: kernel 2024-09-13T23:46:23.883 INFO:teuthology.orchestra.run.smithi173.stdout:Installed-Size: 20 2024-09-13T23:46:23.883 INFO:teuthology.orchestra.run.smithi173.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T23:46:23.883 INFO:teuthology.orchestra.run.smithi173.stdout:Architecture: amd64 2024-09-13T23:46:23.883 INFO:teuthology.orchestra.run.smithi173.stdout:Source: linux-meta 2024-09-13T23:46:23.883 INFO:teuthology.orchestra.run.smithi173.stdout:Version: 5.4.0.195.193 2024-09-13T23:46:23.884 INFO:teuthology.orchestra.run.smithi173.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-13T23:46:23.884 INFO:teuthology.orchestra.run.smithi173.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T23:46:23.884 INFO:teuthology.orchestra.run.smithi173.stdout:Recommends: thermald 2024-09-13T23:46:23.884 INFO:teuthology.orchestra.run.smithi173.stdout:Description: Generic Linux kernel image 2024-09-13T23:46:23.884 INFO:teuthology.orchestra.run.smithi173.stdout: This package will always depend on the latest generic kernel image 2024-09-13T23:46:23.884 INFO:teuthology.orchestra.run.smithi173.stdout: available. 2024-09-13T23:46:23.884 DEBUG:teuthology.orchestra.run.smithi173:> mktemp 2024-09-13T23:46:23.930 INFO:teuthology.orchestra.run.smithi173.stdout:/tmp/tmp.nLQ6jwD50X 2024-09-13T23:46:23.930 DEBUG:teuthology.orchestra.run.smithi173:> sudo cp /boot/grub/grub.cfg /tmp/tmp.nLQ6jwD50X 2024-09-13T23:46:23.945 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0666 /tmp/tmp.nLQ6jwD50X 2024-09-13T23:46:23.989 DEBUG:teuthology.orchestra.remote:smithi173:/tmp/tmp.nLQ6jwD50X is 9KB 2024-09-13T23:46:24.004 DEBUG:teuthology.orchestra.run.smithi173:> rm -fr /tmp/tmp.nLQ6jwD50X 2024-09-13T23:46:24.011 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T23:46:24.065 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-13T23:46:24.065 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T23:46:24.065 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T23:46:24.103 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-195-generic 2024-09-13T23:46:24.103 DEBUG:teuthology.orchestra.run.smithi173:> sudo update-grub 2024-09-13T23:46:24.439 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-09-13T23:46:24.465 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T23:46:24.535 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-09-13T23:46:24.753 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2024-09-13T23:46:24.753 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2024-09-13T23:46:24.997 INFO:teuthology.orchestra.run.smithi087.stdout:linux-image-generic is already the newest version (5.4.0.195.193). 2024-09-13T23:46:24.998 INFO:teuthology.orchestra.run.smithi087.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-09-13T23:46:24.999 DEBUG:teuthology.orchestra.run.smithi087:> dpkg -s linux-image-generic 2024-09-13T23:46:25.021 INFO:teuthology.orchestra.run.smithi087.stdout:Package: linux-image-generic 2024-09-13T23:46:25.021 INFO:teuthology.orchestra.run.smithi087.stdout:Status: install ok installed 2024-09-13T23:46:25.021 INFO:teuthology.orchestra.run.smithi087.stdout:Priority: optional 2024-09-13T23:46:25.021 INFO:teuthology.orchestra.run.smithi087.stdout:Section: kernel 2024-09-13T23:46:25.021 INFO:teuthology.orchestra.run.smithi087.stdout:Installed-Size: 20 2024-09-13T23:46:25.021 INFO:teuthology.orchestra.run.smithi087.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T23:46:25.021 INFO:teuthology.orchestra.run.smithi087.stdout:Architecture: amd64 2024-09-13T23:46:25.021 INFO:teuthology.orchestra.run.smithi087.stdout:Source: linux-meta 2024-09-13T23:46:25.021 INFO:teuthology.orchestra.run.smithi087.stdout:Version: 5.4.0.195.193 2024-09-13T23:46:25.021 INFO:teuthology.orchestra.run.smithi087.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-13T23:46:25.021 INFO:teuthology.orchestra.run.smithi087.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T23:46:25.021 INFO:teuthology.orchestra.run.smithi087.stdout:Recommends: thermald 2024-09-13T23:46:25.022 INFO:teuthology.orchestra.run.smithi087.stdout:Description: Generic Linux kernel image 2024-09-13T23:46:25.022 INFO:teuthology.orchestra.run.smithi087.stdout: This package will always depend on the latest generic kernel image 2024-09-13T23:46:25.022 INFO:teuthology.orchestra.run.smithi087.stdout: available. 2024-09-13T23:46:25.022 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-09-13T23:46:25.026 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.GduELqB0ZV 2024-09-13T23:46:25.026 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /boot/grub/grub.cfg /tmp/tmp.GduELqB0ZV 2024-09-13T23:46:25.041 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.GduELqB0ZV 2024-09-13T23:46:25.074 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.GduELqB0ZV is 9KB 2024-09-13T23:46:25.088 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.GduELqB0ZV 2024-09-13T23:46:25.095 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T23:46:25.152 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T23:46:25.152 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T23:46:25.152 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T23:46:25.187 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-195-generic 2024-09-13T23:46:25.187 DEBUG:teuthology.orchestra.run.smithi087:> sudo update-grub 2024-09-13T23:46:25.501 INFO:teuthology.orchestra.run.smithi173.stderr:Sourcing file `/etc/default/grub' 2024-09-13T23:46:25.506 INFO:teuthology.orchestra.run.smithi173.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T23:46:25.522 INFO:teuthology.orchestra.run.smithi173.stderr:Generating grub configuration file ... 2024-09-13T23:46:25.767 INFO:teuthology.orchestra.run.smithi173.stderr:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-13T23:46:25.778 INFO:teuthology.orchestra.run.smithi173.stderr:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-13T23:46:26.125 INFO:teuthology.orchestra.run.smithi173.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T23:46:26.137 INFO:teuthology.orchestra.run.smithi173.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T23:46:26.477 INFO:teuthology.orchestra.run.smithi087.stderr:Sourcing file `/etc/default/grub' 2024-09-13T23:46:26.486 INFO:teuthology.orchestra.run.smithi087.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T23:46:26.501 INFO:teuthology.orchestra.run.smithi087.stderr:Generating grub configuration file ... 2024-09-13T23:46:26.737 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-13T23:46:26.749 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-13T23:46:27.091 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T23:46:27.102 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T23:46:27.766 INFO:teuthology.orchestra.run.smithi173.stderr:done 2024-09-13T23:46:27.768 DEBUG:teuthology.orchestra.run.smithi173:> sudo shutdown -r now 2024-09-13T23:46:28.743 INFO:teuthology.orchestra.run.smithi087.stderr:done 2024-09-13T23:46:28.745 DEBUG:teuthology.orchestra.run.smithi087:> sudo shutdown -r now 2024-09-13T23:46:57.797 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-13T23:46:57.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-13T23:46:57.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T23:46:58.748 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-13T23:46:58.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-13T23:46:58.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T23:47:16.157 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-09-13T23:47:17.181 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-09-13T23:47:25.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-13T23:47:25.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T23:47:26.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-13T23:47:26.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T23:47:28.253 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-09-13T23:47:29.277 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-09-13T23:47:40.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-13T23:47:40.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T23:47:41.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-13T23:47:41.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T23:47:58.653 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-09-13T23:48:12.981 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-09-13T23:48:13.562 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-13T23:48:13.563 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-195-generic"... 2024-09-13T23:48:13.563 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-09-13T23:48:13.569 INFO:teuthology.orchestra.run.smithi087.stdout:5.4.0-195-generic 2024-09-13T23:48:13.569 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-195-generic vs 5.4.0-195-generic 2024-09-13T23:48:13.569 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T23:48:13.570 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T23:48:13.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-13T23:48:13.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T23:48:13.911 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-09-13T23:48:14.464 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-13T23:48:14.464 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.4.0-195-generic"... 2024-09-13T23:48:14.464 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2024-09-13T23:48:14.515 INFO:teuthology.orchestra.run.smithi173.stdout:5.4.0-195-generic 2024-09-13T23:48:14.515 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-195-generic vs 5.4.0-195-generic 2024-09-13T23:48:14.515 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T23:48:14.515 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T23:48:14.571 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-13T23:48:14.571 DEBUG:teuthology.orchestra.run.smithi087:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T23:48:14.649 INFO:teuthology.orchestra.run.smithi087.stdout:ttyS1 2024-09-13T23:48:14.675 DEBUG:teuthology.parallel:result is None 2024-09-13T23:48:15.516 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-13T23:48:15.517 DEBUG:teuthology.orchestra.run.smithi173:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T23:48:15.598 INFO:teuthology.orchestra.run.smithi173.stdout:ttyS1 2024-09-13T23:48:15.624 DEBUG:teuthology.parallel:result is None 2024-09-13T23:48:15.624 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T23:48:15.631 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T23:48:15.631 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T23:48:15.634 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T23:48:15.641 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T23:48:15.680 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T23:48:15.721 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T23:48:15.721 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T23:48:15.723 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T23:48:15.746 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T23:48:15.753 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T23:48:15.753 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T23:48:15.782 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T23:48:15.798 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T23:48:15.801 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T23:48:15.808 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T23:48:15.811 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T23:48:15.813 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T23:48:15.820 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T23:48:15.820 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T23:48:15.823 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T23:48:15.870 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T23:48:15.878 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T23:48:15.878 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T23:48:15.881 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T23:48:15.887 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T23:48:15.935 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T23:48:15.942 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T23:48:15.942 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T23:48:16.014 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T23:48:16.021 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T23:48:16.072 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-13T23:48:16.072 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T23:48:16.092 DEBUG:teuthology.orchestra.run.smithi087:> sudo service rsyslog restart 2024-09-13T23:48:16.095 DEBUG:teuthology.orchestra.run.smithi173:> sudo service rsyslog restart 2024-09-13T23:48:16.141 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T23:48:16.148 INFO:teuthology.task.internal:Starting timer... 2024-09-13T23:48:16.148 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T23:48:16.174 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T23:48:16.238 DEBUG:teuthology.task.selinux:Excluding smithi087: OS 'ubuntu' does not support SELinux 2024-09-13T23:48:16.238 DEBUG:teuthology.task.selinux:Excluding smithi173: OS 'ubuntu' does not support SELinux 2024-09-13T23:48:16.238 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T23:48:16.238 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-13T23:48:16.238 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T23:48:16.238 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T23:48:16.273 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-13T23:48:16.275 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-13T23:48:16.430 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T23:48:16.440 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T23:48:16.441 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi087.front.sepia.ceph.com,smithi173.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T23:53:50.361 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi087.front.sepia.ceph.com'), Remote(name='ubuntu@smithi173.front.sepia.ceph.com')] 2024-09-13T23:53:50.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-13T23:53:50.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T23:53:50.486 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-09-13T23:53:50.610 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-13T23:53:50.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-13T23:53:50.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T23:53:50.735 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-09-13T23:53:50.862 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-13T23:53:50.862 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T23:53:50.872 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T23:53:50.873 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T23:53:50.873 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T23:53:50.875 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T23:53:50.876 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T23:53:50.910 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 23:53:50 ntpd[13717]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-13T23:53:50.910 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 23:53:50 ntpd[13717]: Command line: ntpd -gq 2024-09-13T23:53:50.911 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 23:53:50 ntpd[13717]: proto: precision = 0.093 usec (-23) 2024-09-13T23:53:50.911 INFO:teuthology.orchestra.run.smithi087.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T23:53:50.911 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 23:53:50 ntpd[13717]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T23:53:50.912 INFO:teuthology.orchestra.run.smithi087.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T23:53:50.913 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 23:53:50 ntpd[13717]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T23:53:50.913 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 23:53:50 ntpd[13717]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T23:53:50.913 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 23:53:50 ntpd[13717]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T23:53:50.913 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 23:53:50 ntpd[13717]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T23:53:50.913 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 23:53:50 ntpd[13717]: Listen normally on 3 enp3s0f1 172.21.15.87:123 2024-09-13T23:53:50.913 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 23:53:50 ntpd[13717]: Listen normally on 4 lo [::1]:123 2024-09-13T23:53:50.914 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 23:53:50 ntpd[13717]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d5f5%5]:123 2024-09-13T23:53:50.914 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 23:53:50 ntpd[13717]: Listening on routing socket on fd #22 for interface updates 2024-09-13T23:53:50.937 INFO:teuthology.orchestra.run.smithi173.stdout:13 Sep 23:53:50 ntpd[13702]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-13T23:53:50.937 INFO:teuthology.orchestra.run.smithi173.stdout:13 Sep 23:53:50 ntpd[13702]: Command line: ntpd -gq 2024-09-13T23:53:50.938 INFO:teuthology.orchestra.run.smithi173.stdout:13 Sep 23:53:50 ntpd[13702]: proto: precision = 0.122 usec (-23) 2024-09-13T23:53:50.938 INFO:teuthology.orchestra.run.smithi173.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T23:53:50.939 INFO:teuthology.orchestra.run.smithi173.stdout:13 Sep 23:53:50 ntpd[13702]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T23:53:50.939 INFO:teuthology.orchestra.run.smithi173.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T23:53:50.940 INFO:teuthology.orchestra.run.smithi173.stdout:13 Sep 23:53:50 ntpd[13702]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T23:53:50.940 INFO:teuthology.orchestra.run.smithi173.stdout:13 Sep 23:53:50 ntpd[13702]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T23:53:50.940 INFO:teuthology.orchestra.run.smithi173.stdout:13 Sep 23:53:50 ntpd[13702]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T23:53:50.940 INFO:teuthology.orchestra.run.smithi173.stdout:13 Sep 23:53:50 ntpd[13702]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T23:53:50.940 INFO:teuthology.orchestra.run.smithi173.stdout:13 Sep 23:53:50 ntpd[13702]: Listen normally on 3 enp3s0f1 172.21.15.173:123 2024-09-13T23:53:50.940 INFO:teuthology.orchestra.run.smithi173.stdout:13 Sep 23:53:50 ntpd[13702]: Listen normally on 4 lo [::1]:123 2024-09-13T23:53:50.940 INFO:teuthology.orchestra.run.smithi173.stdout:13 Sep 23:53:50 ntpd[13702]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7259%5]:123 2024-09-13T23:53:50.940 INFO:teuthology.orchestra.run.smithi173.stdout:13 Sep 23:53:50 ntpd[13702]: Listening on routing socket on fd #22 for interface updates 2024-09-13T23:53:51.911 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:51 ntpd[13717]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:51.911 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:51 ntpd[13717]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:51.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:51 ntpd[13717]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:51.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:51 ntpd[13717]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:51.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:51 ntpd[13717]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:51.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:51 ntpd[13717]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:51.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:51 ntpd[13717]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:51.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:51 ntpd[13717]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:51.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:51 ntpd[13717]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T23:53:51.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:51 ntpd[13717]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T23:53:51.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:51 ntpd[13717]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:51.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:51 ntpd[13717]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:51.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:51 ntpd[13717]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T23:53:51.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:51 ntpd[13717]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T23:53:51.937 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:51 ntpd[13702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:51.938 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:51 ntpd[13702]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:51.938 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:51 ntpd[13702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:51.938 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:51 ntpd[13702]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:51.938 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:51 ntpd[13702]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T23:53:51.938 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:51 ntpd[13702]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T23:53:52.938 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:52 ntpd[13702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:52.938 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:52 ntpd[13702]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:52.938 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:52 ntpd[13702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:52.938 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:52 ntpd[13702]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:52.938 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:52 ntpd[13702]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T23:53:52.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:52 ntpd[13702]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T23:53:53.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:53 ntpd[13717]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:53.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:53 ntpd[13717]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:53.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:53 ntpd[13717]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:53.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:53 ntpd[13717]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:53.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:53 ntpd[13717]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:53.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:53 ntpd[13717]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:53.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:53 ntpd[13717]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:53.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:53 ntpd[13717]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:53.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:53 ntpd[13717]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T23:53:53.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:53 ntpd[13717]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T23:53:53.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:53 ntpd[13717]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:53.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:53 ntpd[13717]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:53.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:53 ntpd[13717]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T23:53:53.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:53 ntpd[13717]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T23:53:53.914 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:53 ntpd[13717]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:53.914 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:53 ntpd[13717]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:53.914 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:53 ntpd[13717]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T23:53:53.914 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:53 ntpd[13717]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T23:53:53.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:53 ntpd[13702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:53.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:53 ntpd[13702]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:53.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:53 ntpd[13702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:53.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:53 ntpd[13702]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:53.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:53 ntpd[13702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:53.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:53 ntpd[13702]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:53.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:53 ntpd[13702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:53.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:53 ntpd[13702]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:53.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:53 ntpd[13702]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T23:53:53.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:53 ntpd[13702]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T23:53:53.940 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:53 ntpd[13702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:53.940 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:53 ntpd[13702]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:53.940 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:53 ntpd[13702]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T23:53:53.940 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:53 ntpd[13702]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T23:53:54.938 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:54 ntpd[13702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:54.938 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:54 ntpd[13702]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:54.938 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:54 ntpd[13702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:54.938 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:54 ntpd[13702]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:54.938 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:54 ntpd[13702]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T23:53:54.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:54 ntpd[13702]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T23:53:55.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:55 ntpd[13717]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:55.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:55 ntpd[13717]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:55.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:55 ntpd[13717]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:55.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:55 ntpd[13717]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:55.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:55 ntpd[13717]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:55.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:55 ntpd[13717]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:55.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:55 ntpd[13717]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:55.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:55 ntpd[13717]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:55.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:55 ntpd[13717]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T23:53:55.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:55 ntpd[13717]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T23:53:55.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:55 ntpd[13717]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:55.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:55 ntpd[13717]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:55.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:55 ntpd[13717]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T23:53:55.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:55 ntpd[13717]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T23:53:55.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:55 ntpd[13717]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:55.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:55 ntpd[13717]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:55.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:55 ntpd[13717]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T23:53:55.914 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:55 ntpd[13717]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T23:53:55.938 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:55 ntpd[13702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:55.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:55 ntpd[13702]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:55.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:55 ntpd[13702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:55.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:55 ntpd[13702]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:55.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:55 ntpd[13702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:55.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:55 ntpd[13702]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:55.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:55 ntpd[13702]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T23:53:55.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:55 ntpd[13702]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T23:53:55.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:55 ntpd[13702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:55.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:55 ntpd[13702]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:55.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:55 ntpd[13702]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T23:53:55.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:55 ntpd[13702]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T23:53:56.938 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:56 ntpd[13702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:56.938 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:56 ntpd[13702]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:56.938 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:56 ntpd[13702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:56.938 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:56 ntpd[13702]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:56.938 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:56 ntpd[13702]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T23:53:56.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:56 ntpd[13702]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T23:53:57.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:57 ntpd[13717]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:57.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:57 ntpd[13717]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:57.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:57 ntpd[13717]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:57.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:57 ntpd[13717]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:57.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:57 ntpd[13717]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:57.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:57 ntpd[13717]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:57.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:57 ntpd[13717]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:57.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:57 ntpd[13717]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:57.912 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:57 ntpd[13717]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T23:53:57.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:57 ntpd[13717]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T23:53:57.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:57 ntpd[13717]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:57.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:57 ntpd[13717]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:57.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:57 ntpd[13717]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T23:53:57.913 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:57 ntpd[13717]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T23:53:57.913 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 23:53:57 ntpd[13717]: ntpd: time slew +0.002908 s 2024-09-13T23:53:57.913 INFO:teuthology.orchestra.run.smithi087.stdout:ntpd: time slew +0.002908s 2024-09-13T23:53:57.914 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:57 ntpd[13717]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T23:53:57.914 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 23:53:57 ntpd[13717]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T23:53:57.938 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:57 ntpd[13702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:57.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:57 ntpd[13702]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:57.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:57 ntpd[13702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:57.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:57 ntpd[13702]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:57.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:57 ntpd[13702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:57.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:57 ntpd[13702]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:57.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:57 ntpd[13702]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T23:53:57.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:57 ntpd[13702]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T23:53:57.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:57 ntpd[13702]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T23:53:57.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:57 ntpd[13702]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T23:53:57.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:57 ntpd[13702]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T23:53:57.939 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:57 ntpd[13702]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T23:53:57.940 INFO:teuthology.orchestra.run.smithi173.stdout:13 Sep 23:53:57 ntpd[13702]: ntpd: time slew +0.000303 s 2024-09-13T23:53:57.940 INFO:teuthology.orchestra.run.smithi173.stdout:ntpd: time slew +0.000303s 2024-09-13T23:53:57.940 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:57 ntpd[13702]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T23:53:57.940 INFO:teuthology.orchestra.run.smithi173.stderr:13 Sep 23:53:57 ntpd[13702]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T23:53:57.989 INFO:teuthology.orchestra.run.smithi087.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T23:53:57.990 INFO:teuthology.orchestra.run.smithi087.stdout:============================================================================== 2024-09-13T23:53:57.990 INFO:teuthology.orchestra.run.smithi087.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T23:53:57.990 INFO:teuthology.orchestra.run.smithi087.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T23:53:57.990 INFO:teuthology.orchestra.run.smithi087.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T23:53:57.990 INFO:teuthology.orchestra.run.smithi087.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T23:53:58.008 INFO:teuthology.orchestra.run.smithi173.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T23:53:58.008 INFO:teuthology.orchestra.run.smithi173.stdout:============================================================================== 2024-09-13T23:53:58.008 INFO:teuthology.orchestra.run.smithi173.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T23:53:58.008 INFO:teuthology.orchestra.run.smithi173.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T23:53:58.008 INFO:teuthology.orchestra.run.smithi173.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T23:53:58.008 INFO:teuthology.orchestra.run.smithi173.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T23:53:58.009 INFO:teuthology.run_tasks:Running task install... 2024-09-13T23:53:58.017 DEBUG:teuthology.task.install:project ceph 2024-09-13T23:53:58.017 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8'}} 2024-09-13T23:53:58.017 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8'} 2024-09-13T23:53:58.018 INFO:teuthology.task.install:Using flavor: default 2024-09-13T23:53:58.022 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T23:53:58.023 INFO:teuthology.task.install:extra packages: [] 2024-09-13T23:53:58.023 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-key list | grep Ceph 2024-09-13T23:53:58.024 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-key list | grep Ceph 2024-09-13T23:53:58.119 INFO:teuthology.orchestra.run.smithi087.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-13T23:53:58.121 INFO:teuthology.orchestra.run.smithi173.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-13T23:53:58.178 INFO:teuthology.orchestra.run.smithi087.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T23:53:58.178 INFO:teuthology.orchestra.run.smithi087.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T23:53:58.179 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-13T23:53:58.179 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=e4e227b37858f5109138494e01e5ba1ba7b8ffe8 2024-09-13T23:53:58.192 INFO:teuthology.orchestra.run.smithi173.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T23:53:58.192 INFO:teuthology.orchestra.run.smithi173.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T23:53:58.192 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-13T23:53:58.192 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=e4e227b37858f5109138494e01e5ba1ba7b8ffe8 2024-09-13T23:53:58.332 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default/ 2024-09-13T23:53:58.332 INFO:teuthology.task.install.deb:Package version is 18.2.4-845-ge4e227b3-1focal 2024-09-13T23:53:58.343 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default/ 2024-09-13T23:53:58.344 INFO:teuthology.task.install.deb:Package version is 18.2.4-845-ge4e227b3-1focal 2024-09-13T23:53:58.449 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T23:53:58.450 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T23:53:58.460 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-13T23:53:58.460 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T23:53:58.466 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get update 2024-09-13T23:53:58.476 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-get update 2024-09-13T23:53:58.609 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T23:53:58.615 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T23:53:58.632 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T23:53:58.663 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T23:53:58.663 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T23:53:58.663 INFO:teuthology.orchestra.run.smithi087.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal InRelease 2024-09-13T23:53:58.668 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T23:53:58.684 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-13T23:53:58.686 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T23:53:58.708 INFO:teuthology.orchestra.run.smithi087.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal Release.gpg 2024-09-13T23:53:58.716 INFO:teuthology.orchestra.run.smithi173.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal InRelease 2024-09-13T23:53:58.727 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:7 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T23:53:58.729 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main i386 Packages [3,420 B] 2024-09-13T23:53:58.738 INFO:teuthology.orchestra.run.smithi173.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-13T23:53:58.761 INFO:teuthology.orchestra.run.smithi173.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal Release.gpg 2024-09-13T23:53:58.763 INFO:teuthology.orchestra.run.smithi087.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-09-13T23:53:58.783 INFO:teuthology.orchestra.run.smithi173.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main i386 Packages [3,420 B] 2024-09-13T23:53:58.815 INFO:teuthology.orchestra.run.smithi173.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-09-13T23:53:59.245 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 28.7 kB in 1s (46.3 kB/s) 2024-09-13T23:53:59.328 INFO:teuthology.orchestra.run.smithi173.stdout:Fetched 28.7 kB in 1s (44.7 kB/s) 2024-09-13T23:54:00.395 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-09-13T23:54:00.421 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-845-ge4e227b3-1focal cephadm=18.2.4-845-ge4e227b3-1focal ceph-mds=18.2.4-845-ge4e227b3-1focal ceph-mgr=18.2.4-845-ge4e227b3-1focal ceph-common=18.2.4-845-ge4e227b3-1focal ceph-fuse=18.2.4-845-ge4e227b3-1focal ceph-test=18.2.4-845-ge4e227b3-1focal ceph-volume=18.2.4-845-ge4e227b3-1focal radosgw=18.2.4-845-ge4e227b3-1focal python3-rados=18.2.4-845-ge4e227b3-1focal python3-rgw=18.2.4-845-ge4e227b3-1focal python3-cephfs=18.2.4-845-ge4e227b3-1focal python3-rbd=18.2.4-845-ge4e227b3-1focal libcephfs2=18.2.4-845-ge4e227b3-1focal libcephfs-dev=18.2.4-845-ge4e227b3-1focal librados2=18.2.4-845-ge4e227b3-1focal librbd1=18.2.4-845-ge4e227b3-1focal rbd-fuse=18.2.4-845-ge4e227b3-1focal 2024-09-13T23:54:00.492 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-09-13T23:54:00.496 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2024-09-13T23:54:00.519 DEBUG:teuthology.orchestra.run.smithi173:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-845-ge4e227b3-1focal cephadm=18.2.4-845-ge4e227b3-1focal ceph-mds=18.2.4-845-ge4e227b3-1focal ceph-mgr=18.2.4-845-ge4e227b3-1focal ceph-common=18.2.4-845-ge4e227b3-1focal ceph-fuse=18.2.4-845-ge4e227b3-1focal ceph-test=18.2.4-845-ge4e227b3-1focal ceph-volume=18.2.4-845-ge4e227b3-1focal radosgw=18.2.4-845-ge4e227b3-1focal python3-rados=18.2.4-845-ge4e227b3-1focal python3-rgw=18.2.4-845-ge4e227b3-1focal python3-cephfs=18.2.4-845-ge4e227b3-1focal python3-rbd=18.2.4-845-ge4e227b3-1focal libcephfs2=18.2.4-845-ge4e227b3-1focal libcephfs-dev=18.2.4-845-ge4e227b3-1focal librados2=18.2.4-845-ge4e227b3-1focal librbd1=18.2.4-845-ge4e227b3-1focal rbd-fuse=18.2.4-845-ge4e227b3-1focal 2024-09-13T23:54:00.599 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2024-09-13T23:54:00.685 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2024-09-13T23:54:00.685 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2024-09-13T23:54:00.795 INFO:teuthology.orchestra.run.smithi173.stdout:Building dependency tree... 2024-09-13T23:54:00.795 INFO:teuthology.orchestra.run.smithi173.stdout:Reading state information... 2024-09-13T23:54:00.876 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T23:54:00.878 INFO:teuthology.orchestra.run.smithi087.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T23:54:00.878 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T23:54:00.878 INFO:teuthology.orchestra.run.smithi087.stdout:The following additional packages will be installed: 2024-09-13T23:54:00.878 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T23:54:00.878 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-13T23:54:00.878 INFO:teuthology.orchestra.run.smithi087.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-13T23:54:00.878 INFO:teuthology.orchestra.run.smithi087.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-13T23:54:00.878 INFO:teuthology.orchestra.run.smithi087.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-13T23:54:00.879 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-13T23:54:00.879 INFO:teuthology.orchestra.run.smithi087.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T23:54:00.879 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T23:54:00.879 INFO:teuthology.orchestra.run.smithi087.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T23:54:00.879 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2024-09-13T23:54:00.879 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-09-13T23:54:00.879 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-13T23:54:00.879 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-13T23:54:00.879 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-13T23:54:00.879 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-13T23:54:00.880 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-09-13T23:54:00.880 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T23:54:00.880 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T23:54:00.880 INFO:teuthology.orchestra.run.smithi087.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T23:54:00.880 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T23:54:00.880 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T23:54:00.880 INFO:teuthology.orchestra.run.smithi087.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T23:54:00.880 INFO:teuthology.orchestra.run.smithi087.stdout:Suggested packages: 2024-09-13T23:54:00.880 INFO:teuthology.orchestra.run.smithi087.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-13T23:54:00.880 INFO:teuthology.orchestra.run.smithi087.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-13T23:54:00.880 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-13T23:54:00.881 INFO:teuthology.orchestra.run.smithi087.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-13T23:54:00.881 INFO:teuthology.orchestra.run.smithi087.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-13T23:54:00.881 INFO:teuthology.orchestra.run.smithi087.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-13T23:54:00.881 INFO:teuthology.orchestra.run.smithi087.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-13T23:54:00.881 INFO:teuthology.orchestra.run.smithi087.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T23:54:00.881 INFO:teuthology.orchestra.run.smithi087.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-13T23:54:00.881 INFO:teuthology.orchestra.run.smithi087.stdout:Recommended packages: 2024-09-13T23:54:00.881 INFO:teuthology.orchestra.run.smithi087.stdout: btrfs-tools 2024-09-13T23:54:00.986 INFO:teuthology.orchestra.run.smithi173.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T23:54:00.988 INFO:teuthology.orchestra.run.smithi173.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T23:54:00.988 INFO:teuthology.orchestra.run.smithi173.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T23:54:00.988 INFO:teuthology.orchestra.run.smithi173.stdout:The following additional packages will be installed: 2024-09-13T23:54:00.988 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T23:54:00.988 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-13T23:54:00.988 INFO:teuthology.orchestra.run.smithi173.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-13T23:54:00.988 INFO:teuthology.orchestra.run.smithi173.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-13T23:54:00.988 INFO:teuthology.orchestra.run.smithi173.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-13T23:54:00.989 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-13T23:54:00.989 INFO:teuthology.orchestra.run.smithi173.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T23:54:00.989 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T23:54:00.989 INFO:teuthology.orchestra.run.smithi173.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T23:54:00.989 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2024-09-13T23:54:00.989 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-09-13T23:54:00.989 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-13T23:54:00.990 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-13T23:54:00.990 INFO:teuthology.orchestra.run.smithi173.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-13T23:54:00.990 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-13T23:54:00.990 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-09-13T23:54:00.990 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T23:54:00.990 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T23:54:00.990 INFO:teuthology.orchestra.run.smithi173.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T23:54:00.990 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T23:54:00.990 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T23:54:00.990 INFO:teuthology.orchestra.run.smithi173.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T23:54:00.990 INFO:teuthology.orchestra.run.smithi173.stdout:Suggested packages: 2024-09-13T23:54:00.991 INFO:teuthology.orchestra.run.smithi173.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-13T23:54:00.991 INFO:teuthology.orchestra.run.smithi173.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-13T23:54:00.991 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-13T23:54:00.991 INFO:teuthology.orchestra.run.smithi173.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-13T23:54:00.991 INFO:teuthology.orchestra.run.smithi173.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-13T23:54:00.991 INFO:teuthology.orchestra.run.smithi173.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-13T23:54:00.991 INFO:teuthology.orchestra.run.smithi173.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-13T23:54:00.991 INFO:teuthology.orchestra.run.smithi173.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T23:54:00.991 INFO:teuthology.orchestra.run.smithi173.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-13T23:54:00.991 INFO:teuthology.orchestra.run.smithi173.stdout:Recommended packages: 2024-09-13T23:54:00.991 INFO:teuthology.orchestra.run.smithi173.stdout: btrfs-tools 2024-09-13T23:54:00.999 INFO:teuthology.orchestra.run.smithi087.stdout:The following NEW packages will be installed: 2024-09-13T23:54:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T23:54:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T23:54:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T23:54:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-09-13T23:54:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-09-13T23:54:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-13T23:54:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-09-13T23:54:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2024-09-13T23:54:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2024-09-13T23:54:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-09-13T23:54:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-13T23:54:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-09-13T23:54:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-09-13T23:54:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-13T23:54:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-13T23:54:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-13T23:54:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-13T23:54:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-09-13T23:54:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-09-13T23:54:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-09-13T23:54:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-13T23:54:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-09-13T23:54:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-09-13T23:54:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2024-09-13T23:54:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet 2024-09-13T23:54:01.003 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages will be upgraded: 2024-09-13T23:54:01.003 INFO:teuthology.orchestra.run.smithi087.stdout: librados2 librbd1 2024-09-13T23:54:01.067 INFO:teuthology.orchestra.run.smithi087.stdout:2 upgraded, 110 newly installed, 0 to remove and 295 not upgraded. 2024-09-13T23:54:01.067 INFO:teuthology.orchestra.run.smithi087.stdout:Need to get 199 MB of archives. 2024-09-13T23:54:01.067 INFO:teuthology.orchestra.run.smithi087.stdout:After this operation, 977 MB of additional disk space will be used. 2024-09-13T23:54:01.067 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-13T23:54:01.114 INFO:teuthology.orchestra.run.smithi173.stdout:The following NEW packages will be installed: 2024-09-13T23:54:01.114 INFO:teuthology.orchestra.run.smithi173.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T23:54:01.114 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T23:54:01.114 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T23:54:01.115 INFO:teuthology.orchestra.run.smithi173.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-09-13T23:54:01.115 INFO:teuthology.orchestra.run.smithi173.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-09-13T23:54:01.115 INFO:teuthology.orchestra.run.smithi173.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-13T23:54:01.115 INFO:teuthology.orchestra.run.smithi173.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-09-13T23:54:01.116 INFO:teuthology.orchestra.run.smithi173.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2024-09-13T23:54:01.116 INFO:teuthology.orchestra.run.smithi173.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2024-09-13T23:54:01.116 INFO:teuthology.orchestra.run.smithi173.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-09-13T23:54:01.116 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-13T23:54:01.116 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-09-13T23:54:01.116 INFO:teuthology.orchestra.run.smithi173.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-09-13T23:54:01.116 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-13T23:54:01.116 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-13T23:54:01.116 INFO:teuthology.orchestra.run.smithi173.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-13T23:54:01.116 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-13T23:54:01.116 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-09-13T23:54:01.117 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-09-13T23:54:01.117 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-09-13T23:54:01.117 INFO:teuthology.orchestra.run.smithi173.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-13T23:54:01.117 INFO:teuthology.orchestra.run.smithi173.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-09-13T23:54:01.117 INFO:teuthology.orchestra.run.smithi173.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-09-13T23:54:01.117 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2024-09-13T23:54:01.117 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet 2024-09-13T23:54:01.117 INFO:teuthology.orchestra.run.smithi173.stdout:The following packages will be upgraded: 2024-09-13T23:54:01.118 INFO:teuthology.orchestra.run.smithi173.stdout: librados2 librbd1 2024-09-13T23:54:01.150 INFO:teuthology.orchestra.run.smithi087.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-13T23:54:01.152 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-13T23:54:01.154 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.4-845-ge4e227b3-1focal [3,451 kB] 2024-09-13T23:54:01.170 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-13T23:54:01.184 INFO:teuthology.orchestra.run.smithi173.stdout:2 upgraded, 110 newly installed, 0 to remove and 295 not upgraded. 2024-09-13T23:54:01.185 INFO:teuthology.orchestra.run.smithi173.stdout:Need to get 199 MB of archives. 2024-09-13T23:54:01.185 INFO:teuthology.orchestra.run.smithi173.stdout:After this operation, 977 MB of additional disk space will be used. 2024-09-13T23:54:01.185 INFO:teuthology.orchestra.run.smithi173.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-13T23:54:01.223 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-13T23:54:01.225 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-13T23:54:01.231 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-13T23:54:01.233 INFO:teuthology.orchestra.run.smithi087.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-13T23:54:01.233 INFO:teuthology.orchestra.run.smithi087.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-13T23:54:01.235 INFO:teuthology.orchestra.run.smithi087.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-13T23:54:01.235 INFO:teuthology.orchestra.run.smithi087.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-13T23:54:01.238 INFO:teuthology.orchestra.run.smithi087.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-13T23:54:01.238 INFO:teuthology.orchestra.run.smithi087.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-13T23:54:01.241 INFO:teuthology.orchestra.run.smithi087.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-13T23:54:01.258 INFO:teuthology.orchestra.run.smithi087.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-13T23:54:01.258 INFO:teuthology.orchestra.run.smithi087.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-13T23:54:01.259 INFO:teuthology.orchestra.run.smithi087.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-13T23:54:01.260 INFO:teuthology.orchestra.run.smithi087.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T23:54:01.260 INFO:teuthology.orchestra.run.smithi087.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-13T23:54:01.260 INFO:teuthology.orchestra.run.smithi087.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-13T23:54:01.262 INFO:teuthology.orchestra.run.smithi087.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-13T23:54:01.263 INFO:teuthology.orchestra.run.smithi087.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-13T23:54:01.264 INFO:teuthology.orchestra.run.smithi087.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-13T23:54:01.267 INFO:teuthology.orchestra.run.smithi173.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.4-845-ge4e227b3-1focal [3,451 kB] 2024-09-13T23:54:01.268 INFO:teuthology.orchestra.run.smithi173.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-13T23:54:01.272 INFO:teuthology.orchestra.run.smithi173.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-13T23:54:01.276 INFO:teuthology.orchestra.run.smithi087.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-13T23:54:01.284 INFO:teuthology.orchestra.run.smithi087.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-13T23:54:01.289 INFO:teuthology.orchestra.run.smithi173.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-13T23:54:01.290 INFO:teuthology.orchestra.run.smithi087.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-13T23:54:01.291 INFO:teuthology.orchestra.run.smithi087.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-13T23:54:01.292 INFO:teuthology.orchestra.run.smithi087.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-13T23:54:01.293 INFO:teuthology.orchestra.run.smithi087.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-13T23:54:01.294 INFO:teuthology.orchestra.run.smithi087.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-13T23:54:01.298 INFO:teuthology.orchestra.run.smithi087.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-13T23:54:01.298 INFO:teuthology.orchestra.run.smithi087.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-13T23:54:01.300 INFO:teuthology.orchestra.run.smithi087.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-13T23:54:01.309 INFO:teuthology.orchestra.run.smithi087.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-09-13T23:54:01.310 INFO:teuthology.orchestra.run.smithi087.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-13T23:54:01.311 INFO:teuthology.orchestra.run.smithi087.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-13T23:54:01.326 INFO:teuthology.orchestra.run.smithi087.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-13T23:54:01.327 INFO:teuthology.orchestra.run.smithi087.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-13T23:54:01.328 INFO:teuthology.orchestra.run.smithi087.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-13T23:54:01.329 INFO:teuthology.orchestra.run.smithi087.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-13T23:54:01.330 INFO:teuthology.orchestra.run.smithi087.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-13T23:54:01.330 INFO:teuthology.orchestra.run.smithi087.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-13T23:54:01.331 INFO:teuthology.orchestra.run.smithi087.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-13T23:54:01.334 INFO:teuthology.orchestra.run.smithi087.stdout:Get:45 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.4-845-ge4e227b3-1focal [4,042 kB] 2024-09-13T23:54:01.343 INFO:teuthology.orchestra.run.smithi087.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T23:54:01.344 INFO:teuthology.orchestra.run.smithi087.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-13T23:54:01.344 INFO:teuthology.orchestra.run.smithi173.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-13T23:54:01.345 INFO:teuthology.orchestra.run.smithi087.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-13T23:54:01.347 INFO:teuthology.orchestra.run.smithi173.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-13T23:54:01.355 INFO:teuthology.orchestra.run.smithi173.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-13T23:54:01.357 INFO:teuthology.orchestra.run.smithi173.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-13T23:54:01.357 INFO:teuthology.orchestra.run.smithi173.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-13T23:54:01.358 INFO:teuthology.orchestra.run.smithi173.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-13T23:54:01.358 INFO:teuthology.orchestra.run.smithi173.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-13T23:54:01.360 INFO:teuthology.orchestra.run.smithi087.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-13T23:54:01.361 INFO:teuthology.orchestra.run.smithi173.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-13T23:54:01.362 INFO:teuthology.orchestra.run.smithi087.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-13T23:54:01.362 INFO:teuthology.orchestra.run.smithi173.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-13T23:54:01.362 INFO:teuthology.orchestra.run.smithi087.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-13T23:54:01.363 INFO:teuthology.orchestra.run.smithi087.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-13T23:54:01.363 INFO:teuthology.orchestra.run.smithi173.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-13T23:54:01.381 INFO:teuthology.orchestra.run.smithi173.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-13T23:54:01.381 INFO:teuthology.orchestra.run.smithi173.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-13T23:54:01.382 INFO:teuthology.orchestra.run.smithi173.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-13T23:54:01.383 INFO:teuthology.orchestra.run.smithi173.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T23:54:01.383 INFO:teuthology.orchestra.run.smithi173.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-13T23:54:01.384 INFO:teuthology.orchestra.run.smithi173.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-13T23:54:01.385 INFO:teuthology.orchestra.run.smithi173.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-13T23:54:01.386 INFO:teuthology.orchestra.run.smithi173.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-13T23:54:01.400 INFO:teuthology.orchestra.run.smithi173.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-13T23:54:01.402 INFO:teuthology.orchestra.run.smithi173.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-13T23:54:01.415 INFO:teuthology.orchestra.run.smithi087.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.4-845-ge4e227b3-1focal [746 kB] 2024-09-13T23:54:01.418 INFO:teuthology.orchestra.run.smithi173.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-13T23:54:01.425 INFO:teuthology.orchestra.run.smithi173.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-13T23:54:01.426 INFO:teuthology.orchestra.run.smithi173.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-13T23:54:01.426 INFO:teuthology.orchestra.run.smithi087.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.4-845-ge4e227b3-1focal [387 kB] 2024-09-13T23:54:01.426 INFO:teuthology.orchestra.run.smithi173.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-13T23:54:01.427 INFO:teuthology.orchestra.run.smithi173.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-13T23:54:01.429 INFO:teuthology.orchestra.run.smithi173.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-13T23:54:01.433 INFO:teuthology.orchestra.run.smithi173.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-13T23:54:01.434 INFO:teuthology.orchestra.run.smithi173.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-13T23:54:01.436 INFO:teuthology.orchestra.run.smithi173.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-13T23:54:01.436 INFO:teuthology.orchestra.run.smithi173.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-09-13T23:54:01.453 INFO:teuthology.orchestra.run.smithi173.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-13T23:54:01.455 INFO:teuthology.orchestra.run.smithi173.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-13T23:54:01.455 INFO:teuthology.orchestra.run.smithi173.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-13T23:54:01.456 INFO:teuthology.orchestra.run.smithi173.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-13T23:54:01.456 INFO:teuthology.orchestra.run.smithi173.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-13T23:54:01.457 INFO:teuthology.orchestra.run.smithi173.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-13T23:54:01.458 INFO:teuthology.orchestra.run.smithi173.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-13T23:54:01.470 INFO:teuthology.orchestra.run.smithi173.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-13T23:54:01.471 INFO:teuthology.orchestra.run.smithi173.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-13T23:54:01.473 INFO:teuthology.orchestra.run.smithi173.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T23:54:01.487 INFO:teuthology.orchestra.run.smithi173.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-13T23:54:01.490 INFO:teuthology.orchestra.run.smithi173.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-13T23:54:01.491 INFO:teuthology.orchestra.run.smithi173.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-13T23:54:01.493 INFO:teuthology.orchestra.run.smithi173.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-13T23:54:01.493 INFO:teuthology.orchestra.run.smithi173.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-13T23:54:01.494 INFO:teuthology.orchestra.run.smithi173.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-13T23:54:01.501 INFO:teuthology.orchestra.run.smithi173.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.4-845-ge4e227b3-1focal [4,042 kB] 2024-09-13T23:54:01.508 INFO:teuthology.orchestra.run.smithi087.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-13T23:54:01.508 INFO:teuthology.orchestra.run.smithi087.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.4-845-ge4e227b3-1focal [31.9 kB] 2024-09-13T23:54:01.509 INFO:teuthology.orchestra.run.smithi087.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.4-845-ge4e227b3-1focal [200 kB] 2024-09-13T23:54:01.513 INFO:teuthology.orchestra.run.smithi087.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.4-845-ge4e227b3-1focal [62.5 kB] 2024-09-13T23:54:01.515 INFO:teuthology.orchestra.run.smithi087.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.4-845-ge4e227b3-1focal [368 kB] 2024-09-13T23:54:01.521 INFO:teuthology.orchestra.run.smithi087.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.4-845-ge4e227b3-1focal [6,630 kB] 2024-09-13T23:54:01.530 INFO:teuthology.orchestra.run.smithi087.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-13T23:54:01.531 INFO:teuthology.orchestra.run.smithi087.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-13T23:54:01.543 INFO:teuthology.orchestra.run.smithi087.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-13T23:54:01.544 INFO:teuthology.orchestra.run.smithi087.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-13T23:54:01.544 INFO:teuthology.orchestra.run.smithi087.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-13T23:54:01.544 INFO:teuthology.orchestra.run.smithi087.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-13T23:54:01.545 INFO:teuthology.orchestra.run.smithi087.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-13T23:54:01.545 INFO:teuthology.orchestra.run.smithi087.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-13T23:54:01.546 INFO:teuthology.orchestra.run.smithi087.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-13T23:54:01.548 INFO:teuthology.orchestra.run.smithi087.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-13T23:54:01.564 INFO:teuthology.orchestra.run.smithi087.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-13T23:54:01.564 INFO:teuthology.orchestra.run.smithi087.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-13T23:54:01.567 INFO:teuthology.orchestra.run.smithi087.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-13T23:54:01.569 INFO:teuthology.orchestra.run.smithi087.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-13T23:54:01.571 INFO:teuthology.orchestra.run.smithi087.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-13T23:54:01.572 INFO:teuthology.orchestra.run.smithi087.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-13T23:54:01.575 INFO:teuthology.orchestra.run.smithi087.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-13T23:54:01.577 INFO:teuthology.orchestra.run.smithi087.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-13T23:54:01.577 INFO:teuthology.orchestra.run.smithi173.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-13T23:54:01.591 INFO:teuthology.orchestra.run.smithi087.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-13T23:54:01.592 INFO:teuthology.orchestra.run.smithi173.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-13T23:54:01.593 INFO:teuthology.orchestra.run.smithi087.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-09-13T23:54:01.594 INFO:teuthology.orchestra.run.smithi173.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-13T23:54:01.595 INFO:teuthology.orchestra.run.smithi087.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-13T23:54:01.605 INFO:teuthology.orchestra.run.smithi173.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-13T23:54:01.636 INFO:teuthology.orchestra.run.smithi087.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-13T23:54:01.637 INFO:teuthology.orchestra.run.smithi087.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-13T23:54:01.637 INFO:teuthology.orchestra.run.smithi087.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-13T23:54:01.639 INFO:teuthology.orchestra.run.smithi087.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-13T23:54:01.651 INFO:teuthology.orchestra.run.smithi087.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T23:54:01.651 INFO:teuthology.orchestra.run.smithi087.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-13T23:54:01.652 INFO:teuthology.orchestra.run.smithi087.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-13T23:54:01.652 INFO:teuthology.orchestra.run.smithi087.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-13T23:54:01.653 INFO:teuthology.orchestra.run.smithi087.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-13T23:54:01.678 INFO:teuthology.orchestra.run.smithi173.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-13T23:54:01.678 INFO:teuthology.orchestra.run.smithi173.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.4-845-ge4e227b3-1focal [746 kB] 2024-09-13T23:54:01.679 INFO:teuthology.orchestra.run.smithi173.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-13T23:54:01.679 INFO:teuthology.orchestra.run.smithi173.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-13T23:54:01.680 INFO:teuthology.orchestra.run.smithi173.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-13T23:54:01.681 INFO:teuthology.orchestra.run.smithi173.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-13T23:54:01.681 INFO:teuthology.orchestra.run.smithi173.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-13T23:54:01.683 INFO:teuthology.orchestra.run.smithi173.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-13T23:54:01.710 INFO:teuthology.orchestra.run.smithi173.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.4-845-ge4e227b3-1focal [387 kB] 2024-09-13T23:54:01.711 INFO:teuthology.orchestra.run.smithi173.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-13T23:54:01.712 INFO:teuthology.orchestra.run.smithi087.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.4-845-ge4e227b3-1focal [113 kB] 2024-09-13T23:54:01.712 INFO:teuthology.orchestra.run.smithi173.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-13T23:54:01.712 INFO:teuthology.orchestra.run.smithi087.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.4-845-ge4e227b3-1focal [478 kB] 2024-09-13T23:54:01.715 INFO:teuthology.orchestra.run.smithi173.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-13T23:54:01.717 INFO:teuthology.orchestra.run.smithi173.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-13T23:54:01.718 INFO:teuthology.orchestra.run.smithi173.stdout:Get:70 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.4-845-ge4e227b3-1focal [31.9 kB] 2024-09-13T23:54:01.719 INFO:teuthology.orchestra.run.smithi087.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.4-845-ge4e227b3-1focal [25.2 MB] 2024-09-13T23:54:01.720 INFO:teuthology.orchestra.run.smithi173.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-13T23:54:01.720 INFO:teuthology.orchestra.run.smithi173.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.4-845-ge4e227b3-1focal [200 kB] 2024-09-13T23:54:01.721 INFO:teuthology.orchestra.run.smithi173.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-13T23:54:01.723 INFO:teuthology.orchestra.run.smithi173.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.4-845-ge4e227b3-1focal [62.5 kB] 2024-09-13T23:54:01.723 INFO:teuthology.orchestra.run.smithi173.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.4-845-ge4e227b3-1focal [368 kB] 2024-09-13T23:54:01.725 INFO:teuthology.orchestra.run.smithi173.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-13T23:54:01.726 INFO:teuthology.orchestra.run.smithi173.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.4-845-ge4e227b3-1focal [6,630 kB] 2024-09-13T23:54:01.727 INFO:teuthology.orchestra.run.smithi173.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-13T23:54:01.742 INFO:teuthology.orchestra.run.smithi173.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-13T23:54:01.745 INFO:teuthology.orchestra.run.smithi173.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-09-13T23:54:01.746 INFO:teuthology.orchestra.run.smithi173.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-13T23:54:01.788 INFO:teuthology.orchestra.run.smithi173.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-13T23:54:01.789 INFO:teuthology.orchestra.run.smithi173.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-13T23:54:01.789 INFO:teuthology.orchestra.run.smithi173.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-13T23:54:01.790 INFO:teuthology.orchestra.run.smithi173.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-13T23:54:01.801 INFO:teuthology.orchestra.run.smithi173.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T23:54:01.802 INFO:teuthology.orchestra.run.smithi173.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-13T23:54:01.803 INFO:teuthology.orchestra.run.smithi173.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-13T23:54:01.803 INFO:teuthology.orchestra.run.smithi173.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-13T23:54:01.803 INFO:teuthology.orchestra.run.smithi173.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-13T23:54:01.946 INFO:teuthology.orchestra.run.smithi173.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.4-845-ge4e227b3-1focal [113 kB] 2024-09-13T23:54:01.948 INFO:teuthology.orchestra.run.smithi173.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.4-845-ge4e227b3-1focal [478 kB] 2024-09-13T23:54:01.955 INFO:teuthology.orchestra.run.smithi173.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.4-845-ge4e227b3-1focal [25.2 MB] 2024-09-13T23:54:02.568 INFO:teuthology.orchestra.run.smithi087.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.4-845-ge4e227b3-1focal [9,611 kB] 2024-09-13T23:54:02.738 INFO:teuthology.orchestra.run.smithi087.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.4-845-ge4e227b3-1focal [238 kB] 2024-09-13T23:54:02.741 INFO:teuthology.orchestra.run.smithi087.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.4-845-ge4e227b3-1focal [148 kB] 2024-09-13T23:54:02.743 INFO:teuthology.orchestra.run.smithi087.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.4-845-ge4e227b3-1focal [1,574 kB] 2024-09-13T23:54:02.786 INFO:teuthology.orchestra.run.smithi087.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.4-845-ge4e227b3-1focal [6,640 kB] 2024-09-13T23:54:02.964 INFO:teuthology.orchestra.run.smithi087.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.4-845-ge4e227b3-1focal [24.5 MB] 2024-09-13T23:54:03.011 INFO:teuthology.orchestra.run.smithi173.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.4-845-ge4e227b3-1focal [9,611 kB] 2024-09-13T23:54:03.360 INFO:teuthology.orchestra.run.smithi173.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.4-845-ge4e227b3-1focal [238 kB] 2024-09-13T23:54:03.364 INFO:teuthology.orchestra.run.smithi173.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.4-845-ge4e227b3-1focal [148 kB] 2024-09-13T23:54:03.366 INFO:teuthology.orchestra.run.smithi173.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.4-845-ge4e227b3-1focal [1,574 kB] 2024-09-13T23:54:03.400 INFO:teuthology.orchestra.run.smithi173.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.4-845-ge4e227b3-1focal [6,640 kB] 2024-09-13T23:54:03.668 INFO:teuthology.orchestra.run.smithi087.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.4-845-ge4e227b3-1focal [13.7 kB] 2024-09-13T23:54:03.669 INFO:teuthology.orchestra.run.smithi087.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.4-845-ge4e227b3-1focal [856 kB] 2024-09-13T23:54:03.683 INFO:teuthology.orchestra.run.smithi087.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.4-845-ge4e227b3-1focal [2,295 kB] 2024-09-13T23:54:03.699 INFO:teuthology.orchestra.run.smithi087.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.4-845-ge4e227b3-1focal [239 kB] 2024-09-13T23:54:03.701 INFO:teuthology.orchestra.run.smithi087.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.4-845-ge4e227b3-1focal [143 kB] 2024-09-13T23:54:03.702 INFO:teuthology.orchestra.run.smithi087.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.4-845-ge4e227b3-1focal [7,015 kB] 2024-09-13T23:54:03.704 INFO:teuthology.orchestra.run.smithi173.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.4-845-ge4e227b3-1focal [24.5 MB] 2024-09-13T23:54:03.855 INFO:teuthology.orchestra.run.smithi087.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.4-845-ge4e227b3-1focal [7,882 kB] 2024-09-13T23:54:04.045 INFO:teuthology.orchestra.run.smithi087.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.4-845-ge4e227b3-1focal [13.9 kB] 2024-09-13T23:54:04.046 INFO:teuthology.orchestra.run.smithi087.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.4-845-ge4e227b3-1focal [46.9 MB] 2024-09-13T23:54:05.094 INFO:teuthology.orchestra.run.smithi173.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.4-845-ge4e227b3-1focal [13.7 kB] 2024-09-13T23:54:05.153 INFO:teuthology.orchestra.run.smithi173.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.4-845-ge4e227b3-1focal [856 kB] 2024-09-13T23:54:05.167 INFO:teuthology.orchestra.run.smithi173.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.4-845-ge4e227b3-1focal [2,295 kB] 2024-09-13T23:54:05.199 INFO:teuthology.orchestra.run.smithi173.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.4-845-ge4e227b3-1focal [239 kB] 2024-09-13T23:54:05.227 INFO:teuthology.orchestra.run.smithi173.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.4-845-ge4e227b3-1focal [143 kB] 2024-09-13T23:54:05.229 INFO:teuthology.orchestra.run.smithi173.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.4-845-ge4e227b3-1focal [7,015 kB] 2024-09-13T23:54:05.343 INFO:teuthology.orchestra.run.smithi087.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.4-845-ge4e227b3-1focal [120 kB] 2024-09-13T23:54:05.346 INFO:teuthology.orchestra.run.smithi087.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.4-845-ge4e227b3-1focal [37.4 kB] 2024-09-13T23:54:05.347 INFO:teuthology.orchestra.run.smithi087.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.4-845-ge4e227b3-1focal [13.5 MB] 2024-09-13T23:54:05.404 INFO:teuthology.orchestra.run.smithi173.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.4-845-ge4e227b3-1focal [7,882 kB] 2024-09-13T23:54:05.590 INFO:teuthology.orchestra.run.smithi087.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.4-845-ge4e227b3-1focal [107 kB] 2024-09-13T23:54:05.730 INFO:teuthology.orchestra.run.smithi173.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.4-845-ge4e227b3-1focal [13.9 kB] 2024-09-13T23:54:05.731 INFO:teuthology.orchestra.run.smithi173.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.4-845-ge4e227b3-1focal [46.9 MB] 2024-09-13T23:54:06.235 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 199 MB in 5s (43.4 MB/s) 2024-09-13T23:54:06.408 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-13T23:54:06.463 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141720 files and directories currently installed.) 2024-09-13T23:54:06.467 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-13T23:54:06.581 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T23:54:06.968 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T23:54:06.984 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-13T23:54:07.026 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T23:54:07.177 INFO:teuthology.orchestra.run.smithi173.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.4-845-ge4e227b3-1focal [120 kB] 2024-09-13T23:54:07.179 INFO:teuthology.orchestra.run.smithi173.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.4-845-ge4e227b3-1focal [37.4 kB] 2024-09-13T23:54:07.180 INFO:teuthology.orchestra.run.smithi173.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.4-845-ge4e227b3-1focal [13.5 MB] 2024-09-13T23:54:07.429 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T23:54:07.447 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-13T23:54:07.487 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T23:54:07.497 INFO:teuthology.orchestra.run.smithi173.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.4-845-ge4e227b3-1focal [107 kB] 2024-09-13T23:54:07.940 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T23:54:07.959 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T23:54:08.026 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T23:54:08.152 INFO:teuthology.orchestra.run.smithi173.stdout:Fetched 199 MB in 6s (31.2 MB/s) 2024-09-13T23:54:08.321 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-13T23:54:08.377 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141720 files and directories currently installed.) 2024-09-13T23:54:08.381 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-13T23:54:08.462 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T23:54:08.585 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T23:54:08.603 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T23:54:08.643 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T23:54:08.807 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T23:54:08.823 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-13T23:54:08.856 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T23:54:09.030 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T23:54:09.045 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T23:54:09.088 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T23:54:09.176 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T23:54:09.192 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-13T23:54:09.234 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T23:54:09.474 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-13T23:54:09.494 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-13T23:54:09.524 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T23:54:09.721 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T23:54:09.737 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T23:54:09.790 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T23:54:09.903 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../007-librbd1_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:10.052 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librbd1 (18.2.4-845-ge4e227b3-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T23:54:10.316 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T23:54:10.333 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T23:54:10.374 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T23:54:10.744 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T23:54:10.756 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../008-librados2_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:10.761 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T23:54:10.811 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T23:54:10.906 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librados2 (18.2.4-845-ge4e227b3-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T23:54:11.231 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-13T23:54:11.248 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-13T23:54:11.289 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T23:54:11.601 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T23:54:11.617 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../009-libcephfs2_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:11.644 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../007-librbd1_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:11.660 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libcephfs2 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:11.767 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking librbd1 (18.2.4-845-ge4e227b3-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T23:54:12.017 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rados. 2024-09-13T23:54:12.037 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../010-python3-rados_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:12.078 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rados (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:12.456 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T23:54:12.472 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-13T23:54:12.474 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../008-librados2_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:12.514 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-ceph-argparse (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:12.622 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking librados2 (18.2.4-845-ge4e227b3-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T23:54:12.800 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T23:54:12.816 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../012-python3-cephfs_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:12.882 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cephfs (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:13.236 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T23:54:13.254 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-13T23:54:13.286 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-ceph-common (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:13.316 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T23:54:13.333 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../009-libcephfs2_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:13.374 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libcephfs2 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:13.631 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T23:54:13.650 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2024-09-13T23:54:13.689 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-13T23:54:13.744 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-rados. 2024-09-13T23:54:13.760 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../010-python3-rados_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:13.802 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-rados (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:13.949 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T23:54:13.965 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../015-python3-rbd_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:13.999 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rbd (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:14.163 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T23:54:14.183 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-13T23:54:14.221 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-ceph-argparse (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:14.352 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-13T23:54:14.371 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-13T23:54:14.410 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T23:54:14.499 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T23:54:14.519 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../012-python3-cephfs_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:14.557 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-cephfs (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:14.746 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-13T23:54:14.766 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-13T23:54:14.806 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T23:54:14.893 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T23:54:14.909 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-13T23:54:14.951 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-ceph-common (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:15.191 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T23:54:15.210 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-13T23:54:15.259 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T23:54:15.297 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T23:54:15.313 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2024-09-13T23:54:15.355 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-13T23:54:15.620 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librgw2. 2024-09-13T23:54:15.632 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T23:54:15.636 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../019-librgw2_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:15.649 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../015-python3-rbd_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:15.687 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librgw2 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:15.690 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-rbd (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:16.068 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-13T23:54:16.085 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-13T23:54:16.126 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T23:54:16.488 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-13T23:54:16.504 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-13T23:54:16.546 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T23:54:16.555 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T23:54:16.574 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../020-python3-rgw_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:16.639 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rgw (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:16.874 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T23:54:16.892 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-13T23:54:16.942 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T23:54:17.017 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liboath0. 2024-09-13T23:54:17.032 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-13T23:54:17.075 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-13T23:54:17.285 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package librgw2. 2024-09-13T23:54:17.301 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../019-librgw2_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:17.343 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking librgw2 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:17.411 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T23:54:17.427 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../022-libradosstriper1_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:17.492 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libradosstriper1 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:17.939 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-common. 2024-09-13T23:54:17.955 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../023-ceph-common_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:17.997 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-common (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:18.263 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T23:54:18.280 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../020-python3-rgw_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:18.321 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-rgw (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:18.899 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package liboath0. 2024-09-13T23:54:18.914 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-13T23:54:18.957 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-13T23:54:19.285 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T23:54:19.303 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../022-libradosstriper1_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:19.343 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libradosstriper1 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:19.821 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-common. 2024-09-13T23:54:19.839 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../023-ceph-common_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:19.879 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-common (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:20.544 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-base. 2024-09-13T23:54:20.560 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../024-ceph-base_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:20.646 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-base (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:21.873 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T23:54:21.889 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-13T23:54:21.939 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-13T23:54:22.343 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T23:54:22.359 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2024-09-13T23:54:22.401 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-13T23:54:22.451 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-base. 2024-09-13T23:54:22.468 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../024-ceph-base_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:22.521 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-base (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:22.679 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T23:54:22.698 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2024-09-13T23:54:22.729 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-13T23:54:23.015 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T23:54:23.032 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-13T23:54:23.073 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-13T23:54:23.434 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-mako. 2024-09-13T23:54:23.450 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-13T23:54:23.517 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T23:54:23.806 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T23:54:23.824 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-13T23:54:23.870 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T23:54:23.886 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-13T23:54:23.887 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T23:54:23.928 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T23:54:24.226 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T23:54:24.239 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T23:54:24.241 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2024-09-13T23:54:24.259 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-13T23:54:24.284 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-13T23:54:24.297 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T23:54:24.583 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-webob. 2024-09-13T23:54:24.599 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-13T23:54:24.637 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T23:54:24.653 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2024-09-13T23:54:24.658 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T23:54:24.695 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-13T23:54:24.978 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-13T23:54:24.989 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T23:54:24.993 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-13T23:54:25.007 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-13T23:54:25.036 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T23:54:25.047 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-13T23:54:25.355 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-bs4. 2024-09-13T23:54:25.374 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2024-09-13T23:54:25.401 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-mako. 2024-09-13T23:54:25.413 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-13T23:54:25.417 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-13T23:54:25.458 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T23:54:25.811 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T23:54:25.825 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T23:54:25.828 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T23:54:25.841 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-13T23:54:25.870 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T23:54:25.886 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T23:54:26.181 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T23:54:26.199 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-13T23:54:26.219 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T23:54:26.239 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2024-09-13T23:54:26.240 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T23:54:26.277 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-13T23:54:26.567 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-webob. 2024-09-13T23:54:26.583 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-13T23:54:26.625 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T23:54:26.647 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-paste. 2024-09-13T23:54:26.667 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-13T23:54:26.713 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T23:54:26.978 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-13T23:54:26.998 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-13T23:54:27.037 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T23:54:27.058 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T23:54:27.074 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-13T23:54:27.116 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T23:54:27.339 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-bs4. 2024-09-13T23:54:27.355 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2024-09-13T23:54:27.389 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-13T23:54:27.427 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T23:54:27.443 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-13T23:54:27.506 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-13T23:54:27.700 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T23:54:27.716 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-13T23:54:27.770 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T23:54:27.838 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T23:54:27.854 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2024-09-13T23:54:27.896 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-13T23:54:28.095 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T23:54:28.114 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2024-09-13T23:54:28.153 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-13T23:54:28.253 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T23:54:28.271 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-13T23:54:28.311 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T23:54:28.465 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-paste. 2024-09-13T23:54:28.481 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-13T23:54:28.523 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T23:54:28.708 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T23:54:28.724 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-13T23:54:28.774 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T23:54:28.883 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T23:54:28.899 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-13T23:54:28.958 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T23:54:29.127 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T23:54:29.144 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-13T23:54:29.185 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-modules-core (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:29.278 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T23:54:29.296 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-13T23:54:29.327 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-13T23:54:29.615 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T23:54:29.632 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:29.655 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T23:54:29.673 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:29.674 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2024-09-13T23:54:29.714 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-13T23:54:30.025 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T23:54:30.041 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-13T23:54:30.043 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T23:54:30.063 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../045-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-13T23:54:30.083 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T23:54:30.126 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T23:54:30.462 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cryptography. 2024-09-13T23:54:30.463 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T23:54:30.478 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../046-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-13T23:54:30.480 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-13T23:54:30.520 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T23:54:30.521 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T23:54:30.841 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T23:54:30.859 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-13T23:54:30.899 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-modules-core (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:30.928 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T23:54:30.947 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../047-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-13T23:54:31.002 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-13T23:54:31.290 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T23:54:31.308 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:31.350 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:31.372 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T23:54:31.388 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../048-ceph-mgr_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:31.447 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:31.694 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T23:54:31.712 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../045-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-13T23:54:31.752 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T23:54:31.975 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T23:54:31.992 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../049-ceph-mon_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:32.048 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mon (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:32.073 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-cryptography. 2024-09-13T23:54:32.091 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../046-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-13T23:54:32.138 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T23:54:32.466 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T23:54:32.484 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../047-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-13T23:54:32.515 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-13T23:54:32.894 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T23:54:32.912 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../048-ceph-mgr_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:32.951 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:32.968 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T23:54:32.984 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../050-ceph-osd_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:33.051 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-osd (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:33.438 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T23:54:33.456 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../049-ceph-mon_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:33.513 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mon (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:35.484 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T23:54:35.503 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../050-ceph-osd_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:35.567 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-osd (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:35.596 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph. 2024-09-13T23:54:35.612 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../051-ceph_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:35.654 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:36.007 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T23:54:36.024 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../052-ceph-fuse_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:36.090 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-fuse (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:36.560 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T23:54:36.579 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../053-ceph-mds_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:36.643 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mds (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:37.213 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package cephadm. 2024-09-13T23:54:37.231 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../054-cephadm_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:37.262 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking cephadm (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:37.598 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T23:54:37.614 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../055-python3-asyncssh_1.12.2-1_all.deb ... 2024-09-13T23:54:37.656 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-09-13T23:54:37.812 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph. 2024-09-13T23:54:37.829 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../051-ceph_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:37.870 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:38.026 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T23:54:38.042 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-13T23:54:38.109 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T23:54:38.222 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T23:54:38.238 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../052-ceph-fuse_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:38.281 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-fuse (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:38.437 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T23:54:38.453 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-13T23:54:38.497 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-cephadm (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:38.651 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T23:54:38.666 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../053-ceph-mds_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:38.701 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mds (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:38.865 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jwt. 2024-09-13T23:54:38.881 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-13T23:54:38.948 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T23:54:39.237 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package cephadm. 2024-09-13T23:54:39.253 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../054-cephadm_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:39.259 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-attr. 2024-09-13T23:54:39.279 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2024-09-13T23:54:39.294 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking cephadm (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:39.317 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-13T23:54:39.606 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T23:54:39.622 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../055-python3-asyncssh_1.12.2-1_all.deb ... 2024-09-13T23:54:39.670 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T23:54:39.672 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-09-13T23:54:39.686 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2024-09-13T23:54:39.728 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-13T23:54:40.042 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T23:54:40.060 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-13T23:54:40.100 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T23:54:40.106 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-py. 2024-09-13T23:54:40.124 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-13T23:54:40.164 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T23:54:40.386 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T23:54:40.405 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-13T23:54:40.519 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-cephadm (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:40.576 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-13T23:54:40.592 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-13T23:54:40.654 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T23:54:40.848 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-jwt. 2024-09-13T23:54:40.865 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-13T23:54:40.906 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T23:54:40.986 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-packaging. 2024-09-13T23:54:41.002 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2024-09-13T23:54:41.044 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-13T23:54:41.251 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-attr. 2024-09-13T23:54:41.269 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2024-09-13T23:54:41.309 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-13T23:54:41.322 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T23:54:41.342 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-13T23:54:41.372 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T23:54:41.662 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T23:54:41.680 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2024-09-13T23:54:41.701 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T23:54:41.717 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2024-09-13T23:54:41.719 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-13T23:54:41.759 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-13T23:54:42.056 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-py. 2024-09-13T23:54:42.073 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-13T23:54:42.122 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T23:54:42.179 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T23:54:42.196 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T23:54:42.237 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T23:54:42.411 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-13T23:54:42.429 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-13T23:54:42.485 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T23:54:42.514 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libjs-underscore. 2024-09-13T23:54:42.530 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-13T23:54:42.573 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T23:54:42.788 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-packaging. 2024-09-13T23:54:42.805 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2024-09-13T23:54:42.846 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-13T23:54:42.883 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-13T23:54:42.902 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-13T23:54:42.962 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T23:54:43.182 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T23:54:43.200 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-13T23:54:43.240 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T23:54:43.311 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-routes. 2024-09-13T23:54:43.326 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2024-09-13T23:54:43.369 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-13T23:54:43.551 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T23:54:43.571 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2024-09-13T23:54:43.626 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-13T23:54:43.730 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T23:54:43.748 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-13T23:54:43.788 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-dashboard (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:43.996 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T23:54:44.012 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T23:54:44.054 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T23:54:44.315 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libjs-underscore. 2024-09-13T23:54:44.335 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-13T23:54:44.406 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T23:54:44.684 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-13T23:54:44.700 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-13T23:54:44.742 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T23:54:45.086 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-routes. 2024-09-13T23:54:45.104 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2024-09-13T23:54:45.144 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-13T23:54:45.285 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-decorator. 2024-09-13T23:54:45.302 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-13T23:54:45.343 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T23:54:45.497 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T23:54:45.513 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-13T23:54:45.555 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-dashboard (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:45.670 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-13T23:54:45.686 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-13T23:54:45.728 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T23:54:46.065 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-scipy. 2024-09-13T23:54:46.081 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-13T23:54:46.156 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-13T23:54:46.986 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-decorator. 2024-09-13T23:54:47.004 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-13T23:54:47.044 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T23:54:47.380 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-13T23:54:47.397 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-13T23:54:47.438 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T23:54:47.481 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-13T23:54:47.500 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-13T23:54:47.539 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T23:54:47.791 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-scipy. 2024-09-13T23:54:47.807 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-13T23:54:47.849 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-13T23:54:48.109 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T23:54:48.125 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2024-09-13T23:54:48.184 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-13T23:54:48.571 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T23:54:48.586 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-13T23:54:48.629 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T23:54:49.167 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-13T23:54:49.185 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-13T23:54:49.225 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T23:54:49.404 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T23:54:49.421 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-13T23:54:49.462 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:49.795 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T23:54:49.815 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2024-09-13T23:54:49.853 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-13T23:54:50.258 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T23:54:50.279 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-13T23:54:50.324 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T23:54:50.949 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T23:54:50.965 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2024-09-13T23:54:50.982 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T23:54:50.999 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-13T23:54:51.004 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-13T23:54:51.041 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:51.335 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T23:54:51.351 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-13T23:54:51.393 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T23:54:51.771 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T23:54:51.789 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-13T23:54:51.829 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T23:54:52.160 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T23:54:52.180 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2024-09-13T23:54:52.239 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-13T23:54:52.265 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T23:54:52.281 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2024-09-13T23:54:52.348 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-13T23:54:52.558 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T23:54:52.576 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-13T23:54:52.616 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T23:54:52.669 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T23:54:52.688 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2024-09-13T23:54:52.727 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-13T23:54:52.936 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T23:54:52.955 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-13T23:54:52.994 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T23:54:53.081 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-blinker. 2024-09-13T23:54:53.097 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-13T23:54:53.139 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T23:54:53.399 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T23:54:53.419 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2024-09-13T23:54:53.457 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-13T23:54:53.492 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-13T23:54:53.508 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-13T23:54:53.550 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T23:54:53.803 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T23:54:53.823 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2024-09-13T23:54:53.861 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-13T23:54:53.905 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T23:54:53.921 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-13T23:54:53.963 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T23:54:54.199 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-blinker. 2024-09-13T23:54:54.218 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-13T23:54:54.248 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T23:54:54.325 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T23:54:54.344 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-13T23:54:54.391 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T23:54:54.555 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-13T23:54:54.572 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-13T23:54:54.613 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T23:54:54.723 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T23:54:54.738 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-13T23:54:54.781 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T23:54:54.967 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T23:54:54.984 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-13T23:54:55.025 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T23:54:55.345 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T23:54:55.354 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T23:54:55.364 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-13T23:54:55.370 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-13T23:54:55.413 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:55.413 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T23:54:55.758 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T23:54:55.779 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-13T23:54:55.799 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T23:54:55.816 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T23:54:55.819 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2024-09-13T23:54:55.857 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-13T23:54:56.227 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T23:54:56.245 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T23:54:56.285 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T23:54:56.396 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T23:54:56.413 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-13T23:54:56.454 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:56.626 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package jq. 2024-09-13T23:54:56.647 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T23:54:56.696 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T23:54:56.807 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T23:54:56.825 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2024-09-13T23:54:56.865 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-13T23:54:56.983 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package socat. 2024-09-13T23:54:57.003 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2024-09-13T23:54:57.040 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-13T23:54:57.235 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T23:54:57.252 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T23:54:57.293 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T23:54:57.377 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T23:54:57.394 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-13T23:54:57.435 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-13T23:54:57.588 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package jq. 2024-09-13T23:54:57.605 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T23:54:57.646 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T23:54:57.807 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-test. 2024-09-13T23:54:57.827 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../094-ceph-test_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:57.864 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-test (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:54:57.899 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package socat. 2024-09-13T23:54:57.916 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2024-09-13T23:54:57.957 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-13T23:54:58.293 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T23:54:58.309 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-13T23:54:58.351 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-13T23:54:58.731 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-test. 2024-09-13T23:54:58.748 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../094-ceph-test_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:54:58.805 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-test (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:02.069 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T23:55:02.086 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../095-ceph-volume_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-13T23:55:02.135 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-volume (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:02.456 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-13T23:55:02.473 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T23:55:02.513 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T23:55:02.977 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T23:55:02.993 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../095-ceph-volume_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-13T23:55:03.026 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-volume (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:03.076 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T23:55:03.096 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:55:03.134 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libcephfs-dev (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:03.325 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-13T23:55:03.342 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T23:55:03.408 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T23:55:03.590 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T23:55:03.609 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-13T23:55:03.666 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T23:55:03.937 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T23:55:03.953 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:55:03.994 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libcephfs-dev (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:04.012 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T23:55:04.029 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-09-13T23:55:04.069 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-09-13T23:55:04.468 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-13T23:55:04.484 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T23:55:04.501 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T23:55:04.517 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-13T23:55:04.525 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T23:55:04.576 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T23:55:04.905 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T23:55:04.921 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-09-13T23:55:04.963 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-09-13T23:55:05.360 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-13T23:55:05.377 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T23:55:05.418 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T23:55:06.214 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-13T23:55:06.233 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-13T23:55:06.271 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-13T23:55:06.633 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-webencodings. 2024-09-13T23:55:06.651 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-13T23:55:06.691 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T23:55:06.952 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-html5lib. 2024-09-13T23:55:06.969 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2024-09-13T23:55:07.002 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-13T23:55:07.397 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-13T23:55:07.412 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-13T23:55:07.416 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-13T23:55:07.431 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-13T23:55:07.455 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T23:55:07.470 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-13T23:55:07.832 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-webencodings. 2024-09-13T23:55:07.849 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-13T23:55:07.890 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T23:55:07.967 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T23:55:07.987 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T23:55:08.024 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T23:55:08.193 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-html5lib. 2024-09-13T23:55:08.210 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2024-09-13T23:55:08.267 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-13T23:55:08.370 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T23:55:08.389 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-13T23:55:08.428 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T23:55:08.591 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-13T23:55:08.611 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-13T23:55:08.649 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T23:55:08.767 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T23:55:08.788 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-13T23:55:08.867 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T23:55:09.111 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T23:55:09.129 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T23:55:09.169 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T23:55:09.195 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T23:55:09.215 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-13T23:55:09.253 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T23:55:09.506 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T23:55:09.526 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-13T23:55:09.564 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T23:55:09.572 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T23:55:09.590 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-13T23:55:09.630 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T23:55:09.926 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T23:55:09.942 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-13T23:55:09.984 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T23:55:10.295 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T23:55:10.316 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-13T23:55:10.353 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T23:55:10.359 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package radosgw. 2024-09-13T23:55:10.376 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../110-radosgw_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:55:10.417 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking radosgw (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:10.667 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T23:55:10.685 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-13T23:55:10.725 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T23:55:11.455 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package radosgw. 2024-09-13T23:55:11.473 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../110-radosgw_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:55:11.505 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking radosgw (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:11.812 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T23:55:11.830 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../111-rbd-fuse_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:55:11.870 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking rbd-fuse (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:12.209 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-13T23:55:12.527 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T23:55:12.678 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T23:55:12.804 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T23:55:12.892 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T23:55:12.909 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../111-rbd-fuse_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-13T23:55:12.949 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking rbd-fuse (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:13.031 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up cephadm (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:13.276 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-13T23:55:13.548 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T23:55:13.667 INFO:teuthology.orchestra.run.smithi087.stdout:Adding system user cephadm....done 2024-09-13T23:55:13.699 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T23:55:13.825 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T23:55:13.855 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T23:55:13.973 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T23:55:14.027 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up cephadm (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:14.341 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T23:55:14.578 INFO:teuthology.orchestra.run.smithi173.stdout:Adding system user cephadm....done 2024-09-13T23:55:14.642 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T23:55:14.767 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T23:55:14.768 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-13T23:55:14.893 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T23:55:14.928 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T23:55:15.253 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T23:55:15.271 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-13T23:55:15.538 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T23:55:15.674 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T23:55:15.697 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-13T23:55:15.807 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T23:55:16.018 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-13T23:55:16.142 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-13T23:55:16.334 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T23:55:16.561 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T23:55:16.635 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T23:55:16.846 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-13T23:55:16.928 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-ceph-argparse (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:17.131 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T23:55:17.237 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T23:55:17.363 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-13T23:55:17.407 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T23:55:17.674 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-ceph-argparse (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:17.689 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T23:55:17.967 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T23:55:18.037 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T23:55:18.118 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-13T23:55:18.166 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T23:55:18.403 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T23:55:18.543 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-13T23:55:18.729 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T23:55:18.855 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T23:55:18.860 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T23:55:19.211 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T23:55:19.240 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-13T23:55:19.516 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T23:55:19.554 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T23:55:19.784 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T23:55:19.847 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T23:55:20.135 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T23:55:20.182 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-13T23:55:20.436 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T23:55:20.483 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-13T23:55:20.763 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-13T23:55:20.792 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T23:55:20.943 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T23:55:21.030 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-13T23:55:21.069 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T23:55:21.315 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T23:55:21.370 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T23:55:21.633 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T23:55:21.759 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T23:55:22.022 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T23:55:22.085 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T23:55:22.390 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T23:55:22.487 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T23:55:22.775 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-13T23:55:22.855 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T23:55:22.901 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-ceph-common (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:23.216 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-13T23:55:23.287 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T23:55:23.367 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-ceph-common (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:23.428 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-13T23:55:23.693 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T23:55:23.788 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T23:55:23.861 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-13T23:55:23.939 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-13T23:55:24.059 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-13T23:55:24.204 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T23:55:24.347 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-13T23:55:24.385 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T23:55:24.473 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-13T23:55:24.761 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T23:55:24.782 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T23:55:24.887 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T23:55:25.046 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T23:55:25.092 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T23:55:25.252 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T23:55:25.373 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T23:55:25.377 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T23:55:25.641 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-13T23:55:25.721 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T23:55:25.942 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T23:55:25.972 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-13T23:55:26.068 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T23:55:26.257 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T23:55:26.377 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-13T23:55:26.391 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T23:55:26.678 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T23:55:26.692 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-13T23:55:26.985 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T23:55:27.054 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T23:55:27.295 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T23:55:27.439 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-13T23:55:27.679 INFO:teuthology.orchestra.run.smithi173.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-13T23:55:27.707 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-13T23:55:27.833 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T23:55:27.939 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-13T23:55:28.065 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T23:55:28.201 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-13T23:55:28.400 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-13T23:55:28.561 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T23:55:28.687 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T23:55:28.776 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T23:55:28.838 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T23:55:28.903 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T23:55:29.029 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T23:55:29.172 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T23:55:29.372 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T23:55:29.457 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-13T23:55:29.648 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-13T23:55:30.913 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T23:55:31.057 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-13T23:55:31.104 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T23:55:31.222 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-13T23:55:31.431 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-13T23:55:31.582 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-13T23:55:31.724 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-13T23:55:31.875 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-13T23:55:32.009 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T23:55:32.134 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-13T23:55:32.184 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T23:55:32.310 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-13T23:55:32.544 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T23:55:32.628 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T23:55:32.863 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-09-13T23:55:32.947 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-09-13T23:55:33.239 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T23:55:33.307 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T23:55:33.548 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T23:55:33.666 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T23:55:34.579 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T23:55:34.705 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-13T23:55:34.714 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T23:55:34.856 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T23:55:34.873 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-13T23:55:34.982 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-13T23:55:34.999 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T23:55:35.126 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-13T23:55:35.283 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T23:55:35.427 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T23:55:35.442 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-13T23:55:35.553 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-13T23:55:35.735 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T23:55:35.854 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T23:55:36.028 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T23:55:36.122 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T23:55:36.338 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T23:55:36.424 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T23:55:36.698 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librados2 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:36.793 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up librados2 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:36.849 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-09-13T23:55:36.919 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-09-13T23:55:36.983 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librgw2 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:37.160 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libsqlite3-mod-ceph (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:37.389 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libcephfs2 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:37.429 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up librgw2 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:37.522 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-13T23:55:37.563 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libsqlite3-mod-ceph (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:37.774 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libcephfs2 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:37.823 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libradosstriper1 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:37.917 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-13T23:55:37.941 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-13T23:55:38.210 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libradosstriper1 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:38.301 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librbd1 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:38.361 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-13T23:55:38.427 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-modules-core (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:38.578 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-fuse (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:38.672 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up librbd1 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:38.800 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-modules-core (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:38.802 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T23:55:38.802 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T23:55:38.924 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-fuse (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:39.149 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T23:55:39.149 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T23:55:39.255 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libcephfs-dev (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:39.381 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rados (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:39.532 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T23:55:39.609 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libcephfs-dev (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:39.763 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-rados (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:39.895 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T23:55:40.444 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rbd (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:40.595 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up rbd-fuse (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:40.721 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rgw (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:40.816 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-rbd (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:40.889 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cephfs (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:40.942 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up rbd-fuse (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:41.015 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-common (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:41.068 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-rgw (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:41.219 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-cephfs (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:41.345 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-common (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:41.618 INFO:teuthology.orchestra.run.smithi087.stdout:Adding group ceph....done 2024-09-13T23:55:41.899 INFO:teuthology.orchestra.run.smithi173.stdout:Adding group ceph....done 2024-09-13T23:55:42.077 INFO:teuthology.orchestra.run.smithi087.stdout:Adding system user ceph....done 2024-09-13T23:55:42.253 INFO:teuthology.orchestra.run.smithi087.stdout:Setting system user ceph properties....done 2024-09-13T23:55:42.279 INFO:teuthology.orchestra.run.smithi087.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T23:55:42.300 INFO:teuthology.orchestra.run.smithi173.stdout:Adding system user ceph....done 2024-09-13T23:55:42.427 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T23:55:42.494 INFO:teuthology.orchestra.run.smithi173.stdout:Setting system user ceph properties....done 2024-09-13T23:55:42.512 INFO:teuthology.orchestra.run.smithi173.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T23:55:42.667 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T23:55:42.753 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T23:55:42.987 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T23:55:43.241 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-test (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:43.376 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up radosgw (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:43.456 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-test (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:43.607 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up radosgw (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:43.868 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T23:55:43.868 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T23:55:44.074 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T23:55:44.074 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T23:55:44.352 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-base (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:44.501 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-base (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:44.738 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T23:55:44.915 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T23:55:45.196 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mds (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:45.387 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mds (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:45.437 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T23:55:45.437 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T23:55:45.619 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T23:55:45.619 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T23:55:45.873 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:46.088 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:46.101 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T23:55:46.101 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T23:55:46.314 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T23:55:46.314 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T23:55:46.532 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-osd (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:46.782 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-osd (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:47.077 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T23:55:47.077 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T23:55:47.250 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T23:55:47.250 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T23:55:47.552 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-k8sevents (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:47.677 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:47.701 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-k8sevents (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:47.827 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:47.845 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mon (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:47.995 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mon (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:48.071 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T23:55:48.071 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T23:55:48.223 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T23:55:48.223 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T23:55:48.513 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-cephadm (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:48.672 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:48.681 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-cephadm (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:48.798 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-dashboard (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:48.833 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:48.966 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-volume (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:49.017 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-dashboard (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:49.161 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-volume (18.2.4-845-ge4e227b3-1focal) ... 2024-09-13T23:55:49.328 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T23:55:49.489 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T23:55:49.814 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T23:55:49.914 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T23:55:50.074 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T23:55:50.359 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T23:55:52.879 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-13T23:55:53.178 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-13T23:55:53.506 INFO:teuthology.orchestra.run.smithi087.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T23:55:53.512 DEBUG:teuthology.parallel:result is None 2024-09-13T23:55:53.781 INFO:teuthology.orchestra.run.smithi173.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T23:55:53.785 DEBUG:teuthology.parallel:result is None 2024-09-13T23:55:53.786 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=e4e227b37858f5109138494e01e5ba1ba7b8ffe8 2024-09-13T23:55:53.941 DEBUG:teuthology.orchestra.run.smithi087:> dpkg-query -W -f '${Version}' ceph 2024-09-13T23:55:53.964 INFO:teuthology.orchestra.run.smithi087.stdout:18.2.4-845-ge4e227b3-1focal 2024-09-13T23:55:53.964 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-845-ge4e227b3-1focal 2024-09-13T23:55:53.965 INFO:teuthology.task.install:The correct ceph version 18.2.4-845-ge4e227b3-1focal is installed. 2024-09-13T23:55:53.967 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=e4e227b37858f5109138494e01e5ba1ba7b8ffe8 2024-09-13T23:55:54.119 DEBUG:teuthology.orchestra.run.smithi173:> dpkg-query -W -f '${Version}' ceph 2024-09-13T23:55:54.143 INFO:teuthology.orchestra.run.smithi173.stdout:18.2.4-845-ge4e227b3-1focal 2024-09-13T23:55:54.143 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-845-ge4e227b3-1focal 2024-09-13T23:55:54.143 INFO:teuthology.task.install:The correct ceph version 18.2.4-845-ge4e227b3-1focal is installed. 2024-09-13T23:55:54.145 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T23:55:54.145 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T23:55:54.145 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T23:55:54.162 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-13T23:55:54.162 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T23:55:54.177 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T23:55:54.178 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T23:55:54.178 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T23:55:54.192 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T23:55:54.249 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-13T23:55:54.250 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T23:55:54.266 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T23:55:54.281 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T23:55:54.281 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T23:55:54.282 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T23:55:54.297 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T23:55:54.308 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-13T23:55:54.308 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T23:55:54.322 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T23:55:54.336 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T23:55:54.336 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T23:55:54.336 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T23:55:54.365 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T23:55:54.376 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-13T23:55:54.376 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T23:55:54.391 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T23:55:54.449 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T23:55:54.523 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T23:55:54.525 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 777 /var/log/ceph 2024-09-13T23:55:54.527 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 777 /var/log/ceph 2024-09-13T23:55:54.543 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T23:55:54.543 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T23:55:54.584 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T23:55:54.600 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T23:55:54.600 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T23:55:54.602 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T23:55:54.663 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T23:55:54.663 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T23:55:54.663 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-13_22:40:03-rgw-reef-distro-default-smithi/7904474', 'branch': 'reef', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_20.04}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7904474', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-13_22:40:03-rgw-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8', 'wait-for-scrub': False}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8'}}, 'rgw': {'ec-data-pool': True, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 4285, 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_e4e227b37858f5109138494e01e5ba1ba7b8ffe8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8', 'targets': {'smithi087.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi173.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8', 'wait-for-scrub': False, 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_22:40:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T23:55:54.664 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T23:55:54.666 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T23:55:54.672 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T23:55:54.674 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T23:55:54.688 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T23:55:54.688 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T23:55:54.733 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T23:55:54.733 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_1 2024-09-13T23:55:54.740 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T23:55:54.740 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T23:55:54.740 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 358 Links: 1 2024-09-13T23:55:54.740 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:55:54.740 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-13 23:52:24.355849926 +0000 2024-09-13T23:55:54.740 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-13 23:52:24.351850018 +0000 2024-09-13T23:55:54.740 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-13 23:52:24.351850018 +0000 2024-09-13T23:55:54.741 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-09-13T23:55:54.741 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T23:55:54.755 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-13T23:55:54.755 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-13T23:55:54.755 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000412019 s, 1.2 MB/s 2024-09-13T23:55:54.756 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T23:55:54.764 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_2 2024-09-13T23:55:54.771 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T23:55:54.772 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T23:55:54.772 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 367 Links: 1 2024-09-13T23:55:54.772 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:55:54.772 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-13 23:52:25.031834351 +0000 2024-09-13T23:55:54.772 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-13 23:52:24.831838958 +0000 2024-09-13T23:55:54.772 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-13 23:52:24.831838958 +0000 2024-09-13T23:55:54.772 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-09-13T23:55:54.772 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T23:55:54.827 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-13T23:55:54.827 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-13T23:55:54.827 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000378567 s, 1.4 MB/s 2024-09-13T23:55:54.828 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T23:55:54.836 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_3 2024-09-13T23:55:54.843 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T23:55:54.843 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T23:55:54.843 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 372 Links: 1 2024-09-13T23:55:54.843 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:55:54.843 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-13 23:52:25.507823384 +0000 2024-09-13T23:55:54.843 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-13 23:52:25.323827623 +0000 2024-09-13T23:55:54.843 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-13 23:52:25.323827623 +0000 2024-09-13T23:55:54.843 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-09-13T23:55:54.844 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T23:55:54.855 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-13T23:55:54.855 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-13T23:55:54.855 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000382062 s, 1.3 MB/s 2024-09-13T23:55:54.856 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T23:55:54.906 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_4 2024-09-13T23:55:54.913 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T23:55:54.913 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T23:55:54.914 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 377 Links: 1 2024-09-13T23:55:54.914 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:55:54.914 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-13 23:52:25.931813615 +0000 2024-09-13T23:55:54.914 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-13 23:52:25.715818591 +0000 2024-09-13T23:55:54.914 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-13 23:52:25.715818591 +0000 2024-09-13T23:55:54.914 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-09-13T23:55:54.914 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T23:55:54.926 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-13T23:55:54.926 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-13T23:55:54.926 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000366052 s, 1.4 MB/s 2024-09-13T23:55:54.927 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T23:55:54.980 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-13T23:55:54.981 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-13T23:55:54.981 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T23:55:54.987 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T23:55:54.988 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_1 2024-09-13T23:55:54.995 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T23:55:54.995 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T23:55:54.995 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 368 Links: 1 2024-09-13T23:55:54.995 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:55:54.995 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-13 23:52:24.372129655 +0000 2024-09-13T23:55:54.995 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-13 23:52:24.188133888 +0000 2024-09-13T23:55:54.995 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-13 23:52:24.188133888 +0000 2024-09-13T23:55:54.995 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2024-09-13T23:55:54.995 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T23:55:55.007 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-13T23:55:55.007 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-13T23:55:55.007 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000425204 s, 1.2 MB/s 2024-09-13T23:55:55.008 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T23:55:55.016 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_2 2024-09-13T23:55:55.023 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T23:55:55.023 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T23:55:55.023 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 377 Links: 1 2024-09-13T23:55:55.023 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:55:55.023 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-13 23:52:24.796119901 +0000 2024-09-13T23:55:55.023 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-13 23:52:24.604124318 +0000 2024-09-13T23:55:55.023 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-13 23:52:24.604124318 +0000 2024-09-13T23:55:55.023 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2024-09-13T23:55:55.023 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T23:55:55.037 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-13T23:55:55.037 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-13T23:55:55.037 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000422395 s, 1.2 MB/s 2024-09-13T23:55:55.038 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T23:55:55.046 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_3 2024-09-13T23:55:55.096 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T23:55:55.096 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T23:55:55.096 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 383 Links: 1 2024-09-13T23:55:55.096 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:55:55.096 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-13 23:52:25.028114562 +0000 2024-09-13T23:55:55.096 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-13 23:52:25.024114655 +0000 2024-09-13T23:55:55.096 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-13 23:52:25.024114655 +0000 2024-09-13T23:55:55.096 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2024-09-13T23:55:55.097 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T23:55:55.111 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-13T23:55:55.111 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-13T23:55:55.111 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000408311 s, 1.3 MB/s 2024-09-13T23:55:55.112 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T23:55:55.120 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_4 2024-09-13T23:55:55.126 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T23:55:55.127 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T23:55:55.127 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 390 Links: 1 2024-09-13T23:55:55.127 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:55:55.127 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-13 23:52:25.648100298 +0000 2024-09-13T23:55:55.127 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-13 23:52:25.428105360 +0000 2024-09-13T23:55:55.127 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-13 23:52:25.428105360 +0000 2024-09-13T23:55:55.127 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2024-09-13T23:55:55.127 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T23:55:55.183 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-13T23:55:55.183 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-13T23:55:55.183 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000366166 s, 1.4 MB/s 2024-09-13T23:55:55.184 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T23:55:55.192 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T23:55:55.192 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi173.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-13T23:55:55.192 INFO:tasks.ceph:Generating config... 2024-09-13T23:55:55.194 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T23:55:55.194 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-13T23:55:55.194 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-13T23:55:55.194 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-13T23:55:55.194 INFO:tasks.ceph:[client] setuser = ceph 2024-09-13T23:55:55.194 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T23:55:55.194 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-13T23:55:55.194 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-13T23:55:55.194 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-13T23:55:55.195 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-13T23:55:55.195 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T23:55:55.195 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T23:55:55.195 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-13T23:55:55.195 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-13T23:55:55.195 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T23:55:55.195 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-13T23:55:55.195 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T23:55:55.195 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T23:55:55.195 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T23:55:55.195 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T23:55:55.195 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T23:55:55.195 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T23:55:55.195 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T23:55:55.195 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T23:55:55.196 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T23:55:55.196 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T23:55:55.196 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T23:55:55.196 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T23:55:55.236 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T23:55:55.248 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T23:55:55.333 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T23:55:55.345 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.87')] 2024-09-13T23:55:55.346 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.87'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-13T23:55:55.347 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T23:55:55.347 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T23:55:55.352 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.87 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:55:55.433 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:55:55.434 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:55:55.434 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:55:55.434 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool: generated fsid 0b890e8e-a4ce-4e8b-9529-48a86f947d30 2024-09-13T23:55:55.434 INFO:teuthology.orchestra.run.smithi087.stdout:setting min_mon_release = pacific 2024-09-13T23:55:55.434 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 0 2024-09-13T23:55:55.434 INFO:teuthology.orchestra.run.smithi087.stdout:fsid 0b890e8e-a4ce-4e8b-9529-48a86f947d30 2024-09-13T23:55:55.434 INFO:teuthology.orchestra.run.smithi087.stdout:last_changed 2024-09-13T23:55:55.431647+0000 2024-09-13T23:55:55.434 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-13T23:55:55.431647+0000 2024-09-13T23:55:55.435 INFO:teuthology.orchestra.run.smithi087.stdout:min_mon_release 16 (pacific) 2024-09-13T23:55:55.435 INFO:teuthology.orchestra.run.smithi087.stdout:election_strategy: 1 2024-09-13T23:55:55.435 INFO:teuthology.orchestra.run.smithi087.stdout:0: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.a 2024-09-13T23:55:55.435 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-13T23:55:55.436 DEBUG:teuthology.orchestra.run.smithi087:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T23:55:55.442 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0b890e8e-a4ce-4e8b-9529-48a86f947d30... 2024-09-13T23:55:55.443 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T23:55:55.445 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T23:55:55.472 INFO:teuthology.orchestra.run.smithi087.stdout:[global] 2024-09-13T23:55:55.472 INFO:teuthology.orchestra.run.smithi087.stdout: chdir = "" 2024-09-13T23:55:55.472 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T23:55:55.472 INFO:teuthology.orchestra.run.smithi087.stdout: auth supported = cephx 2024-09-13T23:55:55.472 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.472 INFO:teuthology.orchestra.run.smithi087.stdout: filestore xattr use omap = true 2024-09-13T23:55:55.472 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.473 INFO:teuthology.orchestra.run.smithi087.stdout: mon clock drift allowed = 1.000 2024-09-13T23:55:55.473 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.473 INFO:teuthology.orchestra.run.smithi087.stdout: osd crush chooseleaf type = 0 2024-09-13T23:55:55.473 INFO:teuthology.orchestra.run.smithi087.stdout: auth debug = true 2024-09-13T23:55:55.473 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.473 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on old message = true 2024-09-13T23:55:55.473 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on bug = true 2024-09-13T23:55:55.473 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.473 INFO:teuthology.orchestra.run.smithi087.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T23:55:55.473 INFO:teuthology.orchestra.run.smithi087.stdout: mon pg warn max object skew = 0 2024-09-13T23:55:55.473 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.473 INFO:teuthology.orchestra.run.smithi087.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T23:55:55.473 INFO:teuthology.orchestra.run.smithi087.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T23:55:55.473 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.474 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default size = 2 2024-09-13T23:55:55.474 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.474 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow primary affinity = true 2024-09-13T23:55:55.474 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow pg remap = true 2024-09-13T23:55:55.474 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on legacy crush tunables = false 2024-09-13T23:55:55.474 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on crush straw calc version zero = false 2024-09-13T23:55:55.474 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on no sortbitwise = false 2024-09-13T23:55:55.474 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on osd down out interval zero = false 2024-09-13T23:55:55.474 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on too few osds = false 2024-09-13T23:55:55.474 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T23:55:55.474 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T23:55:55.474 INFO:teuthology.orchestra.run.smithi087.stdout: mon_allow_pool_size_one = true 2024-09-13T23:55:55.474 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.474 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T23:55:55.474 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.475 INFO:teuthology.orchestra.run.smithi087.stdout: osd default data pool replay window = 5 2024-09-13T23:55:55.475 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.475 INFO:teuthology.orchestra.run.smithi087.stdout: mon allow pool delete = true 2024-09-13T23:55:55.475 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.475 INFO:teuthology.orchestra.run.smithi087.stdout: mon cluster log file level = debug 2024-09-13T23:55:55.475 INFO:teuthology.orchestra.run.smithi087.stdout: debug asserts on shutdown = true 2024-09-13T23:55:55.475 INFO:teuthology.orchestra.run.smithi087.stdout: mon health detail to clog = false 2024-09-13T23:55:55.475 INFO:teuthology.orchestra.run.smithi087.stdout: mon host = 172.21.15.87 2024-09-13T23:55:55.475 INFO:teuthology.orchestra.run.smithi087.stdout: fsid = 0b890e8e-a4ce-4e8b-9529-48a86f947d30 2024-09-13T23:55:55.475 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.475 INFO:teuthology.orchestra.run.smithi087.stdout:[osd] 2024-09-13T23:55:55.475 INFO:teuthology.orchestra.run.smithi087.stdout: osd journal size = 100 2024-09-13T23:55:55.475 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.475 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub load threshold = 5.0 2024-09-13T23:55:55.476 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub max interval = 600 2024-09-13T23:55:55.476 INFO:teuthology.orchestra.run.smithi087.stdout: osd mclock profile = high_recovery_ops 2024-09-13T23:55:55.476 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.476 INFO:teuthology.orchestra.run.smithi087.stdout: osd recover clone overlap = true 2024-09-13T23:55:55.476 INFO:teuthology.orchestra.run.smithi087.stdout: osd recovery max chunk = 1048576 2024-09-13T23:55:55.476 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.476 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug shutdown = true 2024-09-13T23:55:55.476 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug op order = true 2024-09-13T23:55:55.476 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug verify stray on activate = true 2024-09-13T23:55:55.476 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.476 INFO:teuthology.orchestra.run.smithi087.stdout: osd open classes on start = true 2024-09-13T23:55:55.476 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug pg log writeout = true 2024-09-13T23:55:55.476 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.476 INFO:teuthology.orchestra.run.smithi087.stdout: osd deep scrub update digest min age = 30 2024-09-13T23:55:55.476 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.477 INFO:teuthology.orchestra.run.smithi087.stdout: osd map max advance = 10 2024-09-13T23:55:55.477 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.477 INFO:teuthology.orchestra.run.smithi087.stdout: journal zero on create = true 2024-09-13T23:55:55.477 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.477 INFO:teuthology.orchestra.run.smithi087.stdout: filestore ondisk finisher threads = 3 2024-09-13T23:55:55.477 INFO:teuthology.orchestra.run.smithi087.stdout: filestore apply finisher threads = 3 2024-09-13T23:55:55.477 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.477 INFO:teuthology.orchestra.run.smithi087.stdout: bdev debug aio = true 2024-09-13T23:55:55.477 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug misdirected ops = true 2024-09-13T23:55:55.477 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-09-13T23:55:55.477 INFO:teuthology.orchestra.run.smithi087.stdout: debug objclass = 20 2024-09-13T23:55:55.477 INFO:teuthology.orchestra.run.smithi087.stdout: bdev async discard = True 2024-09-13T23:55:55.477 INFO:teuthology.orchestra.run.smithi087.stdout: bdev enable discard = True 2024-09-13T23:55:55.477 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore allocator = bitmap 2024-09-13T23:55:55.478 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore block size = 96636764160 2024-09-13T23:55:55.478 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore fsck on mount = True 2024-09-13T23:55:55.478 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluefs = 1/20 2024-09-13T23:55:55.478 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluestore = 1/20 2024-09-13T23:55:55.478 INFO:teuthology.orchestra.run.smithi087.stdout: debug osd = 20 2024-09-13T23:55:55.478 INFO:teuthology.orchestra.run.smithi087.stdout: debug rocksdb = 4/10 2024-09-13T23:55:55.478 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T23:55:55.478 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd full ratio = 0.9 2024-09-13T23:55:55.478 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd nearfull ratio = 0.8 2024-09-13T23:55:55.478 INFO:teuthology.orchestra.run.smithi087.stdout: osd failsafe full ratio = 0.95 2024-09-13T23:55:55.478 INFO:teuthology.orchestra.run.smithi087.stdout: osd objectstore = bluestore 2024-09-13T23:55:55.478 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.478 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr] 2024-09-13T23:55:55.478 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-09-13T23:55:55.479 INFO:teuthology.orchestra.run.smithi087.stdout: debug mgr = 20 2024-09-13T23:55:55.479 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-09-13T23:55:55.479 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-09-13T23:55:55.479 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-09-13T23:55:55.479 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-09-13T23:55:55.479 INFO:teuthology.orchestra.run.smithi087.stdout: mgr/telemetry/nag = false 2024-09-13T23:55:55.479 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.479 INFO:teuthology.orchestra.run.smithi087.stdout:[mon] 2024-09-13T23:55:55.479 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-09-13T23:55:55.479 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-09-13T23:55:55.479 INFO:teuthology.orchestra.run.smithi087.stdout: debug paxos = 20 2024-09-13T23:55:55.479 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-09-13T23:55:55.479 INFO:teuthology.orchestra.run.smithi087.stdout: mon data avail warn = 5 2024-09-13T23:55:55.479 INFO:teuthology.orchestra.run.smithi087.stdout: mon mgr mkfs grace = 240 2024-09-13T23:55:55.479 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-09-13T23:55:55.480 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd reporter subtree level = osd 2024-09-13T23:55:55.480 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd prime pg temp = true 2024-09-13T23:55:55.480 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-09-13T23:55:55.480 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.480 INFO:teuthology.orchestra.run.smithi087.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T23:55:55.480 INFO:teuthology.orchestra.run.smithi087.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T23:55:55.480 INFO:teuthology.orchestra.run.smithi087.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T23:55:55.480 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.480 INFO:teuthology.orchestra.run.smithi087.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T23:55:55.480 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T23:55:55.480 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T23:55:55.480 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.480 INFO:teuthology.orchestra.run.smithi087.stdout: # 1m isn't quite enough 2024-09-13T23:55:55.480 INFO:teuthology.orchestra.run.smithi087.stdout: mon_down_mkfs_grace = 2m 2024-09-13T23:55:55.480 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.480 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_filestore_osds = false 2024-09-13T23:55:55.481 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:55:55.481 INFO:teuthology.orchestra.run.smithi087.stdout:[client] 2024-09-13T23:55:55.481 INFO:teuthology.orchestra.run.smithi087.stdout: rgw cache enabled = true 2024-09-13T23:55:55.481 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable ops log = true 2024-09-13T23:55:55.481 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable usage log = true 2024-09-13T23:55:55.481 INFO:teuthology.orchestra.run.smithi087.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T23:55:55.481 INFO:teuthology.orchestra.run.smithi087.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T23:55:55.481 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-09-13T23:55:55.481 INFO:teuthology.orchestra.run.smithi087.stdout: rgw gc obj min wait = 15 2024-09-13T23:55:55.481 INFO:teuthology.orchestra.run.smithi087.stdout: debug rgw = 20 2024-09-13T23:55:55.481 INFO:teuthology.orchestra.run.smithi087.stdout: setgroup = ceph 2024-09-13T23:55:55.481 INFO:teuthology.orchestra.run.smithi087.stdout: setuser = ceph 2024-09-13T23:55:55.481 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.a] 2024-09-13T23:55:55.482 INFO:teuthology.orchestra.run.smithi173.stdout:[global] 2024-09-13T23:55:55.482 INFO:teuthology.orchestra.run.smithi173.stdout: chdir = "" 2024-09-13T23:55:55.482 INFO:teuthology.orchestra.run.smithi173.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T23:55:55.483 INFO:teuthology.orchestra.run.smithi173.stdout: auth supported = cephx 2024-09-13T23:55:55.483 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.483 INFO:teuthology.orchestra.run.smithi173.stdout: filestore xattr use omap = true 2024-09-13T23:55:55.483 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.483 INFO:teuthology.orchestra.run.smithi173.stdout: mon clock drift allowed = 1.000 2024-09-13T23:55:55.483 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.483 INFO:teuthology.orchestra.run.smithi173.stdout: osd crush chooseleaf type = 0 2024-09-13T23:55:55.483 INFO:teuthology.orchestra.run.smithi173.stdout: auth debug = true 2024-09-13T23:55:55.483 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.483 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on old message = true 2024-09-13T23:55:55.483 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on bug = true 2024-09-13T23:55:55.483 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.483 INFO:teuthology.orchestra.run.smithi173.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T23:55:55.483 INFO:teuthology.orchestra.run.smithi173.stdout: mon pg warn max object skew = 0 2024-09-13T23:55:55.484 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.484 INFO:teuthology.orchestra.run.smithi173.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T23:55:55.484 INFO:teuthology.orchestra.run.smithi173.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T23:55:55.484 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.484 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default size = 2 2024-09-13T23:55:55.484 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.484 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow primary affinity = true 2024-09-13T23:55:55.484 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow pg remap = true 2024-09-13T23:55:55.484 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on legacy crush tunables = false 2024-09-13T23:55:55.484 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on crush straw calc version zero = false 2024-09-13T23:55:55.484 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on no sortbitwise = false 2024-09-13T23:55:55.484 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on osd down out interval zero = false 2024-09-13T23:55:55.484 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on too few osds = false 2024-09-13T23:55:55.484 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T23:55:55.484 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T23:55:55.485 INFO:teuthology.orchestra.run.smithi173.stdout: mon_allow_pool_size_one = true 2024-09-13T23:55:55.485 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.485 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T23:55:55.485 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.485 INFO:teuthology.orchestra.run.smithi173.stdout: osd default data pool replay window = 5 2024-09-13T23:55:55.485 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.485 INFO:teuthology.orchestra.run.smithi173.stdout: mon allow pool delete = true 2024-09-13T23:55:55.485 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.485 INFO:teuthology.orchestra.run.smithi173.stdout: mon cluster log file level = debug 2024-09-13T23:55:55.485 INFO:teuthology.orchestra.run.smithi173.stdout: debug asserts on shutdown = true 2024-09-13T23:55:55.485 INFO:teuthology.orchestra.run.smithi173.stdout: mon health detail to clog = false 2024-09-13T23:55:55.485 INFO:teuthology.orchestra.run.smithi173.stdout: mon host = 172.21.15.87 2024-09-13T23:55:55.485 INFO:teuthology.orchestra.run.smithi173.stdout: fsid = 0b890e8e-a4ce-4e8b-9529-48a86f947d30 2024-09-13T23:55:55.485 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.485 INFO:teuthology.orchestra.run.smithi173.stdout:[osd] 2024-09-13T23:55:55.485 INFO:teuthology.orchestra.run.smithi173.stdout: osd journal size = 100 2024-09-13T23:55:55.486 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.486 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub load threshold = 5.0 2024-09-13T23:55:55.486 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub max interval = 600 2024-09-13T23:55:55.486 INFO:teuthology.orchestra.run.smithi173.stdout: osd mclock profile = high_recovery_ops 2024-09-13T23:55:55.486 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.486 INFO:teuthology.orchestra.run.smithi173.stdout: osd recover clone overlap = true 2024-09-13T23:55:55.486 INFO:teuthology.orchestra.run.smithi173.stdout: osd recovery max chunk = 1048576 2024-09-13T23:55:55.486 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.486 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug shutdown = true 2024-09-13T23:55:55.486 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug op order = true 2024-09-13T23:55:55.486 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug verify stray on activate = true 2024-09-13T23:55:55.486 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.486 INFO:teuthology.orchestra.run.smithi173.stdout: osd open classes on start = true 2024-09-13T23:55:55.486 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug pg log writeout = true 2024-09-13T23:55:55.487 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.487 INFO:teuthology.orchestra.run.smithi173.stdout: osd deep scrub update digest min age = 30 2024-09-13T23:55:55.487 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.487 INFO:teuthology.orchestra.run.smithi173.stdout: osd map max advance = 10 2024-09-13T23:55:55.487 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.487 INFO:teuthology.orchestra.run.smithi173.stdout: journal zero on create = true 2024-09-13T23:55:55.487 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.487 INFO:teuthology.orchestra.run.smithi173.stdout: filestore ondisk finisher threads = 3 2024-09-13T23:55:55.487 INFO:teuthology.orchestra.run.smithi173.stdout: filestore apply finisher threads = 3 2024-09-13T23:55:55.487 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.487 INFO:teuthology.orchestra.run.smithi173.stdout: bdev debug aio = true 2024-09-13T23:55:55.487 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug misdirected ops = true 2024-09-13T23:55:55.487 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-09-13T23:55:55.487 INFO:teuthology.orchestra.run.smithi173.stdout: debug objclass = 20 2024-09-13T23:55:55.488 INFO:teuthology.orchestra.run.smithi173.stdout: bdev async discard = True 2024-09-13T23:55:55.488 INFO:teuthology.orchestra.run.smithi173.stdout: bdev enable discard = True 2024-09-13T23:55:55.488 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore allocator = bitmap 2024-09-13T23:55:55.488 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore block size = 96636764160 2024-09-13T23:55:55.488 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore fsck on mount = True 2024-09-13T23:55:55.488 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluefs = 1/20 2024-09-13T23:55:55.488 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluestore = 1/20 2024-09-13T23:55:55.488 INFO:teuthology.orchestra.run.smithi173.stdout: debug osd = 20 2024-09-13T23:55:55.488 INFO:teuthology.orchestra.run.smithi173.stdout: debug rocksdb = 4/10 2024-09-13T23:55:55.488 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T23:55:55.488 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd full ratio = 0.9 2024-09-13T23:55:55.488 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd nearfull ratio = 0.8 2024-09-13T23:55:55.488 INFO:teuthology.orchestra.run.smithi173.stdout: osd failsafe full ratio = 0.95 2024-09-13T23:55:55.488 INFO:teuthology.orchestra.run.smithi173.stdout: osd objectstore = bluestore 2024-09-13T23:55:55.488 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.489 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr] 2024-09-13T23:55:55.489 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-09-13T23:55:55.489 INFO:teuthology.orchestra.run.smithi173.stdout: debug mgr = 20 2024-09-13T23:55:55.489 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2024-09-13T23:55:55.489 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2024-09-13T23:55:55.489 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2024-09-13T23:55:55.489 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2024-09-13T23:55:55.489 INFO:teuthology.orchestra.run.smithi173.stdout: mgr/telemetry/nag = false 2024-09-13T23:55:55.489 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.489 INFO:teuthology.orchestra.run.smithi173.stdout:[mon] 2024-09-13T23:55:55.489 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-09-13T23:55:55.489 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2024-09-13T23:55:55.489 INFO:teuthology.orchestra.run.smithi173.stdout: debug paxos = 20 2024-09-13T23:55:55.489 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2024-09-13T23:55:55.489 INFO:teuthology.orchestra.run.smithi173.stdout: mon data avail warn = 5 2024-09-13T23:55:55.490 INFO:teuthology.orchestra.run.smithi173.stdout: mon mgr mkfs grace = 240 2024-09-13T23:55:55.490 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2024-09-13T23:55:55.490 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd reporter subtree level = osd 2024-09-13T23:55:55.490 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd prime pg temp = true 2024-09-13T23:55:55.490 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2024-09-13T23:55:55.490 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.490 INFO:teuthology.orchestra.run.smithi173.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T23:55:55.490 INFO:teuthology.orchestra.run.smithi173.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T23:55:55.490 INFO:teuthology.orchestra.run.smithi173.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T23:55:55.490 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.490 INFO:teuthology.orchestra.run.smithi173.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T23:55:55.490 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T23:55:55.490 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T23:55:55.491 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.491 INFO:teuthology.orchestra.run.smithi173.stdout: # 1m isn't quite enough 2024-09-13T23:55:55.491 INFO:teuthology.orchestra.run.smithi173.stdout: mon_down_mkfs_grace = 2m 2024-09-13T23:55:55.491 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.491 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_filestore_osds = false 2024-09-13T23:55:55.491 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:55:55.491 INFO:teuthology.orchestra.run.smithi173.stdout:[client] 2024-09-13T23:55:55.491 INFO:teuthology.orchestra.run.smithi173.stdout: rgw cache enabled = true 2024-09-13T23:55:55.491 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable ops log = true 2024-09-13T23:55:55.491 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable usage log = true 2024-09-13T23:55:55.491 INFO:teuthology.orchestra.run.smithi173.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T23:55:55.491 INFO:teuthology.orchestra.run.smithi173.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T23:55:55.491 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-09-13T23:55:55.491 INFO:teuthology.orchestra.run.smithi173.stdout: rgw gc obj min wait = 15 2024-09-13T23:55:55.492 INFO:teuthology.orchestra.run.smithi173.stdout: debug rgw = 20 2024-09-13T23:55:55.492 INFO:teuthology.orchestra.run.smithi173.stdout: setgroup = ceph 2024-09-13T23:55:55.492 INFO:teuthology.orchestra.run.smithi173.stdout: setuser = ceph 2024-09-13T23:55:55.492 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.a] 2024-09-13T23:55:55.493 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T23:55:55.493 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T23:55:55.579 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T23:55:55.579 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T23:55:55.579 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T23:55:55.585 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T23:55:55.586 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T23:55:55.592 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T23:55:55.592 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T23:55:55.592 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T23:55:55.592 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T23:55:55.660 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T23:55:55.660 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:55:55.665 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi173.front.sepia.ceph.com 2024-09-13T23:55:55.665 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-13T23:55:55.665 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T23:55:55.665 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T23:55:55.693 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-13T23:55:55.693 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:55:55.743 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T23:55:55.743 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T23:55:55.743 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T23:55:55.793 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T23:55:55.811 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T23:55:55.811 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T23:55:55.812 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T23:55:55.852 INFO:teuthology.orchestra.run.smithi173.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T23:55:55.867 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T23:55:55.867 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi173.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-13T23:55:55.867 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T23:55:55.883 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-13T23:55:55.883 INFO:tasks.ceph:role: osd.0 2024-09-13T23:55:55.883 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T23:55:55.883 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T23:55:56.472 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T23:55:56.473 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T23:55:56.473 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T23:55:56.473 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 2024-09-13T23:55:56.473 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T23:55:56.473 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-09-13T23:55:56.473 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T23:55:56.473 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T23:55:56.473 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T23:55:56.473 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T23:55:56.475 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-09-13T23:55:56.475 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T23:55:56.562 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T23:55:56.573 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T23:55:56.573 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:55:56.574 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:55:56.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:55:56.697+0000 7f9a00fde880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T23:55:56.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:55:56.701+0000 7f9a00fde880 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T23:55:56.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:55:56.701+0000 7f9a00fde880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T23:55:56.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:55:56.701+0000 7f9a00fde880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T23:55:56.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:55:56.701+0000 7f9a00fde880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T23:55:56.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:55:56.705+0000 7f9a00fde880 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T23:55:59.734 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T23:55:59.750 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T23:55:59.766 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T23:55:59.767 INFO:tasks.ceph:role: osd.1 2024-09-13T23:55:59.767 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi173.front.sepia.ceph.com 2024-09-13T23:55:59.767 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T23:56:00.288 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T23:56:00.289 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T23:56:00.289 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T23:56:00.289 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 2024-09-13T23:56:00.289 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T23:56:00.289 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-09-13T23:56:00.289 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T23:56:00.289 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T23:56:00.289 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T23:56:00.289 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T23:56:00.291 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-09-13T23:56:00.291 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-13T23:56:00.379 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T23:56:00.391 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T23:56:00.392 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:56:00.392 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T23:56:00.447 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T23:56:00.447 INFO:tasks.ceph:role: osd.2 2024-09-13T23:56:00.447 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi173.front.sepia.ceph.com 2024-09-13T23:56:00.447 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T23:56:00.969 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T23:56:00.970 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T23:56:00.970 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T23:56:00.970 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 2024-09-13T23:56:00.970 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T23:56:00.970 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-09-13T23:56:00.970 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T23:56:00.970 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T23:56:00.970 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T23:56:00.970 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T23:56:00.971 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-09-13T23:56:00.971 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-13T23:56:01.005 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T23:56:01.014 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T23:56:01.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:56:01.015 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T23:56:01.026 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T23:56:01.026 INFO:tasks.ceph:role: osd.3 2024-09-13T23:56:01.026 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi173.front.sepia.ceph.com 2024-09-13T23:56:01.026 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T23:56:01.553 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T23:56:01.553 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T23:56:01.553 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T23:56:01.553 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 2024-09-13T23:56:01.553 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T23:56:01.553 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-09-13T23:56:01.553 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T23:56:01.553 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T23:56:01.553 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T23:56:01.554 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T23:56:01.555 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-09-13T23:56:01.555 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-13T23:56:01.606 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T23:56:01.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:56:01.616 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T23:56:01.617 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:56:01.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:01.695+0000 7f35c845b880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T23:56:01.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:01.695+0000 7f35c845b880 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T23:56:01.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:01.695+0000 7f35c845b880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T23:56:01.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:01.695+0000 7f35c845b880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T23:56:01.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:01.695+0000 7f35c845b880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T23:56:01.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:01.695+0000 7f35c845b880 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T23:56:04.709 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T23:56:04.726 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:56:04.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:04.815+0000 7fb5a3d2e880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T23:56:04.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:04.815+0000 7fb5a3d2e880 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T23:56:04.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:04.815+0000 7fb5a3d2e880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T23:56:04.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:04.815+0000 7fb5a3d2e880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T23:56:04.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:04.815+0000 7fb5a3d2e880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T23:56:04.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:04.815+0000 7fb5a3d2e880 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T23:56:07.812 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T23:56:07.827 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:56:07.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:07.863+0000 7f825862c880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T23:56:07.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:07.867+0000 7f825862c880 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T23:56:07.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:07.867+0000 7f825862c880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T23:56:07.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:07.867+0000 7f825862c880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T23:56:07.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:07.867+0000 7f825862c880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T23:56:07.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:07.867+0000 7f825862c880 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T23:56:10.883 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T23:56:10.898 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T23:56:10.898 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T23:56:10.898 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T23:56:10.915 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-13T23:56:10.915 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T23:56:10.930 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-13T23:56:10.930 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T23:56:10.988 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-13T23:56:10.988 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T23:56:10.998 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-13T23:56:10.998 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T23:56:11.012 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-13T23:56:11.012 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T23:56:11.018 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T23:56:11.019 DEBUG:teuthology.orchestra.run.smithi087:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T23:56:11.033 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.0] 2024-09-13T23:56:11.034 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQAM0eRmkCD2KRAAAAC+qDAqwFdzTe57ceH3Jw== 2024-09-13T23:56:11.034 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.x] 2024-09-13T23:56:11.034 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQAL0eRmgY5OLxAAPyjg1hVW1SjdEdgEpgDNPg== 2024-09-13T23:56:11.034 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.1] 2024-09-13T23:56:11.034 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQAR0eRmDWKcKRAAcS6/hZHcEXR0U5HOtq8EMQ== 2024-09-13T23:56:11.034 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.2] 2024-09-13T23:56:11.034 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQAU0eRmJErFMBAAMNLQh2vfnREYnivLHnSkLw== 2024-09-13T23:56:11.034 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.3] 2024-09-13T23:56:11.034 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQAX0eRmCXHSMxAA77bOtWIXrSvkK6B1wLe5Bw== 2024-09-13T23:56:11.034 INFO:teuthology.orchestra.run.smithi087.stdout:[client.0] 2024-09-13T23:56:11.035 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQAL0eRmo0bUMhAACd3n9U5XAtgFvX5LNeZvAg== 2024-09-13T23:56:11.035 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T23:56:11.080 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T23:56:11.126 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T23:56:11.170 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T23:56:11.263 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T23:56:11.310 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T23:56:11.359 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T23:56:11.360 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T23:56:11.369 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T23:56:11.453 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T23:56:11.468 DEBUG:teuthology.orchestra.run.smithi087:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:56:11.474 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T23:56:11.474 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T23:56:11.475 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T23:56:11.477 INFO:tasks.ceph.mon.a:Started 2024-09-13T23:56:11.477 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T23:56:11.477 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T23:56:11.477 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T23:56:11.479 INFO:tasks.ceph.mgr.x:Started 2024-09-13T23:56:11.479 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T23:56:11.479 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T23:56:11.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.585+0000 7f04e3d23700 1 Processor -- start 2024-09-13T23:56:11.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.585+0000 7f04e3d23700 1 -- start start 2024-09-13T23:56:11.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.585+0000 7f04e3d23700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f04dc124f80 0x7f04dc125360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:11.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.585+0000 7f04e3d23700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04dc071c90 con 0x7f04dc06f1a0 2024-09-13T23:56:11.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.585+0000 7f04e3d23700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04dc071a80 con 0x7f04dc124f80 2024-09-13T23:56:11.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.585+0000 7f04e1abf700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f04dc124f80 0x7f04dc125360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:11.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.585+0000 7f04e12be700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f04dc06f1a0 0x7f04dc06f5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54678/0 (socket says 172.21.15.87:54678) 2024-09-13T23:56:11.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.585+0000 7f04e12be700 1 -- 172.21.15.87:0/3359715061 learned_addr learned my addr 172.21.15.87:0/3359715061 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T23:56:11.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.585+0000 7f04e1abf700 1 -- 172.21.15.87:0/3359715061 >> v2:172.21.15.87:3300/0 conn(0x7f04dc124f80 msgr2=0x7f04dc125360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T23:56:11.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.585+0000 7f04e1abf700 1 -- 172.21.15.87:0/3359715061 >> v2:172.21.15.87:3300/0 conn(0x7f04dc124f80 msgr2=0x7f04dc125360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T23:56:11.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.585+0000 7f04e1abf700 1 --2- 172.21.15.87:0/3359715061 >> v2:172.21.15.87:3300/0 conn(0x7f04dc124f80 0x7f04dc125360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T23:56:11.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.585+0000 7f04e1abf700 1 --2- 172.21.15.87:0/3359715061 >> v2:172.21.15.87:3300/0 conn(0x7f04dc124f80 0x7f04dc125360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T23:56:11.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.625+0000 7f04e0abd700 1 -- 172.21.15.87:0/3359715061 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3961529790 0 0) 0x7f04dc071c90 con 0x7f04dc06f1a0 2024-09-13T23:56:11.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.625+0000 7f04e0abd700 1 -- 172.21.15.87:0/3359715061 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04c80035d0 con 0x7f04dc06f1a0 2024-09-13T23:56:11.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.625+0000 7f04e0abd700 1 -- 172.21.15.87:0/3359715061 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2032661249 0 0) 0x7f04c80035d0 con 0x7f04dc06f1a0 2024-09-13T23:56:11.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.625+0000 7f04e0abd700 1 -- 172.21.15.87:0/3359715061 >> v2:172.21.15.87:3300/0 conn(0x7f04dc124f80 msgr2=0x7f04dc125360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T23:56:11.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.625+0000 7f04e0abd700 1 --2- 172.21.15.87:0/3359715061 >> v2:172.21.15.87:3300/0 conn(0x7f04dc124f80 0x7f04dc125360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:11.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.625+0000 7f04e0abd700 1 -- 172.21.15.87:0/3359715061 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc098770 con 0x7f04dc06f1a0 2024-09-13T23:56:11.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.625+0000 7f04e0abd700 1 -- 172.21.15.87:0/3359715061 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 4092597791 0 0) 0x7f04d80015a0 con 0x7f04dc06f1a0 2024-09-13T23:56:11.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.625+0000 7f04e0abd700 1 -- 172.21.15.87:0/3359715061 >> v1:172.21.15.87:6789/0 conn(0x7f04dc06f1a0 legacy=0x7f04dc06f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:11.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.625+0000 7f04e0abd700 1 --2- 172.21.15.87:0/3359715061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04c8003a70 0x7f04c8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:11.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.625+0000 7f04e0abd700 1 -- 172.21.15.87:0/3359715061 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc071a80 con 0x7f04c8003a70 2024-09-13T23:56:11.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.629+0000 7f04e1abf700 1 --2- 172.21.15.87:0/3359715061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04c8003a70 0x7f04c8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:11.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.629+0000 7f04e1abf700 1 -- 172.21.15.87:0/3359715061 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c80035d0 con 0x7f04c8003a70 2024-09-13T23:56:11.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.629+0000 7f04e1abf700 1 --2- 172.21.15.87:0/3359715061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04c8003a70 0x7f04c8003e70 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0097f0 tx=0x7f04c80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654ffae3b682a06d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:11.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.629+0000 7f04e0abd700 1 -- 172.21.15.87:0/3359715061 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f04cc00c070 con 0x7f04c8003a70 2024-09-13T23:56:11.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.629+0000 7f04e0abd700 1 -- 172.21.15.87:0/3359715061 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04cc013560 con 0x7f04c8003a70 2024-09-13T23:56:11.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.629+0000 7f04e0abd700 1 -- 172.21.15.87:0/3359715061 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f04cc013840 con 0x7f04c8003a70 2024-09-13T23:56:11.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.629+0000 7f04e3d23700 1 -- 172.21.15.87:0/3359715061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04c8003a70 msgr2=0x7f04c8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:11.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.629+0000 7f04e3d23700 1 --2- 172.21.15.87:0/3359715061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04c8003a70 0x7f04c8003e70 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0097f0 tx=0x7f04c80058a0 comp rx=0 tx=0).stop 2024-09-13T23:56:11.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.629+0000 7f04e3d23700 1 -- 172.21.15.87:0/3359715061 shutdown_connections 2024-09-13T23:56:11.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.629+0000 7f04e3d23700 1 --2- 172.21.15.87:0/3359715061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04c8003a70 0x7f04c8003e70 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:11.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.629+0000 7f04e3d23700 1 --2- 172.21.15.87:0/3359715061 >> v2:172.21.15.87:3300/0 conn(0x7f04dc124f80 0x7f04dc125360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:11.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.629+0000 7f04e3d23700 1 -- 172.21.15.87:0/3359715061 >> 172.21.15.87:0/3359715061 conn(0x7f04dc097a10 msgr2=0x7f04dc097df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:11.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.629+0000 7f04e3d23700 1 -- 172.21.15.87:0/3359715061 shutdown_connections 2024-09-13T23:56:11.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.629+0000 7f04e3d23700 1 -- 172.21.15.87:0/3359715061 wait complete. 2024-09-13T23:56:11.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.633+0000 7f04e3d23700 1 Processor -- start 2024-09-13T23:56:11.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.633+0000 7f04e3d23700 1 -- start start 2024-09-13T23:56:11.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.633+0000 7f04e3d23700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04c8003a70 0x7f04dc122270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:11.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.633+0000 7f04e3d23700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc120ef0 con 0x7f04c8003a70 2024-09-13T23:56:11.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.633+0000 7f04e1abf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04c8003a70 0x7f04dc122270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:11.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.633+0000 7f04e1abf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04c8003a70 0x7f04dc122270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44348/0 (socket says 172.21.15.87:44348) 2024-09-13T23:56:11.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.633+0000 7f04e1abf700 1 -- 172.21.15.87:0/739645288 learned_addr learned my addr 172.21.15.87:0/739645288 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:11.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.633+0000 7f04e1abf700 1 -- 172.21.15.87:0/739645288 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc120790 con 0x7f04c8003a70 2024-09-13T23:56:11.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.637+0000 7f04e1abf700 1 --2- 172.21.15.87:0/739645288 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04c8003a70 0x7f04dc122270 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00a010 tx=0x7f04cc0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:11.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.637+0000 7f04d27fc700 1 -- 172.21.15.87:0/739645288 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f04cc027400 con 0x7f04c8003a70 2024-09-13T23:56:11.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.637+0000 7f04d27fc700 1 -- 172.21.15.87:0/739645288 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04cc027560 con 0x7f04c8003a70 2024-09-13T23:56:11.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.637+0000 7f04e3d23700 1 -- 172.21.15.87:0/739645288 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04dc122000 con 0x7f04c8003a70 2024-09-13T23:56:11.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.637+0000 7f04d27fc700 1 -- 172.21.15.87:0/739645288 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f04cc027820 con 0x7f04c8003a70 2024-09-13T23:56:11.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.637+0000 7f04e3d23700 1 -- 172.21.15.87:0/739645288 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04dc123d90 con 0x7f04c8003a70 2024-09-13T23:56:11.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.637+0000 7f04d27fc700 1 -- 172.21.15.87:0/739645288 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f04cc027c80 con 0x7f04c8003a70 2024-09-13T23:56:11.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.637+0000 7f04d27fc700 1 -- 172.21.15.87:0/739645288 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f04cc030cf0 con 0x7f04c8003a70 2024-09-13T23:56:11.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.637+0000 7f04e3d23700 1 -- 172.21.15.87:0/739645288 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04dc121e40 con 0x7f04c8003a70 2024-09-13T23:56:11.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.645+0000 7f04d27fc700 1 -- 172.21.15.87:0/739645288 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f04cc00f040 con 0x7f04c8003a70 2024-09-13T23:56:11.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.717+0000 7f04e3d23700 1 -- 172.21.15.87:0/739645288 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f04dc121e40 con 0x7f04c8003a70 2024-09-13T23:56:11.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.721+0000 7f04d27fc700 1 -- 172.21.15.87:0/739645288 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f04cc030440 con 0x7f04c8003a70 2024-09-13T23:56:11.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.725+0000 7f04e3d23700 1 -- 172.21.15.87:0/739645288 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04c8003a70 msgr2=0x7f04dc122270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:11.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.725+0000 7f04e3d23700 1 --2- 172.21.15.87:0/739645288 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04c8003a70 0x7f04dc122270 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00a010 tx=0x7f04cc0047e0 comp rx=0 tx=0).stop 2024-09-13T23:56:11.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.725+0000 7f04e3d23700 1 -- 172.21.15.87:0/739645288 shutdown_connections 2024-09-13T23:56:11.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.725+0000 7f04e3d23700 1 --2- 172.21.15.87:0/739645288 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04c8003a70 0x7f04dc122270 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:11.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.725+0000 7f04e3d23700 1 -- 172.21.15.87:0/739645288 >> 172.21.15.87:0/739645288 conn(0x7f04dc097a10 msgr2=0x7f04dc06e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:11.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.725+0000 7f04e3d23700 1 -- 172.21.15.87:0/739645288 shutdown_connections 2024-09-13T23:56:11.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:11.725+0000 7f04e3d23700 1 -- 172.21.15.87:0/739645288 wait complete. 2024-09-13T23:56:11.733 INFO:teuthology.orchestra.run.smithi087.stderr:adjusted tunables profile to default 2024-09-13T23:56:11.743 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T23:56:11.744 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T23:56:11.744 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T23:56:11.744 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T23:56:11.758 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-13T23:56:11.758 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T23:56:11.775 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-13T23:56:11.775 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T23:56:11.784 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-13T23:56:11.784 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T23:56:11.838 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 6ddf6b11-fbca-4310-8745-88ed2a341ca8 0 2024-09-13T23:56:11.843 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-13T23:56:11.839+0000 7f9d4956b2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T23:56:11.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.939+0000 7ff062093700 1 Processor -- start 2024-09-13T23:56:11.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.939+0000 7ff062093700 1 -- start start 2024-09-13T23:56:11.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.939+0000 7ff062093700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff05c119490 0x7ff05c11b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:11.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.939+0000 7ff062093700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05c11be50 con 0x7ff05c1109f0 2024-09-13T23:56:11.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.939+0000 7ff062093700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05c11d010 con 0x7ff05c119490 2024-09-13T23:56:11.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.939+0000 7ff05affd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff05c119490 0x7ff05c11b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:11.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.939+0000 7ff05affd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff05c119490 0x7ff05c11b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:56286/0 (socket says 172.21.15.173:56286) 2024-09-13T23:56:11.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.939+0000 7ff05affd700 1 -- 172.21.15.173:0/210969657 learned_addr learned my addr 172.21.15.173:0/210969657 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:11.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.939+0000 7ff05affd700 1 -- 172.21.15.173:0/210969657 >> v1:172.21.15.87:6789/0 conn(0x7ff05c1109f0 legacy=0x7ff05c110dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:11.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.939+0000 7ff05affd700 1 -- 172.21.15.173:0/210969657 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c11d180 con 0x7ff05c119490 2024-09-13T23:56:11.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.939+0000 7ff05affd700 1 --2- 172.21.15.173:0/210969657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff05c119490 0x7ff05c11b880 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff050009890 tx=0x7ff050009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4e5e8213074b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:11.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.943+0000 7ff05a7fc700 1 -- 172.21.15.173:0/210969657 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff050004160 con 0x7ff05c119490 2024-09-13T23:56:11.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.943+0000 7ff05a7fc700 1 -- 172.21.15.173:0/210969657 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0500042c0 con 0x7ff05c119490 2024-09-13T23:56:11.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.943+0000 7ff05a7fc700 1 -- 172.21.15.173:0/210969657 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff050004580 con 0x7ff05c119490 2024-09-13T23:56:11.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.943+0000 7ff062093700 1 -- 172.21.15.173:0/210969657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff05c119490 msgr2=0x7ff05c11b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:11.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.943+0000 7ff062093700 1 --2- 172.21.15.173:0/210969657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff05c119490 0x7ff05c11b880 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff050009890 tx=0x7ff050009ba0 comp rx=0 tx=0).stop 2024-09-13T23:56:11.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.943+0000 7ff062093700 1 -- 172.21.15.173:0/210969657 shutdown_connections 2024-09-13T23:56:11.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.943+0000 7ff062093700 1 --2- 172.21.15.173:0/210969657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff05c119490 0x7ff05c11b880 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:11.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.943+0000 7ff062093700 1 -- 172.21.15.173:0/210969657 >> 172.21.15.173:0/210969657 conn(0x7ff05c06d700 msgr2=0x7ff05c10ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:11.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.943+0000 7ff062093700 1 -- 172.21.15.173:0/210969657 shutdown_connections 2024-09-13T23:56:11.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.943+0000 7ff062093700 1 -- 172.21.15.173:0/210969657 wait complete. 2024-09-13T23:56:11.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.943+0000 7ff062093700 1 Processor -- start 2024-09-13T23:56:11.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.943+0000 7ff062093700 1 -- start start 2024-09-13T23:56:11.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.943+0000 7ff062093700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff05c1109f0 0x7ff05c1aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:11.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.943+0000 7ff062093700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c1ab2c0 con 0x7ff05c1109f0 2024-09-13T23:56:11.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.943+0000 7ff05b7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff05c1109f0 0x7ff05c1aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:11.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.943+0000 7ff05b7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff05c1109f0 0x7ff05c1aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:56298/0 (socket says 172.21.15.173:56298) 2024-09-13T23:56:11.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.943+0000 7ff05b7fe700 1 -- 172.21.15.173:0/203597405 learned_addr learned my addr 172.21.15.173:0/203597405 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:11.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.943+0000 7ff05b7fe700 1 -- 172.21.15.173:0/203597405 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff050009570 con 0x7ff05c1109f0 2024-09-13T23:56:11.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.943+0000 7ff05b7fe700 1 --2- 172.21.15.173:0/203597405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff05c1109f0 0x7ff05c1aacf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff04c00c480 tx=0x7ff04c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:11.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.943+0000 7ff043fff700 1 -- 172.21.15.173:0/203597405 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff04c005150 con 0x7ff05c1109f0 2024-09-13T23:56:11.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.943+0000 7ff043fff700 1 -- 172.21.15.173:0/203597405 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c0052b0 con 0x7ff05c1109f0 2024-09-13T23:56:11.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.943+0000 7ff062093700 1 -- 172.21.15.173:0/203597405 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05c1ab4c0 con 0x7ff05c1109f0 2024-09-13T23:56:11.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.947+0000 7ff043fff700 1 -- 172.21.15.173:0/203597405 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff04c005590 con 0x7ff05c1109f0 2024-09-13T23:56:11.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.947+0000 7ff062093700 1 -- 172.21.15.173:0/203597405 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05c1a4d90 con 0x7ff05c1109f0 2024-09-13T23:56:11.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.947+0000 7ff043fff700 1 -- 172.21.15.173:0/203597405 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7ff04c006b80 con 0x7ff05c1109f0 2024-09-13T23:56:11.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.947+0000 7ff043fff700 1 -- 172.21.15.173:0/203597405 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff04c0038d0 con 0x7ff05c1109f0 2024-09-13T23:56:11.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.951+0000 7ff062093700 1 -- 172.21.15.173:0/203597405 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff05c11cac0 con 0x7ff05c1109f0 2024-09-13T23:56:11.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:11.955+0000 7ff043fff700 1 -- 172.21.15.173:0/203597405 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7ff04c007080 con 0x7ff05c1109f0 2024-09-13T23:56:12.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.031+0000 7ff062093700 1 -- 172.21.15.173:0/203597405 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6ddf6b11-fbca-4310-8745-88ed2a341ca8", "id": 0} v 0) v1 -- 0x7ff05c119490 con 0x7ff05c1109f0 2024-09-13T23:56:12.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.035+0000 7ff043fff700 1 -- 172.21.15.173:0/203597405 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6ddf6b11-fbca-4310-8745-88ed2a341ca8", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff04c003ba0 con 0x7ff05c1109f0 2024-09-13T23:56:12.040 INFO:teuthology.orchestra.run.smithi173.stdout:0 2024-09-13T23:56:12.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.035+0000 7ff062093700 1 -- 172.21.15.173:0/203597405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff05c1109f0 msgr2=0x7ff05c1aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:12.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.035+0000 7ff062093700 1 --2- 172.21.15.173:0/203597405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff05c1109f0 0x7ff05c1aacf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff04c00c480 tx=0x7ff04c00c840 comp rx=0 tx=0).stop 2024-09-13T23:56:12.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.035+0000 7ff062093700 1 -- 172.21.15.173:0/203597405 shutdown_connections 2024-09-13T23:56:12.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.035+0000 7ff062093700 1 --2- 172.21.15.173:0/203597405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff05c1109f0 0x7ff05c1aacf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:12.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.035+0000 7ff062093700 1 -- 172.21.15.173:0/203597405 >> 172.21.15.173:0/203597405 conn(0x7ff05c06d700 msgr2=0x7ff05c119f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:12.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.035+0000 7ff062093700 1 -- 172.21.15.173:0/203597405 shutdown_connections 2024-09-13T23:56:12.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.035+0000 7ff062093700 1 -- 172.21.15.173:0/203597405 wait complete. 2024-09-13T23:56:12.053 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 2a5386ff-fe63-40b4-8671-bc161b4d65fa 1 2024-09-13T23:56:12.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.151+0000 7f32a0a9c700 1 Processor -- start 2024-09-13T23:56:12.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.151+0000 7f32a0a9c700 1 -- start start 2024-09-13T23:56:12.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.151+0000 7f32a0a9c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f329c10f3c0 0x7f329c10f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:12.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.155+0000 7f32a0a9c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329c114a50 con 0x7f329c10fd40 2024-09-13T23:56:12.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.155+0000 7f32a0a9c700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329c114c00 con 0x7f329c10f3c0 2024-09-13T23:56:12.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.155+0000 7f329b7fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f329c10f3c0 0x7f329c10f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:12.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.155+0000 7f329affd700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f329c10fd40 0x7f329c114200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:48758/0 (socket says 172.21.15.173:48758) 2024-09-13T23:56:12.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.155+0000 7f329affd700 1 -- 172.21.15.173:0/2593006226 learned_addr learned my addr 172.21.15.173:0/2593006226 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:56:12.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.155+0000 7f329b7fe700 1 -- 172.21.15.173:0/2593006226 >> v1:172.21.15.87:6789/0 conn(0x7f329c10fd40 legacy=0x7f329c114200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:12.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.155+0000 7f329b7fe700 1 -- 172.21.15.173:0/2593006226 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329c114d70 con 0x7f329c10f3c0 2024-09-13T23:56:12.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.155+0000 7f329b7fe700 1 --2- 172.21.15.173:0/2593006226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f329c10f3c0 0x7f329c10f7a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3294009d90 tx=0x7f329400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a036bcd552764619 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:12.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.155+0000 7f329a7fc700 1 -- 172.21.15.173:0/2593006226 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f329400e070 con 0x7f329c10f3c0 2024-09-13T23:56:12.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.155+0000 7f329a7fc700 1 -- 172.21.15.173:0/2593006226 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329400bc80 con 0x7f329c10f3c0 2024-09-13T23:56:12.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.155+0000 7f329a7fc700 1 -- 172.21.15.173:0/2593006226 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3294003a40 con 0x7f329c10f3c0 2024-09-13T23:56:12.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.155+0000 7f32a0a9c700 1 -- 172.21.15.173:0/2593006226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f329c10f3c0 msgr2=0x7f329c10f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:12.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.155+0000 7f32a0a9c700 1 --2- 172.21.15.173:0/2593006226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f329c10f3c0 0x7f329c10f7a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3294009d90 tx=0x7f329400b330 comp rx=0 tx=0).stop 2024-09-13T23:56:12.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.155+0000 7f32a0a9c700 1 -- 172.21.15.173:0/2593006226 shutdown_connections 2024-09-13T23:56:12.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.155+0000 7f32a0a9c700 1 --2- 172.21.15.173:0/2593006226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f329c10f3c0 0x7f329c10f7a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:12.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.155+0000 7f32a0a9c700 1 -- 172.21.15.173:0/2593006226 >> 172.21.15.173:0/2593006226 conn(0x7f329c06ee30 msgr2=0x7f329c071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:12.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.155+0000 7f32a0a9c700 1 -- 172.21.15.173:0/2593006226 shutdown_connections 2024-09-13T23:56:12.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.155+0000 7f32a0a9c700 1 -- 172.21.15.173:0/2593006226 wait complete. 2024-09-13T23:56:12.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.155+0000 7f32a0a9c700 1 Processor -- start 2024-09-13T23:56:12.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.155+0000 7f32a0a9c700 1 -- start start 2024-09-13T23:56:12.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.159+0000 7f32a0a9c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f329c10f3c0 0x7f329c1a2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:12.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.159+0000 7f32a0a9c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c1a3380 con 0x7f329c10f3c0 2024-09-13T23:56:12.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.159+0000 7f329b7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f329c10f3c0 0x7f329c1a2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:12.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.159+0000 7f329b7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f329c10f3c0 0x7f329c1a2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:56318/0 (socket says 172.21.15.173:56318) 2024-09-13T23:56:12.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.159+0000 7f329b7fe700 1 -- 172.21.15.173:0/728526325 learned_addr learned my addr 172.21.15.173:0/728526325 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:12.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.159+0000 7f329b7fe700 1 -- 172.21.15.173:0/728526325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3294009a70 con 0x7f329c10f3c0 2024-09-13T23:56:12.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.159+0000 7f329b7fe700 1 --2- 172.21.15.173:0/728526325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f329c10f3c0 0x7f329c1a2e40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3294000f80 tx=0x7f3294004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:12.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.159+0000 7f3283fff700 1 -- 172.21.15.173:0/728526325 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3294004710 con 0x7f329c10f3c0 2024-09-13T23:56:12.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.159+0000 7f3283fff700 1 -- 172.21.15.173:0/728526325 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3294004870 con 0x7f329c10f3c0 2024-09-13T23:56:12.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.159+0000 7f32a0a9c700 1 -- 172.21.15.173:0/728526325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f329c1a3580 con 0x7f329c10f3c0 2024-09-13T23:56:12.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.159+0000 7f3283fff700 1 -- 172.21.15.173:0/728526325 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3294012580 con 0x7f329c10f3c0 2024-09-13T23:56:12.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.159+0000 7f32a0a9c700 1 -- 172.21.15.173:0/728526325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329c1a75b0 con 0x7f329c10f3c0 2024-09-13T23:56:12.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.159+0000 7f3283fff700 1 -- 172.21.15.173:0/728526325 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f32940129e0 con 0x7f329c10f3c0 2024-09-13T23:56:12.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.159+0000 7f3283fff700 1 -- 172.21.15.173:0/728526325 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f3294025400 con 0x7f329c10f3c0 2024-09-13T23:56:12.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.159+0000 7f32a0a9c700 1 -- 172.21.15.173:0/728526325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f329c1a39b0 con 0x7f329c10f3c0 2024-09-13T23:56:12.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.167+0000 7f3283fff700 1 -- 172.21.15.173:0/728526325 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f329401d420 con 0x7f329c10f3c0 2024-09-13T23:56:12.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.243+0000 7f32a0a9c700 1 -- 172.21.15.173:0/728526325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2a5386ff-fe63-40b4-8671-bc161b4d65fa", "id": 1} v 0) v1 -- 0x7f329c10f820 con 0x7f329c10f3c0 2024-09-13T23:56:12.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.255+0000 7f3283fff700 1 -- 172.21.15.173:0/728526325 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2a5386ff-fe63-40b4-8671-bc161b4d65fa", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f329401d690 con 0x7f329c10f3c0 2024-09-13T23:56:12.258 INFO:teuthology.orchestra.run.smithi173.stdout:1 2024-09-13T23:56:12.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.255+0000 7f32a0a9c700 1 -- 172.21.15.173:0/728526325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f329c10f3c0 msgr2=0x7f329c1a2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:12.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.255+0000 7f32a0a9c700 1 --2- 172.21.15.173:0/728526325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f329c10f3c0 0x7f329c1a2e40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3294000f80 tx=0x7f3294004af0 comp rx=0 tx=0).stop 2024-09-13T23:56:12.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.255+0000 7f32a0a9c700 1 -- 172.21.15.173:0/728526325 shutdown_connections 2024-09-13T23:56:12.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.255+0000 7f32a0a9c700 1 --2- 172.21.15.173:0/728526325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f329c10f3c0 0x7f329c1a2e40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:12.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.255+0000 7f32a0a9c700 1 -- 172.21.15.173:0/728526325 >> 172.21.15.173:0/728526325 conn(0x7f329c06ee30 msgr2=0x7f329c112230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:12.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.255+0000 7f32a0a9c700 1 -- 172.21.15.173:0/728526325 shutdown_connections 2024-09-13T23:56:12.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.255+0000 7f32a0a9c700 1 -- 172.21.15.173:0/728526325 wait complete. 2024-09-13T23:56:12.272 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new dceb34f9-5dfa-4065-8842-aee85a133580 2 2024-09-13T23:56:12.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.379+0000 7fd31759e700 1 Processor -- start 2024-09-13T23:56:12.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.379+0000 7fd31759e700 1 -- start start 2024-09-13T23:56:12.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.379+0000 7fd31759e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd31806c0d0 0x7fd31806c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:12.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.379+0000 7fd31759e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd31811bca0 con 0x7fd31806c9f0 2024-09-13T23:56:12.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.379+0000 7fd31759e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd31811ce60 con 0x7fd31806c0d0 2024-09-13T23:56:12.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.383+0000 7fd31659c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd31806c0d0 0x7fd31806c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:12.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.383+0000 7fd315d9b700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd31806c9f0 0x7fd31811a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:48760/0 (socket says 172.21.15.173:48760) 2024-09-13T23:56:12.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.383+0000 7fd31659c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd31806c0d0 0x7fd31806c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:56320/0 (socket says 172.21.15.173:56320) 2024-09-13T23:56:12.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.383+0000 7fd315d9b700 1 -- 172.21.15.173:0/3897591083 learned_addr learned my addr 172.21.15.173:0/3897591083 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:56:12.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.383+0000 7fd31659c700 1 -- 172.21.15.173:0/3897591083 >> v1:172.21.15.87:6789/0 conn(0x7fd31806c9f0 legacy=0x7fd31811a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:12.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.383+0000 7fd31659c700 1 -- 172.21.15.173:0/3897591083 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31811cfd0 con 0x7fd31806c0d0 2024-09-13T23:56:12.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.383+0000 7fd31659c700 1 --2- 172.21.15.173:0/3897591083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd31806c0d0 0x7fd31806c4b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd3080097d0 tx=0x7fd308009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd40f2e6f11641af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:12.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.383+0000 7fd31559a700 1 -- 172.21.15.173:0/3897591083 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3080041c0 con 0x7fd31806c0d0 2024-09-13T23:56:12.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.383+0000 7fd31559a700 1 -- 172.21.15.173:0/3897591083 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd308004320 con 0x7fd31806c0d0 2024-09-13T23:56:12.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.383+0000 7fd31559a700 1 -- 172.21.15.173:0/3897591083 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3080036c0 con 0x7fd31806c0d0 2024-09-13T23:56:12.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.383+0000 7fd31759e700 1 -- 172.21.15.173:0/3897591083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd31806c0d0 msgr2=0x7fd31806c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:12.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.383+0000 7fd31759e700 1 --2- 172.21.15.173:0/3897591083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd31806c0d0 0x7fd31806c4b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd3080097d0 tx=0x7fd308009ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:12.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.383+0000 7fd31759e700 1 -- 172.21.15.173:0/3897591083 shutdown_connections 2024-09-13T23:56:12.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.383+0000 7fd31759e700 1 --2- 172.21.15.173:0/3897591083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd31806c0d0 0x7fd31806c4b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:12.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.383+0000 7fd31759e700 1 -- 172.21.15.173:0/3897591083 >> 172.21.15.173:0/3897591083 conn(0x7fd31806fbc0 msgr2=0x7fd318071fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:12.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.383+0000 7fd31759e700 1 -- 172.21.15.173:0/3897591083 shutdown_connections 2024-09-13T23:56:12.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.383+0000 7fd31759e700 1 -- 172.21.15.173:0/3897591083 wait complete. 2024-09-13T23:56:12.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.383+0000 7fd31759e700 1 Processor -- start 2024-09-13T23:56:12.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.383+0000 7fd31759e700 1 -- start start 2024-09-13T23:56:12.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.383+0000 7fd31759e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd31806c0d0 0x7fd3181aac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:12.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.383+0000 7fd31759e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3181ab230 con 0x7fd31806c0d0 2024-09-13T23:56:12.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.387+0000 7fd31659c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd31806c0d0 0x7fd3181aac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:12.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.387+0000 7fd31659c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd31806c0d0 0x7fd3181aac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:56324/0 (socket says 172.21.15.173:56324) 2024-09-13T23:56:12.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.387+0000 7fd31659c700 1 -- 172.21.15.173:0/2072361107 learned_addr learned my addr 172.21.15.173:0/2072361107 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:12.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.387+0000 7fd31659c700 1 -- 172.21.15.173:0/2072361107 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3080094b0 con 0x7fd31806c0d0 2024-09-13T23:56:12.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.387+0000 7fd31659c700 1 --2- 172.21.15.173:0/2072361107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd31806c0d0 0x7fd3181aac60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd308014040 tx=0x7fd308004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:12.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.387+0000 7fd306ffd700 1 -- 172.21.15.173:0/2072361107 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd308011630 con 0x7fd31806c0d0 2024-09-13T23:56:12.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.387+0000 7fd31759e700 1 -- 172.21.15.173:0/2072361107 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3181ab3d0 con 0x7fd31806c0d0 2024-09-13T23:56:12.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.387+0000 7fd306ffd700 1 -- 172.21.15.173:0/2072361107 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd308011790 con 0x7fd31806c0d0 2024-09-13T23:56:12.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.387+0000 7fd306ffd700 1 -- 172.21.15.173:0/2072361107 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd308011a30 con 0x7fd31806c0d0 2024-09-13T23:56:12.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.387+0000 7fd31759e700 1 -- 172.21.15.173:0/2072361107 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3181a4c80 con 0x7fd31806c0d0 2024-09-13T23:56:12.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.387+0000 7fd306ffd700 1 -- 172.21.15.173:0/2072361107 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fd308018050 con 0x7fd31806c0d0 2024-09-13T23:56:12.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.387+0000 7fd306ffd700 1 -- 172.21.15.173:0/2072361107 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fd30801b830 con 0x7fd31806c0d0 2024-09-13T23:56:12.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.387+0000 7fd31759e700 1 -- 172.21.15.173:0/2072361107 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31806c530 con 0x7fd31806c0d0 2024-09-13T23:56:12.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.395+0000 7fd306ffd700 1 -- 172.21.15.173:0/2072361107 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fd308045e30 con 0x7fd31806c0d0 2024-09-13T23:56:12.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.471+0000 7fd31759e700 1 -- 172.21.15.173:0/2072361107 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dceb34f9-5dfa-4065-8842-aee85a133580", "id": 2} v 0) v1 -- 0x7fd31806c9f0 con 0x7fd31806c0d0 2024-09-13T23:56:12.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.479+0000 7fd306ffd700 1 -- 172.21.15.173:0/2072361107 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dceb34f9-5dfa-4065-8842-aee85a133580", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd308034030 con 0x7fd31806c0d0 2024-09-13T23:56:12.484 INFO:teuthology.orchestra.run.smithi173.stdout:2 2024-09-13T23:56:12.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.483+0000 7fd31759e700 1 -- 172.21.15.173:0/2072361107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd31806c0d0 msgr2=0x7fd3181aac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:12.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.483+0000 7fd31759e700 1 --2- 172.21.15.173:0/2072361107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd31806c0d0 0x7fd3181aac60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd308014040 tx=0x7fd308004770 comp rx=0 tx=0).stop 2024-09-13T23:56:12.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.483+0000 7fd31759e700 1 -- 172.21.15.173:0/2072361107 shutdown_connections 2024-09-13T23:56:12.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.483+0000 7fd31759e700 1 --2- 172.21.15.173:0/2072361107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd31806c0d0 0x7fd3181aac60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:12.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.483+0000 7fd31759e700 1 -- 172.21.15.173:0/2072361107 >> 172.21.15.173:0/2072361107 conn(0x7fd31806fbc0 msgr2=0x7fd318116520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:12.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.483+0000 7fd31759e700 1 -- 172.21.15.173:0/2072361107 shutdown_connections 2024-09-13T23:56:12.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.483+0000 7fd31759e700 1 -- 172.21.15.173:0/2072361107 wait complete. 2024-09-13T23:56:12.503 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 1b757f70-683f-43a8-863d-5bcb9a416247 3 2024-09-13T23:56:12.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.607+0000 7f8e428a2700 1 Processor -- start 2024-09-13T23:56:12.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.607+0000 7f8e428a2700 1 -- start start 2024-09-13T23:56:12.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.607+0000 7f8e428a2700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8e3c06c990 0x7f8e3c11fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:12.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.607+0000 7f8e428a2700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e3c120140 con 0x7f8e3c06bea0 2024-09-13T23:56:12.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.607+0000 7f8e428a2700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3c1212e0 con 0x7f8e3c06c990 2024-09-13T23:56:12.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.607+0000 7f8e4109f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8e3c06c990 0x7f8e3c11fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:12.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.607+0000 7f8e418a0700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8e3c06bea0 0x7f8e3c06c280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:48768/0 (socket says 172.21.15.173:48768) 2024-09-13T23:56:12.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.607+0000 7f8e418a0700 1 -- 172.21.15.173:0/3130872008 learned_addr learned my addr 172.21.15.173:0/3130872008 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:56:12.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.607+0000 7f8e4109f700 1 -- 172.21.15.173:0/3130872008 >> v1:172.21.15.87:6789/0 conn(0x7f8e3c06bea0 legacy=0x7f8e3c06c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:12.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.607+0000 7f8e4109f700 1 -- 172.21.15.173:0/3130872008 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c121420 con 0x7f8e3c06c990 2024-09-13T23:56:12.613 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-13T23:56:12.607+0000 7f9d4956b2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T23:56:12.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.607+0000 7f8e4109f700 1 --2- 172.21.15.173:0/3130872008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e3c06c990 0x7f8e3c11fc00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0097d0 tx=0x7f8e2c009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54fa55c62a427aff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:12.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.607+0000 7f8e4089e700 1 -- 172.21.15.173:0/3130872008 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e2c0041c0 con 0x7f8e3c06c990 2024-09-13T23:56:12.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.607+0000 7f8e4089e700 1 -- 172.21.15.173:0/3130872008 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c004320 con 0x7f8e3c06c990 2024-09-13T23:56:12.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.607+0000 7f8e4089e700 1 -- 172.21.15.173:0/3130872008 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e2c0036c0 con 0x7f8e3c06c990 2024-09-13T23:56:12.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.611+0000 7f8e428a2700 1 -- 172.21.15.173:0/3130872008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e3c06c990 msgr2=0x7f8e3c11fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:12.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.611+0000 7f8e428a2700 1 --2- 172.21.15.173:0/3130872008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e3c06c990 0x7f8e3c11fc00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0097d0 tx=0x7f8e2c009ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:12.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.611+0000 7f8e428a2700 1 -- 172.21.15.173:0/3130872008 shutdown_connections 2024-09-13T23:56:12.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.611+0000 7f8e428a2700 1 --2- 172.21.15.173:0/3130872008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e3c06c990 0x7f8e3c11fc00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:12.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.611+0000 7f8e428a2700 1 -- 172.21.15.173:0/3130872008 >> 172.21.15.173:0/3130872008 conn(0x7f8e3c06fbc0 msgr2=0x7f8e3c071fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:12.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.611+0000 7f8e428a2700 1 -- 172.21.15.173:0/3130872008 shutdown_connections 2024-09-13T23:56:12.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.611+0000 7f8e428a2700 1 -- 172.21.15.173:0/3130872008 wait complete. 2024-09-13T23:56:12.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.611+0000 7f8e428a2700 1 Processor -- start 2024-09-13T23:56:12.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.611+0000 7f8e428a2700 1 -- start start 2024-09-13T23:56:12.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.611+0000 7f8e428a2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e3c06bea0 0x7f8e3c1af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:12.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.611+0000 7f8e428a2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c1af660 con 0x7f8e3c06bea0 2024-09-13T23:56:12.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.611+0000 7f8e418a0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e3c06bea0 0x7f8e3c1af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:12.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.611+0000 7f8e418a0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e3c06bea0 0x7f8e3c1af090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:56342/0 (socket says 172.21.15.173:56342) 2024-09-13T23:56:12.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.611+0000 7f8e418a0700 1 -- 172.21.15.173:0/2429046831 learned_addr learned my addr 172.21.15.173:0/2429046831 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:12.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.611+0000 7f8e418a0700 1 -- 172.21.15.173:0/2429046831 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c0094b0 con 0x7f8e3c06bea0 2024-09-13T23:56:12.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.611+0000 7f8e418a0700 1 --2- 172.21.15.173:0/2429046831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e3c06bea0 0x7f8e3c1af090 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8e3800c680 tx=0x7f8e3800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:12.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.611+0000 7f8e327fc700 1 -- 172.21.15.173:0/2429046831 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e38005cc0 con 0x7f8e3c06bea0 2024-09-13T23:56:12.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.611+0000 7f8e327fc700 1 -- 172.21.15.173:0/2429046831 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e38005e20 con 0x7f8e3c06bea0 2024-09-13T23:56:12.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.611+0000 7f8e428a2700 1 -- 172.21.15.173:0/2429046831 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3c1af860 con 0x7f8e3c06bea0 2024-09-13T23:56:12.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.611+0000 7f8e327fc700 1 -- 172.21.15.173:0/2429046831 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e38007200 con 0x7f8e3c06bea0 2024-09-13T23:56:12.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.611+0000 7f8e428a2700 1 -- 172.21.15.173:0/2429046831 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3c1a90b0 con 0x7f8e3c06bea0 2024-09-13T23:56:12.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.611+0000 7f8e327fc700 1 -- 172.21.15.173:0/2429046831 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f8e38007660 con 0x7f8e3c06bea0 2024-09-13T23:56:12.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.611+0000 7f8e327fc700 1 -- 172.21.15.173:0/2429046831 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f8e3801c8d0 con 0x7f8e3c06bea0 2024-09-13T23:56:12.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.615+0000 7f8e428a2700 1 -- 172.21.15.173:0/2429046831 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e3c120db0 con 0x7f8e3c06bea0 2024-09-13T23:56:12.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.619+0000 7f8e327fc700 1 -- 172.21.15.173:0/2429046831 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f8e38021060 con 0x7f8e3c06bea0 2024-09-13T23:56:12.672 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-13T23:56:12.667+0000 7f9d4956b2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T23:56:12.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.695+0000 7f8e428a2700 1 -- 172.21.15.173:0/2429046831 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1b757f70-683f-43a8-863d-5bcb9a416247", "id": 3} v 0) v1 -- 0x7f8e3c06c990 con 0x7f8e3c06bea0 2024-09-13T23:56:12.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.703+0000 7f8e327fc700 1 -- 172.21.15.173:0/2429046831 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1b757f70-683f-43a8-863d-5bcb9a416247", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8e3c06c990 con 0x7f8e3c06bea0 2024-09-13T23:56:12.707 INFO:teuthology.orchestra.run.smithi173.stdout:3 2024-09-13T23:56:12.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.703+0000 7f8e428a2700 1 -- 172.21.15.173:0/2429046831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e3c06bea0 msgr2=0x7f8e3c1af090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:12.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.703+0000 7f8e428a2700 1 --2- 172.21.15.173:0/2429046831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e3c06bea0 0x7f8e3c1af090 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8e3800c680 tx=0x7f8e3800ca40 comp rx=0 tx=0).stop 2024-09-13T23:56:12.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.703+0000 7f8e428a2700 1 -- 172.21.15.173:0/2429046831 shutdown_connections 2024-09-13T23:56:12.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.703+0000 7f8e428a2700 1 --2- 172.21.15.173:0/2429046831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e3c06bea0 0x7f8e3c1af090 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:12.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.703+0000 7f8e428a2700 1 -- 172.21.15.173:0/2429046831 >> 172.21.15.173:0/2429046831 conn(0x7f8e3c06fbc0 msgr2=0x7f8e3c11af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:12.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.703+0000 7f8e428a2700 1 -- 172.21.15.173:0/2429046831 shutdown_connections 2024-09-13T23:56:12.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:12.703+0000 7f8e428a2700 1 -- 172.21.15.173:0/2429046831 wait complete. 2024-09-13T23:56:12.720 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T23:56:12.720 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T23:56:12.723 INFO:tasks.ceph.osd.0:Started 2024-09-13T23:56:12.723 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T23:56:12.723 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T23:56:12.725 INFO:tasks.ceph.osd.1:Started 2024-09-13T23:56:12.725 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T23:56:12.725 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T23:56:12.726 INFO:tasks.ceph.osd.2:Started 2024-09-13T23:56:12.727 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T23:56:12.727 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T23:56:12.728 INFO:tasks.ceph.osd.3:Started 2024-09-13T23:56:12.729 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T23:56:12.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.837+0000 7fd5cf59e700 1 Processor -- start 2024-09-13T23:56:12.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.837+0000 7fd5cf59e700 1 -- start start 2024-09-13T23:56:12.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.837+0000 7fd5cf59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd5d012d880 0x7fd5d006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:12.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.837+0000 7fd5cf59e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d012dcd0 con 0x7fd5d012d4a0 2024-09-13T23:56:12.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.837+0000 7fd5cf59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d0071270 con 0x7fd5d012d880 2024-09-13T23:56:12.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.837+0000 7fd5ce59c700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd5d012d4a0 0x7fd5d006dae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54698/0 (socket says 172.21.15.87:54698) 2024-09-13T23:56:12.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.837+0000 7fd5ce59c700 1 -- 172.21.15.87:0/2196386949 learned_addr learned my addr 172.21.15.87:0/2196386949 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T23:56:12.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.837+0000 7fd5cdd9b700 1 --2- 172.21.15.87:0/2196386949 >> v2:172.21.15.87:3300/0 conn(0x7fd5d012d880 0x7fd5d006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:12.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.837+0000 7fd5cd59a700 1 -- 172.21.15.87:0/2196386949 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3514669279 0 0) 0x7fd5d012dcd0 con 0x7fd5d012d4a0 2024-09-13T23:56:12.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.837+0000 7fd5cd59a700 1 -- 172.21.15.87:0/2196386949 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5b80035d0 con 0x7fd5d012d4a0 2024-09-13T23:56:12.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.837+0000 7fd5cd59a700 1 -- 172.21.15.87:0/2196386949 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2048478344 0 0) 0x7fd5b80035d0 con 0x7fd5d012d4a0 2024-09-13T23:56:12.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.837+0000 7fd5cd59a700 1 -- 172.21.15.87:0/2196386949 >> v2:172.21.15.87:3300/0 conn(0x7fd5d012d880 msgr2=0x7fd5d006e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T23:56:12.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.837+0000 7fd5cd59a700 1 --2- 172.21.15.87:0/2196386949 >> v2:172.21.15.87:3300/0 conn(0x7fd5d012d880 0x7fd5d006e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:12.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.837+0000 7fd5cd59a700 1 -- 172.21.15.87:0/2196386949 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d0070f60 con 0x7fd5d012d4a0 2024-09-13T23:56:12.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.837+0000 7fd5cd59a700 1 -- 172.21.15.87:0/2196386949 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 4092597791 0 0) 0x7fd5c8001920 con 0x7fd5d012d4a0 2024-09-13T23:56:12.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.837+0000 7fd5cd59a700 1 -- 172.21.15.87:0/2196386949 >> v1:172.21.15.87:6789/0 conn(0x7fd5d012d4a0 legacy=0x7fd5d006dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:12.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.837+0000 7fd5cd59a700 1 --2- 172.21.15.87:0/2196386949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5b8003a20 0x7fd5b8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:12.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.837+0000 7fd5cd59a700 1 -- 172.21.15.87:0/2196386949 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d0071270 con 0x7fd5b8003a20 2024-09-13T23:56:12.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.841+0000 7fd5cdd9b700 1 --2- 172.21.15.87:0/2196386949 >> v2:172.21.15.87:3300/0 conn(0x7fd5d012d880 0x7fd5d006e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T23:56:12.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.841+0000 7fd5ce59c700 1 --2- 172.21.15.87:0/2196386949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5b8003a20 0x7fd5b8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:12.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.841+0000 7fd5ce59c700 1 -- 172.21.15.87:0/2196386949 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b80035d0 con 0x7fd5b8003a20 2024-09-13T23:56:12.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.841+0000 7fd5ce59c700 1 --2- 172.21.15.87:0/2196386949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5b8003a20 0x7fd5b8003e20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800a730 tx=0x7fd5b80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76794c2851457a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:12.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.841+0000 7fd5cd59a700 1 -- 172.21.15.87:0/2196386949 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd5c800ad70 con 0x7fd5b8003a20 2024-09-13T23:56:12.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.841+0000 7fd5cd59a700 1 -- 172.21.15.87:0/2196386949 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c80070d0 con 0x7fd5b8003a20 2024-09-13T23:56:12.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.841+0000 7fd5cd59a700 1 -- 172.21.15.87:0/2196386949 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd5c8007280 con 0x7fd5b8003a20 2024-09-13T23:56:12.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.841+0000 7fd5cf59e700 1 -- 172.21.15.87:0/2196386949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5b8003a20 msgr2=0x7fd5b8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:12.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.841+0000 7fd5cf59e700 1 --2- 172.21.15.87:0/2196386949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5b8003a20 0x7fd5b8003e20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800a730 tx=0x7fd5b80058a0 comp rx=0 tx=0).stop 2024-09-13T23:56:12.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.841+0000 7fd5cf59e700 1 -- 172.21.15.87:0/2196386949 shutdown_connections 2024-09-13T23:56:12.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.841+0000 7fd5cf59e700 1 --2- 172.21.15.87:0/2196386949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5b8003a20 0x7fd5b8003e20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:12.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.841+0000 7fd5cf59e700 1 --2- 172.21.15.87:0/2196386949 >> v2:172.21.15.87:3300/0 conn(0x7fd5d012d880 0x7fd5d006e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:12.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.841+0000 7fd5cf59e700 1 -- 172.21.15.87:0/2196386949 >> 172.21.15.87:0/2196386949 conn(0x7fd5d009cd10 msgr2=0x7fd5d006c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:12.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.841+0000 7fd5cf59e700 1 -- 172.21.15.87:0/2196386949 shutdown_connections 2024-09-13T23:56:12.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.841+0000 7fd5cf59e700 1 -- 172.21.15.87:0/2196386949 wait complete. 2024-09-13T23:56:12.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.841+0000 7fd5cf59e700 1 Processor -- start 2024-09-13T23:56:12.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.841+0000 7fd5cf59e700 1 -- start start 2024-09-13T23:56:12.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.841+0000 7fd5cf59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5b8003a20 0x7fd5d011bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:12.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.841+0000 7fd5cf59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d011d150 con 0x7fd5b8003a20 2024-09-13T23:56:12.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.841+0000 7fd5ce59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5b8003a20 0x7fd5d011bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:12.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.841+0000 7fd5ce59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5b8003a20 0x7fd5d011bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44380/0 (socket says 172.21.15.87:44380) 2024-09-13T23:56:12.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.841+0000 7fd5ce59c700 1 -- 172.21.15.87:0/4241009110 learned_addr learned my addr 172.21.15.87:0/4241009110 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:12.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.845+0000 7fd5ce59c700 1 -- 172.21.15.87:0/4241009110 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c40094b0 con 0x7fd5b8003a20 2024-09-13T23:56:12.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.845+0000 7fd5ce59c700 1 --2- 172.21.15.87:0/4241009110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5b8003a20 0x7fd5d011bff0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80070a0 tx=0x7fd5c8001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:12.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.845+0000 7fd5beffd700 1 -- 172.21.15.87:0/4241009110 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd5c80018e0 con 0x7fd5b8003a20 2024-09-13T23:56:12.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.845+0000 7fd5beffd700 1 -- 172.21.15.87:0/4241009110 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c801f430 con 0x7fd5b8003a20 2024-09-13T23:56:12.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.845+0000 7fd5beffd700 1 -- 172.21.15.87:0/4241009110 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd5c801f710 con 0x7fd5b8003a20 2024-09-13T23:56:12.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.845+0000 7fd5cf59e700 1 -- 172.21.15.87:0/4241009110 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d00717e0 con 0x7fd5b8003a20 2024-09-13T23:56:12.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.845+0000 7fd5cf59e700 1 -- 172.21.15.87:0/4241009110 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d011d870 con 0x7fd5b8003a20 2024-09-13T23:56:12.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.845+0000 7fd5beffd700 1 -- 172.21.15.87:0/4241009110 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fd5c801f910 con 0x7fd5b8003a20 2024-09-13T23:56:12.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.845+0000 7fd5beffd700 1 -- 172.21.15.87:0/4241009110 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fd5c8029e20 con 0x7fd5b8003a20 2024-09-13T23:56:12.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.845+0000 7fd5cf59e700 1 -- 172.21.15.87:0/4241009110 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d006b550 con 0x7fd5b8003a20 2024-09-13T23:56:12.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.849+0000 7fd5beffd700 1 -- 172.21.15.87:0/4241009110 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fd5c8018070 con 0x7fd5b8003a20 2024-09-13T23:56:12.863 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-13T23:56:12.859+0000 7f9d4956b2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T23:56:12.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.917+0000 7fd5cf59e700 1 -- 172.21.15.87:0/4241009110 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5d011eb00 con 0x7fd5b8003a20 2024-09-13T23:56:12.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.917+0000 7fd5beffd700 1 -- 172.21.15.87:0/4241009110 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4152 (secure 0 0 0) 0x7fd5c800a3d0 con 0x7fd5b8003a20 2024-09-13T23:56:12.925 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:56:12.925 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":6,"fsid":"0b890e8e-a4ce-4e8b-9529-48a86f947d30","created":"2024-09-13T23:56:11.607628+0000","modified":"2024-09-13T23:56:12.698218+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T23:56:12.698218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6ddf6b11-fbca-4310-8745-88ed2a341ca8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2a5386ff-fe63-40b4-8671-bc161b4d65fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dceb34f9-5dfa-4065-8842-aee85a133580","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1b757f70-683f-43a8-863d-5bcb9a416247","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T23:56:12.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.917+0000 7fd5cf59e700 1 -- 172.21.15.87:0/4241009110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5b8003a20 msgr2=0x7fd5d011bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:12.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.917+0000 7fd5cf59e700 1 --2- 172.21.15.87:0/4241009110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5b8003a20 0x7fd5d011bff0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80070a0 tx=0x7fd5c8001cb0 comp rx=0 tx=0).stop 2024-09-13T23:56:12.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.917+0000 7fd5cf59e700 1 -- 172.21.15.87:0/4241009110 shutdown_connections 2024-09-13T23:56:12.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.917+0000 7fd5cf59e700 1 --2- 172.21.15.87:0/4241009110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5b8003a20 0x7fd5d011bff0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:12.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.917+0000 7fd5cf59e700 1 -- 172.21.15.87:0/4241009110 >> 172.21.15.87:0/4241009110 conn(0x7fd5d009cd10 msgr2=0x7fd5d009d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:12.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.917+0000 7fd5cf59e700 1 -- 172.21.15.87:0/4241009110 shutdown_connections 2024-09-13T23:56:12.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:12.917+0000 7fd5cf59e700 1 -- 172.21.15.87:0/4241009110 wait complete. 2024-09-13T23:56:12.937 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T23:56:12.937 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T23:56:13.072 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-13T23:56:13.067+0000 7f9d4956b2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T23:56:13.123 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-13T23:56:13.119+0000 7f9d4956b2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T23:56:13.123 INFO:tasks.ceph.osd.3.smithi173.stderr:2024-09-13T23:56:13.119+0000 7f57f90b8880 -1 Falling back to public interface 2024-09-13T23:56:13.290 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-13T23:56:13.287+0000 7f9d4956b2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T23:56:13.337 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-13T23:56:13.329+0000 7f85f4dc7880 -1 Falling back to public interface 2024-09-13T23:56:13.340 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T23:56:13.353 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-13T23:56:13.347+0000 7f9d4956b2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T23:56:13.368 INFO:tasks.ceph.osd.1.smithi173.stderr:2024-09-13T23:56:13.363+0000 7ff63dac5880 -1 Falling back to public interface 2024-09-13T23:56:13.369 INFO:tasks.ceph.osd.2.smithi173.stderr:2024-09-13T23:56:13.363+0000 7f6df452e880 -1 Falling back to public interface 2024-09-13T23:56:13.418 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-13T23:56:13.415+0000 7f9d4956b2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T23:56:13.448 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.441+0000 7fe44731b700 1 Processor -- start 2024-09-13T23:56:13.448 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.441+0000 7fe44731b700 1 -- start start 2024-09-13T23:56:13.450 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.441+0000 7fe44731b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe44009c9a0 0x7fe440132220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:13.450 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.441+0000 7fe44731b700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe440099710 con 0x7fe44012ccf0 2024-09-13T23:56:13.450 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.441+0000 7fe44731b700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe440098bf0 con 0x7fe44009c9a0 2024-09-13T23:56:13.450 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.441+0000 7fe445b18700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe44009c9a0 0x7fe440132220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:13.451 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.441+0000 7fe445b18700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe44009c9a0 0x7fe440132220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44384/0 (socket says 172.21.15.87:44384) 2024-09-13T23:56:13.451 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.441+0000 7fe445b18700 1 -- 172.21.15.87:0/2123481832 learned_addr learned my addr 172.21.15.87:0/2123481832 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:13.451 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.441+0000 7fe445b18700 1 -- 172.21.15.87:0/2123481832 >> v1:172.21.15.87:6789/0 conn(0x7fe44012ccf0 legacy=0x7fe44012d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:13.451 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.441+0000 7fe445b18700 1 -- 172.21.15.87:0/2123481832 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44012d7e0 con 0x7fe44009c9a0 2024-09-13T23:56:13.451 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.441+0000 7fe445b18700 1 --2- 172.21.15.87:0/2123481832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe44009c9a0 0x7fe440132220 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009890 tx=0x7fe43c009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b409c4fb0aa2276b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:13.451 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.441+0000 7fe445317700 1 -- 172.21.15.87:0/2123481832 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe43c004160 con 0x7fe44009c9a0 2024-09-13T23:56:13.451 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.441+0000 7fe445317700 1 -- 172.21.15.87:0/2123481832 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43c0042c0 con 0x7fe44009c9a0 2024-09-13T23:56:13.451 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.441+0000 7fe445317700 1 -- 172.21.15.87:0/2123481832 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe43c004580 con 0x7fe44009c9a0 2024-09-13T23:56:13.451 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.441+0000 7fe44731b700 1 -- 172.21.15.87:0/2123481832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe44009c9a0 msgr2=0x7fe440132220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:13.451 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.441+0000 7fe44731b700 1 --2- 172.21.15.87:0/2123481832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe44009c9a0 0x7fe440132220 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009890 tx=0x7fe43c009ba0 comp rx=0 tx=0).stop 2024-09-13T23:56:13.452 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.441+0000 7fe44731b700 1 -- 172.21.15.87:0/2123481832 shutdown_connections 2024-09-13T23:56:13.452 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.441+0000 7fe44731b700 1 --2- 172.21.15.87:0/2123481832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe44009c9a0 0x7fe440132220 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:13.452 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.441+0000 7fe44731b700 1 -- 172.21.15.87:0/2123481832 >> 172.21.15.87:0/2123481832 conn(0x7fe44009fbe0 msgr2=0x7fe44009c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:13.452 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.441+0000 7fe44731b700 1 -- 172.21.15.87:0/2123481832 shutdown_connections 2024-09-13T23:56:13.452 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.441+0000 7fe44731b700 1 -- 172.21.15.87:0/2123481832 wait complete. 2024-09-13T23:56:13.454 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.445+0000 7fe44731b700 1 Processor -- start 2024-09-13T23:56:13.454 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.445+0000 7fe44731b700 1 -- start start 2024-09-13T23:56:13.454 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.445+0000 7fe44731b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe44009c9a0 0x7fe440130120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:13.454 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.445+0000 7fe44731b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44006d1b0 con 0x7fe44009c9a0 2024-09-13T23:56:13.454 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.445+0000 7fe446319700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe44009c9a0 0x7fe440130120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:13.454 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.445+0000 7fe446319700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe44009c9a0 0x7fe440130120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44398/0 (socket says 172.21.15.87:44398) 2024-09-13T23:56:13.454 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.445+0000 7fe446319700 1 -- 172.21.15.87:0/617629610 learned_addr learned my addr 172.21.15.87:0/617629610 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:13.454 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.445+0000 7fe446319700 1 -- 172.21.15.87:0/617629610 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43c009570 con 0x7fe44009c9a0 2024-09-13T23:56:13.454 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.445+0000 7fe446319700 1 --2- 172.21.15.87:0/617629610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe44009c9a0 0x7fe440130120 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe43000c480 tx=0x7fe43000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:13.455 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.445+0000 7fe436ffd700 1 -- 172.21.15.87:0/617629610 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe430005150 con 0x7fe44009c9a0 2024-09-13T23:56:13.455 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.445+0000 7fe436ffd700 1 -- 172.21.15.87:0/617629610 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4300052b0 con 0x7fe44009c9a0 2024-09-13T23:56:13.455 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.445+0000 7fe436ffd700 1 -- 172.21.15.87:0/617629610 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe430005590 con 0x7fe44009c9a0 2024-09-13T23:56:13.455 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.445+0000 7fe44731b700 1 -- 172.21.15.87:0/617629610 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4401276a0 con 0x7fe44009c9a0 2024-09-13T23:56:13.455 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.445+0000 7fe44731b700 1 -- 172.21.15.87:0/617629610 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44006cd90 con 0x7fe44009c9a0 2024-09-13T23:56:13.455 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.445+0000 7fe436ffd700 1 -- 172.21.15.87:0/617629610 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fe430006b80 con 0x7fe44009c9a0 2024-09-13T23:56:13.455 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.445+0000 7fe436ffd700 1 -- 172.21.15.87:0/617629610 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fe430006e30 con 0x7fe44009c9a0 2024-09-13T23:56:13.455 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.445+0000 7fe44731b700 1 -- 172.21.15.87:0/617629610 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe44006cb40 con 0x7fe44009c9a0 2024-09-13T23:56:13.459 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.453+0000 7fe436ffd700 1 -- 172.21.15.87:0/617629610 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fe430003930 con 0x7fe44009c9a0 2024-09-13T23:56:13.528 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.521+0000 7fe44731b700 1 -- 172.21.15.87:0/617629610 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe44012db50 con 0x7fe44009c9a0 2024-09-13T23:56:13.528 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.521+0000 7fe436ffd700 1 -- 172.21.15.87:0/617629610 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4152 (secure 0 0 0) 0x7fe430003be0 con 0x7fe44009c9a0 2024-09-13T23:56:13.529 INFO:teuthology.misc.health.smithi087.stdout: 2024-09-13T23:56:13.529 INFO:teuthology.misc.health.smithi087.stdout:{"epoch":6,"fsid":"0b890e8e-a4ce-4e8b-9529-48a86f947d30","created":"2024-09-13T23:56:11.607628+0000","modified":"2024-09-13T23:56:12.698218+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T23:56:12.698218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6ddf6b11-fbca-4310-8745-88ed2a341ca8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2a5386ff-fe63-40b4-8671-bc161b4d65fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dceb34f9-5dfa-4065-8842-aee85a133580","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1b757f70-683f-43a8-863d-5bcb9a416247","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T23:56:13.530 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.521+0000 7fe44731b700 1 -- 172.21.15.87:0/617629610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe44009c9a0 msgr2=0x7fe440130120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:13.530 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.521+0000 7fe44731b700 1 --2- 172.21.15.87:0/617629610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe44009c9a0 0x7fe440130120 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe43000c480 tx=0x7fe43000c840 comp rx=0 tx=0).stop 2024-09-13T23:56:13.530 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.521+0000 7fe44731b700 1 -- 172.21.15.87:0/617629610 shutdown_connections 2024-09-13T23:56:13.530 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.521+0000 7fe44731b700 1 --2- 172.21.15.87:0/617629610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe44009c9a0 0x7fe440130120 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:13.530 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.521+0000 7fe44731b700 1 -- 172.21.15.87:0/617629610 >> 172.21.15.87:0/617629610 conn(0x7fe44009fbe0 msgr2=0x7fe440126680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:13.530 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.521+0000 7fe44731b700 1 -- 172.21.15.87:0/617629610 shutdown_connections 2024-09-13T23:56:13.531 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:13.521+0000 7fe44731b700 1 -- 172.21.15.87:0/617629610 wait complete. 2024-09-13T23:56:13.541 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-13T23:56:13.804 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-13T23:56:13.799+0000 7f9d4956b2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T23:56:13.920 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-13T23:56:13.915+0000 7f9d4956b2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T23:56:14.250 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-13T23:56:14.247+0000 7f9d4956b2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T23:56:14.434 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-13T23:56:14.431+0000 7f9d4956b2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T23:56:14.502 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-13T23:56:14.499+0000 7f9d4956b2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T23:56:14.663 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-13T23:56:14.659+0000 7f9d4956b2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T23:56:15.389 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-13T23:56:15.387+0000 7f9d4956b2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T23:56:15.460 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-13T23:56:15.455+0000 7f9d4956b2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T23:56:15.629 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-13T23:56:15.623+0000 7f9d4956b2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T23:56:15.697 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-13T23:56:15.691+0000 7f9d4956b2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T23:56:15.770 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-13T23:56:15.767+0000 7f9d4956b2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T23:56:16.107 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-13T23:56:16.103+0000 7f9d4956b2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T23:56:16.185 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-13T23:56:16.179+0000 7f9d4956b2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T23:56:16.889 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-13T23:56:16.883+0000 7f9d4956b2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T23:56:16.944 INFO:tasks.ceph.osd.2.smithi173.stderr:2024-09-13T23:56:16.939+0000 7f6df452e880 -1 osd.2 0 log_to_monitors true 2024-09-13T23:56:16.979 INFO:tasks.ceph.osd.3.smithi173.stderr:2024-09-13T23:56:16.975+0000 7f57f90b8880 -1 osd.3 0 log_to_monitors true 2024-09-13T23:56:17.099 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-13T23:56:17.093+0000 7f85f4dc7880 -1 osd.0 0 log_to_monitors true 2024-09-13T23:56:17.198 INFO:tasks.ceph.osd.1.smithi173.stderr:2024-09-13T23:56:17.195+0000 7ff63dac5880 -1 osd.1 0 log_to_monitors true 2024-09-13T23:56:17.922 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-09-13T23:56:17.919+0000 7f9d300e2700 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-13T23:56:19.945 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T23:56:20.050 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.041+0000 7f29cf54a700 1 Processor -- start 2024-09-13T23:56:20.050 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.041+0000 7f29cf54a700 1 -- start start 2024-09-13T23:56:20.052 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.041+0000 7f29cf54a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f29c8095530 0x7f29c812e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:20.052 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.041+0000 7f29cf54a700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c806c330 con 0x7f29c8094a40 2024-09-13T23:56:20.052 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.041+0000 7f29cf54a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c806af30 con 0x7f29c8095530 2024-09-13T23:56:20.052 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.041+0000 7f29cdd47700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f29c8095530 0x7f29c812e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:20.052 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.041+0000 7f29ce548700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f29c8094a40 0x7f29c8094e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51210/0 (socket says 172.21.15.87:51210) 2024-09-13T23:56:20.052 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.041+0000 7f29ce548700 1 -- 172.21.15.87:0/1868913778 learned_addr learned my addr 172.21.15.87:0/1868913778 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T23:56:20.052 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.041+0000 7f29cdd47700 1 -- 172.21.15.87:0/1868913778 >> v1:172.21.15.87:6789/0 conn(0x7f29c8094a40 legacy=0x7f29c8094e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:20.052 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.045+0000 7f29cdd47700 1 -- 172.21.15.87:0/1868913778 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c806c6e0 con 0x7f29c8095530 2024-09-13T23:56:20.053 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.045+0000 7f29cdd47700 1 --2- 172.21.15.87:0/1868913778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29c8095530 0x7f29c812e490 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f29b80097d0 tx=0x7f29b8009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671251a12b12ad82 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:20.053 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.045+0000 7f29cd546700 1 -- 172.21.15.87:0/1868913778 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29b80041c0 con 0x7f29c8095530 2024-09-13T23:56:20.053 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.045+0000 7f29cd546700 1 -- 172.21.15.87:0/1868913778 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b8004320 con 0x7f29c8095530 2024-09-13T23:56:20.053 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.045+0000 7f29cd546700 1 -- 172.21.15.87:0/1868913778 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29b80036c0 con 0x7f29c8095530 2024-09-13T23:56:20.054 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.045+0000 7f29cf54a700 1 -- 172.21.15.87:0/1868913778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29c8095530 msgr2=0x7f29c812e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:20.054 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.045+0000 7f29cf54a700 1 --2- 172.21.15.87:0/1868913778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29c8095530 0x7f29c812e490 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f29b80097d0 tx=0x7f29b8009ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:20.054 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.045+0000 7f29cf54a700 1 -- 172.21.15.87:0/1868913778 shutdown_connections 2024-09-13T23:56:20.054 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.045+0000 7f29cf54a700 1 --2- 172.21.15.87:0/1868913778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29c8095530 0x7f29c812e490 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:20.054 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.045+0000 7f29cf54a700 1 -- 172.21.15.87:0/1868913778 >> 172.21.15.87:0/1868913778 conn(0x7f29c8098d00 msgr2=0x7f29c8093140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:20.054 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.045+0000 7f29cf54a700 1 -- 172.21.15.87:0/1868913778 shutdown_connections 2024-09-13T23:56:20.054 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.045+0000 7f29cf54a700 1 -- 172.21.15.87:0/1868913778 wait complete. 2024-09-13T23:56:20.054 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.045+0000 7f29cf54a700 1 Processor -- start 2024-09-13T23:56:20.055 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.045+0000 7f29cf54a700 1 -- start start 2024-09-13T23:56:20.056 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.045+0000 7f29cf54a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29c8094a40 0x7f29c80703a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:20.056 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.045+0000 7f29cf54a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c8122380 con 0x7f29c8094a40 2024-09-13T23:56:20.056 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.045+0000 7f29ce548700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29c8094a40 0x7f29c80703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:20.057 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.045+0000 7f29ce548700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29c8094a40 0x7f29c80703a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49984/0 (socket says 172.21.15.87:49984) 2024-09-13T23:56:20.057 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.045+0000 7f29ce548700 1 -- 172.21.15.87:0/2247013010 learned_addr learned my addr 172.21.15.87:0/2247013010 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:20.057 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.049+0000 7f29ce548700 1 -- 172.21.15.87:0/2247013010 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b80094b0 con 0x7f29c8094a40 2024-09-13T23:56:20.057 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.049+0000 7f29ce548700 1 --2- 172.21.15.87:0/2247013010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29c8094a40 0x7f29c80703a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f29c400c680 tx=0x7f29c400ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:20.057 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.049+0000 7f29beffd700 1 -- 172.21.15.87:0/2247013010 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29c4005cc0 con 0x7f29c8094a40 2024-09-13T23:56:20.057 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.049+0000 7f29beffd700 1 -- 172.21.15.87:0/2247013010 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c4005e20 con 0x7f29c8094a40 2024-09-13T23:56:20.057 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.049+0000 7f29beffd700 1 -- 172.21.15.87:0/2247013010 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29c4007200 con 0x7f29c8094a40 2024-09-13T23:56:20.057 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.049+0000 7f29cf54a700 1 -- 172.21.15.87:0/2247013010 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c8126bd0 con 0x7f29c8094a40 2024-09-13T23:56:20.057 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.049+0000 7f29cf54a700 1 -- 172.21.15.87:0/2247013010 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c8121380 con 0x7f29c8094a40 2024-09-13T23:56:20.057 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.049+0000 7f29beffd700 1 -- 172.21.15.87:0/2247013010 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 4) v1 ==== 43251+0+0 (secure 0 0 0) 0x7f29c4007360 con 0x7f29c8094a40 2024-09-13T23:56:20.058 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.049+0000 7f29cf54a700 1 -- 172.21.15.87:0/2247013010 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c8122130 con 0x7f29c8094a40 2024-09-13T23:56:20.058 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.049+0000 7f29beffd700 1 --2- 172.21.15.87:0/2247013010 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f29ac0354b0 0x7f29ac037970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:20.058 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.049+0000 7f29beffd700 1 -- 172.21.15.87:0/2247013010 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1623+0+0 (secure 0 0 0) 0x7f29c40463a0 con 0x7f29c8094a40 2024-09-13T23:56:20.058 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.049+0000 7f29cdd47700 1 --2- 172.21.15.87:0/2247013010 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f29ac0354b0 0x7f29ac037970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:20.058 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.049+0000 7f29cdd47700 1 --2- 172.21.15.87:0/2247013010 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f29ac0354b0 0x7f29ac037970 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f29b8009b20 tx=0x7f29b8011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:20.062 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.053+0000 7f29beffd700 1 -- 172.21.15.87:0/2247013010 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f29c401b730 con 0x7f29c8094a40 2024-09-13T23:56:20.238 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.229+0000 7f29cf54a700 1 -- 172.21.15.87:0/2247013010 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29c8094e20 con 0x7f29c8094a40 2024-09-13T23:56:20.238 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.229+0000 7f29beffd700 1 -- 172.21.15.87:0/2247013010 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) v1 ==== 74+0+4152 (secure 0 0 0) 0x7f29c4017030 con 0x7f29c8094a40 2024-09-13T23:56:20.239 INFO:teuthology.misc.health.smithi087.stdout: 2024-09-13T23:56:20.239 INFO:teuthology.misc.health.smithi087.stdout:{"epoch":8,"fsid":"0b890e8e-a4ce-4e8b-9529-48a86f947d30","created":"2024-09-13T23:56:11.607628+0000","modified":"2024-09-13T23:56:18.918614+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T23:56:12.698218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6ddf6b11-fbca-4310-8745-88ed2a341ca8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2a5386ff-fe63-40b4-8671-bc161b4d65fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dceb34f9-5dfa-4065-8842-aee85a133580","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1b757f70-683f-43a8-863d-5bcb9a416247","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T23:56:20.241 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.233+0000 7f29cf54a700 1 -- 172.21.15.87:0/2247013010 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f29ac0354b0 msgr2=0x7f29ac037970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:20.241 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.233+0000 7f29cf54a700 1 --2- 172.21.15.87:0/2247013010 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f29ac0354b0 0x7f29ac037970 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f29b8009b20 tx=0x7f29b8011000 comp rx=0 tx=0).stop 2024-09-13T23:56:20.241 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.233+0000 7f29cf54a700 1 -- 172.21.15.87:0/2247013010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29c8094a40 msgr2=0x7f29c80703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:20.241 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.233+0000 7f29cf54a700 1 --2- 172.21.15.87:0/2247013010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29c8094a40 0x7f29c80703a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f29c400c680 tx=0x7f29c400ca40 comp rx=0 tx=0).stop 2024-09-13T23:56:20.241 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.233+0000 7f29cf54a700 1 -- 172.21.15.87:0/2247013010 shutdown_connections 2024-09-13T23:56:20.241 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.233+0000 7f29cf54a700 1 --2- 172.21.15.87:0/2247013010 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f29ac0354b0 0x7f29ac037970 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:20.241 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.233+0000 7f29cf54a700 1 --2- 172.21.15.87:0/2247013010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29c8094a40 0x7f29c80703a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:20.241 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.233+0000 7f29cf54a700 1 -- 172.21.15.87:0/2247013010 >> 172.21.15.87:0/2247013010 conn(0x7f29c8098d00 msgr2=0x7f29c8096df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:20.242 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.233+0000 7f29cf54a700 1 -- 172.21.15.87:0/2247013010 shutdown_connections 2024-09-13T23:56:20.242 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:20.233+0000 7f29cf54a700 1 -- 172.21.15.87:0/2247013010 wait complete. 2024-09-13T23:56:20.246 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-13T23:56:20.237+0000 7f85f03e3700 -1 osd.0 0 waiting for initial osdmap 2024-09-13T23:56:20.251 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-09-13T23:56:20.241+0000 7f85e86b8700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:56:20.252 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-13T23:56:20.740 INFO:tasks.ceph.osd.1.smithi173.stderr:2024-09-13T23:56:20.734+0000 7ff6390e1700 -1 osd.1 0 waiting for initial osdmap 2024-09-13T23:56:20.745 INFO:tasks.ceph.osd.1.smithi173.stderr:2024-09-13T23:56:20.742+0000 7ff6313b6700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:56:20.762 INFO:tasks.ceph.osd.3.smithi173.stderr:2024-09-13T23:56:20.758+0000 7f57f46d4700 -1 osd.3 0 waiting for initial osdmap 2024-09-13T23:56:20.766 INFO:tasks.ceph.osd.3.smithi173.stderr:2024-09-13T23:56:20.762+0000 7f57ec9a9700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:56:20.767 INFO:tasks.ceph.osd.2.smithi173.stderr:2024-09-13T23:56:20.762+0000 7f6df14f5700 -1 osd.2 0 waiting for initial osdmap 2024-09-13T23:56:20.775 INFO:tasks.ceph.osd.2.smithi173.stderr:2024-09-13T23:56:20.770+0000 7f6de7e1f700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:56:26.656 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T23:56:26.764 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.757+0000 7f271359e700 1 Processor -- start 2024-09-13T23:56:26.764 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.757+0000 7f271359e700 1 -- start start 2024-09-13T23:56:26.766 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.757+0000 7f271359e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f27140916d0 0x7f27140928e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:26.766 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.757+0000 7f271359e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2714094720 con 0x7f2714095460 2024-09-13T23:56:26.766 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.757+0000 7f271359e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2714091ab0 con 0x7f27140916d0 2024-09-13T23:56:26.766 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.757+0000 7f271259c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f27140916d0 0x7f27140928e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:26.766 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.757+0000 7f2711d9b700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f2714095460 0x7f2714092e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51220/0 (socket says 172.21.15.87:51220) 2024-09-13T23:56:26.766 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.757+0000 7f2711d9b700 1 -- 172.21.15.87:0/1706077606 learned_addr learned my addr 172.21.15.87:0/1706077606 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T23:56:26.766 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.757+0000 7f271159a700 1 -- 172.21.15.87:0/1706077606 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414348061 0 0) 0x7f2714094720 con 0x7f2714095460 2024-09-13T23:56:26.766 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.757+0000 7f271159a700 1 -- 172.21.15.87:0/1706077606 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26fc0035d0 con 0x7f2714095460 2024-09-13T23:56:26.766 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.757+0000 7f271259c700 1 -- 172.21.15.87:0/1706077606 >> v1:172.21.15.87:6789/0 conn(0x7f2714095460 legacy=0x7f2714092e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:26.766 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.757+0000 7f271259c700 1 -- 172.21.15.87:0/1706077606 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2714093960 con 0x7f27140916d0 2024-09-13T23:56:26.766 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.757+0000 7f271259c700 1 --2- 172.21.15.87:0/1706077606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27140916d0 0x7f27140928e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f27080097d0 tx=0x7f2708009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6610ec102b5fa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:26.767 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.757+0000 7f271159a700 1 -- 172.21.15.87:0/1706077606 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2708004160 con 0x7f27140916d0 2024-09-13T23:56:26.768 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.757+0000 7f271159a700 1 -- 172.21.15.87:0/1706077606 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27080042c0 con 0x7f27140916d0 2024-09-13T23:56:26.768 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.757+0000 7f271159a700 1 -- 172.21.15.87:0/1706077606 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2708004580 con 0x7f27140916d0 2024-09-13T23:56:26.768 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.757+0000 7f271359e700 1 -- 172.21.15.87:0/1706077606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27140916d0 msgr2=0x7f27140928e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:26.768 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.757+0000 7f271359e700 1 --2- 172.21.15.87:0/1706077606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27140916d0 0x7f27140928e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f27080097d0 tx=0x7f2708009ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:26.768 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.757+0000 7f271359e700 1 -- 172.21.15.87:0/1706077606 shutdown_connections 2024-09-13T23:56:26.768 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.757+0000 7f271359e700 1 --2- 172.21.15.87:0/1706077606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27140916d0 0x7f27140928e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:26.768 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.757+0000 7f271359e700 1 -- 172.21.15.87:0/1706077606 >> 172.21.15.87:0/1706077606 conn(0x7f27140992e0 msgr2=0x7f27140996f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:26.768 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.757+0000 7f271359e700 1 -- 172.21.15.87:0/1706077606 shutdown_connections 2024-09-13T23:56:26.768 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.761+0000 7f271359e700 1 -- 172.21.15.87:0/1706077606 wait complete. 2024-09-13T23:56:26.769 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.761+0000 7f271359e700 1 Processor -- start 2024-09-13T23:56:26.769 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.761+0000 7f271359e700 1 -- start start 2024-09-13T23:56:26.769 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.761+0000 7f271359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27140916d0 0x7f27141bdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:26.769 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.761+0000 7f271359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27141a7170 con 0x7f27140916d0 2024-09-13T23:56:26.769 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.761+0000 7f271259c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27140916d0 0x7f27141bdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:26.769 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.761+0000 7f271259c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27140916d0 0x7f27141bdf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49998/0 (socket says 172.21.15.87:49998) 2024-09-13T23:56:26.770 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.761+0000 7f271259c700 1 -- 172.21.15.87:0/1273213941 learned_addr learned my addr 172.21.15.87:0/1273213941 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:26.770 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.761+0000 7f271259c700 1 -- 172.21.15.87:0/1273213941 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27080094b0 con 0x7f27140916d0 2024-09-13T23:56:26.771 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.761+0000 7f271259c700 1 --2- 172.21.15.87:0/1273213941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27140916d0 0x7f27141bdf30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2708009b20 tx=0x7f2708004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:26.771 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.761+0000 7f2702ffd700 1 -- 172.21.15.87:0/1273213941 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2708006ea0 con 0x7f27140916d0 2024-09-13T23:56:26.771 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.761+0000 7f271359e700 1 -- 172.21.15.87:0/1273213941 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27141a9360 con 0x7f27140916d0 2024-09-13T23:56:26.771 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.761+0000 7f2702ffd700 1 -- 172.21.15.87:0/1273213941 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270801f070 con 0x7f27140916d0 2024-09-13T23:56:26.771 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.761+0000 7f2702ffd700 1 -- 172.21.15.87:0/1273213941 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2708003e60 con 0x7f27140916d0 2024-09-13T23:56:26.771 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.761+0000 7f271359e700 1 -- 172.21.15.87:0/1273213941 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27141a9670 con 0x7f27140916d0 2024-09-13T23:56:26.771 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.765+0000 7f2702ffd700 1 -- 172.21.15.87:0/1273213941 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 4) v1 ==== 43251+0+0 (secure 0 0 0) 0x7f2708021030 con 0x7f27140916d0 2024-09-13T23:56:26.772 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.765+0000 7f271359e700 1 -- 172.21.15.87:0/1273213941 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27140928e0 con 0x7f27140916d0 2024-09-13T23:56:26.772 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.765+0000 7f2702ffd700 1 --2- 172.21.15.87:0/1273213941 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f26f4035440 0x7f26f4037900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:26.772 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.765+0000 7f2702ffd700 1 -- 172.21.15.87:0/1273213941 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3129+0+0 (secure 0 0 0) 0x7f2708048a50 con 0x7f27140916d0 2024-09-13T23:56:26.773 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.765+0000 7f2711d9b700 1 --2- 172.21.15.87:0/1273213941 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f26f4035440 0x7f26f4037900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:26.773 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.765+0000 7f2711d9b700 1 --2- 172.21.15.87:0/1273213941 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f26f4035440 0x7f26f4037900 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f27040012e0 tx=0x7f2704001420 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:26.780 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.773+0000 7f2702ffd700 1 -- 172.21.15.87:0/1273213941 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f27080195a0 con 0x7f27140916d0 2024-09-13T23:56:26.959 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.953+0000 7f271359e700 1 -- 172.21.15.87:0/1273213941 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27140008d0 con 0x7f27140916d0 2024-09-13T23:56:26.961 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.953+0000 7f2702ffd700 1 -- 172.21.15.87:0/1273213941 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+7941 (secure 0 0 0) 0x7f270801b440 con 0x7f27140916d0 2024-09-13T23:56:26.961 INFO:teuthology.misc.health.smithi087.stdout: 2024-09-13T23:56:26.961 INFO:teuthology.misc.health.smithi087.stdout:{"epoch":13,"fsid":"0b890e8e-a4ce-4e8b-9529-48a86f947d30","created":"2024-09-13T23:56:11.607628+0000","modified":"2024-09-13T23:56:25.270289+0000","last_up_change":"2024-09-13T23:56:21.244126+0000","last_in_change":"2024-09-13T23:56:12.698218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T23:56:22.979454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ddf6b11-fbca-4310-8745-88ed2a341ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3507919120},{"type":"v1","addr":"172.21.15.87:6801","nonce":3507919120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3507919120},{"type":"v1","addr":"172.21.15.87:6803","nonce":3507919120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3507919120},{"type":"v1","addr":"172.21.15.87:6807","nonce":3507919120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3507919120},{"type":"v1","addr":"172.21.15.87:6805","nonce":3507919120}]},"public_addr":"172.21.15.87:6801/3507919120","cluster_addr":"172.21.15.87:6803/3507919120","heartbeat_back_addr":"172.21.15.87:6807/3507919120","heartbeat_front_addr":"172.21.15.87:6805/3507919120","state":["exists","up"]},{"osd":1,"uuid":"2a5386ff-fe63-40b4-8671-bc161b4d65fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":3256211813},{"type":"v1","addr":"172.21.15.173:6810","nonce":3256211813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3256211813},{"type":"v1","addr":"172.21.15.173:6813","nonce":3256211813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3256211813},{"type":"v1","addr":"172.21.15.173:6820","nonce":3256211813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6815","nonce":3256211813},{"type":"v1","addr":"172.21.15.173:6816","nonce":3256211813}]},"public_addr":"172.21.15.173:6810/3256211813","cluster_addr":"172.21.15.173:6813/3256211813","heartbeat_back_addr":"172.21.15.173:6820/3256211813","heartbeat_front_addr":"172.21.15.173:6816/3256211813","state":["exists","up"]},{"osd":2,"uuid":"dceb34f9-5dfa-4065-8842-aee85a133580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6809","nonce":889985573},{"type":"v1","addr":"172.21.15.173:6812","nonce":889985573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":889985573},{"type":"v1","addr":"172.21.15.173:6817","nonce":889985573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":889985573},{"type":"v1","addr":"172.21.15.173:6823","nonce":889985573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6819","nonce":889985573},{"type":"v1","addr":"172.21.15.173:6821","nonce":889985573}]},"public_addr":"172.21.15.173:6812/889985573","cluster_addr":"172.21.15.173:6817/889985573","heartbeat_back_addr":"172.21.15.173:6823/889985573","heartbeat_front_addr":"172.21.15.173:6821/889985573","state":["exists","up"]},{"osd":3,"uuid":"1b757f70-683f-43a8-863d-5bcb9a416247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4020038786},{"type":"v1","addr":"172.21.15.173:6801","nonce":4020038786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4020038786},{"type":"v1","addr":"172.21.15.173:6803","nonce":4020038786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4020038786},{"type":"v1","addr":"172.21.15.173:6807","nonce":4020038786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4020038786},{"type":"v1","addr":"172.21.15.173:6805","nonce":4020038786}]},"public_addr":"172.21.15.173:6801/4020038786","cluster_addr":"172.21.15.173:6803/4020038786","heartbeat_back_addr":"172.21.15.173:6807/4020038786","heartbeat_front_addr":"172.21.15.173:6805/4020038786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:56:18.058043+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:56:18.173198+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:56:17.904714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:56:17.983811+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T23:56:26.966 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.957+0000 7f271359e700 1 -- 172.21.15.87:0/1273213941 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f26f4035440 msgr2=0x7f26f4037900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:26.966 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.957+0000 7f271359e700 1 --2- 172.21.15.87:0/1273213941 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f26f4035440 0x7f26f4037900 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f27040012e0 tx=0x7f2704001420 comp rx=0 tx=0).stop 2024-09-13T23:56:26.966 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.957+0000 7f271359e700 1 -- 172.21.15.87:0/1273213941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27140916d0 msgr2=0x7f27141bdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:26.966 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.957+0000 7f271359e700 1 --2- 172.21.15.87:0/1273213941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27140916d0 0x7f27141bdf30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2708009b20 tx=0x7f2708004770 comp rx=0 tx=0).stop 2024-09-13T23:56:26.966 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.957+0000 7f271359e700 1 -- 172.21.15.87:0/1273213941 shutdown_connections 2024-09-13T23:56:26.966 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.957+0000 7f271359e700 1 --2- 172.21.15.87:0/1273213941 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f26f4035440 0x7f26f4037900 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:26.966 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.957+0000 7f271359e700 1 --2- 172.21.15.87:0/1273213941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27140916d0 0x7f27141bdf30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:26.966 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.957+0000 7f271359e700 1 -- 172.21.15.87:0/1273213941 >> 172.21.15.87:0/1273213941 conn(0x7f27140992e0 msgr2=0x7f271408d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:26.966 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.957+0000 7f271359e700 1 -- 172.21.15.87:0/1273213941 shutdown_connections 2024-09-13T23:56:26.966 INFO:teuthology.misc.health.smithi087.stderr:2024-09-13T23:56:26.957+0000 7f271359e700 1 -- 172.21.15.87:0/1273213941 wait complete. 2024-09-13T23:56:26.981 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-13T23:56:26.981 INFO:tasks.ceph:Creating RBD pool 2024-09-13T23:56:26.981 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-13T23:56:27.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.077+0000 7f7304f99700 1 Processor -- start 2024-09-13T23:56:27.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.077+0000 7f7304f99700 1 -- start start 2024-09-13T23:56:27.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.081+0000 7f7304f99700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f730012db70 0x7f73001325b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:27.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.081+0000 7f7304f99700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730006f900 con 0x7f730012d080 2024-09-13T23:56:27.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.081+0000 7f7304f99700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7300070fe0 con 0x7f730012db70 2024-09-13T23:56:27.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.081+0000 7f72f6ffd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f730012db70 0x7f73001325b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:27.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.081+0000 7f72ff7fe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f730012d080 0x7f730012d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51234/0 (socket says 172.21.15.87:51234) 2024-09-13T23:56:27.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.081+0000 7f72f6ffd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f730012db70 0x7f73001325b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50006/0 (socket says 172.21.15.87:50006) 2024-09-13T23:56:27.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.081+0000 7f72f6ffd700 1 -- 172.21.15.87:0/190890528 learned_addr learned my addr 172.21.15.87:0/190890528 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:27.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.081+0000 7f72f6ffd700 1 -- 172.21.15.87:0/190890528 >> v1:172.21.15.87:6789/0 conn(0x7f730012d080 legacy=0x7f730012d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:27.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.081+0000 7f72f6ffd700 1 -- 172.21.15.87:0/190890528 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730009d0f0 con 0x7f730012db70 2024-09-13T23:56:27.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.081+0000 7f72f6ffd700 1 --2- 172.21.15.87:0/190890528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f730012db70 0x7f73001325b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f72e8009890 tx=0x7f72e8009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0955a26b85aa61 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:27.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.081+0000 7f72feffd700 1 -- 172.21.15.87:0/190890528 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e8004160 con 0x7f730012db70 2024-09-13T23:56:27.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.081+0000 7f72feffd700 1 -- 172.21.15.87:0/190890528 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e80042c0 con 0x7f730012db70 2024-09-13T23:56:27.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.081+0000 7f72feffd700 1 -- 172.21.15.87:0/190890528 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72e8004580 con 0x7f730012db70 2024-09-13T23:56:27.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.081+0000 7f7304f99700 1 -- 172.21.15.87:0/190890528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f730012db70 msgr2=0x7f73001325b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:27.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.081+0000 7f7304f99700 1 --2- 172.21.15.87:0/190890528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f730012db70 0x7f73001325b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f72e8009890 tx=0x7f72e8009ba0 comp rx=0 tx=0).stop 2024-09-13T23:56:27.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.081+0000 7f7304f99700 1 -- 172.21.15.87:0/190890528 shutdown_connections 2024-09-13T23:56:27.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.081+0000 7f7304f99700 1 --2- 172.21.15.87:0/190890528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f730012db70 0x7f73001325b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:27.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.081+0000 7f7304f99700 1 -- 172.21.15.87:0/190890528 >> 172.21.15.87:0/190890528 conn(0x7f730009be20 msgr2=0x7f730009c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:27.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.081+0000 7f7304f99700 1 -- 172.21.15.87:0/190890528 shutdown_connections 2024-09-13T23:56:27.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.081+0000 7f7304f99700 1 -- 172.21.15.87:0/190890528 wait complete. 2024-09-13T23:56:27.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.081+0000 7f7304f99700 1 Processor -- start 2024-09-13T23:56:27.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.081+0000 7f7304f99700 1 -- start start 2024-09-13T23:56:27.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.085+0000 7f7304f99700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f730012d080 0x7f730011bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:27.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.085+0000 7f7304f99700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730011e600 con 0x7f730012d080 2024-09-13T23:56:27.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.085+0000 7f72ff7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f730012d080 0x7f730011bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:27.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.085+0000 7f72ff7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f730012d080 0x7f730011bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50014/0 (socket says 172.21.15.87:50014) 2024-09-13T23:56:27.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.085+0000 7f72ff7fe700 1 -- 172.21.15.87:0/290755127 learned_addr learned my addr 172.21.15.87:0/290755127 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:27.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.085+0000 7f72ff7fe700 1 -- 172.21.15.87:0/290755127 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e8009570 con 0x7f730012d080 2024-09-13T23:56:27.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.085+0000 7f72ff7fe700 1 --2- 172.21.15.87:0/290755127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f730012d080 0x7f730011bb40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f72f000c480 tx=0x7f72f000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:27.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.085+0000 7f72fcff9700 1 -- 172.21.15.87:0/290755127 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72f0005c00 con 0x7f730012d080 2024-09-13T23:56:27.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.085+0000 7f72fcff9700 1 -- 172.21.15.87:0/290755127 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f0005d60 con 0x7f730012d080 2024-09-13T23:56:27.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.085+0000 7f7304f99700 1 -- 172.21.15.87:0/290755127 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730011f0b0 con 0x7f730012d080 2024-09-13T23:56:27.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.085+0000 7f72fcff9700 1 -- 172.21.15.87:0/290755127 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72f00070d0 con 0x7f730012d080 2024-09-13T23:56:27.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.085+0000 7f7304f99700 1 -- 172.21.15.87:0/290755127 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730011e7e0 con 0x7f730012d080 2024-09-13T23:56:27.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.085+0000 7f72fcff9700 1 -- 172.21.15.87:0/290755127 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 4) v1 ==== 43251+0+0 (secure 0 0 0) 0x7f72f0007230 con 0x7f730012d080 2024-09-13T23:56:27.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.085+0000 7f72fcff9700 1 --2- 172.21.15.87:0/290755127 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f72e4035460 0x7f72e4037920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:27.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.085+0000 7f72fcff9700 1 -- 172.21.15.87:0/290755127 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3129+0+0 (secure 0 0 0) 0x7f72f0046830 con 0x7f730012d080 2024-09-13T23:56:27.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.085+0000 7f72f6ffd700 1 --2- 172.21.15.87:0/290755127 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f72e4035460 0x7f72e4037920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:27.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.085+0000 7f7304f99700 1 -- 172.21.15.87:0/290755127 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f730011e040 con 0x7f730012d080 2024-09-13T23:56:27.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.089+0000 7f72f6ffd700 1 --2- 172.21.15.87:0/290755127 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f72e4035460 0x7f72e4037920 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f72e8000c00 tx=0x7f72e8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:27.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.093+0000 7f72fcff9700 1 -- 172.21.15.87:0/290755127 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f72f0017020 con 0x7f730012d080 2024-09-13T23:56:27.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.265+0000 7f7304f99700 1 -- 172.21.15.87:0/290755127 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f730011e3e0 con 0x7f730012d080 2024-09-13T23:56:27.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.317+0000 7f72fcff9700 1 -- 172.21.15.87:0/290755127 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f72f001b590 con 0x7f730012d080 2024-09-13T23:56:27.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.361+0000 7f72fcff9700 1 -- 172.21.15.87:0/290755127 <== mon.0 v2:172.21.15.87:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7f72f00192c0 con 0x7f730012d080 2024-09-13T23:56:27.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.365+0000 7f7304f99700 1 -- 172.21.15.87:0/290755127 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f72e4035460 msgr2=0x7f72e4037920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:27.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.365+0000 7f7304f99700 1 --2- 172.21.15.87:0/290755127 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f72e4035460 0x7f72e4037920 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f72e8000c00 tx=0x7f72e8008030 comp rx=0 tx=0).stop 2024-09-13T23:56:27.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.365+0000 7f7304f99700 1 -- 172.21.15.87:0/290755127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f730012d080 msgr2=0x7f730011bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:27.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.365+0000 7f7304f99700 1 --2- 172.21.15.87:0/290755127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f730012d080 0x7f730011bb40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f72f000c480 tx=0x7f72f000c840 comp rx=0 tx=0).stop 2024-09-13T23:56:27.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.365+0000 7f7304f99700 1 -- 172.21.15.87:0/290755127 shutdown_connections 2024-09-13T23:56:27.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.365+0000 7f7304f99700 1 --2- 172.21.15.87:0/290755127 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f72e4035460 0x7f72e4037920 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:27.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.365+0000 7f7304f99700 1 --2- 172.21.15.87:0/290755127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f730012d080 0x7f730011bb40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:27.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.365+0000 7f7304f99700 1 -- 172.21.15.87:0/290755127 >> 172.21.15.87:0/290755127 conn(0x7f730009be20 msgr2=0x7f7300131460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:27.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.365+0000 7f7304f99700 1 -- 172.21.15.87:0/290755127 shutdown_connections 2024-09-13T23:56:27.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.365+0000 7f7304f99700 1 -- 172.21.15.87:0/290755127 wait complete. 2024-09-13T23:56:27.375 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'rbd' created 2024-09-13T23:56:27.388 DEBUG:teuthology.orchestra.run.smithi087:> rbd --cluster ceph pool init rbd 2024-09-13T23:56:27.438 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:56:27.438 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:56:27.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.429+0000 7f74b6670780 1 Processor -- start 2024-09-13T23:56:27.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.429+0000 7f74b6670780 1 -- start start 2024-09-13T23:56:27.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.433+0000 7f74b6670780 1 --2- >> v2:172.21.15.87:3300/0 conn(0x5611240d26c0 0x56112403d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:27.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.433+0000 7f74b6670780 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x561123ec1ca0 con 0x56112403de60 2024-09-13T23:56:27.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.433+0000 7f74b6670780 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x561123f04540 con 0x5611240d26c0 2024-09-13T23:56:27.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.433+0000 7f74b51a7700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x5611240d26c0 0x56112403d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:27.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.433+0000 7f74b51a7700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x5611240d26c0 0x56112403d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50022/0 (socket says 172.21.15.87:50022) 2024-09-13T23:56:27.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.433+0000 7f74b51a7700 1 -- 172.21.15.87:0/29349641 learned_addr learned my addr 172.21.15.87:0/29349641 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:27.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.433+0000 7f74b49a6700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x56112403de60 0x56112403e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51238/0 (socket says 172.21.15.87:51238) 2024-09-13T23:56:27.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.433+0000 7f74a7fff700 1 -- 172.21.15.87:0/29349641 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 286255171 0 0) 0x561123ec1ca0 con 0x56112403de60 2024-09-13T23:56:27.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.433+0000 7f74b51a7700 1 -- 172.21.15.87:0/29349641 >> v1:172.21.15.87:6789/0 conn(0x56112403de60 legacy=0x56112403e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:27.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.433+0000 7f74b51a7700 1 -- 172.21.15.87:0/29349641 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561123e9abb0 con 0x5611240d26c0 2024-09-13T23:56:27.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.433+0000 7f74b51a7700 1 --2- 172.21.15.87:0/29349641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611240d26c0 0x56112403d920 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f74a800a520 tx=0x7f74a800a830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef248e905588eeb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:27.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.433+0000 7f74a7fff700 1 -- 172.21.15.87:0/29349641 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74a80087c0 con 0x5611240d26c0 2024-09-13T23:56:27.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.433+0000 7f74a7fff700 1 -- 172.21.15.87:0/29349641 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a8008920 con 0x5611240d26c0 2024-09-13T23:56:27.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.433+0000 7f74a7fff700 1 -- 172.21.15.87:0/29349641 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74a8008be0 con 0x5611240d26c0 2024-09-13T23:56:27.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.433+0000 7f74b6670780 1 -- 172.21.15.87:0/29349641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611240d26c0 msgr2=0x56112403d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:27.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.433+0000 7f74b6670780 1 --2- 172.21.15.87:0/29349641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611240d26c0 0x56112403d920 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f74a800a520 tx=0x7f74a800a830 comp rx=0 tx=0).stop 2024-09-13T23:56:27.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.433+0000 7f74b6670780 1 -- 172.21.15.87:0/29349641 shutdown_connections 2024-09-13T23:56:27.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.433+0000 7f74b6670780 1 --2- 172.21.15.87:0/29349641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5611240d26c0 0x56112403d920 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:27.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.433+0000 7f74b6670780 1 -- 172.21.15.87:0/29349641 >> 172.21.15.87:0/29349641 conn(0x5611240423e0 msgr2=0x5611240427f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:27.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.433+0000 7f74b6670780 1 -- 172.21.15.87:0/29349641 shutdown_connections 2024-09-13T23:56:27.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.433+0000 7f74b6670780 1 -- 172.21.15.87:0/29349641 wait complete. 2024-09-13T23:56:27.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.437+0000 7f74b6670780 1 Processor -- start 2024-09-13T23:56:27.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.437+0000 7f74b6670780 1 -- start start 2024-09-13T23:56:27.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.437+0000 7f74b6670780 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56112403de60 0x5611240c08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:27.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.437+0000 7f74b6670780 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x561123f01b10 con 0x56112403de60 2024-09-13T23:56:27.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.437+0000 7f74b51a7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56112403de60 0x5611240c08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:27.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.437+0000 7f74b51a7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56112403de60 0x5611240c08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50032/0 (socket says 172.21.15.87:50032) 2024-09-13T23:56:27.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.437+0000 7f74b51a7700 1 -- 172.21.15.87:0/3028986225 learned_addr learned my addr 172.21.15.87:0/3028986225 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:27.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.437+0000 7f74b51a7700 1 -- 172.21.15.87:0/3028986225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a8005de0 con 0x56112403de60 2024-09-13T23:56:27.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.437+0000 7f74b51a7700 1 --2- 172.21.15.87:0/3028986225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56112403de60 0x5611240c08c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f74a8014040 tx=0x7f74a8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:27.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.441+0000 7f74a57fa700 1 -- 172.21.15.87:0/3028986225 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74a801c770 con 0x56112403de60 2024-09-13T23:56:27.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.441+0000 7f74a57fa700 1 -- 172.21.15.87:0/3028986225 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a801c8f0 con 0x56112403de60 2024-09-13T23:56:27.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.441+0000 7f74b6670780 1 -- 172.21.15.87:0/3028986225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561123ea7b00 con 0x56112403de60 2024-09-13T23:56:27.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.441+0000 7f74a57fa700 1 -- 172.21.15.87:0/3028986225 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74a801cbd0 con 0x56112403de60 2024-09-13T23:56:27.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.441+0000 7f74b6670780 1 -- 172.21.15.87:0/3028986225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561123e9af40 con 0x56112403de60 2024-09-13T23:56:27.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.441+0000 7f74a57fa700 1 -- 172.21.15.87:0/3028986225 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f74a8012400 con 0x56112403de60 2024-09-13T23:56:27.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.441+0000 7f74a57fa700 1 --2- 172.21.15.87:0/3028986225 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f7498033d70 0x7f7498036230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:27.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.441+0000 7f74a57fa700 1 -- 172.21.15.87:0/3028986225 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3471+0+0 (secure 0 0 0) 0x7f74a8048500 con 0x56112403de60 2024-09-13T23:56:27.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.441+0000 7f74b49a6700 1 --2- 172.21.15.87:0/3028986225 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f7498033d70 0x7f7498036230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:27.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.441+0000 7f74b6670780 1 -- 172.21.15.87:0/3028986225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) v1 -- 0x561123e9a9a0 con 0x56112403de60 2024-09-13T23:56:27.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:27.445+0000 7f74b49a6700 1 --2- 172.21.15.87:0/3028986225 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f7498033d70 0x7f7498036230 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f74ac000c00 tx=0x7f74ac0013b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:28.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:28.365+0000 7f74a57fa700 1 -- 172.21.15.87:0/3028986225 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 141+0+0 (secure 0 0 0) 0x7f74a8006380 con 0x56112403de60 2024-09-13T23:56:28.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:28.365+0000 7f74b6670780 1 -- 172.21.15.87:0/3028986225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x561123ec0dd0 con 0x56112403de60 2024-09-13T23:56:28.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:28.365+0000 7f74a57fa700 1 -- 172.21.15.87:0/3028986225 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74a801b390 con 0x56112403de60 2024-09-13T23:56:28.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:28.365+0000 7f74a77fe700 1 -- 172.21.15.87:0/3028986225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=15}) v3 -- 0x7f7490002ae0 con 0x56112403de60 2024-09-13T23:56:28.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:28.365+0000 7f74a57fa700 1 -- 172.21.15.87:0/3028986225 <== mon.0 v2:172.21.15.87:3300/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 650+0+0 (secure 0 0 0) 0x7f74a801cdc0 con 0x56112403de60 2024-09-13T23:56:28.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:28.365+0000 7f74b6670780 1 --2- 172.21.15.87:0/3028986225 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5611240d26c0 0x5611240e5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:28.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:28.365+0000 7f74b6670780 1 -- 172.21.15.87:0/3028986225 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) v8 -- 0x5611240e56c0 con 0x5611240d26c0 2024-09-13T23:56:28.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:28.365+0000 7f74b6409700 1 --2- 172.21.15.87:0/3028986225 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5611240d26c0 0x5611240e5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:28.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:28.369+0000 7f74b6409700 1 --2- 172.21.15.87:0/3028986225 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5611240d26c0 0x5611240e5180 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:28.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:28.377+0000 7f74b6409700 1 -- 172.21.15.87:0/3028986225 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(1 rbd_trash [create] v15'1 uv1 ondisk = 0) v8 ==== 153+0+0 (crc 0 0 0) 0x7f74b000a490 con 0x5611240d26c0 2024-09-13T23:56:28.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:28.377+0000 7f74b6670780 1 -- 172.21.15.87:0/3028986225 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x561124134f20 con 0x5611240d26c0 2024-09-13T23:56:28.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:28.381+0000 7f74b6409700 1 -- 172.21.15.87:0/3028986225 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74b000a490 con 0x5611240d26c0 2024-09-13T23:56:28.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:28.381+0000 7f74b6670780 1 -- 172.21.15.87:0/3028986225 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x561124134030 con 0x5611240d26c0 2024-09-13T23:56:28.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:28.381+0000 7f74b6409700 1 -- 172.21.15.87:0/3028986225 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74b000a490 con 0x5611240d26c0 2024-09-13T23:56:28.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:28.381+0000 7f74a6ffd700 1 -- 172.21.15.87:0/3028986225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) v4 -- 0x7f7494001f20 con 0x56112403de60 2024-09-13T23:56:29.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:29.369+0000 7f74a57fa700 1 -- 172.21.15.87:0/3028986225 <== mon.0 v2:172.21.15.87:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v16) v1 ==== 55+0+0 (secure 0 0 0) 0x7f74a802fb40 con 0x56112403de60 2024-09-13T23:56:29.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:29.369+0000 7f74a57fa700 1 -- 172.21.15.87:0/3028986225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=16}) v3 -- 0x7f7498039810 con 0x56112403de60 2024-09-13T23:56:29.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:29.369+0000 7f74a57fa700 1 -- 172.21.15.87:0/3028986225 <== mon.0 v2:172.21.15.87:3300/0 10 ==== osd_map(16..16 src has 1..16) v4 ==== 626+0+0 (secure 0 0 0) 0x7f74a80126b0 con 0x56112403de60 2024-09-13T23:56:29.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:29.369+0000 7f74a77fe700 1 -- 172.21.15.87:0/3028986225 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) v8 -- 0x7f7490005620 con 0x5611240d26c0 2024-09-13T23:56:29.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:29.373+0000 7f74b6409700 1 -- 172.21.15.87:0/3028986225 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v16'1 uv1 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f74b000a490 con 0x5611240d26c0 2024-09-13T23:56:29.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:29.373+0000 7f74a6ffd700 1 -- 172.21.15.87:0/3028986225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v16) v4 -- 0x7f74940033a0 con 0x56112403de60 2024-09-13T23:56:30.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.369+0000 7f74a57fa700 1 -- 172.21.15.87:0/3028986225 <== mon.0 v2:172.21.15.87:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v17) v1 ==== 43+0+0 (secure 0 0 0) 0x7f74a802fd20 con 0x56112403de60 2024-09-13T23:56:30.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.369+0000 7f74a57fa700 1 -- 172.21.15.87:0/3028986225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=17}) v3 -- 0x7f7498039a60 con 0x56112403de60 2024-09-13T23:56:30.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.369+0000 7f74a57fa700 1 -- 172.21.15.87:0/3028986225 <== mon.0 v2:172.21.15.87:3300/0 12 ==== osd_map(17..17 src has 1..17) v4 ==== 654+0+0 (secure 0 0 0) 0x7f74a802f350 con 0x56112403de60 2024-09-13T23:56:30.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.369+0000 7f74a77fe700 1 -- 172.21.15.87:0/3028986225 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) v8 -- 0x7f7490005a50 con 0x5611240d26c0 2024-09-13T23:56:30.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.381+0000 7f74b6409700 1 -- 172.21.15.87:0/3028986225 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(7 rbd_info [write 0~19] v17'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74b000a490 con 0x5611240d26c0 2024-09-13T23:56:30.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.381+0000 7f74b6670780 1 -- 172.21.15.87:0/3028986225 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5611240d26c0 msgr2=0x5611240e5180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:30.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.381+0000 7f74b6670780 1 --2- 172.21.15.87:0/3028986225 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5611240d26c0 0x5611240e5180 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:30.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.381+0000 7f74b6670780 1 -- 172.21.15.87:0/3028986225 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f7498033d70 msgr2=0x7f7498036230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:30.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.381+0000 7f74b6670780 1 --2- 172.21.15.87:0/3028986225 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f7498033d70 0x7f7498036230 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f74ac000c00 tx=0x7f74ac0013b0 comp rx=0 tx=0).stop 2024-09-13T23:56:30.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.381+0000 7f74b6670780 1 -- 172.21.15.87:0/3028986225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56112403de60 msgr2=0x5611240c08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:30.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.381+0000 7f74b6670780 1 --2- 172.21.15.87:0/3028986225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56112403de60 0x5611240c08c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f74a8014040 tx=0x7f74a8002fb0 comp rx=0 tx=0).stop 2024-09-13T23:56:30.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.381+0000 7f74b6670780 1 -- 172.21.15.87:0/3028986225 shutdown_connections 2024-09-13T23:56:30.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.381+0000 7f74b6670780 1 --2- 172.21.15.87:0/3028986225 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5611240d26c0 0x5611240e5180 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:30.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.381+0000 7f74b6670780 1 --2- 172.21.15.87:0/3028986225 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f7498033d70 0x7f7498036230 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:30.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.381+0000 7f74b6670780 1 --2- 172.21.15.87:0/3028986225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56112403de60 0x5611240c08c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:30.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.381+0000 7f74b6670780 1 -- 172.21.15.87:0/3028986225 >> 172.21.15.87:0/3028986225 conn(0x5611240423e0 msgr2=0x5611240d4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:30.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.381+0000 7f74b6670780 1 -- 172.21.15.87:0/3028986225 shutdown_connections 2024-09-13T23:56:30.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.381+0000 7f74b6670780 1 -- 172.21.15.87:0/3028986225 wait complete. 2024-09-13T23:56:30.395 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T23:56:30.395 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T23:56:30.395 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T23:56:30.395 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T23:56:30.396 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T23:56:30.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.505+0000 7f8cf3fff700 1 Processor -- start 2024-09-13T23:56:30.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.505+0000 7f8cf3fff700 1 -- start start 2024-09-13T23:56:30.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.505+0000 7f8cf3fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8cf406e870 0x7f8cf41323a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:30.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.505+0000 7f8cf3fff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf406f700 con 0x7f8cf412d0e0 2024-09-13T23:56:30.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.505+0000 7f8cf3fff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf4071390 con 0x7f8cf406e870 2024-09-13T23:56:30.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.505+0000 7f8cf27fc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8cf406e870 0x7f8cf41323a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:30.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.505+0000 7f8cf2ffd700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8cf412d0e0 0x7f8cf412d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45262/0 (socket says 172.21.15.87:45262) 2024-09-13T23:56:30.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.505+0000 7f8cf27fc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8cf406e870 0x7f8cf41323a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39944/0 (socket says 172.21.15.87:39944) 2024-09-13T23:56:30.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.505+0000 7f8cf2ffd700 1 -- 172.21.15.87:0/3759129851 learned_addr learned my addr 172.21.15.87:0/3759129851 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T23:56:30.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.505+0000 7f8cf27fc700 1 -- 172.21.15.87:0/3759129851 >> v1:172.21.15.87:6789/0 conn(0x7f8cf412d0e0 legacy=0x7f8cf412d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:30.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.505+0000 7f8cf27fc700 1 -- 172.21.15.87:0/3759129851 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf4071080 con 0x7f8cf406e870 2024-09-13T23:56:30.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.505+0000 7f8cf27fc700 1 --2- 172.21.15.87:0/3759129851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cf406e870 0x7f8cf41323a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009dc0 tx=0x7f8cec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70c435c10074bba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:30.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.505+0000 7f8cf1ffb700 1 -- 172.21.15.87:0/3759129851 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8cec00e070 con 0x7f8cf406e870 2024-09-13T23:56:30.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.505+0000 7f8cf1ffb700 1 -- 172.21.15.87:0/3759129851 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec00bc40 con 0x7f8cf406e870 2024-09-13T23:56:30.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.505+0000 7f8cf1ffb700 1 -- 172.21.15.87:0/3759129851 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8cec003a40 con 0x7f8cf406e870 2024-09-13T23:56:30.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.505+0000 7f8cf3fff700 1 -- 172.21.15.87:0/3759129851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cf406e870 msgr2=0x7f8cf41323a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:30.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.505+0000 7f8cf3fff700 1 --2- 172.21.15.87:0/3759129851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cf406e870 0x7f8cf41323a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009dc0 tx=0x7f8cec00b330 comp rx=0 tx=0).stop 2024-09-13T23:56:30.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.505+0000 7f8cf3fff700 1 -- 172.21.15.87:0/3759129851 shutdown_connections 2024-09-13T23:56:30.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.505+0000 7f8cf3fff700 1 --2- 172.21.15.87:0/3759129851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cf406e870 0x7f8cf41323a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:30.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.505+0000 7f8cf3fff700 1 -- 172.21.15.87:0/3759129851 >> 172.21.15.87:0/3759129851 conn(0x7f8cf409cd60 msgr2=0x7f8cf406c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:30.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.505+0000 7f8cf3fff700 1 -- 172.21.15.87:0/3759129851 shutdown_connections 2024-09-13T23:56:30.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.509+0000 7f8cf3fff700 1 -- 172.21.15.87:0/3759129851 wait complete. 2024-09-13T23:56:30.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.509+0000 7f8cf3fff700 1 Processor -- start 2024-09-13T23:56:30.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.509+0000 7f8cf3fff700 1 -- start start 2024-09-13T23:56:30.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.509+0000 7f8cf3fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cf406e870 0x7f8cf412b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:30.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.509+0000 7f8cf3fff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf411f130 con 0x7f8cf406e870 2024-09-13T23:56:30.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.509+0000 7f8cf2ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cf406e870 0x7f8cf412b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:30.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.509+0000 7f8cf2ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cf406e870 0x7f8cf412b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39948/0 (socket says 172.21.15.87:39948) 2024-09-13T23:56:30.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.509+0000 7f8cf2ffd700 1 -- 172.21.15.87:0/4184554410 learned_addr learned my addr 172.21.15.87:0/4184554410 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:30.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.509+0000 7f8cf2ffd700 1 -- 172.21.15.87:0/4184554410 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec009a70 con 0x7f8cf406e870 2024-09-13T23:56:30.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.509+0000 7f8cf2ffd700 1 --2- 172.21.15.87:0/4184554410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cf406e870 0x7f8cf412b660 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc00c480 tx=0x7f8cdc00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:30.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.513+0000 7f8ceb7fe700 1 -- 172.21.15.87:0/4184554410 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8cdc005cc0 con 0x7f8cf406e870 2024-09-13T23:56:30.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.513+0000 7f8ceb7fe700 1 -- 172.21.15.87:0/4184554410 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc005e20 con 0x7f8cf406e870 2024-09-13T23:56:30.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.513+0000 7f8cf3fff700 1 -- 172.21.15.87:0/4184554410 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf411d7e0 con 0x7f8cf406e870 2024-09-13T23:56:30.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.513+0000 7f8ceb7fe700 1 -- 172.21.15.87:0/4184554410 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8cdc0049c0 con 0x7f8cf406e870 2024-09-13T23:56:30.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.513+0000 7f8cf3fff700 1 -- 172.21.15.87:0/4184554410 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf411e650 con 0x7f8cf406e870 2024-09-13T23:56:30.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.513+0000 7f8ceb7fe700 1 -- 172.21.15.87:0/4184554410 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f8cdc004c30 con 0x7f8cf406e870 2024-09-13T23:56:30.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.513+0000 7f8ceb7fe700 1 --2- 172.21.15.87:0/4184554410 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f8cd40354f0 0x7f8cd40379b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:30.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.513+0000 7f8cf3fff700 1 -- 172.21.15.87:0/4184554410 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf411ef80 con 0x7f8cf406e870 2024-09-13T23:56:30.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.513+0000 7f8ceb7fe700 1 -- 172.21.15.87:0/4184554410 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3538+0+0 (secure 0 0 0) 0x7f8cdc046f80 con 0x7f8cf406e870 2024-09-13T23:56:30.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.513+0000 7f8cf27fc700 1 --2- 172.21.15.87:0/4184554410 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f8cd40354f0 0x7f8cd40379b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:30.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.513+0000 7f8cf27fc700 1 --2- 172.21.15.87:0/4184554410 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f8cd40354f0 0x7f8cd40379b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8cf406ecc0 tx=0x7f8cec011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:30.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.521+0000 7f8ceb7fe700 1 -- 172.21.15.87:0/4184554410 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8cdc01f120 con 0x7f8cf406e870 2024-09-13T23:56:30.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.733+0000 7f8cf3fff700 1 -- 172.21.15.87:0/4184554410 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8cf411dfb0 con 0x7f8cf406e870 2024-09-13T23:56:30.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.737+0000 7f8ceb7fe700 1 -- 172.21.15.87:0/4184554410 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+83118 (secure 0 0 0) 0x7f8cdc01f120 con 0x7f8cf406e870 2024-09-13T23:56:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:56:30.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.741+0000 7f8cf3fff700 1 -- 172.21.15.87:0/4184554410 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f8cd40354f0 msgr2=0x7f8cd40379b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:30.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.741+0000 7f8cf3fff700 1 --2- 172.21.15.87:0/4184554410 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f8cd40354f0 0x7f8cd40379b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8cf406ecc0 tx=0x7f8cec011000 comp rx=0 tx=0).stop 2024-09-13T23:56:30.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.741+0000 7f8cf3fff700 1 -- 172.21.15.87:0/4184554410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cf406e870 msgr2=0x7f8cf412b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:30.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.741+0000 7f8cf3fff700 1 --2- 172.21.15.87:0/4184554410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cf406e870 0x7f8cf412b660 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc00c480 tx=0x7f8cdc00c840 comp rx=0 tx=0).stop 2024-09-13T23:56:30.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.741+0000 7f8cf3fff700 1 -- 172.21.15.87:0/4184554410 shutdown_connections 2024-09-13T23:56:30.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.741+0000 7f8cf3fff700 1 --2- 172.21.15.87:0/4184554410 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f8cd40354f0 0x7f8cd40379b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:30.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.741+0000 7f8cf3fff700 1 --2- 172.21.15.87:0/4184554410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cf406e870 0x7f8cf412b660 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:30.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.741+0000 7f8cf3fff700 1 -- 172.21.15.87:0/4184554410 >> 172.21.15.87:0/4184554410 conn(0x7f8cf409cd60 msgr2=0x7f8cf4130f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:30.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.741+0000 7f8cf3fff700 1 -- 172.21.15.87:0/4184554410 shutdown_connections 2024-09-13T23:56:30.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.741+0000 7f8cf3fff700 1 -- 172.21.15.87:0/4184554410 wait complete. 2024-09-13T23:56:30.762 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":884576791},{"type":"v1","addr":"172.21.15.173:6825","nonce":884576791}]},"active_addr":"172.21.15.173:6825/884576791","active_change":"2024-09-13T23:56:16.904766+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":279770692}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":2807356642}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":2146735093}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":1753820513}]}]} 2024-09-13T23:56:30.764 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T23:56:30.764 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T23:56:30.764 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T23:56:30.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.869+0000 7f8050f8b700 1 Processor -- start 2024-09-13T23:56:30.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.869+0000 7f8050f8b700 1 -- start start 2024-09-13T23:56:30.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.873+0000 7f8050f8b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f804c12abb0 0x7f804c12fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:30.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.873+0000 7f8050f8b700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f804c09af10 con 0x7f804c111d80 2024-09-13T23:56:30.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.873+0000 7f8050f8b700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f804c06fb90 con 0x7f804c12abb0 2024-09-13T23:56:30.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.873+0000 7f8043fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f804c12abb0 0x7f804c12fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:30.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.873+0000 7f804b7fe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f804c111d80 0x7f804c12b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45272/0 (socket says 172.21.15.87:45272) 2024-09-13T23:56:30.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.873+0000 7f804b7fe700 1 -- 172.21.15.87:0/1706179830 learned_addr learned my addr 172.21.15.87:0/1706179830 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T23:56:30.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.873+0000 7f8043fff700 1 -- 172.21.15.87:0/1706179830 >> v1:172.21.15.87:6789/0 conn(0x7f804c111d80 legacy=0x7f804c12b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:30.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.873+0000 7f804affd700 1 -- 172.21.15.87:0/1706179830 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2522594780 0 0) 0x7f804c09af10 con 0x7f804c111d80 2024-09-13T23:56:30.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.873+0000 7f8043fff700 1 -- 172.21.15.87:0/1706179830 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c112450 con 0x7f804c12abb0 2024-09-13T23:56:30.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.873+0000 7f8043fff700 1 --2- 172.21.15.87:0/1706179830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f804c12abb0 0x7f804c12fe30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f80340097d0 tx=0x7f8034009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=febf62cf92e6d792 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:30.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.873+0000 7f804affd700 1 -- 172.21.15.87:0/1706179830 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80340041c0 con 0x7f804c12abb0 2024-09-13T23:56:30.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.873+0000 7f804affd700 1 -- 172.21.15.87:0/1706179830 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8034004320 con 0x7f804c12abb0 2024-09-13T23:56:30.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.873+0000 7f804affd700 1 -- 172.21.15.87:0/1706179830 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80340036c0 con 0x7f804c12abb0 2024-09-13T23:56:30.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.873+0000 7f8050f8b700 1 -- 172.21.15.87:0/1706179830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f804c12abb0 msgr2=0x7f804c12fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:30.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.873+0000 7f8050f8b700 1 --2- 172.21.15.87:0/1706179830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f804c12abb0 0x7f804c12fe30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f80340097d0 tx=0x7f8034009ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:30.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.873+0000 7f8050f8b700 1 -- 172.21.15.87:0/1706179830 shutdown_connections 2024-09-13T23:56:30.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.873+0000 7f8050f8b700 1 --2- 172.21.15.87:0/1706179830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f804c12abb0 0x7f804c12fe30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:30.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.873+0000 7f8050f8b700 1 -- 172.21.15.87:0/1706179830 >> 172.21.15.87:0/1706179830 conn(0x7f804c0991a0 msgr2=0x7f804c0995b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:30.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.873+0000 7f8050f8b700 1 -- 172.21.15.87:0/1706179830 shutdown_connections 2024-09-13T23:56:30.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.873+0000 7f8050f8b700 1 -- 172.21.15.87:0/1706179830 wait complete. 2024-09-13T23:56:30.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.873+0000 7f8050f8b700 1 Processor -- start 2024-09-13T23:56:30.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.877+0000 7f8050f8b700 1 -- start start 2024-09-13T23:56:30.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.877+0000 7f8050f8b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f804c111d80 0x7f804c12d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:30.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.877+0000 7f8050f8b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c114260 con 0x7f804c111d80 2024-09-13T23:56:30.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.877+0000 7f804b7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f804c111d80 0x7f804c12d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:30.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.877+0000 7f804b7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f804c111d80 0x7f804c12d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39968/0 (socket says 172.21.15.87:39968) 2024-09-13T23:56:30.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.877+0000 7f804b7fe700 1 -- 172.21.15.87:0/3942215601 learned_addr learned my addr 172.21.15.87:0/3942215601 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:30.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.877+0000 7f804b7fe700 1 -- 172.21.15.87:0/3942215601 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80340094b0 con 0x7f804c111d80 2024-09-13T23:56:30.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.877+0000 7f804b7fe700 1 --2- 172.21.15.87:0/3942215601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f804c111d80 0x7f804c12d9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f803c00c4a0 tx=0x7f803c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:30.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.877+0000 7f8048ff9700 1 -- 172.21.15.87:0/3942215601 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f803c004bd0 con 0x7f804c111d80 2024-09-13T23:56:30.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.877+0000 7f8048ff9700 1 -- 172.21.15.87:0/3942215601 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803c004d70 con 0x7f804c111d80 2024-09-13T23:56:30.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.877+0000 7f8050f8b700 1 -- 172.21.15.87:0/3942215601 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804c112cf0 con 0x7f804c111d80 2024-09-13T23:56:30.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.877+0000 7f8048ff9700 1 -- 172.21.15.87:0/3942215601 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f803c007240 con 0x7f804c111d80 2024-09-13T23:56:30.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.877+0000 7f8050f8b700 1 -- 172.21.15.87:0/3942215601 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f804c113110 con 0x7f804c111d80 2024-09-13T23:56:30.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.877+0000 7f8048ff9700 1 -- 172.21.15.87:0/3942215601 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f803c0074c0 con 0x7f804c111d80 2024-09-13T23:56:30.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.877+0000 7f8048ff9700 1 --2- 172.21.15.87:0/3942215601 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f802c0354a0 0x7f802c037960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:30.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.877+0000 7f8048ff9700 1 -- 172.21.15.87:0/3942215601 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3538+0+0 (secure 0 0 0) 0x7f803c047370 con 0x7f804c111d80 2024-09-13T23:56:30.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.877+0000 7f8050f8b700 1 -- 172.21.15.87:0/3942215601 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f804c12b130 con 0x7f804c111d80 2024-09-13T23:56:30.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.881+0000 7f8043fff700 1 --2- 172.21.15.87:0/3942215601 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f802c0354a0 0x7f802c037960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:30.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.881+0000 7f8043fff700 1 --2- 172.21.15.87:0/3942215601 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f802c0354a0 0x7f802c037960 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8034014040 tx=0x7f8034010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:30.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:30.885+0000 7f8048ff9700 1 -- 172.21.15.87:0/3942215601 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f803c0123b0 con 0x7f804c111d80 2024-09-13T23:56:31.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.057+0000 7f8050f8b700 1 -- 172.21.15.87:0/3942215601 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f804c113c70 con 0x7f804c111d80 2024-09-13T23:56:31.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.057+0000 7f8048ff9700 1 -- 172.21.15.87:0/3942215601 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+9783 (secure 0 0 0) 0x7f803c03a070 con 0x7f804c111d80 2024-09-13T23:56:31.067 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:56:31.067 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":17,"fsid":"0b890e8e-a4ce-4e8b-9529-48a86f947d30","created":"2024-09-13T23:56:11.607628+0000","modified":"2024-09-13T23:56:30.369560+0000","last_up_change":"2024-09-13T23:56:21.244126+0000","last_in_change":"2024-09-13T23:56:12.698218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T23:56:22.979454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T23:56:27.309352+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ddf6b11-fbca-4310-8745-88ed2a341ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3507919120},{"type":"v1","addr":"172.21.15.87:6801","nonce":3507919120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3507919120},{"type":"v1","addr":"172.21.15.87:6803","nonce":3507919120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3507919120},{"type":"v1","addr":"172.21.15.87:6807","nonce":3507919120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3507919120},{"type":"v1","addr":"172.21.15.87:6805","nonce":3507919120}]},"public_addr":"172.21.15.87:6801/3507919120","cluster_addr":"172.21.15.87:6803/3507919120","heartbeat_back_addr":"172.21.15.87:6807/3507919120","heartbeat_front_addr":"172.21.15.87:6805/3507919120","state":["exists","up"]},{"osd":1,"uuid":"2a5386ff-fe63-40b4-8671-bc161b4d65fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":3256211813},{"type":"v1","addr":"172.21.15.173:6810","nonce":3256211813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3256211813},{"type":"v1","addr":"172.21.15.173:6813","nonce":3256211813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3256211813},{"type":"v1","addr":"172.21.15.173:6820","nonce":3256211813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6815","nonce":3256211813},{"type":"v1","addr":"172.21.15.173:6816","nonce":3256211813}]},"public_addr":"172.21.15.173:6810/3256211813","cluster_addr":"172.21.15.173:6813/3256211813","heartbeat_back_addr":"172.21.15.173:6820/3256211813","heartbeat_front_addr":"172.21.15.173:6816/3256211813","state":["exists","up"]},{"osd":2,"uuid":"dceb34f9-5dfa-4065-8842-aee85a133580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6809","nonce":889985573},{"type":"v1","addr":"172.21.15.173:6812","nonce":889985573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":889985573},{"type":"v1","addr":"172.21.15.173:6817","nonce":889985573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":889985573},{"type":"v1","addr":"172.21.15.173:6823","nonce":889985573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6819","nonce":889985573},{"type":"v1","addr":"172.21.15.173:6821","nonce":889985573}]},"public_addr":"172.21.15.173:6812/889985573","cluster_addr":"172.21.15.173:6817/889985573","heartbeat_back_addr":"172.21.15.173:6823/889985573","heartbeat_front_addr":"172.21.15.173:6821/889985573","state":["exists","up"]},{"osd":3,"uuid":"1b757f70-683f-43a8-863d-5bcb9a416247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4020038786},{"type":"v1","addr":"172.21.15.173:6801","nonce":4020038786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4020038786},{"type":"v1","addr":"172.21.15.173:6803","nonce":4020038786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4020038786},{"type":"v1","addr":"172.21.15.173:6807","nonce":4020038786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4020038786},{"type":"v1","addr":"172.21.15.173:6805","nonce":4020038786}]},"public_addr":"172.21.15.173:6801/4020038786","cluster_addr":"172.21.15.173:6803/4020038786","heartbeat_back_addr":"172.21.15.173:6807/4020038786","heartbeat_front_addr":"172.21.15.173:6805/4020038786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:56:18.058043+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:56:18.173198+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:56:17.904714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:56:17.983811+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T23:56:31.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.061+0000 7f8050f8b700 1 -- 172.21.15.87:0/3942215601 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f802c0354a0 msgr2=0x7f802c037960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.061+0000 7f8050f8b700 1 --2- 172.21.15.87:0/3942215601 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f802c0354a0 0x7f802c037960 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8034014040 tx=0x7f8034010000 comp rx=0 tx=0).stop 2024-09-13T23:56:31.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.061+0000 7f8050f8b700 1 -- 172.21.15.87:0/3942215601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f804c111d80 msgr2=0x7f804c12d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.061+0000 7f8050f8b700 1 --2- 172.21.15.87:0/3942215601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f804c111d80 0x7f804c12d9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f803c00c4a0 tx=0x7f803c00c860 comp rx=0 tx=0).stop 2024-09-13T23:56:31.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.061+0000 7f8050f8b700 1 -- 172.21.15.87:0/3942215601 shutdown_connections 2024-09-13T23:56:31.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.061+0000 7f8050f8b700 1 --2- 172.21.15.87:0/3942215601 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f802c0354a0 0x7f802c037960 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.061+0000 7f8050f8b700 1 --2- 172.21.15.87:0/3942215601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f804c111d80 0x7f804c12d9c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.061+0000 7f8050f8b700 1 -- 172.21.15.87:0/3942215601 >> 172.21.15.87:0/3942215601 conn(0x7f804c0991a0 msgr2=0x7f804c06e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:31.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.061+0000 7f8050f8b700 1 -- 172.21.15.87:0/3942215601 shutdown_connections 2024-09-13T23:56:31.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.061+0000 7f8050f8b700 1 -- 172.21.15.87:0/3942215601 wait complete. 2024-09-13T23:56:31.081 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T23:56:31.082 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T23:56:31.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.181+0000 7f6cce33c700 1 Processor -- start 2024-09-13T23:56:31.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.181+0000 7f6cce33c700 1 -- start start 2024-09-13T23:56:31.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.181+0000 7f6cce33c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6cc812ad60 0x7f6cc812fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.181+0000 7f6cce33c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc806c230 con 0x7f6cc806f920 2024-09-13T23:56:31.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.181+0000 7f6cce33c700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc8111d80 con 0x7f6cc812ad60 2024-09-13T23:56:31.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.181+0000 7f6cccb39700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6cc812ad60 0x7f6cc812fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.181+0000 7f6cccb39700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6cc812ad60 0x7f6cc812fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39976/0 (socket says 172.21.15.87:39976) 2024-09-13T23:56:31.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.181+0000 7f6cccb39700 1 -- 172.21.15.87:0/70852854 learned_addr learned my addr 172.21.15.87:0/70852854 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:31.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.181+0000 7f6ccd33a700 1 --1- 172.21.15.87:0/70852854 >> v1:172.21.15.87:6789/0 conn(0x7f6cc806f920 0x7f6cc812b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45278/0 (socket says 172.21.15.87:45278) 2024-09-13T23:56:31.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.181+0000 7f6cccb39700 1 -- 172.21.15.87:0/70852854 >> v1:172.21.15.87:6789/0 conn(0x7f6cc806f920 legacy=0x7f6cc812b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.181+0000 7f6cccb39700 1 -- 172.21.15.87:0/70852854 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc812b920 con 0x7f6cc812ad60 2024-09-13T23:56:31.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.181+0000 7f6cccb39700 1 --2- 172.21.15.87:0/70852854 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cc812ad60 0x7f6cc812fe70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009890 tx=0x7f6cc4009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f37d0bbb61afda server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.181+0000 7f6cbffff700 1 -- 172.21.15.87:0/70852854 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6cc4004160 con 0x7f6cc812ad60 2024-09-13T23:56:31.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.181+0000 7f6cbffff700 1 -- 172.21.15.87:0/70852854 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc40042c0 con 0x7f6cc812ad60 2024-09-13T23:56:31.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.181+0000 7f6cbffff700 1 -- 172.21.15.87:0/70852854 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6cc4004580 con 0x7f6cc812ad60 2024-09-13T23:56:31.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.181+0000 7f6cce33c700 1 -- 172.21.15.87:0/70852854 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cc812ad60 msgr2=0x7f6cc812fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.181+0000 7f6cce33c700 1 --2- 172.21.15.87:0/70852854 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cc812ad60 0x7f6cc812fe70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009890 tx=0x7f6cc4009ba0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.185+0000 7f6cce33c700 1 -- 172.21.15.87:0/70852854 shutdown_connections 2024-09-13T23:56:31.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.185+0000 7f6cce33c700 1 --2- 172.21.15.87:0/70852854 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cc812ad60 0x7f6cc812fe70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.185+0000 7f6cce33c700 1 -- 172.21.15.87:0/70852854 >> 172.21.15.87:0/70852854 conn(0x7f6cc80991a0 msgr2=0x7f6cc80995b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:31.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.185+0000 7f6cce33c700 1 -- 172.21.15.87:0/70852854 shutdown_connections 2024-09-13T23:56:31.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.185+0000 7f6cce33c700 1 -- 172.21.15.87:0/70852854 wait complete. 2024-09-13T23:56:31.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.185+0000 7f6cce33c700 1 Processor -- start 2024-09-13T23:56:31.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.185+0000 7f6cce33c700 1 -- start start 2024-09-13T23:56:31.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.185+0000 7f6cce33c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cc806f920 0x7f6cc812dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.185+0000 7f6cce33c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc80701b0 con 0x7f6cc806f920 2024-09-13T23:56:31.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.185+0000 7f6ccd33a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cc806f920 0x7f6cc812dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.185+0000 7f6ccd33a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cc806f920 0x7f6cc812dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39978/0 (socket says 172.21.15.87:39978) 2024-09-13T23:56:31.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.185+0000 7f6ccd33a700 1 -- 172.21.15.87:0/40919075 learned_addr learned my addr 172.21.15.87:0/40919075 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:31.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.185+0000 7f6ccd33a700 1 -- 172.21.15.87:0/40919075 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc4009570 con 0x7f6cc806f920 2024-09-13T23:56:31.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.185+0000 7f6ccd33a700 1 --2- 172.21.15.87:0/40919075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cc806f920 0x7f6cc812dc70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800c480 tx=0x7f6cb800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.185+0000 7f6cbdffb700 1 -- 172.21.15.87:0/40919075 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6cb8005c00 con 0x7f6cc806f920 2024-09-13T23:56:31.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.185+0000 7f6cbdffb700 1 -- 172.21.15.87:0/40919075 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb8005d60 con 0x7f6cc806f920 2024-09-13T23:56:31.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.185+0000 7f6cce33c700 1 -- 172.21.15.87:0/40919075 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc8112660 con 0x7f6cc806f920 2024-09-13T23:56:31.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.185+0000 7f6cbdffb700 1 -- 172.21.15.87:0/40919075 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6cb80070d0 con 0x7f6cc806f920 2024-09-13T23:56:31.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.185+0000 7f6cce33c700 1 -- 172.21.15.87:0/40919075 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc8070790 con 0x7f6cc806f920 2024-09-13T23:56:31.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.189+0000 7f6cce33c700 1 -- 172.21.15.87:0/40919075 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc8071760 con 0x7f6cc806f920 2024-09-13T23:56:31.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.189+0000 7f6cbdffb700 1 -- 172.21.15.87:0/40919075 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f6cb8007230 con 0x7f6cc806f920 2024-09-13T23:56:31.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.189+0000 7f6cbdffb700 1 --2- 172.21.15.87:0/40919075 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f6cac0354f0 0x7f6cac0379b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.189+0000 7f6cbdffb700 1 -- 172.21.15.87:0/40919075 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3538+0+0 (secure 0 0 0) 0x7f6cb8046ab0 con 0x7f6cc806f920 2024-09-13T23:56:31.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.189+0000 7f6cccb39700 1 --2- 172.21.15.87:0/40919075 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f6cac0354f0 0x7f6cac0379b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.189+0000 7f6cccb39700 1 --2- 172.21.15.87:0/40919075 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f6cac0354f0 0x7f6cac0379b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8128630 tx=0x7f6cc4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.197+0000 7f6cbdffb700 1 -- 172.21.15.87:0/40919075 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6cb80113a0 con 0x7f6cc806f920 2024-09-13T23:56:31.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.357+0000 7f6cce33c700 1 -- 172.21.15.87:0/40919075 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6cc812b210 con 0x7f6cc806f920 2024-09-13T23:56:31.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.357+0000 7f6cbdffb700 1 -- 172.21.15.87:0/40919075 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+9783 (secure 0 0 0) 0x7f6cb8017030 con 0x7f6cc806f920 2024-09-13T23:56:31.366 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:56:31.366 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":17,"fsid":"0b890e8e-a4ce-4e8b-9529-48a86f947d30","created":"2024-09-13T23:56:11.607628+0000","modified":"2024-09-13T23:56:30.369560+0000","last_up_change":"2024-09-13T23:56:21.244126+0000","last_in_change":"2024-09-13T23:56:12.698218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T23:56:22.979454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T23:56:27.309352+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ddf6b11-fbca-4310-8745-88ed2a341ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3507919120},{"type":"v1","addr":"172.21.15.87:6801","nonce":3507919120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3507919120},{"type":"v1","addr":"172.21.15.87:6803","nonce":3507919120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3507919120},{"type":"v1","addr":"172.21.15.87:6807","nonce":3507919120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3507919120},{"type":"v1","addr":"172.21.15.87:6805","nonce":3507919120}]},"public_addr":"172.21.15.87:6801/3507919120","cluster_addr":"172.21.15.87:6803/3507919120","heartbeat_back_addr":"172.21.15.87:6807/3507919120","heartbeat_front_addr":"172.21.15.87:6805/3507919120","state":["exists","up"]},{"osd":1,"uuid":"2a5386ff-fe63-40b4-8671-bc161b4d65fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":3256211813},{"type":"v1","addr":"172.21.15.173:6810","nonce":3256211813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":3256211813},{"type":"v1","addr":"172.21.15.173:6813","nonce":3256211813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3256211813},{"type":"v1","addr":"172.21.15.173:6820","nonce":3256211813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6815","nonce":3256211813},{"type":"v1","addr":"172.21.15.173:6816","nonce":3256211813}]},"public_addr":"172.21.15.173:6810/3256211813","cluster_addr":"172.21.15.173:6813/3256211813","heartbeat_back_addr":"172.21.15.173:6820/3256211813","heartbeat_front_addr":"172.21.15.173:6816/3256211813","state":["exists","up"]},{"osd":2,"uuid":"dceb34f9-5dfa-4065-8842-aee85a133580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6809","nonce":889985573},{"type":"v1","addr":"172.21.15.173:6812","nonce":889985573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":889985573},{"type":"v1","addr":"172.21.15.173:6817","nonce":889985573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":889985573},{"type":"v1","addr":"172.21.15.173:6823","nonce":889985573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6819","nonce":889985573},{"type":"v1","addr":"172.21.15.173:6821","nonce":889985573}]},"public_addr":"172.21.15.173:6812/889985573","cluster_addr":"172.21.15.173:6817/889985573","heartbeat_back_addr":"172.21.15.173:6823/889985573","heartbeat_front_addr":"172.21.15.173:6821/889985573","state":["exists","up"]},{"osd":3,"uuid":"1b757f70-683f-43a8-863d-5bcb9a416247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4020038786},{"type":"v1","addr":"172.21.15.173:6801","nonce":4020038786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4020038786},{"type":"v1","addr":"172.21.15.173:6803","nonce":4020038786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4020038786},{"type":"v1","addr":"172.21.15.173:6807","nonce":4020038786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4020038786},{"type":"v1","addr":"172.21.15.173:6805","nonce":4020038786}]},"public_addr":"172.21.15.173:6801/4020038786","cluster_addr":"172.21.15.173:6803/4020038786","heartbeat_back_addr":"172.21.15.173:6807/4020038786","heartbeat_front_addr":"172.21.15.173:6805/4020038786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:56:18.058043+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:56:18.173198+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:56:17.904714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:56:17.983811+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T23:56:31.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.361+0000 7f6cce33c700 1 -- 172.21.15.87:0/40919075 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f6cac0354f0 msgr2=0x7f6cac0379b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.361+0000 7f6cce33c700 1 --2- 172.21.15.87:0/40919075 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f6cac0354f0 0x7f6cac0379b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8128630 tx=0x7f6cc4008030 comp rx=0 tx=0).stop 2024-09-13T23:56:31.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.361+0000 7f6cce33c700 1 -- 172.21.15.87:0/40919075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cc806f920 msgr2=0x7f6cc812dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.361+0000 7f6cce33c700 1 --2- 172.21.15.87:0/40919075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cc806f920 0x7f6cc812dc70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800c480 tx=0x7f6cb800c840 comp rx=0 tx=0).stop 2024-09-13T23:56:31.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.361+0000 7f6cce33c700 1 -- 172.21.15.87:0/40919075 shutdown_connections 2024-09-13T23:56:31.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.361+0000 7f6cce33c700 1 --2- 172.21.15.87:0/40919075 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f6cac0354f0 0x7f6cac0379b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.361+0000 7f6cce33c700 1 --2- 172.21.15.87:0/40919075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cc806f920 0x7f6cc812dc70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.361+0000 7f6cce33c700 1 -- 172.21.15.87:0/40919075 >> 172.21.15.87:0/40919075 conn(0x7f6cc80991a0 msgr2=0x7f6cc8129610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:31.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.361+0000 7f6cce33c700 1 -- 172.21.15.87:0/40919075 shutdown_connections 2024-09-13T23:56:31.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.361+0000 7f6cce33c700 1 -- 172.21.15.87:0/40919075 wait complete. 2024-09-13T23:56:31.379 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T23:56:31.379 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T23:56:31.380 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T23:56:31.380 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T23:56:31.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7f8a8489c700 1 Processor -- start 2024-09-13T23:56:31.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7f8a8489c700 1 -- start start 2024-09-13T23:56:31.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7efc6d3a0700 1 Processor -- start 2024-09-13T23:56:31.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7efc6d3a0700 1 -- start start 2024-09-13T23:56:31.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7f8a8489c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8a8012a0b0 0x7f8a8012a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7f8a8489c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a80099500 con 0x7f8a8012ad70 2024-09-13T23:56:31.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7f8a8489c700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a80098c50 con 0x7f8a8012a0b0 2024-09-13T23:56:31.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7efc6d3a0700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efc6806ed90 0x7efc6812f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7efc6d3a0700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc6806ff60 con 0x7efc6806e2a0 2024-09-13T23:56:31.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7efc6d3a0700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc68071490 con 0x7efc6806ed90 2024-09-13T23:56:31.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7f8a7f7fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8a8012a0b0 0x7f8a8012a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7f8a77fff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8a8012ad70 0x7f8a8012b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45288/0 (socket says 172.21.15.87:45288) 2024-09-13T23:56:31.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7f8a77fff700 1 -- 172.21.15.87:0/317815986 learned_addr learned my addr 172.21.15.87:0/317815986 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T23:56:31.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7efc67fff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7efc6806e2a0 0x7efc6806e680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45298/0 (socket says 172.21.15.87:45298) 2024-09-13T23:56:31.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7efc67fff700 1 -- 172.21.15.87:0/3620412906 learned_addr learned my addr 172.21.15.87:0/3620412906 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T23:56:31.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7efc677fe700 1 --2- 172.21.15.87:0/3620412906 >> v2:172.21.15.87:3300/0 conn(0x7efc6806ed90 0x7efc6812f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7f8a7f7fe700 1 -- 172.21.15.87:0/317815986 >> v1:172.21.15.87:6789/0 conn(0x7f8a8012ad70 legacy=0x7f8a8012b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7f8a7f7fe700 1 -- 172.21.15.87:0/317815986 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8009ccb0 con 0x7f8a8012a0b0 2024-09-13T23:56:31.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7efc66ffd700 1 -- 172.21.15.87:0/3620412906 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 384282743 0 0) 0x7efc6806ff60 con 0x7efc6806e2a0 2024-09-13T23:56:31.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7efc66ffd700 1 -- 172.21.15.87:0/3620412906 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc500057e0 con 0x7efc6806e2a0 2024-09-13T23:56:31.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7f8a7f7fe700 1 --2- 172.21.15.87:0/317815986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a8012a0b0 0x7f8a8012a490 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8a700097d0 tx=0x7f8a70009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdecf02da567c74e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7efc677fe700 1 -- 172.21.15.87:0/3620412906 >> v1:172.21.15.87:6789/0 conn(0x7efc6806e2a0 legacy=0x7efc6806e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7efc677fe700 1 -- 172.21.15.87:0/3620412906 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc68099c90 con 0x7efc6806ed90 2024-09-13T23:56:31.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7f8a7effd700 1 -- 172.21.15.87:0/317815986 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a700041c0 con 0x7f8a8012a0b0 2024-09-13T23:56:31.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7efc677fe700 1 --2- 172.21.15.87:0/3620412906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc6806ed90 0x7efc6812f010 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efc5c0097d0 tx=0x7efc5c009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbdd61b236ffb50e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.465+0000 7f8a7effd700 1 -- 172.21.15.87:0/317815986 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a70004320 con 0x7f8a8012a0b0 2024-09-13T23:56:31.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7f8a7effd700 1 -- 172.21.15.87:0/317815986 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a700036c0 con 0x7f8a8012a0b0 2024-09-13T23:56:31.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7efc66ffd700 1 -- 172.21.15.87:0/3620412906 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc5c004160 con 0x7efc6806ed90 2024-09-13T23:56:31.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7efc66ffd700 1 -- 172.21.15.87:0/3620412906 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5c0042c0 con 0x7efc6806ed90 2024-09-13T23:56:31.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7efc66ffd700 1 -- 172.21.15.87:0/3620412906 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc5c0045a0 con 0x7efc6806ed90 2024-09-13T23:56:31.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7f8a8489c700 1 -- 172.21.15.87:0/317815986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a8012a0b0 msgr2=0x7f8a8012a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7f8a8489c700 1 --2- 172.21.15.87:0/317815986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a8012a0b0 0x7f8a8012a490 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8a700097d0 tx=0x7f8a70009ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7f8a8489c700 1 -- 172.21.15.87:0/317815986 shutdown_connections 2024-09-13T23:56:31.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7f8a8489c700 1 --2- 172.21.15.87:0/317815986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a8012a0b0 0x7f8a8012a490 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7f8a8489c700 1 -- 172.21.15.87:0/317815986 >> 172.21.15.87:0/317815986 conn(0x7f8a8009b620 msgr2=0x7f8a800714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:31.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7f8a8489c700 1 -- 172.21.15.87:0/317815986 shutdown_connections 2024-09-13T23:56:31.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7f8a8489c700 1 -- 172.21.15.87:0/317815986 wait complete. 2024-09-13T23:56:31.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7efc6d3a0700 1 -- 172.21.15.87:0/3620412906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc6806ed90 msgr2=0x7efc6812f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7efc6d3a0700 1 --2- 172.21.15.87:0/3620412906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc6806ed90 0x7efc6812f010 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efc5c0097d0 tx=0x7efc5c009ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7efc6d3a0700 1 -- 172.21.15.87:0/3620412906 shutdown_connections 2024-09-13T23:56:31.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7efc6d3a0700 1 --2- 172.21.15.87:0/3620412906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc6806ed90 0x7efc6812f010 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7efc6d3a0700 1 -- 172.21.15.87:0/3620412906 >> 172.21.15.87:0/3620412906 conn(0x7efc6809b0f0 msgr2=0x7efc6809b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:31.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7efc6d3a0700 1 -- 172.21.15.87:0/3620412906 shutdown_connections 2024-09-13T23:56:31.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7efc6d3a0700 1 -- 172.21.15.87:0/3620412906 wait complete. 2024-09-13T23:56:31.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7f8a8489c700 1 Processor -- start 2024-09-13T23:56:31.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7f8a8489c700 1 -- start start 2024-09-13T23:56:31.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7f8a8489c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a8012a0b0 0x7f8a8006d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7f8a8489c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a80128ba0 con 0x7f8a8012a0b0 2024-09-13T23:56:31.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7efc6d3a0700 1 Processor -- start 2024-09-13T23:56:31.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7f8a7f7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a8012a0b0 0x7f8a8006d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7f8a7f7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a8012a0b0 0x7f8a8006d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40000/0 (socket says 172.21.15.87:40000) 2024-09-13T23:56:31.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7f8a7f7fe700 1 -- 172.21.15.87:0/2027673288 learned_addr learned my addr 172.21.15.87:0/2027673288 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:31.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7f8a7f7fe700 1 -- 172.21.15.87:0/2027673288 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a700094b0 con 0x7f8a8012a0b0 2024-09-13T23:56:31.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7f8a7f7fe700 1 --2- 172.21.15.87:0/2027673288 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a8012a0b0 0x7f8a8006d530 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009b20 tx=0x7f8a70004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7efc6d3a0700 1 -- start start 2024-09-13T23:56:31.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7efc6d3a0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc6806e2a0 0x7efc68124ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7efc6d3a0700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc68071a00 con 0x7efc6806e2a0 2024-09-13T23:56:31.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7efc67fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc6806e2a0 0x7efc68124ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7efc67fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc6806e2a0 0x7efc68124ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40016/0 (socket says 172.21.15.87:40016) 2024-09-13T23:56:31.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7efc67fff700 1 -- 172.21.15.87:0/60020655 learned_addr learned my addr 172.21.15.87:0/60020655 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:31.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7efc67fff700 1 -- 172.21.15.87:0/60020655 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5c0094b0 con 0x7efc6806e2a0 2024-09-13T23:56:31.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7efc67fff700 1 --2- 172.21.15.87:0/60020655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc6806e2a0 0x7efc68124ef0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efc5800c680 tx=0x7efc5800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7efc64ff9700 1 -- 172.21.15.87:0/60020655 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc58005cc0 con 0x7efc6806e2a0 2024-09-13T23:56:31.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7efc64ff9700 1 -- 172.21.15.87:0/60020655 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc58005e20 con 0x7efc6806e2a0 2024-09-13T23:56:31.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7efc6d3a0700 1 -- 172.21.15.87:0/60020655 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc68126da0 con 0x7efc6806e2a0 2024-09-13T23:56:31.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.469+0000 7efc64ff9700 1 -- 172.21.15.87:0/60020655 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc58007220 con 0x7efc6806e2a0 2024-09-13T23:56:31.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7efc6d3a0700 1 -- 172.21.15.87:0/60020655 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc68127a30 con 0x7efc6806e2a0 2024-09-13T23:56:31.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7efc64ff9700 1 -- 172.21.15.87:0/60020655 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7efc58007380 con 0x7efc6806e2a0 2024-09-13T23:56:31.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7efc6d3a0700 1 -- 172.21.15.87:0/60020655 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efc48000f10 con 0x7efc6806e2a0 2024-09-13T23:56:31.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7efc64ff9700 1 --2- 172.21.15.87:0/60020655 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7efc50035810 0x7efc50037cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7efc64ff9700 1 -- 172.21.15.87:0/60020655 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3538+0+0 (secure 0 0 0) 0x7efc58046c80 con 0x7efc6806e2a0 2024-09-13T23:56:31.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7efc64ff9700 1 --2- 172.21.15.87:0/60020655 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x7efc5003af30 0x7efc5003d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7efc64ff9700 1 -- 172.21.15.87:0/60020655 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc5003da80 con 0x7efc5003af30 2024-09-13T23:56:31.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7efc64ff9700 1 -- 172.21.15.87:0/60020655 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc58019b40 con 0x7efc6806e2a0 2024-09-13T23:56:31.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7fdcc359e700 1 Processor -- start 2024-09-13T23:56:31.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7fdcc359e700 1 -- start start 2024-09-13T23:56:31.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7efc677fe700 1 --2- 172.21.15.87:0/60020655 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7efc50035810 0x7efc50037cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7f8a7cff9700 1 -- 172.21.15.87:0/2027673288 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a70006ea0 con 0x7f8a8012a0b0 2024-09-13T23:56:31.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7f8a7cff9700 1 -- 172.21.15.87:0/2027673288 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a70011630 con 0x7f8a8012a0b0 2024-09-13T23:56:31.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7f8a7cff9700 1 -- 172.21.15.87:0/2027673288 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a700118d0 con 0x7f8a8012a0b0 2024-09-13T23:56:31.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7efc6cb9f700 1 --2- 172.21.15.87:0/60020655 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x7efc5003af30 0x7efc5003d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7f8a8489c700 1 -- 172.21.15.87:0/2027673288 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a8006e370 con 0x7f8a8012a0b0 2024-09-13T23:56:31.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7f8a8489c700 1 -- 172.21.15.87:0/2027673288 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a8011e180 con 0x7f8a8012a0b0 2024-09-13T23:56:31.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7fdcc359e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdcc406e2a0 0x7fdcc406e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7fdcc359e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc406fd30 con 0x7fdcc406ebc0 2024-09-13T23:56:31.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7fdcc359e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc406faf0 con 0x7fdcc406e2a0 2024-09-13T23:56:31.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7efc677fe700 1 --2- 172.21.15.87:0/60020655 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7efc50035810 0x7efc50037cd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efc5c006ee0 tx=0x7efc5c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7efc6cb9f700 1 --2- 172.21.15.87:0/60020655 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x7efc5003af30 0x7efc5003d3b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7fdcc259c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdcc406e2a0 0x7fdcc406e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7fdcc259c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdcc406e2a0 0x7fdcc406e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40020/0 (socket says 172.21.15.87:40020) 2024-09-13T23:56:31.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7f8a8489c700 1 -- 172.21.15.87:0/2027673288 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8a8011e520 con 0x7f8a8012a0b0 2024-09-13T23:56:31.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7fdcc259c700 1 -- 172.21.15.87:0/3202236389 learned_addr learned my addr 172.21.15.87:0/3202236389 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:31.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7f8a7cff9700 1 -- 172.21.15.87:0/2027673288 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f8a70011a30 con 0x7f8a8012a0b0 2024-09-13T23:56:31.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7fdcc259c700 1 -- 172.21.15.87:0/3202236389 >> v1:172.21.15.87:6789/0 conn(0x7fdcc406ebc0 legacy=0x7fdcc4128960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7fdcc259c700 1 -- 172.21.15.87:0/3202236389 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc409bcc0 con 0x7fdcc406e2a0 2024-09-13T23:56:31.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7f8a7cff9700 1 --2- 172.21.15.87:0/2027673288 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f8a60035540 0x7f8a60037a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7f8a7cff9700 1 -- 172.21.15.87:0/2027673288 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3538+0+0 (secure 0 0 0) 0x7f8a70048aa0 con 0x7f8a8012a0b0 2024-09-13T23:56:31.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7fdcc259c700 1 --2- 172.21.15.87:0/3202236389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcc406e2a0 0x7fdcc406e680 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00d150 tx=0x7fdcbc00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e89fec5d14554fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7f8a7cff9700 1 --2- 172.21.15.87:0/2027673288 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x7f8a6003ac60 0x7f8a6003d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7f8a7cff9700 1 -- 172.21.15.87:0/2027673288 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8a6003d7b0 con 0x7f8a6003ac60 2024-09-13T23:56:31.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7f8a7cff9700 1 -- 172.21.15.87:0/2027673288 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a7004d220 con 0x7f8a8012a0b0 2024-09-13T23:56:31.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7fdcc159a700 1 -- 172.21.15.87:0/3202236389 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcbc010070 con 0x7fdcc406e2a0 2024-09-13T23:56:31.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7fdcc159a700 1 -- 172.21.15.87:0/3202236389 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc00de70 con 0x7fdcc406e2a0 2024-09-13T23:56:31.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7fdcc159a700 1 -- 172.21.15.87:0/3202236389 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcbc00b220 con 0x7fdcc406e2a0 2024-09-13T23:56:31.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7f8a77fff700 1 --2- 172.21.15.87:0/2027673288 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f8a60035540 0x7f8a60037a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.473+0000 7f8a7ffff700 1 --2- 172.21.15.87:0/2027673288 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x7f8a6003ac60 0x7f8a6003d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7efc64ff9700 1 -- 172.21.15.87:0/60020655 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7efc5003da80 con 0x7efc5003af30 2024-09-13T23:56:31.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcc359e700 1 -- 172.21.15.87:0/3202236389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcc406e2a0 msgr2=0x7fdcc406e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcc359e700 1 --2- 172.21.15.87:0/3202236389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcc406e2a0 0x7fdcc406e680 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00d150 tx=0x7fdcbc00d460 comp rx=0 tx=0).stop 2024-09-13T23:56:31.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcc359e700 1 -- 172.21.15.87:0/3202236389 shutdown_connections 2024-09-13T23:56:31.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcc359e700 1 --2- 172.21.15.87:0/3202236389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcc406e2a0 0x7fdcc406e680 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcc359e700 1 -- 172.21.15.87:0/3202236389 >> 172.21.15.87:0/3202236389 conn(0x7fdcc4098900 msgr2=0x7fdcc409ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:31.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcc359e700 1 -- 172.21.15.87:0/3202236389 shutdown_connections 2024-09-13T23:56:31.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcc359e700 1 -- 172.21.15.87:0/3202236389 wait complete. 2024-09-13T23:56:31.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcc359e700 1 Processor -- start 2024-09-13T23:56:31.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcc359e700 1 -- start start 2024-09-13T23:56:31.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcc359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcc406e2a0 0x7fdcc411c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcc359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc411e540 con 0x7fdcc406e2a0 2024-09-13T23:56:31.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcc259c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcc406e2a0 0x7fdcc411c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcc259c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcc406e2a0 0x7fdcc411c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40026/0 (socket says 172.21.15.87:40026) 2024-09-13T23:56:31.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcc259c700 1 -- 172.21.15.87:0/460959589 learned_addr learned my addr 172.21.15.87:0/460959589 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:31.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcc259c700 1 -- 172.21.15.87:0/460959589 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcbc00bd40 con 0x7fdcc406e2a0 2024-09-13T23:56:31.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcc259c700 1 --2- 172.21.15.87:0/460959589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcc406e2a0 0x7fdcc411c6e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00d4a0 tx=0x7fdcbc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcb2ffd700 1 -- 172.21.15.87:0/460959589 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcbc009a00 con 0x7fdcc406e2a0 2024-09-13T23:56:31.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcb2ffd700 1 -- 172.21.15.87:0/460959589 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc009b80 con 0x7fdcc406e2a0 2024-09-13T23:56:31.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcc359e700 1 -- 172.21.15.87:0/460959589 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc4071cf0 con 0x7fdcc406e2a0 2024-09-13T23:56:31.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcb2ffd700 1 -- 172.21.15.87:0/460959589 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcbc009e60 con 0x7fdcc406e2a0 2024-09-13T23:56:31.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcc359e700 1 -- 172.21.15.87:0/460959589 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc4128730 con 0x7fdcc406e2a0 2024-09-13T23:56:31.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcb2ffd700 1 -- 172.21.15.87:0/460959589 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7fdcbc01b050 con 0x7fdcc406e2a0 2024-09-13T23:56:31.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcc359e700 1 -- 172.21.15.87:0/460959589 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdcc406efd0 con 0x7fdcc406e2a0 2024-09-13T23:56:31.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcb2ffd700 1 --2- 172.21.15.87:0/460959589 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fdca40354f0 0x7fdca40379b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcb2ffd700 1 -- 172.21.15.87:0/460959589 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3538+0+0 (secure 0 0 0) 0x7fdcbc048d10 con 0x7fdcc406e2a0 2024-09-13T23:56:31.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcb2ffd700 1 --2- 172.21.15.87:0/460959589 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x7fdca403ac10 0x7fdca403d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcb2ffd700 1 -- 172.21.15.87:0/460959589 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdca403d760 con 0x7fdca403ac10 2024-09-13T23:56:31.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7fdcb2ffd700 1 -- 172.21.15.87:0/460959589 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcbc027360 con 0x7fdcc406e2a0 2024-09-13T23:56:31.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.481+0000 7fdcc1d9b700 1 --2- 172.21.15.87:0/460959589 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fdca40354f0 0x7fdca40379b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.481+0000 7fdcc2d9d700 1 --2- 172.21.15.87:0/460959589 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x7fdca403ac10 0x7fdca403d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.481+0000 7fdcc2d9d700 1 --2- 172.21.15.87:0/460959589 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x7fdca403ac10 0x7fdca403d090 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.481+0000 7fdcc1d9b700 1 --2- 172.21.15.87:0/460959589 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fdca40354f0 0x7fdca40379b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4000f60 tx=0x7fdcb4007ae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7f8a7ffff700 1 --2- 172.21.15.87:0/2027673288 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x7f8a6003ac60 0x7f8a6003d0e0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.477+0000 7f8a7cff9700 1 -- 172.21.15.87:0/2027673288 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8a6003d7b0 con 0x7f8a6003ac60 2024-09-13T23:56:31.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.481+0000 7f8a77fff700 1 --2- 172.21.15.87:0/2027673288 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f8a60035540 0x7f8a60037a00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8a680016a0 tx=0x7f8a68007b70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.481+0000 7fdcb2ffd700 1 -- 172.21.15.87:0/460959589 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fdca403d760 con 0x7fdca403ac10 2024-09-13T23:56:31.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.489+0000 7f659f59e700 1 Processor -- start 2024-09-13T23:56:31.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.489+0000 7f659f59e700 1 -- start start 2024-09-13T23:56:31.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.489+0000 7f659f59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f65a006ee80 0x7f65a0132330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.489+0000 7f659f59e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a0071200 con 0x7f65a006e390 2024-09-13T23:56:31.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.489+0000 7f659f59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a0071480 con 0x7f65a006ee80 2024-09-13T23:56:31.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.489+0000 7f659dd9b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f65a006ee80 0x7f65a0132330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.489+0000 7f659e59c700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f65a006e390 0x7f65a006e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45304/0 (socket says 172.21.15.87:45304) 2024-09-13T23:56:31.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.489+0000 7f659e59c700 1 -- 172.21.15.87:0/1017280198 learned_addr learned my addr 172.21.15.87:0/1017280198 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T23:56:31.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.489+0000 7f659dd9b700 1 -- 172.21.15.87:0/1017280198 >> v1:172.21.15.87:6789/0 conn(0x7f65a006e390 legacy=0x7f65a006e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.489+0000 7f659d59a700 1 -- 172.21.15.87:0/1017280198 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1172057843 0 0) 0x7f65a0071200 con 0x7f65a006e390 2024-09-13T23:56:31.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.489+0000 7f659dd9b700 1 -- 172.21.15.87:0/1017280198 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a009af40 con 0x7f65a006ee80 2024-09-13T23:56:31.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f659dd9b700 1 --2- 172.21.15.87:0/1017280198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65a006ee80 0x7f65a0132330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f65940097d0 tx=0x7f6594009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737a74710afd3a5c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f659d59a700 1 -- 172.21.15.87:0/1017280198 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65940041c0 con 0x7f65a006ee80 2024-09-13T23:56:31.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f659d59a700 1 -- 172.21.15.87:0/1017280198 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6594004320 con 0x7f65a006ee80 2024-09-13T23:56:31.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f659d59a700 1 -- 172.21.15.87:0/1017280198 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65940036c0 con 0x7f65a006ee80 2024-09-13T23:56:31.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f659f59e700 1 -- 172.21.15.87:0/1017280198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65a006ee80 msgr2=0x7f65a0132330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f659f59e700 1 --2- 172.21.15.87:0/1017280198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65a006ee80 0x7f65a0132330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f65940097d0 tx=0x7f6594009ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7efc6d3a0700 1 -- 172.21.15.87:0/60020655 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efc48002c00 con 0x7efc5003af30 2024-09-13T23:56:31.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f659f59e700 1 -- 172.21.15.87:0/1017280198 shutdown_connections 2024-09-13T23:56:31.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f659f59e700 1 --2- 172.21.15.87:0/1017280198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65a006ee80 0x7f65a0132330 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f659f59e700 1 -- 172.21.15.87:0/1017280198 >> 172.21.15.87:0/1017280198 conn(0x7f65a00991a0 msgr2=0x7f65a00995b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:31.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f659f59e700 1 -- 172.21.15.87:0/1017280198 shutdown_connections 2024-09-13T23:56:31.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f659f59e700 1 -- 172.21.15.87:0/1017280198 wait complete. 2024-09-13T23:56:31.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7efc64ff9700 1 -- 172.21.15.87:0/60020655 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efc48002c00 con 0x7efc5003af30 2024-09-13T23:56:31.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7efc6d3a0700 1 -- 172.21.15.87:0/60020655 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x7efc5003af30 msgr2=0x7efc5003d3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7efc6d3a0700 1 --2- 172.21.15.87:0/60020655 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x7efc5003af30 0x7efc5003d3b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7efc6d3a0700 1 -- 172.21.15.87:0/60020655 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7efc50035810 msgr2=0x7efc50037cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7efc6d3a0700 1 --2- 172.21.15.87:0/60020655 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7efc50035810 0x7efc50037cd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efc5c006ee0 tx=0x7efc5c008030 comp rx=0 tx=0).stop 2024-09-13T23:56:31.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7efc6d3a0700 1 -- 172.21.15.87:0/60020655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc6806e2a0 msgr2=0x7efc68124ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7efc6d3a0700 1 --2- 172.21.15.87:0/60020655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc6806e2a0 0x7efc68124ef0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efc5800c680 tx=0x7efc5800ca40 comp rx=0 tx=0).stop 2024-09-13T23:56:31.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f659f59e700 1 Processor -- start 2024-09-13T23:56:31.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7efc6d3a0700 1 -- 172.21.15.87:0/60020655 shutdown_connections 2024-09-13T23:56:31.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7efc6d3a0700 1 --2- 172.21.15.87:0/60020655 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7efc50035810 0x7efc50037cd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7efc6d3a0700 1 --2- 172.21.15.87:0/60020655 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x7efc5003af30 0x7efc5003d3b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7efc6d3a0700 1 --2- 172.21.15.87:0/60020655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc6806e2a0 0x7efc68124ef0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7efc6d3a0700 1 -- 172.21.15.87:0/60020655 >> 172.21.15.87:0/60020655 conn(0x7efc6809b0f0 msgr2=0x7efc68097a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:31.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f659f59e700 1 -- start start 2024-09-13T23:56:31.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7efc6d3a0700 1 -- 172.21.15.87:0/60020655 shutdown_connections 2024-09-13T23:56:31.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7efc6d3a0700 1 -- 172.21.15.87:0/60020655 wait complete. 2024-09-13T23:56:31.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f659f59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65a006e390 0x7f65a012d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f659f59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a0115250 con 0x7f65a006e390 2024-09-13T23:56:31.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f659e59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65a006e390 0x7f65a012d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f659e59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65a006e390 0x7f65a012d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40042/0 (socket says 172.21.15.87:40042) 2024-09-13T23:56:31.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f659e59c700 1 -- 172.21.15.87:0/36103234 learned_addr learned my addr 172.21.15.87:0/36103234 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:31.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f659e59c700 1 -- 172.21.15.87:0/36103234 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65940094b0 con 0x7f65a006e390 2024-09-13T23:56:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f659e59c700 1 --2- 172.21.15.87:0/36103234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65a006e390 0x7f65a012d6b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f659800cc00 tx=0x7f659800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f658effd700 1 -- 172.21.15.87:0/36103234 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f659800aa90 con 0x7f65a006e390 2024-09-13T23:56:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f658effd700 1 -- 172.21.15.87:0/36103234 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659800ac10 con 0x7f65a006e390 2024-09-13T23:56:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f659f59e700 1 -- 172.21.15.87:0/36103234 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a01154e0 con 0x7f65a006e390 2024-09-13T23:56:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f658effd700 1 -- 172.21.15.87:0/36103234 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65980070d0 con 0x7f65a006e390 2024-09-13T23:56:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.493+0000 7f659f59e700 1 -- 172.21.15.87:0/36103234 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a012dbf0 con 0x7f65a006e390 2024-09-13T23:56:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.497+0000 7f658effd700 1 -- 172.21.15.87:0/36103234 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f65980072c0 con 0x7f65a006e390 2024-09-13T23:56:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.497+0000 7f659f59e700 1 -- 172.21.15.87:0/36103234 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6584000f10 con 0x7f65a006e390 2024-09-13T23:56:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.497+0000 7f658effd700 1 --2- 172.21.15.87:0/36103234 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f65880354a0 0x7f6588037960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.497+0000 7f658effd700 1 -- 172.21.15.87:0/36103234 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3538+0+0 (secure 0 0 0) 0x7f6598047740 con 0x7f65a006e390 2024-09-13T23:56:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.497+0000 7f658effd700 1 --2- 172.21.15.87:0/36103234 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x7f658803abc0 0x7f658803d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.497+0000 7f658effd700 1 -- 172.21.15.87:0/36103234 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f658803d710 con 0x7f658803abc0 2024-09-13T23:56:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.497+0000 7f658effd700 1 -- 172.21.15.87:0/36103234 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6598049d70 con 0x7f65a006e390 2024-09-13T23:56:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.497+0000 7f659dd9b700 1 --2- 172.21.15.87:0/36103234 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f65880354a0 0x7f6588037960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.497+0000 7f659ed9d700 1 --2- 172.21.15.87:0/36103234 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x7f658803abc0 0x7f658803d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.497+0000 7f659ed9d700 1 --2- 172.21.15.87:0/36103234 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x7f658803abc0 0x7f658803d040 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.497+0000 7f659dd9b700 1 --2- 172.21.15.87:0/36103234 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f65880354a0 0x7f6588037960 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6594014040 tx=0x7f6594010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.497+0000 7f658effd700 1 -- 172.21.15.87:0/36103234 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f658803d710 con 0x7f658803abc0 2024-09-13T23:56:31.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.501+0000 7f8a8489c700 1 -- 172.21.15.87:0/2027673288 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8a8011e6a0 con 0x7f8a6003ac60 2024-09-13T23:56:31.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.501+0000 7f8a7cff9700 1 -- 172.21.15.87:0/2027673288 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8a8011e6a0 con 0x7f8a6003ac60 2024-09-13T23:56:31.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.501+0000 7f8a8489c700 1 -- 172.21.15.87:0/2027673288 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x7f8a6003ac60 msgr2=0x7f8a6003d0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.501+0000 7f8a8489c700 1 --2- 172.21.15.87:0/2027673288 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x7f8a6003ac60 0x7f8a6003d0e0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.501+0000 7f8a8489c700 1 -- 172.21.15.87:0/2027673288 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f8a60035540 msgr2=0x7f8a60037a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.501+0000 7f8a8489c700 1 --2- 172.21.15.87:0/2027673288 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f8a60035540 0x7f8a60037a00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8a680016a0 tx=0x7f8a68007b70 comp rx=0 tx=0).stop 2024-09-13T23:56:31.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.501+0000 7f8a8489c700 1 -- 172.21.15.87:0/2027673288 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a8012a0b0 msgr2=0x7f8a8006d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.501+0000 7f8a8489c700 1 --2- 172.21.15.87:0/2027673288 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a8012a0b0 0x7f8a8006d530 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009b20 tx=0x7f8a70004770 comp rx=0 tx=0).stop 2024-09-13T23:56:31.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.501+0000 7f8a8489c700 1 -- 172.21.15.87:0/2027673288 shutdown_connections 2024-09-13T23:56:31.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.501+0000 7f8a8489c700 1 --2- 172.21.15.87:0/2027673288 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x7f8a6003ac60 0x7f8a6003d0e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.501+0000 7f8a8489c700 1 --2- 172.21.15.87:0/2027673288 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f8a60035540 0x7f8a60037a00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.501+0000 7f8a8489c700 1 --2- 172.21.15.87:0/2027673288 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a8012a0b0 0x7f8a8006d530 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.501+0000 7f8a8489c700 1 -- 172.21.15.87:0/2027673288 >> 172.21.15.87:0/2027673288 conn(0x7f8a8009b620 msgr2=0x7f8a80129250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:31.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.501+0000 7f8a8489c700 1 -- 172.21.15.87:0/2027673288 shutdown_connections 2024-09-13T23:56:31.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.501+0000 7f8a8489c700 1 -- 172.21.15.87:0/2027673288 wait complete. 2024-09-13T23:56:31.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.505+0000 7fdcc359e700 1 -- 172.21.15.87:0/460959589 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdcc411d3e0 con 0x7fdca403ac10 2024-09-13T23:56:31.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.505+0000 7fdcb2ffd700 1 -- 172.21.15.87:0/460959589 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdcc411d3e0 con 0x7fdca403ac10 2024-09-13T23:56:31.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.505+0000 7fdcc359e700 1 -- 172.21.15.87:0/460959589 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x7fdca403ac10 msgr2=0x7fdca403d090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.505+0000 7fdcc359e700 1 --2- 172.21.15.87:0/460959589 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x7fdca403ac10 0x7fdca403d090 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.505+0000 7fdcc359e700 1 -- 172.21.15.87:0/460959589 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fdca40354f0 msgr2=0x7fdca40379b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.505+0000 7fdcc359e700 1 --2- 172.21.15.87:0/460959589 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fdca40354f0 0x7fdca40379b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4000f60 tx=0x7fdcb4007ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.505+0000 7fdcc359e700 1 -- 172.21.15.87:0/460959589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcc406e2a0 msgr2=0x7fdcc411c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.505+0000 7fdcc359e700 1 --2- 172.21.15.87:0/460959589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcc406e2a0 0x7fdcc411c6e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00d4a0 tx=0x7fdcbc004af0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.505+0000 7fdcc359e700 1 -- 172.21.15.87:0/460959589 shutdown_connections 2024-09-13T23:56:31.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.505+0000 7fdcc359e700 1 --2- 172.21.15.87:0/460959589 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x7fdca403ac10 0x7fdca403d090 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.505+0000 7fdcc359e700 1 --2- 172.21.15.87:0/460959589 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fdca40354f0 0x7fdca40379b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.505+0000 7fdcc359e700 1 --2- 172.21.15.87:0/460959589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcc406e2a0 0x7fdcc411c6e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.505+0000 7fdcc359e700 1 -- 172.21.15.87:0/460959589 >> 172.21.15.87:0/460959589 conn(0x7fdcc4098900 msgr2=0x7fdcc406d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:31.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.505+0000 7fdcc359e700 1 -- 172.21.15.87:0/460959589 shutdown_connections 2024-09-13T23:56:31.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.505+0000 7fdcc359e700 1 -- 172.21.15.87:0/460959589 wait complete. 2024-09-13T23:56:31.516 INFO:teuthology.orchestra.run.smithi087.stdout:38654705668 2024-09-13T23:56:31.517 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T23:56:31.520 INFO:teuthology.orchestra.run.smithi087.stdout:38654705669 2024-09-13T23:56:31.520 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T23:56:31.527 INFO:teuthology.orchestra.run.smithi087.stdout:38654705668 2024-09-13T23:56:31.527 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T23:56:31.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.521+0000 7f659f59e700 1 -- 172.21.15.87:0/36103234 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6584002c00 con 0x7f658803abc0 2024-09-13T23:56:31.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.521+0000 7f658effd700 1 -- 172.21.15.87:0/36103234 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6584002c00 con 0x7f658803abc0 2024-09-13T23:56:31.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.521+0000 7f659f59e700 1 -- 172.21.15.87:0/36103234 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x7f658803abc0 msgr2=0x7f658803d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.521+0000 7f659f59e700 1 --2- 172.21.15.87:0/36103234 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x7f658803abc0 0x7f658803d040 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.521+0000 7f659f59e700 1 -- 172.21.15.87:0/36103234 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f65880354a0 msgr2=0x7f6588037960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.521+0000 7f659f59e700 1 --2- 172.21.15.87:0/36103234 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f65880354a0 0x7f6588037960 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6594014040 tx=0x7f6594010000 comp rx=0 tx=0).stop 2024-09-13T23:56:31.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.521+0000 7f659f59e700 1 -- 172.21.15.87:0/36103234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65a006e390 msgr2=0x7f65a012d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.521+0000 7f659f59e700 1 --2- 172.21.15.87:0/36103234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65a006e390 0x7f65a012d6b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f659800cc00 tx=0x7f659800a060 comp rx=0 tx=0).stop 2024-09-13T23:56:31.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.521+0000 7f659f59e700 1 -- 172.21.15.87:0/36103234 shutdown_connections 2024-09-13T23:56:31.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.521+0000 7f659f59e700 1 --2- 172.21.15.87:0/36103234 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x7f658803abc0 0x7f658803d040 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.521+0000 7f659f59e700 1 --2- 172.21.15.87:0/36103234 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f65880354a0 0x7f6588037960 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.521+0000 7f659f59e700 1 --2- 172.21.15.87:0/36103234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65a006e390 0x7f65a012d6b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.521+0000 7f659f59e700 1 -- 172.21.15.87:0/36103234 >> 172.21.15.87:0/36103234 conn(0x7f65a00991a0 msgr2=0x7f65a0115c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:31.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.521+0000 7f659f59e700 1 -- 172.21.15.87:0/36103234 shutdown_connections 2024-09-13T23:56:31.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.521+0000 7f659f59e700 1 -- 172.21.15.87:0/36103234 wait complete. 2024-09-13T23:56:31.540 INFO:teuthology.orchestra.run.smithi087.stdout:38654705669 2024-09-13T23:56:31.540 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T23:56:31.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.617+0000 7ffb2f2dd700 1 Processor -- start 2024-09-13T23:56:31.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.617+0000 7ffb2f2dd700 1 -- start start 2024-09-13T23:56:31.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.617+0000 7ffb2f2dd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffb28095420 0x7ffb28095800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.617+0000 7ffb2f2dd700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb28070690 con 0x7ffb2806e7c0 2024-09-13T23:56:31.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.617+0000 7ffb2f2dd700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb2806ffb0 con 0x7ffb28095420 2024-09-13T23:56:31.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.617+0000 7ffb2e2db700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffb28095420 0x7ffb28095800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.617+0000 7ffb2dada700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ffb2806e7c0 0x7ffb2806ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45316/0 (socket says 172.21.15.87:45316) 2024-09-13T23:56:31.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.617+0000 7ffb2dada700 1 -- 172.21.15.87:0/3808670767 learned_addr learned my addr 172.21.15.87:0/3808670767 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T23:56:31.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.617+0000 7ffb2d2d9700 1 -- 172.21.15.87:0/3808670767 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 378178631 0 0) 0x7ffb28070690 con 0x7ffb2806e7c0 2024-09-13T23:56:31.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.617+0000 7ffb2d2d9700 1 -- 172.21.15.87:0/3808670767 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb140035d0 con 0x7ffb2806e7c0 2024-09-13T23:56:31.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.617+0000 7ffb2e2db700 1 -- 172.21.15.87:0/3808670767 >> v1:172.21.15.87:6789/0 conn(0x7ffb2806e7c0 legacy=0x7ffb2806ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.617+0000 7ffb2e2db700 1 -- 172.21.15.87:0/3808670767 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb280993c0 con 0x7ffb28095420 2024-09-13T23:56:31.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.617+0000 7ffb2e2db700 1 --2- 172.21.15.87:0/3808670767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb28095420 0x7ffb28095800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffb240097d0 tx=0x7ffb24009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c05b34884655172 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.617+0000 7ffb2d2d9700 1 -- 172.21.15.87:0/3808670767 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb24004160 con 0x7ffb28095420 2024-09-13T23:56:31.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.617+0000 7ffb2d2d9700 1 -- 172.21.15.87:0/3808670767 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb240042c0 con 0x7ffb28095420 2024-09-13T23:56:31.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.617+0000 7ffb2d2d9700 1 -- 172.21.15.87:0/3808670767 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb240045a0 con 0x7ffb28095420 2024-09-13T23:56:31.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.621+0000 7ffb2f2dd700 1 -- 172.21.15.87:0/3808670767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb28095420 msgr2=0x7ffb28095800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.621+0000 7ffb2f2dd700 1 --2- 172.21.15.87:0/3808670767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb28095420 0x7ffb28095800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffb240097d0 tx=0x7ffb24009ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.621+0000 7ffb2f2dd700 1 -- 172.21.15.87:0/3808670767 shutdown_connections 2024-09-13T23:56:31.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.621+0000 7ffb2f2dd700 1 --2- 172.21.15.87:0/3808670767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb28095420 0x7ffb28095800 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.621+0000 7ffb2f2dd700 1 -- 172.21.15.87:0/3808670767 >> 172.21.15.87:0/3808670767 conn(0x7ffb280988a0 msgr2=0x7ffb28098cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:31.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.621+0000 7ffb2f2dd700 1 -- 172.21.15.87:0/3808670767 shutdown_connections 2024-09-13T23:56:31.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.621+0000 7ffb2f2dd700 1 -- 172.21.15.87:0/3808670767 wait complete. 2024-09-13T23:56:31.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.621+0000 7ffb2f2dd700 1 Processor -- start 2024-09-13T23:56:31.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.621+0000 7ffb2f2dd700 1 -- start start 2024-09-13T23:56:31.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.621+0000 7ffb2f2dd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb2806e7c0 0x7ffb2808ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.621+0000 7ffb2f2dd700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2808df90 con 0x7ffb2806e7c0 2024-09-13T23:56:31.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.621+0000 7ffb2e2db700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb2806e7c0 0x7ffb2808ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.621+0000 7ffb2e2db700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb2806e7c0 0x7ffb2808ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40060/0 (socket says 172.21.15.87:40060) 2024-09-13T23:56:31.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.621+0000 7ffb2e2db700 1 -- 172.21.15.87:0/3650205720 learned_addr learned my addr 172.21.15.87:0/3650205720 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:31.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.621+0000 7ffb2e2db700 1 -- 172.21.15.87:0/3650205720 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb240094b0 con 0x7ffb2806e7c0 2024-09-13T23:56:31.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.621+0000 7ffb2e2db700 1 --2- 172.21.15.87:0/3650205720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb2806e7c0 0x7ffb2808ba90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffb24009b20 tx=0x7ffb24004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.621+0000 7ffb1effd700 1 -- 172.21.15.87:0/3650205720 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb24003c80 con 0x7ffb2806e7c0 2024-09-13T23:56:31.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.621+0000 7ffb1effd700 1 -- 172.21.15.87:0/3650205720 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2401f070 con 0x7ffb2806e7c0 2024-09-13T23:56:31.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.621+0000 7ffb1effd700 1 -- 172.21.15.87:0/3650205720 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb24011630 con 0x7ffb2806e7c0 2024-09-13T23:56:31.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.621+0000 7ffb2f2dd700 1 -- 172.21.15.87:0/3650205720 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2808d830 con 0x7ffb2806e7c0 2024-09-13T23:56:31.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.621+0000 7ffb2f2dd700 1 -- 172.21.15.87:0/3650205720 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb28071d00 con 0x7ffb2806e7c0 2024-09-13T23:56:31.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.625+0000 7ffb1effd700 1 -- 172.21.15.87:0/3650205720 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7ffb24021030 con 0x7ffb2806e7c0 2024-09-13T23:56:31.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.625+0000 7ffb1effd700 1 --2- 172.21.15.87:0/3650205720 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7ffb0c0354a0 0x7ffb0c037960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.625+0000 7ffb1effd700 1 -- 172.21.15.87:0/3650205720 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3538+0+0 (secure 0 0 0) 0x7ffb24048df0 con 0x7ffb2806e7c0 2024-09-13T23:56:31.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.625+0000 7ffb2dada700 1 --2- 172.21.15.87:0/3650205720 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7ffb0c0354a0 0x7ffb0c037960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.625+0000 7ffb2dada700 1 --2- 172.21.15.87:0/3650205720 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7ffb0c0354a0 0x7ffb0c037960 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ffb180016d0 tx=0x7ffb18007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.625+0000 7ffb2f2dd700 1 -- 172.21.15.87:0/3650205720 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb28094ed0 con 0x7ffb2806e7c0 2024-09-13T23:56:31.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7f51c97b0700 1 Processor -- start 2024-09-13T23:56:31.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7f51c97b0700 1 -- start start 2024-09-13T23:56:31.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7f51c97b0700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f51c406e390 0x7f51c406e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7f51c97b0700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c4071200 con 0x7f51c406ecb0 2024-09-13T23:56:31.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7f51c97b0700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c4071480 con 0x7f51c406e390 2024-09-13T23:56:31.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7f51c3fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f51c406e390 0x7f51c406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7f51c37fe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f51c406ecb0 0x7f51c412ce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45320/0 (socket says 172.21.15.87:45320) 2024-09-13T23:56:31.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7f51c3fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f51c406e390 0x7f51c406e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40062/0 (socket says 172.21.15.87:40062) 2024-09-13T23:56:31.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7f51c37fe700 1 -- 172.21.15.87:0/2428506277 learned_addr learned my addr 172.21.15.87:0/2428506277 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T23:56:31.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7f51c3fff700 1 -- 172.21.15.87:0/2428506277 >> v1:172.21.15.87:6789/0 conn(0x7f51c406ecb0 legacy=0x7f51c412ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7f51c3fff700 1 -- 172.21.15.87:0/2428506277 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c409af40 con 0x7f51c406e390 2024-09-13T23:56:31.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7f51c3fff700 1 --2- 172.21.15.87:0/2428506277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51c406e390 0x7f51c406e770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0097d0 tx=0x7f51ac009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22edd2bacb950089 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7fbee6131700 1 Processor -- start 2024-09-13T23:56:31.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7fbee6131700 1 -- start start 2024-09-13T23:56:31.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7f51c2ffd700 1 -- 172.21.15.87:0/2428506277 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51ac0041c0 con 0x7f51c406e390 2024-09-13T23:56:31.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7f51c2ffd700 1 -- 172.21.15.87:0/2428506277 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac004320 con 0x7f51c406e390 2024-09-13T23:56:31.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7ffb1effd700 1 -- 172.21.15.87:0/3650205720 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffb2401a460 con 0x7ffb2806e7c0 2024-09-13T23:56:31.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7f51c2ffd700 1 -- 172.21.15.87:0/2428506277 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51ac0036c0 con 0x7f51c406e390 2024-09-13T23:56:31.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7fbee6131700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbee012aff0 0x7fbee012b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7fbee6131700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee012ab30 con 0x7fbee006c180 2024-09-13T23:56:31.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7fbee6131700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee0070b40 con 0x7fbee012aff0 2024-09-13T23:56:31.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7fbedf7fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbee012aff0 0x7fbee012b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7fbedeffd700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fbee006c180 0x7fbee006c5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45328/0 (socket says 172.21.15.87:45328) 2024-09-13T23:56:31.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7fbedeffd700 1 -- 172.21.15.87:0/2798333039 learned_addr learned my addr 172.21.15.87:0/2798333039 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T23:56:31.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7fbcc080c700 1 Processor -- start 2024-09-13T23:56:31.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7fbcc080c700 1 -- start start 2024-09-13T23:56:31.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7f51c97b0700 1 -- 172.21.15.87:0/2428506277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51c406e390 msgr2=0x7f51c406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7f51c97b0700 1 --2- 172.21.15.87:0/2428506277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51c406e390 0x7f51c406e770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0097d0 tx=0x7f51ac009ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7f51c97b0700 1 -- 172.21.15.87:0/2428506277 shutdown_connections 2024-09-13T23:56:31.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7f51c97b0700 1 --2- 172.21.15.87:0/2428506277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51c406e390 0x7f51c406e770 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7f51c97b0700 1 -- 172.21.15.87:0/2428506277 >> 172.21.15.87:0/2428506277 conn(0x7f51c40991a0 msgr2=0x7f51c40995b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:31.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7f51c97b0700 1 -- 172.21.15.87:0/2428506277 shutdown_connections 2024-09-13T23:56:31.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7fbede7fc700 1 -- 172.21.15.87:0/2798333039 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573308390 0 0) 0x7fbee012ab30 con 0x7fbee006c180 2024-09-13T23:56:31.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.633+0000 7fbede7fc700 1 -- 172.21.15.87:0/2798333039 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbecc0035d0 con 0x7fbee006c180 2024-09-13T23:56:31.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7f51c97b0700 1 -- 172.21.15.87:0/2428506277 wait complete. 2024-09-13T23:56:31.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbede7fc700 1 -- 172.21.15.87:0/2798333039 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2808723759 0 0) 0x7fbecc0035d0 con 0x7fbee006c180 2024-09-13T23:56:31.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbede7fc700 1 -- 172.21.15.87:0/2798333039 >> v2:172.21.15.87:3300/0 conn(0x7fbee012aff0 msgr2=0x7fbee012b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T23:56:31.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbede7fc700 1 --2- 172.21.15.87:0/2798333039 >> v2:172.21.15.87:3300/0 conn(0x7fbee012aff0 0x7fbee012b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbede7fc700 1 -- 172.21.15.87:0/2798333039 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee0070f80 con 0x7fbee006c180 2024-09-13T23:56:31.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbede7fc700 1 -- 172.21.15.87:0/2798333039 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 4092597791 0 0) 0x7fbed00015a0 con 0x7fbee006c180 2024-09-13T23:56:31.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbede7fc700 1 -- 172.21.15.87:0/2798333039 >> v1:172.21.15.87:6789/0 conn(0x7fbee006c180 legacy=0x7fbee006c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbede7fc700 1 --2- 172.21.15.87:0/2798333039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbecc003a20 0x7fbecc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbede7fc700 1 -- 172.21.15.87:0/2798333039 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee0070b40 con 0x7fbecc003a20 2024-09-13T23:56:31.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbcc080c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbcbc070e90 0x7fbcbc12e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbcc080c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcbc071d50 con 0x7fbcbc1293b0 2024-09-13T23:56:31.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbcbad9d700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fbcbc1293b0 0x7fbcbc129790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45338/0 (socket says 172.21.15.87:45338) 2024-09-13T23:56:31.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbcbad9d700 1 -- 172.21.15.87:0/516701508 learned_addr learned my addr 172.21.15.87:0/516701508 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T23:56:31.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbcba59c700 1 --2- 172.21.15.87:0/516701508 >> v2:172.21.15.87:3300/0 conn(0x7fbcbc070e90 0x7fbcbc12e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbcc080c700 1 -- 172.21.15.87:0/516701508 --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcbc070500 con 0x7fbcbc070e90 2024-09-13T23:56:31.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbedf7fe700 1 --2- 172.21.15.87:0/2798333039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbecc003a20 0x7fbecc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7f51c97b0700 1 Processor -- start 2024-09-13T23:56:31.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7f51c97b0700 1 -- start start 2024-09-13T23:56:31.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbcb9d9b700 1 -- 172.21.15.87:0/516701508 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507539981 0 0) 0x7fbcbc071d50 con 0x7fbcbc1293b0 2024-09-13T23:56:31.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbedf7fe700 1 -- 172.21.15.87:0/2798333039 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc0035d0 con 0x7fbecc003a20 2024-09-13T23:56:31.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbcba59c700 1 -- 172.21.15.87:0/516701508 >> v1:172.21.15.87:6789/0 conn(0x7fbcbc1293b0 legacy=0x7fbcbc129790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbcba59c700 1 -- 172.21.15.87:0/516701508 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc129ea0 con 0x7fbcbc070e90 2024-09-13T23:56:31.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7f51c97b0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51c406ecb0 0x7f51c411d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7f51c97b0700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c411e280 con 0x7f51c406ecb0 2024-09-13T23:56:31.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbcba59c700 1 --2- 172.21.15.87:0/516701508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcbc070e90 0x7fbcbc12e4c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00097d0 tx=0x7fbcb0009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0443361ba21ac3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbedf7fe700 1 --2- 172.21.15.87:0/2798333039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbecc003a20 0x7fbecc003e20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbed8009f50 tx=0x7fbecc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465fffd8f7ad4e83 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbcb9d9b700 1 -- 172.21.15.87:0/516701508 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbcb00041c0 con 0x7fbcbc070e90 2024-09-13T23:56:31.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbede7fc700 1 -- 172.21.15.87:0/2798333039 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbed8007c50 con 0x7fbecc003a20 2024-09-13T23:56:31.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbede7fc700 1 -- 172.21.15.87:0/2798333039 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed8007db0 con 0x7fbecc003a20 2024-09-13T23:56:31.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbede7fc700 1 -- 172.21.15.87:0/2798333039 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbed8003bb0 con 0x7fbecc003a20 2024-09-13T23:56:31.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7f51c3fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51c406ecb0 0x7f51c411d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7f51c3fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51c406ecb0 0x7f51c411d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40112/0 (socket says 172.21.15.87:40112) 2024-09-13T23:56:31.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7f51c3fff700 1 -- 172.21.15.87:0/1183619496 learned_addr learned my addr 172.21.15.87:0/1183619496 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:31.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbcb9d9b700 1 -- 172.21.15.87:0/516701508 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb0004320 con 0x7fbcbc070e90 2024-09-13T23:56:31.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbcb9d9b700 1 -- 172.21.15.87:0/516701508 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbcb00036c0 con 0x7fbcbc070e90 2024-09-13T23:56:31.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbee6131700 1 -- 172.21.15.87:0/2798333039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbecc003a20 msgr2=0x7fbecc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbee6131700 1 --2- 172.21.15.87:0/2798333039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbecc003a20 0x7fbecc003e20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbed8009f50 tx=0x7fbecc0058a0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbee6131700 1 -- 172.21.15.87:0/2798333039 shutdown_connections 2024-09-13T23:56:31.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbee6131700 1 --2- 172.21.15.87:0/2798333039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbecc003a20 0x7fbecc003e20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbee6131700 1 --2- 172.21.15.87:0/2798333039 >> v2:172.21.15.87:3300/0 conn(0x7fbee012aff0 0x7fbee012b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbee6131700 1 -- 172.21.15.87:0/2798333039 >> 172.21.15.87:0/2798333039 conn(0x7fbee009b2c0 msgr2=0x7fbee009b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:31.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbee6131700 1 -- 172.21.15.87:0/2798333039 shutdown_connections 2024-09-13T23:56:31.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbcc080c700 1 -- 172.21.15.87:0/516701508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcbc070e90 msgr2=0x7fbcbc12e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbcc080c700 1 --2- 172.21.15.87:0/516701508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcbc070e90 0x7fbcbc12e4c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00097d0 tx=0x7fbcb0009ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbee6131700 1 -- 172.21.15.87:0/2798333039 wait complete. 2024-09-13T23:56:31.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7f51c3fff700 1 -- 172.21.15.87:0/1183619496 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac0094b0 con 0x7f51c406ecb0 2024-09-13T23:56:31.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7f51c3fff700 1 --2- 172.21.15.87:0/1183619496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51c406ecb0 0x7f51c411d120 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f51ac009b20 tx=0x7f51ac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbcc080c700 1 -- 172.21.15.87:0/516701508 shutdown_connections 2024-09-13T23:56:31.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbcc080c700 1 --2- 172.21.15.87:0/516701508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcbc070e90 0x7fbcbc12e4c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.637+0000 7fbcc080c700 1 -- 172.21.15.87:0/516701508 >> 172.21.15.87:0/516701508 conn(0x7fbcbc0991a0 msgr2=0x7fbcbc0995b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:31.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbcc080c700 1 -- 172.21.15.87:0/516701508 shutdown_connections 2024-09-13T23:56:31.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7f51c0ff9700 1 -- 172.21.15.87:0/1183619496 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51ac006ea0 con 0x7f51c406ecb0 2024-09-13T23:56:31.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbcc080c700 1 -- 172.21.15.87:0/516701508 wait complete. 2024-09-13T23:56:31.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7f51c0ff9700 1 -- 172.21.15.87:0/1183619496 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac011630 con 0x7f51c406ecb0 2024-09-13T23:56:31.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7f51c0ff9700 1 -- 172.21.15.87:0/1183619496 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51ac0118d0 con 0x7f51c406ecb0 2024-09-13T23:56:31.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7f51c97b0700 1 -- 172.21.15.87:0/1183619496 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c411fea0 con 0x7f51c406ecb0 2024-09-13T23:56:31.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7f51c97b0700 1 -- 172.21.15.87:0/1183619496 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c41202a0 con 0x7f51c406ecb0 2024-09-13T23:56:31.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbee6131700 1 Processor -- start 2024-09-13T23:56:31.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbee6131700 1 -- start start 2024-09-13T23:56:31.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbcc080c700 1 Processor -- start 2024-09-13T23:56:31.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbee6131700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbecc003a20 0x7fbee01152d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbee6131700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee01252c0 con 0x7fbecc003a20 2024-09-13T23:56:31.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbcc080c700 1 -- start start 2024-09-13T23:56:31.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbcc080c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcbc070e90 0x7fbcbc1167c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbcc080c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc119030 con 0x7fbcbc070e90 2024-09-13T23:56:31.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbcbad9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcbc070e90 0x7fbcbc1167c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbcbad9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcbc070e90 0x7fbcbc1167c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40128/0 (socket says 172.21.15.87:40128) 2024-09-13T23:56:31.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbcbad9d700 1 -- 172.21.15.87:0/1878932916 learned_addr learned my addr 172.21.15.87:0/1878932916 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:31.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbedf7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbecc003a20 0x7fbee01152d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbcbad9d700 1 -- 172.21.15.87:0/1878932916 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb00094b0 con 0x7fbcbc070e90 2024-09-13T23:56:31.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbedf7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbecc003a20 0x7fbee01152d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40124/0 (socket says 172.21.15.87:40124) 2024-09-13T23:56:31.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbedf7fe700 1 -- 172.21.15.87:0/1139796973 learned_addr learned my addr 172.21.15.87:0/1139796973 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:31.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbcbad9d700 1 --2- 172.21.15.87:0/1878932916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcbc070e90 0x7fbcbc1167c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00c4d0 tx=0x7fbcac00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbedf7fe700 1 -- 172.21.15.87:0/1139796973 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee0116e60 con 0x7fbecc003a20 2024-09-13T23:56:31.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7f51c0ff9700 1 -- 172.21.15.87:0/1183619496 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f51ac011a30 con 0x7f51c406ecb0 2024-09-13T23:56:31.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbca37fe700 1 -- 172.21.15.87:0/1878932916 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbcac004bd0 con 0x7fbcbc070e90 2024-09-13T23:56:31.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbcc080c700 1 -- 172.21.15.87:0/1878932916 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcbc119720 con 0x7fbcbc070e90 2024-09-13T23:56:31.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbcc080c700 1 -- 172.21.15.87:0/1878932916 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcbc1182a0 con 0x7fbcbc070e90 2024-09-13T23:56:31.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7f51c0ff9700 1 --2- 172.21.15.87:0/1183619496 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f51a4035540 0x7f51a4037a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7f51c0ff9700 1 -- 172.21.15.87:0/1183619496 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3538+0+0 (secure 0 0 0) 0x7f51ac0488c0 con 0x7f51c406ecb0 2024-09-13T23:56:31.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbedf7fe700 1 --2- 172.21.15.87:0/1139796973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbecc003a20 0x7fbee01152d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbed8017040 tx=0x7fbed8004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbed7fff700 1 -- 172.21.15.87:0/1139796973 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbed80046e0 con 0x7fbecc003a20 2024-09-13T23:56:31.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbed7fff700 1 -- 172.21.15.87:0/1139796973 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed8004840 con 0x7fbecc003a20 2024-09-13T23:56:31.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbee6131700 1 -- 172.21.15.87:0/1139796973 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee0117300 con 0x7fbecc003a20 2024-09-13T23:56:31.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbed7fff700 1 -- 172.21.15.87:0/1139796973 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbed8027410 con 0x7fbecc003a20 2024-09-13T23:56:31.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.641+0000 7fbee6131700 1 -- 172.21.15.87:0/1139796973 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee0118b10 con 0x7fbecc003a20 2024-09-13T23:56:31.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.645+0000 7fbed7fff700 1 -- 172.21.15.87:0/1139796973 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7fbed801b070 con 0x7fbecc003a20 2024-09-13T23:56:31.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.645+0000 7fbca37fe700 1 -- 172.21.15.87:0/1878932916 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcac004d50 con 0x7fbcbc070e90 2024-09-13T23:56:31.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.645+0000 7fbcc080c700 1 -- 172.21.15.87:0/1878932916 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcbc0008d0 con 0x7fbcbc070e90 2024-09-13T23:56:31.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.645+0000 7fbca37fe700 1 -- 172.21.15.87:0/1878932916 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbcac0070d0 con 0x7fbcbc070e90 2024-09-13T23:56:31.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.645+0000 7fbca37fe700 1 -- 172.21.15.87:0/1878932916 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7fbcac007230 con 0x7fbcbc070e90 2024-09-13T23:56:31.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.645+0000 7fbca37fe700 1 --2- 172.21.15.87:0/1878932916 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fbca8039a00 0x7fbca803bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.645+0000 7fbca37fe700 1 -- 172.21.15.87:0/1878932916 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3538+0+0 (secure 0 0 0) 0x7fbcac047560 con 0x7fbcbc070e90 2024-09-13T23:56:31.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.645+0000 7f51c37fe700 1 --2- 172.21.15.87:0/1183619496 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f51a4035540 0x7f51a4037a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.645+0000 7fbee6131700 1 -- 172.21.15.87:0/1139796973 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee0117ec0 con 0x7fbecc003a20 2024-09-13T23:56:31.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.645+0000 7fbed7fff700 1 --2- 172.21.15.87:0/1139796973 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fbec003dd00 0x7fbec00401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:31.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.645+0000 7fbcba59c700 1 --2- 172.21.15.87:0/1878932916 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fbca8039a00 0x7fbca803bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.645+0000 7fbedeffd700 1 --2- 172.21.15.87:0/1139796973 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fbec003dd00 0x7fbec00401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:31.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.645+0000 7fbcba59c700 1 --2- 172.21.15.87:0/1878932916 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fbca8039a00 0x7fbca803bec0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0009b20 tx=0x7fbcb0011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.645+0000 7fbedeffd700 1 --2- 172.21.15.87:0/1139796973 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fbec003dd00 0x7fbec00401c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbed00016d0 tx=0x7fbed0001160 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.645+0000 7f51c37fe700 1 --2- 172.21.15.87:0/1183619496 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f51a4035540 0x7f51a4037a00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0016a0 tx=0x7f51bc007b70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:31.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.649+0000 7f51c97b0700 1 -- 172.21.15.87:0/1183619496 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c41205a0 con 0x7f51c406ecb0 2024-09-13T23:56:31.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.649+0000 7fbed7fff700 1 -- 172.21.15.87:0/1139796973 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3538+0+0 (secure 0 0 0) 0x7fbed8047080 con 0x7fbecc003a20 2024-09-13T23:56:31.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.649+0000 7fbca37fe700 1 -- 172.21.15.87:0/1878932916 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbcac0102c0 con 0x7fbcbc070e90 2024-09-13T23:56:31.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.653+0000 7f51c0ff9700 1 -- 172.21.15.87:0/1183619496 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f51ac016070 con 0x7f51c406ecb0 2024-09-13T23:56:31.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.657+0000 7fbed7fff700 1 -- 172.21.15.87:0/1139796973 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbed801b910 con 0x7fbecc003a20 2024-09-13T23:56:31.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.817+0000 7fbee6131700 1 -- 172.21.15.87:0/1139796973 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbee0117aa0 con 0x7fbecc003a20 2024-09-13T23:56:31.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.817+0000 7fbed7fff700 1 -- 172.21.15.87:0/1139796973 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbed8019020 con 0x7fbecc003a20 2024-09-13T23:56:31.826 INFO:teuthology.orchestra.run.smithi087.stdout:38654705668 2024-09-13T23:56:31.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.821+0000 7fbee6131700 1 -- 172.21.15.87:0/1139796973 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fbec003dd00 msgr2=0x7fbec00401c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.821+0000 7fbee6131700 1 --2- 172.21.15.87:0/1139796973 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fbec003dd00 0x7fbec00401c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbed00016d0 tx=0x7fbed0001160 comp rx=0 tx=0).stop 2024-09-13T23:56:31.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.821+0000 7fbee6131700 1 -- 172.21.15.87:0/1139796973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbecc003a20 msgr2=0x7fbee01152d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.821+0000 7fbee6131700 1 --2- 172.21.15.87:0/1139796973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbecc003a20 0x7fbee01152d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbed8017040 tx=0x7fbed8004b60 comp rx=0 tx=0).stop 2024-09-13T23:56:31.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.821+0000 7fbee6131700 1 -- 172.21.15.87:0/1139796973 shutdown_connections 2024-09-13T23:56:31.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.821+0000 7fbee6131700 1 --2- 172.21.15.87:0/1139796973 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fbec003dd00 0x7fbec00401c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.821+0000 7fbee6131700 1 --2- 172.21.15.87:0/1139796973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbecc003a20 0x7fbee01152d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.821+0000 7fbee6131700 1 -- 172.21.15.87:0/1139796973 >> 172.21.15.87:0/1139796973 conn(0x7fbee009b2c0 msgr2=0x7fbee0098440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:31.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.821+0000 7fbee6131700 1 -- 172.21.15.87:0/1139796973 shutdown_connections 2024-09-13T23:56:31.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.821+0000 7fbee6131700 1 -- 172.21.15.87:0/1139796973 wait complete. 2024-09-13T23:56:31.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.821+0000 7ffb2f2dd700 1 -- 172.21.15.87:0/3650205720 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffb2806b7b0 con 0x7ffb2806e7c0 2024-09-13T23:56:31.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.821+0000 7ffb1effd700 1 -- 172.21.15.87:0/3650205720 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffb24010e60 con 0x7ffb2806e7c0 2024-09-13T23:56:31.830 INFO:teuthology.orchestra.run.smithi087.stdout:38654705667 2024-09-13T23:56:31.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.825+0000 7ffb2f2dd700 1 -- 172.21.15.87:0/3650205720 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7ffb0c0354a0 msgr2=0x7ffb0c037960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.825+0000 7ffb2f2dd700 1 --2- 172.21.15.87:0/3650205720 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7ffb0c0354a0 0x7ffb0c037960 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ffb180016d0 tx=0x7ffb18007a20 comp rx=0 tx=0).stop 2024-09-13T23:56:31.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.825+0000 7ffb2f2dd700 1 -- 172.21.15.87:0/3650205720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb2806e7c0 msgr2=0x7ffb2808ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.825+0000 7ffb2f2dd700 1 --2- 172.21.15.87:0/3650205720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb2806e7c0 0x7ffb2808ba90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffb24009b20 tx=0x7ffb24004770 comp rx=0 tx=0).stop 2024-09-13T23:56:31.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.825+0000 7ffb2f2dd700 1 -- 172.21.15.87:0/3650205720 shutdown_connections 2024-09-13T23:56:31.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.825+0000 7ffb2f2dd700 1 --2- 172.21.15.87:0/3650205720 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7ffb0c0354a0 0x7ffb0c037960 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.825+0000 7ffb2f2dd700 1 --2- 172.21.15.87:0/3650205720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb2806e7c0 0x7ffb2808ba90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.825+0000 7ffb2f2dd700 1 -- 172.21.15.87:0/3650205720 >> 172.21.15.87:0/3650205720 conn(0x7ffb280988a0 msgr2=0x7ffb28097bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:31.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.825+0000 7ffb2f2dd700 1 -- 172.21.15.87:0/3650205720 shutdown_connections 2024-09-13T23:56:31.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.825+0000 7ffb2f2dd700 1 -- 172.21.15.87:0/3650205720 wait complete. 2024-09-13T23:56:31.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.825+0000 7f51c97b0700 1 -- 172.21.15.87:0/1183619496 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f51c406e770 con 0x7f51c406ecb0 2024-09-13T23:56:31.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.825+0000 7f51c0ff9700 1 -- 172.21.15.87:0/1183619496 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f51ac01d7d0 con 0x7f51c406ecb0 2024-09-13T23:56:31.835 INFO:teuthology.orchestra.run.smithi087.stdout:38654705668 2024-09-13T23:56:31.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.829+0000 7f51c97b0700 1 -- 172.21.15.87:0/1183619496 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f51a4035540 msgr2=0x7f51a4037a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.829+0000 7f51c97b0700 1 --2- 172.21.15.87:0/1183619496 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f51a4035540 0x7f51a4037a00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0016a0 tx=0x7f51bc007b70 comp rx=0 tx=0).stop 2024-09-13T23:56:31.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.829+0000 7f51c97b0700 1 -- 172.21.15.87:0/1183619496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51c406ecb0 msgr2=0x7f51c411d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.829+0000 7f51c97b0700 1 --2- 172.21.15.87:0/1183619496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51c406ecb0 0x7f51c411d120 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f51ac009b20 tx=0x7f51ac004770 comp rx=0 tx=0).stop 2024-09-13T23:56:31.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.829+0000 7f51c97b0700 1 -- 172.21.15.87:0/1183619496 shutdown_connections 2024-09-13T23:56:31.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.829+0000 7f51c97b0700 1 --2- 172.21.15.87:0/1183619496 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f51a4035540 0x7f51a4037a00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.829+0000 7f51c97b0700 1 --2- 172.21.15.87:0/1183619496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51c406ecb0 0x7f51c411d120 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.829+0000 7f51c97b0700 1 -- 172.21.15.87:0/1183619496 >> 172.21.15.87:0/1183619496 conn(0x7f51c40991a0 msgr2=0x7f51c41b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:31.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.829+0000 7f51c97b0700 1 -- 172.21.15.87:0/1183619496 shutdown_connections 2024-09-13T23:56:31.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.829+0000 7f51c97b0700 1 -- 172.21.15.87:0/1183619496 wait complete. 2024-09-13T23:56:31.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.2 2024-09-13T23:56:31.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.829+0000 7fbcc080c700 1 -- 172.21.15.87:0/1878932916 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbcbc119bb0 con 0x7fbcbc070e90 2024-09-13T23:56:31.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.829+0000 7fbca37fe700 1 -- 172.21.15.87:0/1878932916 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbcac011e80 con 0x7fbcbc070e90 2024-09-13T23:56:31.839 INFO:teuthology.orchestra.run.smithi087.stdout:38654705667 2024-09-13T23:56:31.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.833+0000 7fbcc080c700 1 -- 172.21.15.87:0/1878932916 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fbca8039a00 msgr2=0x7fbca803bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.833+0000 7fbcc080c700 1 --2- 172.21.15.87:0/1878932916 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fbca8039a00 0x7fbca803bec0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0009b20 tx=0x7fbcb0011000 comp rx=0 tx=0).stop 2024-09-13T23:56:31.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.833+0000 7fbcc080c700 1 -- 172.21.15.87:0/1878932916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcbc070e90 msgr2=0x7fbcbc1167c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:31.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.833+0000 7fbcc080c700 1 --2- 172.21.15.87:0/1878932916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcbc070e90 0x7fbcbc1167c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00c4d0 tx=0x7fbcac00c890 comp rx=0 tx=0).stop 2024-09-13T23:56:31.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.833+0000 7fbcc080c700 1 -- 172.21.15.87:0/1878932916 shutdown_connections 2024-09-13T23:56:31.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.833+0000 7fbcc080c700 1 --2- 172.21.15.87:0/1878932916 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fbca8039a00 0x7fbca803bec0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.833+0000 7fbcc080c700 1 --2- 172.21.15.87:0/1878932916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcbc070e90 0x7fbcbc1167c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:31.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.833+0000 7fbcc080c700 1 -- 172.21.15.87:0/1878932916 >> 172.21.15.87:0/1878932916 conn(0x7fbcbc0991a0 msgr2=0x7fbcbc1279f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:31.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.833+0000 7fbcc080c700 1 -- 172.21.15.87:0/1878932916 shutdown_connections 2024-09-13T23:56:31.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:31.833+0000 7fbcc080c700 1 -- 172.21.15.87:0/1878932916 wait complete. 2024-09-13T23:56:31.848 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2024-09-13T23:56:31.848 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.3 2024-09-13T23:56:31.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.1 2024-09-13T23:56:32.839 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T23:56:32.848 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T23:56:32.849 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T23:56:32.855 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T23:56:32.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.949+0000 7f077bfff700 1 Processor -- start 2024-09-13T23:56:32.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.949+0000 7f077bfff700 1 -- start start 2024-09-13T23:56:32.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.949+0000 7f077bfff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f077c12d4a0 0x7f077c12d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:32.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.949+0000 7f077bfff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c071270 con 0x7f077c06dae0 2024-09-13T23:56:32.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.949+0000 7f077bfff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077c070f60 con 0x7f077c12d4a0 2024-09-13T23:56:32.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.949+0000 7f077affd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f077c12d4a0 0x7f077c12d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:32.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.949+0000 7f0773fff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f077c06dae0 0x7f077c06df30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45354/0 (socket says 172.21.15.87:45354) 2024-09-13T23:56:32.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.949+0000 7f0773fff700 1 -- 172.21.15.87:0/2751666835 learned_addr learned my addr 172.21.15.87:0/2751666835 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T23:56:32.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.949+0000 7f077affd700 1 -- 172.21.15.87:0/2751666835 >> v1:172.21.15.87:6789/0 conn(0x7f077c06dae0 legacy=0x7f077c06df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:32.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.949+0000 7f077affd700 1 -- 172.21.15.87:0/2751666835 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c06f820 con 0x7f077c12d4a0 2024-09-13T23:56:32.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.949+0000 7f077affd700 1 --2- 172.21.15.87:0/2751666835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f077c12d4a0 0x7f077c12d880 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f076c0097d0 tx=0x7f076c009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c34a3de177305 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:32.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.949+0000 7f077a7fc700 1 -- 172.21.15.87:0/2751666835 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f076c0041c0 con 0x7f077c12d4a0 2024-09-13T23:56:32.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.949+0000 7f077a7fc700 1 -- 172.21.15.87:0/2751666835 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c004320 con 0x7f077c12d4a0 2024-09-13T23:56:32.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.949+0000 7f077a7fc700 1 -- 172.21.15.87:0/2751666835 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f076c0036c0 con 0x7f077c12d4a0 2024-09-13T23:56:32.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.953+0000 7f077bfff700 1 -- 172.21.15.87:0/2751666835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f077c12d4a0 msgr2=0x7f077c12d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:32.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.953+0000 7f077bfff700 1 --2- 172.21.15.87:0/2751666835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f077c12d4a0 0x7f077c12d880 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f076c0097d0 tx=0x7f076c009ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:32.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.953+0000 7f077bfff700 1 -- 172.21.15.87:0/2751666835 shutdown_connections 2024-09-13T23:56:32.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.953+0000 7f077bfff700 1 --2- 172.21.15.87:0/2751666835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f077c12d4a0 0x7f077c12d880 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:32.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.953+0000 7f077bfff700 1 -- 172.21.15.87:0/2751666835 >> 172.21.15.87:0/2751666835 conn(0x7f077c09cd10 msgr2=0x7f077c06c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:32.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.953+0000 7f077bfff700 1 -- 172.21.15.87:0/2751666835 shutdown_connections 2024-09-13T23:56:32.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.953+0000 7f077bfff700 1 -- 172.21.15.87:0/2751666835 wait complete. 2024-09-13T23:56:32.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.953+0000 7f077bfff700 1 Processor -- start 2024-09-13T23:56:32.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.953+0000 7f077bfff700 1 -- start start 2024-09-13T23:56:32.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.953+0000 7f077bfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f077c06dae0 0x7f077c11f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:32.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.953+0000 7f077bfff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c1228f0 con 0x7f077c06dae0 2024-09-13T23:56:32.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.953+0000 7f077affd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f077c06dae0 0x7f077c11f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:32.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.953+0000 7f077affd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f077c06dae0 0x7f077c11f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40154/0 (socket says 172.21.15.87:40154) 2024-09-13T23:56:32.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.953+0000 7f077affd700 1 -- 172.21.15.87:0/1980735174 learned_addr learned my addr 172.21.15.87:0/1980735174 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:32.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.953+0000 7f077affd700 1 -- 172.21.15.87:0/1980735174 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c0094b0 con 0x7f077c06dae0 2024-09-13T23:56:32.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.953+0000 7f077affd700 1 --2- 172.21.15.87:0/1980735174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f077c06dae0 0x7f077c11f380 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f076c0090b0 tx=0x7f076c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:32.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.953+0000 7f07737fe700 1 -- 172.21.15.87:0/1980735174 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f076c006ea0 con 0x7f077c06dae0 2024-09-13T23:56:32.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.953+0000 7f07737fe700 1 -- 172.21.15.87:0/1980735174 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c003e10 con 0x7f077c06dae0 2024-09-13T23:56:32.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.953+0000 7f07737fe700 1 -- 172.21.15.87:0/1980735174 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f076c0119b0 con 0x7f077c06dae0 2024-09-13T23:56:32.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.953+0000 7f077bfff700 1 -- 172.21.15.87:0/1980735174 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077c121b90 con 0x7f077c06dae0 2024-09-13T23:56:32.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.953+0000 7f077bfff700 1 -- 172.21.15.87:0/1980735174 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077c120eb0 con 0x7f077c06dae0 2024-09-13T23:56:32.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.957+0000 7f07737fe700 1 -- 172.21.15.87:0/1980735174 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f076c018050 con 0x7f077c06dae0 2024-09-13T23:56:32.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.957+0000 7f077bfff700 1 -- 172.21.15.87:0/1980735174 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0760005100 con 0x7f077c06dae0 2024-09-13T23:56:32.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.957+0000 7f07737fe700 1 --2- 172.21.15.87:0/1980735174 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f07680354f0 0x7f07680379b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:32.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.957+0000 7f07737fe700 1 -- 172.21.15.87:0/1980735174 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3538+0+0 (secure 0 0 0) 0x7f076c048600 con 0x7f077c06dae0 2024-09-13T23:56:32.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.957+0000 7f0773fff700 1 --2- 172.21.15.87:0/1980735174 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f07680354f0 0x7f07680379b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:32.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.957+0000 7f0773fff700 1 --2- 172.21.15.87:0/1980735174 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f07680354f0 0x7f07680379b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f07640016a0 tx=0x7f0764007b70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:32.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.965+0000 7f07737fe700 1 -- 172.21.15.87:0/1980735174 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f076c02b020 con 0x7f077c06dae0 2024-09-13T23:56:32.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.989+0000 7f47b9a38700 1 Processor -- start 2024-09-13T23:56:32.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.989+0000 7f47b9a38700 1 -- start start 2024-09-13T23:56:32.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.989+0000 7f47b9a38700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f47b412de60 0x7f47b4130250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:32.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.989+0000 7f47b9a38700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b4071180 con 0x7f47b4095420 2024-09-13T23:56:32.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.989+0000 7f47b9a38700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b4070f90 con 0x7f47b412de60 2024-09-13T23:56:32.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.989+0000 7f47b8a36700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f47b4095420 0x7f47b4095800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45360/0 (socket says 172.21.15.87:45360) 2024-09-13T23:56:32.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.989+0000 7f47b3fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f47b412de60 0x7f47b4130250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:32.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.989+0000 7f47b8a36700 1 -- 172.21.15.87:0/1373059903 learned_addr learned my addr 172.21.15.87:0/1373059903 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T23:56:32.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.989+0000 7f47b3fff700 1 -- 172.21.15.87:0/1373059903 >> v1:172.21.15.87:6789/0 conn(0x7f47b4095420 legacy=0x7f47b4095800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:32.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.989+0000 7f47b3fff700 1 -- 172.21.15.87:0/1373059903 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b406ae20 con 0x7f47b412de60 2024-09-13T23:56:32.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.989+0000 7f47b37fe700 1 -- 172.21.15.87:0/1373059903 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482987548 0 0) 0x7f47b4071180 con 0x7f47b4095420 2024-09-13T23:56:32.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.989+0000 7f47b3fff700 1 --2- 172.21.15.87:0/1373059903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47b412de60 0x7f47b4130250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f47a80097d0 tx=0x7f47a8009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aadcfe267a0c50e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:32.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.989+0000 7f47b37fe700 1 -- 172.21.15.87:0/1373059903 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47a80041c0 con 0x7f47b412de60 2024-09-13T23:56:32.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.989+0000 7f47b37fe700 1 -- 172.21.15.87:0/1373059903 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a8004320 con 0x7f47b412de60 2024-09-13T23:56:32.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.989+0000 7f47b37fe700 1 -- 172.21.15.87:0/1373059903 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47a80036c0 con 0x7f47b412de60 2024-09-13T23:56:32.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.989+0000 7f47b9a38700 1 -- 172.21.15.87:0/1373059903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47b412de60 msgr2=0x7f47b4130250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:32.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.989+0000 7f47b9a38700 1 --2- 172.21.15.87:0/1373059903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47b412de60 0x7f47b4130250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f47a80097d0 tx=0x7f47a8009ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:32.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.989+0000 7f47b9a38700 1 -- 172.21.15.87:0/1373059903 shutdown_connections 2024-09-13T23:56:32.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.989+0000 7f47b9a38700 1 --2- 172.21.15.87:0/1373059903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47b412de60 0x7f47b4130250 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:32.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.989+0000 7f47b9a38700 1 -- 172.21.15.87:0/1373059903 >> 172.21.15.87:0/1373059903 conn(0x7f47b40988a0 msgr2=0x7f47b4098cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:32.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.989+0000 7f47b9a38700 1 -- 172.21.15.87:0/1373059903 shutdown_connections 2024-09-13T23:56:32.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.989+0000 7f47b9a38700 1 -- 172.21.15.87:0/1373059903 wait complete. 2024-09-13T23:56:33.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.993+0000 7f47b9a38700 1 Processor -- start 2024-09-13T23:56:33.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.993+0000 7f47b9a38700 1 -- start start 2024-09-13T23:56:33.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.993+0000 7f47b9a38700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47b4095420 0x7f47b41bfc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:33.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.993+0000 7f47b9a38700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b4093b60 con 0x7f47b4095420 2024-09-13T23:56:33.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.993+0000 7f47b8a36700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47b4095420 0x7f47b41bfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:33.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.993+0000 7f47b8a36700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47b4095420 0x7f47b41bfc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40166/0 (socket says 172.21.15.87:40166) 2024-09-13T23:56:33.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.993+0000 7f47b8a36700 1 -- 172.21.15.87:0/4006697977 learned_addr learned my addr 172.21.15.87:0/4006697977 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:33.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.993+0000 7f47b8a36700 1 -- 172.21.15.87:0/4006697977 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a80094b0 con 0x7f47b4095420 2024-09-13T23:56:33.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.993+0000 7f47b8a36700 1 --2- 172.21.15.87:0/4006697977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47b4095420 0x7f47b41bfc30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00cc00 tx=0x7f47ac00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:33.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.993+0000 7f47b17fa700 1 -- 172.21.15.87:0/4006697977 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47ac00aa90 con 0x7f47b4095420 2024-09-13T23:56:33.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.993+0000 7f47b17fa700 1 -- 172.21.15.87:0/4006697977 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ac00ac10 con 0x7f47b4095420 2024-09-13T23:56:33.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.993+0000 7f47b9a38700 1 -- 172.21.15.87:0/4006697977 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b4094870 con 0x7f47b4095420 2024-09-13T23:56:33.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.993+0000 7f47b17fa700 1 -- 172.21.15.87:0/4006697977 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47ac0070d0 con 0x7f47b4095420 2024-09-13T23:56:33.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.993+0000 7f47b9a38700 1 -- 172.21.15.87:0/4006697977 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b40944d0 con 0x7f47b4095420 2024-09-13T23:56:33.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.993+0000 7f47b17fa700 1 -- 172.21.15.87:0/4006697977 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f47ac007230 con 0x7f47b4095420 2024-09-13T23:56:33.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.993+0000 7f47b17fa700 1 --2- 172.21.15.87:0/4006697977 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f47a00354f0 0x7f47a00379b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:33.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.993+0000 7f47b17fa700 1 -- 172.21.15.87:0/4006697977 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3538+0+0 (secure 0 0 0) 0x7f47ac0476a0 con 0x7f47b4095420 2024-09-13T23:56:33.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.993+0000 7f47b3fff700 1 --2- 172.21.15.87:0/4006697977 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f47a00354f0 0x7f47a00379b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:33.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.997+0000 7f47b9a38700 1 -- 172.21.15.87:0/4006697977 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4794005100 con 0x7f47b4095420 2024-09-13T23:56:33.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.997+0000 7f47b3fff700 1 --2- 172.21.15.87:0/4006697977 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f47a00354f0 0x7f47a00379b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f47a8014040 tx=0x7f47a8010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:33.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.997+0000 7f4271d59700 1 Processor -- start 2024-09-13T23:56:33.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.997+0000 7f4271d59700 1 -- start start 2024-09-13T23:56:33.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.997+0000 7fa86ffff700 1 Processor -- start 2024-09-13T23:56:33.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.997+0000 7fa86ffff700 1 -- start start 2024-09-13T23:56:33.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.997+0000 7f4271d59700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f426c06e390 0x7f426c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:33.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.997+0000 7f4271d59700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426c071200 con 0x7f426c06ecb0 2024-09-13T23:56:33.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.997+0000 7f4271d59700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f426c071480 con 0x7f426c06e390 2024-09-13T23:56:33.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.997+0000 7fa86ffff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa87012c4c0 0x7fa87012e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:33.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.997+0000 7fa86ffff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87006c380 con 0x7fa870125f20 2024-09-13T23:56:33.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.997+0000 7fa86ffff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa870072070 con 0x7fa87012c4c0 2024-09-13T23:56:33.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.997+0000 7f4270d57700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f426c06e390 0x7f426c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:33.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.997+0000 7f4270d57700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f426c06e390 0x7f426c06e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40176/0 (socket says 172.21.15.87:40176) 2024-09-13T23:56:33.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.997+0000 7f4270d57700 1 -- 172.21.15.87:0/761957178 learned_addr learned my addr 172.21.15.87:0/761957178 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:33.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.997+0000 7fa86effd700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fa870125f20 0x7fa870126300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45364/0 (socket says 172.21.15.87:45364) 2024-09-13T23:56:33.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.997+0000 7fa86effd700 1 -- 172.21.15.87:0/240427826 learned_addr learned my addr 172.21.15.87:0/240427826 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T23:56:33.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.997+0000 7fa86e7fc700 1 --2- 172.21.15.87:0/240427826 >> v2:172.21.15.87:3300/0 conn(0x7fa87012c4c0 0x7fa87012e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:33.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.997+0000 7fa86e7fc700 1 -- 172.21.15.87:0/240427826 >> v1:172.21.15.87:6789/0 conn(0x7fa870125f20 legacy=0x7fa870126300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:33.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.997+0000 7fa86e7fc700 1 -- 172.21.15.87:0/240427826 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa870071d30 con 0x7fa87012c4c0 2024-09-13T23:56:33.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.997+0000 7f4270d57700 1 -- 172.21.15.87:0/761957178 >> v1:172.21.15.87:6789/0 conn(0x7f426c06ecb0 legacy=0x7f426c12ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:33.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.997+0000 7f4270d57700 1 -- 172.21.15.87:0/761957178 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c09af40 con 0x7f426c06e390 2024-09-13T23:56:33.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:32.997+0000 7fa86e7fc700 1 --2- 172.21.15.87:0/240427826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa87012c4c0 0x7fa87012e8b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa868009d90 tx=0x7fa86800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591e75c3d912b8ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:33.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.001+0000 7f4270d57700 1 --2- 172.21.15.87:0/761957178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f426c06e390 0x7f426c06e770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4264009e50 tx=0x7f426400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c628b4361c193d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:33.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.001+0000 7f426b7fe700 1 -- 172.21.15.87:0/761957178 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f426400e070 con 0x7f426c06e390 2024-09-13T23:56:33.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.001+0000 7f426b7fe700 1 -- 172.21.15.87:0/761957178 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4264003a40 con 0x7f426c06e390 2024-09-13T23:56:33.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.001+0000 7fa86dffb700 1 -- 172.21.15.87:0/240427826 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa86800e070 con 0x7fa87012c4c0 2024-09-13T23:56:33.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.001+0000 7fa86dffb700 1 -- 172.21.15.87:0/240427826 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86800bc80 con 0x7fa87012c4c0 2024-09-13T23:56:33.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.001+0000 7fa86dffb700 1 -- 172.21.15.87:0/240427826 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa868003a40 con 0x7fa87012c4c0 2024-09-13T23:56:33.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.001+0000 7f426b7fe700 1 -- 172.21.15.87:0/761957178 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4264003d00 con 0x7f426c06e390 2024-09-13T23:56:33.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.001+0000 7f47b17fa700 1 -- 172.21.15.87:0/4006697977 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f47ac018070 con 0x7f47b4095420 2024-09-13T23:56:33.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.001+0000 7f4271d59700 1 -- 172.21.15.87:0/761957178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f426c06e390 msgr2=0x7f426c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:33.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.001+0000 7f4271d59700 1 --2- 172.21.15.87:0/761957178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f426c06e390 0x7f426c06e770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4264009e50 tx=0x7f426400b330 comp rx=0 tx=0).stop 2024-09-13T23:56:33.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.001+0000 7fa86ffff700 1 -- 172.21.15.87:0/240427826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa87012c4c0 msgr2=0x7fa87012e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:33.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.001+0000 7fa86ffff700 1 --2- 172.21.15.87:0/240427826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa87012c4c0 0x7fa87012e8b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa868009d90 tx=0x7fa86800b330 comp rx=0 tx=0).stop 2024-09-13T23:56:33.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.001+0000 7f4271d59700 1 -- 172.21.15.87:0/761957178 shutdown_connections 2024-09-13T23:56:33.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.001+0000 7f4271d59700 1 --2- 172.21.15.87:0/761957178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f426c06e390 0x7f426c06e770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:33.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.001+0000 7f4271d59700 1 -- 172.21.15.87:0/761957178 >> 172.21.15.87:0/761957178 conn(0x7f426c0991a0 msgr2=0x7f426c0995b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:33.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.001+0000 7fa86ffff700 1 -- 172.21.15.87:0/240427826 shutdown_connections 2024-09-13T23:56:33.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.001+0000 7fa86ffff700 1 --2- 172.21.15.87:0/240427826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa87012c4c0 0x7fa87012e8b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:33.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.001+0000 7fa86ffff700 1 -- 172.21.15.87:0/240427826 >> 172.21.15.87:0/240427826 conn(0x7fa8700991a0 msgr2=0x7fa8700995b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:33.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.001+0000 7f4271d59700 1 -- 172.21.15.87:0/761957178 shutdown_connections 2024-09-13T23:56:33.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.001+0000 7f4271d59700 1 -- 172.21.15.87:0/761957178 wait complete. 2024-09-13T23:56:33.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.001+0000 7fa86ffff700 1 -- 172.21.15.87:0/240427826 shutdown_connections 2024-09-13T23:56:33.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.001+0000 7fa86ffff700 1 -- 172.21.15.87:0/240427826 wait complete. 2024-09-13T23:56:33.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7f4271d59700 1 Processor -- start 2024-09-13T23:56:33.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7fa86ffff700 1 Processor -- start 2024-09-13T23:56:33.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7f4271d59700 1 -- start start 2024-09-13T23:56:33.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7f4271d59700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f426c06e390 0x7f426c11c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:33.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7f4271d59700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426c11eed0 con 0x7f426c06e390 2024-09-13T23:56:33.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7fa86ffff700 1 -- start start 2024-09-13T23:56:33.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7f4270d57700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f426c06e390 0x7f426c11c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:33.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7f4270d57700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f426c06e390 0x7f426c11c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40190/0 (socket says 172.21.15.87:40190) 2024-09-13T23:56:33.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7f4270d57700 1 -- 172.21.15.87:0/1009956499 learned_addr learned my addr 172.21.15.87:0/1009956499 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:33.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7fa86ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa870125f20 0x7fa8701bd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:33.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7fa86ffff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa870115c80 con 0x7fa870125f20 2024-09-13T23:56:33.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7fa86effd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa870125f20 0x7fa8701bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:33.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7f4270d57700 1 -- 172.21.15.87:0/1009956499 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4264009b30 con 0x7f426c06e390 2024-09-13T23:56:33.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7fa86effd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa870125f20 0x7fa8701bd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40200/0 (socket says 172.21.15.87:40200) 2024-09-13T23:56:33.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7fa86effd700 1 -- 172.21.15.87:0/753566783 learned_addr learned my addr 172.21.15.87:0/753566783 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:33.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7f4270d57700 1 --2- 172.21.15.87:0/1009956499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f426c06e390 0x7f426c11c1a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4264000f80 tx=0x7f4264004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:33.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7f42697fa700 1 -- 172.21.15.87:0/1009956499 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4264004430 con 0x7f426c06e390 2024-09-13T23:56:33.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7fa86effd700 1 -- 172.21.15.87:0/753566783 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa868009a70 con 0x7fa870125f20 2024-09-13T23:56:33.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7f42697fa700 1 -- 172.21.15.87:0/1009956499 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4264004590 con 0x7f426c06e390 2024-09-13T23:56:33.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7f42697fa700 1 -- 172.21.15.87:0/1009956499 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4264004850 con 0x7f426c06e390 2024-09-13T23:56:33.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7fa86effd700 1 --2- 172.21.15.87:0/753566783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa870125f20 0x7fa8701bd670 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa86400c390 tx=0x7fa86400c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:33.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7fa8577fe700 1 -- 172.21.15.87:0/753566783 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa864005b90 con 0x7fa870125f20 2024-09-13T23:56:33.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7fa8577fe700 1 -- 172.21.15.87:0/753566783 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa864005cf0 con 0x7fa870125f20 2024-09-13T23:56:33.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7fa86ffff700 1 -- 172.21.15.87:0/753566783 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa870116420 con 0x7fa870125f20 2024-09-13T23:56:33.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7fa8577fe700 1 -- 172.21.15.87:0/753566783 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa864004890 con 0x7fa870125f20 2024-09-13T23:56:33.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7f4271d59700 1 -- 172.21.15.87:0/1009956499 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f426c11eb60 con 0x7f426c06e390 2024-09-13T23:56:33.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7f4271d59700 1 -- 172.21.15.87:0/1009956499 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426c11f2d0 con 0x7f426c06e390 2024-09-13T23:56:33.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.009+0000 7f42697fa700 1 -- 172.21.15.87:0/1009956499 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f4264019030 con 0x7f426c06e390 2024-09-13T23:56:33.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.005+0000 7fa86ffff700 1 -- 172.21.15.87:0/753566783 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa870116960 con 0x7fa870125f20 2024-09-13T23:56:33.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.009+0000 7fa8577fe700 1 -- 172.21.15.87:0/753566783 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7fa8640049f0 con 0x7fa870125f20 2024-09-13T23:56:33.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.009+0000 7f42697fa700 1 --2- 172.21.15.87:0/1009956499 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f4258035540 0x7f4258037a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:33.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.009+0000 7f42697fa700 1 -- 172.21.15.87:0/1009956499 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3538+0+0 (secure 0 0 0) 0x7f4264048c60 con 0x7f426c06e390 2024-09-13T23:56:33.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.009+0000 7fa8577fe700 1 --2- 172.21.15.87:0/753566783 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fa858039910 0x7fa85803bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:33.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.009+0000 7fa8577fe700 1 -- 172.21.15.87:0/753566783 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3538+0+0 (secure 0 0 0) 0x7fa864046ee0 con 0x7fa870125f20 2024-09-13T23:56:33.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.009+0000 7f426bfff700 1 --2- 172.21.15.87:0/1009956499 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f4258035540 0x7f4258037a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:33.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.009+0000 7fa86e7fc700 1 --2- 172.21.15.87:0/753566783 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fa858039910 0x7fa85803bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:33.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.009+0000 7f426bfff700 1 --2- 172.21.15.87:0/1009956499 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f4258035540 0x7f4258037a00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f425c001620 tx=0x7f425c007b00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:33.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.009+0000 7fa86e7fc700 1 --2- 172.21.15.87:0/753566783 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fa858039910 0x7fa85803bdd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa870126d70 tx=0x7fa868011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:33.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.013+0000 7f4271d59700 1 -- 172.21.15.87:0/1009956499 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f426c06e770 con 0x7f426c06e390 2024-09-13T23:56:33.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.013+0000 7fa86ffff700 1 -- 172.21.15.87:0/753566783 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8701269f0 con 0x7fa870125f20 2024-09-13T23:56:33.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.017+0000 7f42697fa700 1 -- 172.21.15.87:0/1009956499 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f426402a080 con 0x7f426c06e390 2024-09-13T23:56:33.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.021+0000 7fa8577fe700 1 -- 172.21.15.87:0/753566783 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa8701269f0 con 0x7fa870125f20 2024-09-13T23:56:33.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.137+0000 7f077bfff700 1 -- 172.21.15.87:0/1980735174 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f07600053b0 con 0x7f077c06dae0 2024-09-13T23:56:33.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.137+0000 7f07737fe700 1 -- 172.21.15.87:0/1980735174 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f076c016070 con 0x7f077c06dae0 2024-09-13T23:56:33.146 INFO:teuthology.orchestra.run.smithi087.stdout:38654705668 2024-09-13T23:56:33.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.141+0000 7f077bfff700 1 -- 172.21.15.87:0/1980735174 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f07680354f0 msgr2=0x7f07680379b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:33.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.141+0000 7f077bfff700 1 --2- 172.21.15.87:0/1980735174 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f07680354f0 0x7f07680379b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f07640016a0 tx=0x7f0764007b70 comp rx=0 tx=0).stop 2024-09-13T23:56:33.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.141+0000 7f077bfff700 1 -- 172.21.15.87:0/1980735174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f077c06dae0 msgr2=0x7f077c11f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:33.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.141+0000 7f077bfff700 1 --2- 172.21.15.87:0/1980735174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f077c06dae0 0x7f077c11f380 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f076c0090b0 tx=0x7f076c004770 comp rx=0 tx=0).stop 2024-09-13T23:56:33.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.141+0000 7f077bfff700 1 -- 172.21.15.87:0/1980735174 shutdown_connections 2024-09-13T23:56:33.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.141+0000 7f077bfff700 1 --2- 172.21.15.87:0/1980735174 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f07680354f0 0x7f07680379b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:33.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.141+0000 7f077bfff700 1 --2- 172.21.15.87:0/1980735174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f077c06dae0 0x7f077c11f380 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:33.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.141+0000 7f077bfff700 1 -- 172.21.15.87:0/1980735174 >> 172.21.15.87:0/1980735174 conn(0x7f077c09cd10 msgr2=0x7f077c12b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:33.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.141+0000 7f077bfff700 1 -- 172.21.15.87:0/1980735174 shutdown_connections 2024-09-13T23:56:33.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.141+0000 7f077bfff700 1 -- 172.21.15.87:0/1980735174 wait complete. 2024-09-13T23:56:33.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.2 2024-09-13T23:56:33.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.173+0000 7f47b9a38700 1 -- 172.21.15.87:0/4006697977 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f47940053b0 con 0x7f47b4095420 2024-09-13T23:56:33.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.173+0000 7f47b17fa700 1 -- 172.21.15.87:0/4006697977 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f47ac01a2c0 con 0x7f47b4095420 2024-09-13T23:56:33.181 INFO:teuthology.orchestra.run.smithi087.stdout:38654705668 2024-09-13T23:56:33.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.177+0000 7f47b9a38700 1 -- 172.21.15.87:0/4006697977 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f47a00354f0 msgr2=0x7f47a00379b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:33.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.177+0000 7f47b9a38700 1 --2- 172.21.15.87:0/4006697977 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f47a00354f0 0x7f47a00379b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f47a8014040 tx=0x7f47a8010000 comp rx=0 tx=0).stop 2024-09-13T23:56:33.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.177+0000 7f47b9a38700 1 -- 172.21.15.87:0/4006697977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47b4095420 msgr2=0x7f47b41bfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:33.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.177+0000 7f47b9a38700 1 --2- 172.21.15.87:0/4006697977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47b4095420 0x7f47b41bfc30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00cc00 tx=0x7f47ac00a060 comp rx=0 tx=0).stop 2024-09-13T23:56:33.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.177+0000 7f47b9a38700 1 -- 172.21.15.87:0/4006697977 shutdown_connections 2024-09-13T23:56:33.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.177+0000 7f47b9a38700 1 --2- 172.21.15.87:0/4006697977 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f47a00354f0 0x7f47a00379b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:33.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.177+0000 7f47b9a38700 1 --2- 172.21.15.87:0/4006697977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47b4095420 0x7f47b41bfc30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:33.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.177+0000 7f47b9a38700 1 -- 172.21.15.87:0/4006697977 >> 172.21.15.87:0/4006697977 conn(0x7f47b40988a0 msgr2=0x7f47b4096dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:33.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.177+0000 7f47b9a38700 1 -- 172.21.15.87:0/4006697977 shutdown_connections 2024-09-13T23:56:33.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.177+0000 7f47b9a38700 1 -- 172.21.15.87:0/4006697977 wait complete. 2024-09-13T23:56:33.194 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2024-09-13T23:56:33.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.185+0000 7fa86ffff700 1 -- 172.21.15.87:0/753566783 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa8701269f0 con 0x7fa870125f20 2024-09-13T23:56:33.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.189+0000 7fa8577fe700 1 -- 172.21.15.87:0/753566783 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa8701269f0 con 0x7fa870125f20 2024-09-13T23:56:33.195 INFO:teuthology.orchestra.run.smithi087.stdout:38654705667 2024-09-13T23:56:33.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.189+0000 7f4271d59700 1 -- 172.21.15.87:0/1009956499 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f426c11f520 con 0x7f426c06e390 2024-09-13T23:56:33.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.189+0000 7f42697fa700 1 -- 172.21.15.87:0/1009956499 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4264017070 con 0x7f426c06e390 2024-09-13T23:56:33.197 INFO:teuthology.orchestra.run.smithi087.stdout:38654705667 2024-09-13T23:56:33.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.189+0000 7fa86ffff700 1 -- 172.21.15.87:0/753566783 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fa858039910 msgr2=0x7fa85803bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:33.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.189+0000 7fa86ffff700 1 --2- 172.21.15.87:0/753566783 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fa858039910 0x7fa85803bdd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa870126d70 tx=0x7fa868011000 comp rx=0 tx=0).stop 2024-09-13T23:56:33.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.189+0000 7fa86ffff700 1 -- 172.21.15.87:0/753566783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa870125f20 msgr2=0x7fa8701bd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:33.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.189+0000 7fa86ffff700 1 --2- 172.21.15.87:0/753566783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa870125f20 0x7fa8701bd670 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa86400c390 tx=0x7fa86400c750 comp rx=0 tx=0).stop 2024-09-13T23:56:33.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.189+0000 7fa86ffff700 1 -- 172.21.15.87:0/753566783 shutdown_connections 2024-09-13T23:56:33.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.189+0000 7fa86ffff700 1 --2- 172.21.15.87:0/753566783 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fa858039910 0x7fa85803bdd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:33.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.189+0000 7fa86ffff700 1 --2- 172.21.15.87:0/753566783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa870125f20 0x7fa8701bd670 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:33.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.189+0000 7fa86ffff700 1 -- 172.21.15.87:0/753566783 >> 172.21.15.87:0/753566783 conn(0x7fa8700991a0 msgr2=0x7fa870124680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:33.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.189+0000 7fa86ffff700 1 -- 172.21.15.87:0/753566783 shutdown_connections 2024-09-13T23:56:33.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.189+0000 7fa86ffff700 1 -- 172.21.15.87:0/753566783 wait complete. 2024-09-13T23:56:33.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.193+0000 7f4271d59700 1 -- 172.21.15.87:0/1009956499 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f4258035540 msgr2=0x7f4258037a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:33.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.193+0000 7f4271d59700 1 --2- 172.21.15.87:0/1009956499 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f4258035540 0x7f4258037a00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f425c001620 tx=0x7f425c007b00 comp rx=0 tx=0).stop 2024-09-13T23:56:33.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.193+0000 7f4271d59700 1 -- 172.21.15.87:0/1009956499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f426c06e390 msgr2=0x7f426c11c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:33.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.193+0000 7f4271d59700 1 --2- 172.21.15.87:0/1009956499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f426c06e390 0x7f426c11c1a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4264000f80 tx=0x7f4264004af0 comp rx=0 tx=0).stop 2024-09-13T23:56:33.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.193+0000 7f4271d59700 1 -- 172.21.15.87:0/1009956499 shutdown_connections 2024-09-13T23:56:33.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.193+0000 7f4271d59700 1 --2- 172.21.15.87:0/1009956499 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f4258035540 0x7f4258037a00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:33.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.193+0000 7f4271d59700 1 --2- 172.21.15.87:0/1009956499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f426c06e390 0x7f426c11c1a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:33.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.193+0000 7f4271d59700 1 -- 172.21.15.87:0/1009956499 >> 172.21.15.87:0/1009956499 conn(0x7f426c0991a0 msgr2=0x7f426c1b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:33.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.193+0000 7f4271d59700 1 -- 172.21.15.87:0/1009956499 shutdown_connections 2024-09-13T23:56:33.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:33.193+0000 7f4271d59700 1 -- 172.21.15.87:0/1009956499 wait complete. 2024-09-13T23:56:33.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.1 2024-09-13T23:56:33.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.3 2024-09-13T23:56:34.160 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T23:56:34.195 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T23:56:34.211 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T23:56:34.211 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T23:56:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.288+0000 7fe802bc4700 1 Processor -- start 2024-09-13T23:56:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.288+0000 7fe802bc4700 1 -- start start 2024-09-13T23:56:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.288+0000 7fe802bc4700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe7fc12d880 0x7fe7fc06e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.288+0000 7fe802bc4700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7fc12dcd0 con 0x7fe7fc12d4a0 2024-09-13T23:56:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.288+0000 7fe802bc4700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7fc071270 con 0x7fe7fc12d880 2024-09-13T23:56:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.288+0000 7fe801bc2700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe7fc12d4a0 0x7fe7fc06dae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45388/0 (socket says 172.21.15.87:45388) 2024-09-13T23:56:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.288+0000 7fe801bc2700 1 -- 172.21.15.87:0/3548371181 learned_addr learned my addr 172.21.15.87:0/3548371181 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T23:56:34.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.288+0000 7fe8013c1700 1 --2- 172.21.15.87:0/3548371181 >> v2:172.21.15.87:3300/0 conn(0x7fe7fc12d880 0x7fe7fc06e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:34.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.288+0000 7fe800bc0700 1 -- 172.21.15.87:0/3548371181 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130058738 0 0) 0x7fe7fc12dcd0 con 0x7fe7fc12d4a0 2024-09-13T23:56:34.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.288+0000 7fe800bc0700 1 -- 172.21.15.87:0/3548371181 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7e80035d0 con 0x7fe7fc12d4a0 2024-09-13T23:56:34.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.288+0000 7fe8013c1700 1 -- 172.21.15.87:0/3548371181 >> v1:172.21.15.87:6789/0 conn(0x7fe7fc12d4a0 legacy=0x7fe7fc06dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:34.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.288+0000 7fe8013c1700 1 -- 172.21.15.87:0/3548371181 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc070f60 con 0x7fe7fc12d880 2024-09-13T23:56:34.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.292+0000 7fe8013c1700 1 --2- 172.21.15.87:0/3548371181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7fc12d880 0x7fe7fc06e1f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec0097d0 tx=0x7fe7ec009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160c244e96170275 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.292+0000 7fe800bc0700 1 -- 172.21.15.87:0/3548371181 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7ec004160 con 0x7fe7fc12d880 2024-09-13T23:56:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.292+0000 7fe800bc0700 1 -- 172.21.15.87:0/3548371181 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ec0042c0 con 0x7fe7fc12d880 2024-09-13T23:56:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.292+0000 7fe800bc0700 1 -- 172.21.15.87:0/3548371181 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7ec0045a0 con 0x7fe7fc12d880 2024-09-13T23:56:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.292+0000 7fe802bc4700 1 -- 172.21.15.87:0/3548371181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7fc12d880 msgr2=0x7fe7fc06e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.292+0000 7fe802bc4700 1 --2- 172.21.15.87:0/3548371181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7fc12d880 0x7fe7fc06e1f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec0097d0 tx=0x7fe7ec009ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.292+0000 7fe802bc4700 1 -- 172.21.15.87:0/3548371181 shutdown_connections 2024-09-13T23:56:34.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.292+0000 7fe802bc4700 1 --2- 172.21.15.87:0/3548371181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7fc12d880 0x7fe7fc06e1f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:34.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.292+0000 7fe802bc4700 1 -- 172.21.15.87:0/3548371181 >> 172.21.15.87:0/3548371181 conn(0x7fe7fc09cd10 msgr2=0x7fe7fc06c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:34.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.292+0000 7fe802bc4700 1 -- 172.21.15.87:0/3548371181 shutdown_connections 2024-09-13T23:56:34.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.292+0000 7fe802bc4700 1 -- 172.21.15.87:0/3548371181 wait complete. 2024-09-13T23:56:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.292+0000 7fe802bc4700 1 Processor -- start 2024-09-13T23:56:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.292+0000 7fe802bc4700 1 -- start start 2024-09-13T23:56:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.292+0000 7fe802bc4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7fc12d4a0 0x7fe7fc11f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.292+0000 7fe802bc4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc122db0 con 0x7fe7fc12d4a0 2024-09-13T23:56:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.292+0000 7fe801bc2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7fc12d4a0 0x7fe7fc11f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.292+0000 7fe801bc2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7fc12d4a0 0x7fe7fc11f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40230/0 (socket says 172.21.15.87:40230) 2024-09-13T23:56:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.292+0000 7fe801bc2700 1 -- 172.21.15.87:0/997837460 learned_addr learned my addr 172.21.15.87:0/997837460 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:34.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.292+0000 7fe801bc2700 1 -- 172.21.15.87:0/997837460 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ec0094b0 con 0x7fe7fc12d4a0 2024-09-13T23:56:34.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.292+0000 7fe801bc2700 1 --2- 172.21.15.87:0/997837460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7fc12d4a0 0x7fe7fc11f9a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe7f800c680 tx=0x7fe7f800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:34.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.296+0000 7fe7f27fc700 1 -- 172.21.15.87:0/997837460 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7f8005cc0 con 0x7fe7fc12d4a0 2024-09-13T23:56:34.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.296+0000 7fe7f27fc700 1 -- 172.21.15.87:0/997837460 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f8005e20 con 0x7fe7fc12d4a0 2024-09-13T23:56:34.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.296+0000 7fe7f27fc700 1 -- 172.21.15.87:0/997837460 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7f8007220 con 0x7fe7fc12d4a0 2024-09-13T23:56:34.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.296+0000 7fe802bc4700 1 -- 172.21.15.87:0/997837460 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7fc121300 con 0x7fe7fc12d4a0 2024-09-13T23:56:34.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.296+0000 7fe802bc4700 1 -- 172.21.15.87:0/997837460 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7fc121f40 con 0x7fe7fc12d4a0 2024-09-13T23:56:34.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.296+0000 7fe7f27fc700 1 -- 172.21.15.87:0/997837460 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7fe7f8007380 con 0x7fe7fc12d4a0 2024-09-13T23:56:34.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.296+0000 7fe7f27fc700 1 --2- 172.21.15.87:0/997837460 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fe7e00354f0 0x7fe7e00379b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:34.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.296+0000 7fe7f27fc700 1 -- 172.21.15.87:0/997837460 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3538+0+0 (secure 0 0 0) 0x7fe7f8046c80 con 0x7fe7fc12d4a0 2024-09-13T23:56:34.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.296+0000 7fe802bc4700 1 -- 172.21.15.87:0/997837460 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7fc122330 con 0x7fe7fc12d4a0 2024-09-13T23:56:34.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.296+0000 7fe8013c1700 1 --2- 172.21.15.87:0/997837460 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fe7e00354f0 0x7fe7e00379b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:34.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.296+0000 7fe8013c1700 1 --2- 172.21.15.87:0/997837460 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fe7e00354f0 0x7fe7e00379b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec006ee0 tx=0x7fe7ec008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:34.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.300+0000 7fe7f27fc700 1 -- 172.21.15.87:0/997837460 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe7f8017020 con 0x7fe7fc12d4a0 2024-09-13T23:56:34.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.340+0000 7f15856a3700 1 Processor -- start 2024-09-13T23:56:34.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.340+0000 7f15856a3700 1 -- start start 2024-09-13T23:56:34.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.340+0000 7f15856a3700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f158006e2a0 0x7f158006e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:34.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.340+0000 7f15856a3700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1580070000 con 0x7f15800706e0 2024-09-13T23:56:34.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.340+0000 7f15856a3700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f158006f700 con 0x7f158006e2a0 2024-09-13T23:56:34.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.340+0000 7f157ffff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f158006e2a0 0x7f158006e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:34.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.340+0000 7f157f7fe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f15800706e0 0x7f1580129c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45394/0 (socket says 172.21.15.87:45394) 2024-09-13T23:56:34.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.340+0000 7f157f7fe700 1 -- 172.21.15.87:0/2545759594 learned_addr learned my addr 172.21.15.87:0/2545759594 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T23:56:34.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.340+0000 7f157effd700 1 -- 172.21.15.87:0/2545759594 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828201944 0 0) 0x7f1580070000 con 0x7f15800706e0 2024-09-13T23:56:34.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.340+0000 7f157effd700 1 -- 172.21.15.87:0/2545759594 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15680035d0 con 0x7f15800706e0 2024-09-13T23:56:34.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.340+0000 7f157ffff700 1 -- 172.21.15.87:0/2545759594 >> v1:172.21.15.87:6789/0 conn(0x7f15800706e0 legacy=0x7f1580129c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:34.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.340+0000 7f157ffff700 1 -- 172.21.15.87:0/2545759594 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158006fae0 con 0x7f158006e2a0 2024-09-13T23:56:34.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.340+0000 7f157ffff700 1 --2- 172.21.15.87:0/2545759594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f158006e2a0 0x7f158006e680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1578009dc0 tx=0x7f157800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=655beb28d5e9636b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:34.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.340+0000 7f157effd700 1 -- 172.21.15.87:0/2545759594 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f157800e070 con 0x7f158006e2a0 2024-09-13T23:56:34.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.340+0000 7f157effd700 1 -- 172.21.15.87:0/2545759594 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157800bb90 con 0x7f158006e2a0 2024-09-13T23:56:34.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.340+0000 7f157effd700 1 -- 172.21.15.87:0/2545759594 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f157800be70 con 0x7f158006e2a0 2024-09-13T23:56:34.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.340+0000 7f15856a3700 1 -- 172.21.15.87:0/2545759594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f158006e2a0 msgr2=0x7f158006e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:34.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.340+0000 7f15856a3700 1 --2- 172.21.15.87:0/2545759594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f158006e2a0 0x7f158006e680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1578009dc0 tx=0x7f157800b330 comp rx=0 tx=0).stop 2024-09-13T23:56:34.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.340+0000 7f15856a3700 1 -- 172.21.15.87:0/2545759594 shutdown_connections 2024-09-13T23:56:34.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.340+0000 7f15856a3700 1 --2- 172.21.15.87:0/2545759594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f158006e2a0 0x7f158006e680 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:34.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.340+0000 7f15856a3700 1 -- 172.21.15.87:0/2545759594 >> 172.21.15.87:0/2545759594 conn(0x7f158009b2b0 msgr2=0x7f158009b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:34.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.340+0000 7f15856a3700 1 -- 172.21.15.87:0/2545759594 shutdown_connections 2024-09-13T23:56:34.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.344+0000 7f15856a3700 1 -- 172.21.15.87:0/2545759594 wait complete. 2024-09-13T23:56:34.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.344+0000 7f15856a3700 1 Processor -- start 2024-09-13T23:56:34.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.344+0000 7f15856a3700 1 -- start start 2024-09-13T23:56:34.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.344+0000 7f15856a3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f158006e2a0 0x7f158011b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:34.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.344+0000 7f15856a3700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158011e9c0 con 0x7f158006e2a0 2024-09-13T23:56:34.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.344+0000 7f157ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f158006e2a0 0x7f158011b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:34.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.344+0000 7f157ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f158006e2a0 0x7f158011b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40250/0 (socket says 172.21.15.87:40250) 2024-09-13T23:56:34.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.344+0000 7f157ffff700 1 -- 172.21.15.87:0/2026813178 learned_addr learned my addr 172.21.15.87:0/2026813178 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:34.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.344+0000 7f157ffff700 1 -- 172.21.15.87:0/2026813178 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1578009a70 con 0x7f158006e2a0 2024-09-13T23:56:34.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.344+0000 7f157ffff700 1 --2- 172.21.15.87:0/2026813178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f158006e2a0 0x7f158011b980 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1580071e60 tx=0x7f1578004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:34.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.344+0000 7f157cff9700 1 -- 172.21.15.87:0/2026813178 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1578012430 con 0x7f158006e2a0 2024-09-13T23:56:34.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.344+0000 7f157cff9700 1 -- 172.21.15.87:0/2026813178 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15780125b0 con 0x7f158006e2a0 2024-09-13T23:56:34.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.344+0000 7f15856a3700 1 -- 172.21.15.87:0/2026813178 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158011e650 con 0x7f158006e2a0 2024-09-13T23:56:34.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.344+0000 7f157cff9700 1 -- 172.21.15.87:0/2026813178 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1578012890 con 0x7f158006e2a0 2024-09-13T23:56:34.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.348+0000 7f15856a3700 1 -- 172.21.15.87:0/2026813178 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158011edc0 con 0x7f158006e2a0 2024-09-13T23:56:34.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.348+0000 7f157cff9700 1 -- 172.21.15.87:0/2026813178 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f15780129f0 con 0x7f158006e2a0 2024-09-13T23:56:34.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.348+0000 7f15856a3700 1 -- 172.21.15.87:0/2026813178 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f158006f010 con 0x7f158006e2a0 2024-09-13T23:56:34.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.348+0000 7f157cff9700 1 --2- 172.21.15.87:0/2026813178 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f156c0354e0 0x7f156c0379a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:34.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.348+0000 7f157cff9700 1 -- 172.21.15.87:0/2026813178 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3538+0+0 (secure 0 0 0) 0x7f1578049d80 con 0x7f158006e2a0 2024-09-13T23:56:34.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.348+0000 7f157f7fe700 1 --2- 172.21.15.87:0/2026813178 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f156c0354e0 0x7f156c0379a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:34.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.348+0000 7f157f7fe700 1 --2- 172.21.15.87:0/2026813178 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f156c0354e0 0x7f156c0379a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f158006b570 tx=0x7f1570007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:34.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.352+0000 7f157cff9700 1 -- 172.21.15.87:0/2026813178 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f157804e070 con 0x7f158006e2a0 2024-09-13T23:56:34.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7f4624905700 1 Processor -- start 2024-09-13T23:56:34.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7f4624905700 1 -- start start 2024-09-13T23:56:34.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7f4624905700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4620111d80 0x7f4620127f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:34.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7f4624905700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4620128460 con 0x7f4620127b40 2024-09-13T23:56:34.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7f4624905700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4620112610 con 0x7f4620111d80 2024-09-13T23:56:34.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7f461dd9b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4620111d80 0x7f4620127f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:34.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7f461e59c700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f4620127b40 0x7f462012aad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45408/0 (socket says 172.21.15.87:45408) 2024-09-13T23:56:34.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7f461e59c700 1 -- 172.21.15.87:0/386109620 learned_addr learned my addr 172.21.15.87:0/386109620 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T23:56:34.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7fe55cb40700 1 Processor -- start 2024-09-13T23:56:34.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7fe55cb40700 1 -- start start 2024-09-13T23:56:34.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7f461dd9b700 1 -- 172.21.15.87:0/386109620 >> v1:172.21.15.87:6789/0 conn(0x7f4620127b40 legacy=0x7f462012aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:34.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7f461dd9b700 1 -- 172.21.15.87:0/386109620 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4620127660 con 0x7f4620111d80 2024-09-13T23:56:34.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7fe55cb40700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe558094150 0x7fe558094530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:34.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7fe55cb40700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe558095d70 con 0x7fe558094a70 2024-09-13T23:56:34.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7fe55cb40700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe558095b60 con 0x7fe558094150 2024-09-13T23:56:34.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7f461dd9b700 1 --2- 172.21.15.87:0/386109620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4620111d80 0x7f4620127f20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f46100097d0 tx=0x7f4610009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ddd680d6e3f5cb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:34.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7fe555d9b700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe558094a70 0x7fe558129d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45418/0 (socket says 172.21.15.87:45418) 2024-09-13T23:56:34.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7fe555d9b700 1 -- 172.21.15.87:0/2658762542 learned_addr learned my addr 172.21.15.87:0/2658762542 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T23:56:34.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7fe55659c700 1 --2- 172.21.15.87:0/2658762542 >> v2:172.21.15.87:3300/0 conn(0x7fe558094150 0x7fe558094530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:34.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7f461d59a700 1 -- 172.21.15.87:0/386109620 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46100041c0 con 0x7f4620111d80 2024-09-13T23:56:34.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7f461d59a700 1 -- 172.21.15.87:0/386109620 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4610004320 con 0x7f4620111d80 2024-09-13T23:56:34.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7f461d59a700 1 -- 172.21.15.87:0/386109620 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46100036c0 con 0x7f4620111d80 2024-09-13T23:56:34.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7fe55659c700 1 -- 172.21.15.87:0/2658762542 >> v1:172.21.15.87:6789/0 conn(0x7fe558094a70 legacy=0x7fe558129d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:34.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7fe55659c700 1 -- 172.21.15.87:0/2658762542 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe558095fa0 con 0x7fe558094150 2024-09-13T23:56:34.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7fe55559a700 1 -- 172.21.15.87:0/2658762542 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736610882 0 0) 0x7fe558095d70 con 0x7fe558094a70 2024-09-13T23:56:34.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7fe55659c700 1 --2- 172.21.15.87:0/2658762542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe558094150 0x7fe558094530 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0097d0 tx=0x7fe54c009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea1505506be714b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:34.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7fe55559a700 1 -- 172.21.15.87:0/2658762542 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe54c0041c0 con 0x7fe558094150 2024-09-13T23:56:34.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7fe55559a700 1 -- 172.21.15.87:0/2658762542 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c004320 con 0x7fe558094150 2024-09-13T23:56:34.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7fe55559a700 1 -- 172.21.15.87:0/2658762542 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe54c0036c0 con 0x7fe558094150 2024-09-13T23:56:34.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7f4624905700 1 -- 172.21.15.87:0/386109620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4620111d80 msgr2=0x7f4620127f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:34.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7f4624905700 1 --2- 172.21.15.87:0/386109620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4620111d80 0x7f4620127f20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f46100097d0 tx=0x7f4610009ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:34.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7f4624905700 1 -- 172.21.15.87:0/386109620 shutdown_connections 2024-09-13T23:56:34.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7f4624905700 1 --2- 172.21.15.87:0/386109620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4620111d80 0x7f4620127f20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:34.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7f4624905700 1 -- 172.21.15.87:0/386109620 >> 172.21.15.87:0/386109620 conn(0x7f4620099420 msgr2=0x7f4620099830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:34.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7f4624905700 1 -- 172.21.15.87:0/386109620 shutdown_connections 2024-09-13T23:56:34.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7f4624905700 1 -- 172.21.15.87:0/386109620 wait complete. 2024-09-13T23:56:34.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7fe55cb40700 1 -- 172.21.15.87:0/2658762542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe558094150 msgr2=0x7fe558094530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:34.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7fe55cb40700 1 --2- 172.21.15.87:0/2658762542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe558094150 0x7fe558094530 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0097d0 tx=0x7fe54c009ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:34.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7fe55cb40700 1 -- 172.21.15.87:0/2658762542 shutdown_connections 2024-09-13T23:56:34.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7fe55cb40700 1 --2- 172.21.15.87:0/2658762542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe558094150 0x7fe558094530 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:34.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7fe55cb40700 1 -- 172.21.15.87:0/2658762542 >> 172.21.15.87:0/2658762542 conn(0x7fe558098740 msgr2=0x7fe558098b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:34.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7fe55cb40700 1 -- 172.21.15.87:0/2658762542 shutdown_connections 2024-09-13T23:56:34.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.360+0000 7fe55cb40700 1 -- 172.21.15.87:0/2658762542 wait complete. 2024-09-13T23:56:34.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7f4624905700 1 Processor -- start 2024-09-13T23:56:34.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7f4624905700 1 -- start start 2024-09-13T23:56:34.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7fe55cb40700 1 Processor -- start 2024-09-13T23:56:34.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7fe55cb40700 1 -- start start 2024-09-13T23:56:34.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7f4624905700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4620111d80 0x7f46201bfc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:34.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7f4624905700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4620125240 con 0x7f4620111d80 2024-09-13T23:56:34.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7f461e59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4620111d80 0x7f46201bfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:34.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7f461e59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4620111d80 0x7f46201bfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40272/0 (socket says 172.21.15.87:40272) 2024-09-13T23:56:34.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7f461e59c700 1 -- 172.21.15.87:0/2147124294 learned_addr learned my addr 172.21.15.87:0/2147124294 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:34.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7fe55cb40700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe558094150 0x7fe5581c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:34.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7fe55cb40700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe558070a40 con 0x7fe558094150 2024-09-13T23:56:34.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7fe55659c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe558094150 0x7fe5581c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:34.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7fe55659c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe558094150 0x7fe5581c1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40282/0 (socket says 172.21.15.87:40282) 2024-09-13T23:56:34.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7fe55659c700 1 -- 172.21.15.87:0/3947063836 learned_addr learned my addr 172.21.15.87:0/3947063836 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:34.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7f461e59c700 1 -- 172.21.15.87:0/2147124294 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46100094b0 con 0x7f4620111d80 2024-09-13T23:56:34.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7f461e59c700 1 --2- 172.21.15.87:0/2147124294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4620111d80 0x7f46201bfc50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f461800cb20 tx=0x7f461800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:34.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7fe55659c700 1 -- 172.21.15.87:0/3947063836 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54c0094b0 con 0x7fe558094150 2024-09-13T23:56:34.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7f460effd700 1 -- 172.21.15.87:0/2147124294 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f461800a6d0 con 0x7f4620111d80 2024-09-13T23:56:34.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7f460effd700 1 -- 172.21.15.87:0/2147124294 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461800a830 con 0x7f4620111d80 2024-09-13T23:56:34.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7f460effd700 1 -- 172.21.15.87:0/2147124294 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f461800aad0 con 0x7f4620111d80 2024-09-13T23:56:34.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7fe55659c700 1 --2- 172.21.15.87:0/3947063836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe558094150 0x7fe5581c1cd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0090b0 tx=0x7fe54c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:34.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7fe546ffd700 1 -- 172.21.15.87:0/3947063836 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe54c006ea0 con 0x7fe558094150 2024-09-13T23:56:34.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7fe546ffd700 1 -- 172.21.15.87:0/3947063836 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c011760 con 0x7fe558094150 2024-09-13T23:56:34.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7fe55cb40700 1 -- 172.21.15.87:0/3947063836 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55806f980 con 0x7fe558094150 2024-09-13T23:56:34.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7fe546ffd700 1 -- 172.21.15.87:0/3947063836 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe54c011a20 con 0x7fe558094150 2024-09-13T23:56:34.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7fe55cb40700 1 -- 172.21.15.87:0/3947063836 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5581c1880 con 0x7fe558094150 2024-09-13T23:56:34.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7f4624905700 1 -- 172.21.15.87:0/2147124294 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4620117d90 con 0x7f4620111d80 2024-09-13T23:56:34.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7f4624905700 1 -- 172.21.15.87:0/2147124294 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46201190b0 con 0x7f4620111d80 2024-09-13T23:56:34.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7f4624905700 1 -- 172.21.15.87:0/2147124294 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4620118f20 con 0x7f4620111d80 2024-09-13T23:56:34.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.364+0000 7fe544ff9700 1 -- 172.21.15.87:0/3947063836 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe53c005100 con 0x7fe558094150 2024-09-13T23:56:34.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.368+0000 7fe546ffd700 1 -- 172.21.15.87:0/3947063836 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7fe54c018050 con 0x7fe558094150 2024-09-13T23:56:34.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.368+0000 7fe546ffd700 1 --2- 172.21.15.87:0/3947063836 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fe5380354f0 0x7fe5380379b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:34.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.368+0000 7fe546ffd700 1 -- 172.21.15.87:0/3947063836 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3538+0+0 (secure 0 0 0) 0x7fe54c048940 con 0x7fe558094150 2024-09-13T23:56:34.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.368+0000 7f460effd700 1 -- 172.21.15.87:0/2147124294 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f461800ac30 con 0x7f4620111d80 2024-09-13T23:56:34.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.368+0000 7f460effd700 1 --2- 172.21.15.87:0/2147124294 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f4600035540 0x7f4600037a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:34.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.368+0000 7f460effd700 1 -- 172.21.15.87:0/2147124294 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3538+0+0 (secure 0 0 0) 0x7f4618047560 con 0x7f4620111d80 2024-09-13T23:56:34.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.368+0000 7fe555d9b700 1 --2- 172.21.15.87:0/3947063836 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fe5380354f0 0x7fe5380379b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:34.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.368+0000 7f461dd9b700 1 --2- 172.21.15.87:0/2147124294 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f4600035540 0x7f4600037a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:34.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.368+0000 7fe555d9b700 1 --2- 172.21.15.87:0/3947063836 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fe5380354f0 0x7fe5380379b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe548000c00 tx=0x7fe548007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:34.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.368+0000 7f461dd9b700 1 --2- 172.21.15.87:0/2147124294 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f4600035540 0x7f4600037a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4610014040 tx=0x7f4610010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:34.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.376+0000 7fe546ffd700 1 -- 172.21.15.87:0/3947063836 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe54c02e940 con 0x7fe558094150 2024-09-13T23:56:34.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.384+0000 7f460effd700 1 -- 172.21.15.87:0/2147124294 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4618010d30 con 0x7f4620111d80 2024-09-13T23:56:34.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.500+0000 7fe802bc4700 1 -- 172.21.15.87:0/997837460 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe7fc06eaf0 con 0x7fe7fc12d4a0 2024-09-13T23:56:34.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.500+0000 7fe7f27fc700 1 -- 172.21.15.87:0/997837460 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe7f8019730 con 0x7fe7fc12d4a0 2024-09-13T23:56:34.508 INFO:teuthology.orchestra.run.smithi087.stdout:38654705670 2024-09-13T23:56:34.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.500+0000 7fe802bc4700 1 -- 172.21.15.87:0/997837460 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fe7e00354f0 msgr2=0x7fe7e00379b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:34.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.500+0000 7fe802bc4700 1 --2- 172.21.15.87:0/997837460 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fe7e00354f0 0x7fe7e00379b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec006ee0 tx=0x7fe7ec008030 comp rx=0 tx=0).stop 2024-09-13T23:56:34.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.500+0000 7fe802bc4700 1 -- 172.21.15.87:0/997837460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7fc12d4a0 msgr2=0x7fe7fc11f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:34.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.500+0000 7fe802bc4700 1 --2- 172.21.15.87:0/997837460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7fc12d4a0 0x7fe7fc11f9a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe7f800c680 tx=0x7fe7f800ca40 comp rx=0 tx=0).stop 2024-09-13T23:56:34.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.500+0000 7fe802bc4700 1 -- 172.21.15.87:0/997837460 shutdown_connections 2024-09-13T23:56:34.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.500+0000 7fe802bc4700 1 --2- 172.21.15.87:0/997837460 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fe7e00354f0 0x7fe7e00379b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:34.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.500+0000 7fe802bc4700 1 --2- 172.21.15.87:0/997837460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7fc12d4a0 0x7fe7fc11f9a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:34.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.500+0000 7fe802bc4700 1 -- 172.21.15.87:0/997837460 >> 172.21.15.87:0/997837460 conn(0x7fe7fc09cd10 msgr2=0x7fe7fc09df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:34.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.500+0000 7fe802bc4700 1 -- 172.21.15.87:0/997837460 shutdown_connections 2024-09-13T23:56:34.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.500+0000 7fe802bc4700 1 -- 172.21.15.87:0/997837460 wait complete. 2024-09-13T23:56:34.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705670 for osd.2 2024-09-13T23:56:34.522 DEBUG:teuthology.parallel:result is None 2024-09-13T23:56:34.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.536+0000 7f15856a3700 1 -- 172.21.15.87:0/2026813178 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f158006b7b0 con 0x7f158006e2a0 2024-09-13T23:56:34.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.536+0000 7f157cff9700 1 -- 172.21.15.87:0/2026813178 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f15780117a0 con 0x7f158006e2a0 2024-09-13T23:56:34.545 INFO:teuthology.orchestra.run.smithi087.stdout:38654705670 2024-09-13T23:56:34.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.536+0000 7f15856a3700 1 -- 172.21.15.87:0/2026813178 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f156c0354e0 msgr2=0x7f156c0379a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:34.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.536+0000 7f15856a3700 1 --2- 172.21.15.87:0/2026813178 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f156c0354e0 0x7f156c0379a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f158006b570 tx=0x7f1570007a20 comp rx=0 tx=0).stop 2024-09-13T23:56:34.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.536+0000 7f15856a3700 1 -- 172.21.15.87:0/2026813178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f158006e2a0 msgr2=0x7f158011b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:34.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.536+0000 7f15856a3700 1 --2- 172.21.15.87:0/2026813178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f158006e2a0 0x7f158011b980 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1580071e60 tx=0x7f1578004af0 comp rx=0 tx=0).stop 2024-09-13T23:56:34.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.536+0000 7f15856a3700 1 -- 172.21.15.87:0/2026813178 shutdown_connections 2024-09-13T23:56:34.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.536+0000 7f15856a3700 1 --2- 172.21.15.87:0/2026813178 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f156c0354e0 0x7f156c0379a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:34.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.536+0000 7f15856a3700 1 --2- 172.21.15.87:0/2026813178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f158006e2a0 0x7f158011b980 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:34.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.536+0000 7f15856a3700 1 -- 172.21.15.87:0/2026813178 >> 172.21.15.87:0/2026813178 conn(0x7f158009b2b0 msgr2=0x7f15800988a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:34.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.536+0000 7f15856a3700 1 -- 172.21.15.87:0/2026813178 shutdown_connections 2024-09-13T23:56:34.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.536+0000 7f15856a3700 1 -- 172.21.15.87:0/2026813178 wait complete. 2024-09-13T23:56:34.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.544+0000 7fe544ff9700 1 -- 172.21.15.87:0/3947063836 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe53c005680 con 0x7fe558094150 2024-09-13T23:56:34.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.548+0000 7fe546ffd700 1 -- 172.21.15.87:0/3947063836 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe54c02b030 con 0x7fe558094150 2024-09-13T23:56:34.556 INFO:teuthology.orchestra.run.smithi087.stdout:38654705669 2024-09-13T23:56:34.558 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705670 for osd.0 2024-09-13T23:56:34.558 DEBUG:teuthology.parallel:result is None 2024-09-13T23:56:34.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.548+0000 7fe544ff9700 1 -- 172.21.15.87:0/3947063836 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fe5380354f0 msgr2=0x7fe5380379b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:34.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.548+0000 7fe544ff9700 1 --2- 172.21.15.87:0/3947063836 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fe5380354f0 0x7fe5380379b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe548000c00 tx=0x7fe548007a20 comp rx=0 tx=0).stop 2024-09-13T23:56:34.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.548+0000 7fe544ff9700 1 -- 172.21.15.87:0/3947063836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe558094150 msgr2=0x7fe5581c1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:34.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.548+0000 7fe544ff9700 1 --2- 172.21.15.87:0/3947063836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe558094150 0x7fe5581c1cd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0090b0 tx=0x7fe54c004770 comp rx=0 tx=0).stop 2024-09-13T23:56:34.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.548+0000 7fe544ff9700 1 -- 172.21.15.87:0/3947063836 shutdown_connections 2024-09-13T23:56:34.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.548+0000 7fe544ff9700 1 --2- 172.21.15.87:0/3947063836 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fe5380354f0 0x7fe5380379b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:34.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.548+0000 7fe544ff9700 1 --2- 172.21.15.87:0/3947063836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe558094150 0x7fe5581c1cd0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:34.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.548+0000 7fe544ff9700 1 -- 172.21.15.87:0/3947063836 >> 172.21.15.87:0/3947063836 conn(0x7fe558098740 msgr2=0x7fe55812c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:34.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.548+0000 7fe544ff9700 1 -- 172.21.15.87:0/3947063836 shutdown_connections 2024-09-13T23:56:34.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.548+0000 7fe544ff9700 1 -- 172.21.15.87:0/3947063836 wait complete. 2024-09-13T23:56:34.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.552+0000 7f4624905700 1 -- 172.21.15.87:0/2147124294 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4620118b30 con 0x7f4620111d80 2024-09-13T23:56:34.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.552+0000 7f460effd700 1 -- 172.21.15.87:0/2147124294 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4618010300 con 0x7f4620111d80 2024-09-13T23:56:34.562 INFO:teuthology.orchestra.run.smithi087.stdout:38654705669 2024-09-13T23:56:34.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.556+0000 7f4624905700 1 -- 172.21.15.87:0/2147124294 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f4600035540 msgr2=0x7f4600037a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:34.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.556+0000 7f4624905700 1 --2- 172.21.15.87:0/2147124294 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f4600035540 0x7f4600037a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4610014040 tx=0x7f4610010000 comp rx=0 tx=0).stop 2024-09-13T23:56:34.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.556+0000 7f4624905700 1 -- 172.21.15.87:0/2147124294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4620111d80 msgr2=0x7f46201bfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:34.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.556+0000 7f4624905700 1 --2- 172.21.15.87:0/2147124294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4620111d80 0x7f46201bfc50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f461800cb20 tx=0x7f461800cc00 comp rx=0 tx=0).stop 2024-09-13T23:56:34.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.556+0000 7f4624905700 1 -- 172.21.15.87:0/2147124294 shutdown_connections 2024-09-13T23:56:34.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.556+0000 7f4624905700 1 --2- 172.21.15.87:0/2147124294 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f4600035540 0x7f4600037a00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:34.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.556+0000 7f4624905700 1 --2- 172.21.15.87:0/2147124294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4620111d80 0x7f46201bfc50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:34.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.556+0000 7f4624905700 1 -- 172.21.15.87:0/2147124294 >> 172.21.15.87:0/2147124294 conn(0x7f4620099420 msgr2=0x7f4620125ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:34.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.556+0000 7f4624905700 1 -- 172.21.15.87:0/2147124294 shutdown_connections 2024-09-13T23:56:34.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.556+0000 7f4624905700 1 -- 172.21.15.87:0/2147124294 wait complete. 2024-09-13T23:56:34.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705669 for osd.1 2024-09-13T23:56:34.570 DEBUG:teuthology.parallel:result is None 2024-09-13T23:56:34.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705669 for osd.3 2024-09-13T23:56:34.575 DEBUG:teuthology.parallel:result is None 2024-09-13T23:56:34.575 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T23:56:34.575 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T23:56:34.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.676+0000 7f246d3df700 1 Processor -- start 2024-09-13T23:56:34.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.676+0000 7f246d3df700 1 -- start start 2024-09-13T23:56:34.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.676+0000 7f246d3df700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f246806f5f0 0x7f2468136620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:34.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.676+0000 7f246d3df700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24680718d0 con 0x7f2468131840 2024-09-13T23:56:34.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.676+0000 7f246d3df700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24680714a0 con 0x7f246806f5f0 2024-09-13T23:56:34.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.676+0000 7f24677fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f246806f5f0 0x7f2468136620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:34.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.676+0000 7f24677fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f246806f5f0 0x7f2468136620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40290/0 (socket says 172.21.15.87:40290) 2024-09-13T23:56:34.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.676+0000 7f24677fe700 1 -- 172.21.15.87:0/1702138797 learned_addr learned my addr 172.21.15.87:0/1702138797 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:34.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.676+0000 7f24677fe700 1 -- 172.21.15.87:0/1702138797 >> v1:172.21.15.87:6789/0 conn(0x7f2468131840 legacy=0x7f2468131c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:34.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.676+0000 7f24677fe700 1 -- 172.21.15.87:0/1702138797 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246806c380 con 0x7f246806f5f0 2024-09-13T23:56:34.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.676+0000 7f24677fe700 1 --2- 172.21.15.87:0/1702138797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f246806f5f0 0x7f2468136620 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2458009e50 tx=0x7f245800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b209bfbe746c7c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:34.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.676+0000 7f2466ffd700 1 -- 172.21.15.87:0/1702138797 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f245800e070 con 0x7f246806f5f0 2024-09-13T23:56:34.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.676+0000 7f2466ffd700 1 -- 172.21.15.87:0/1702138797 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2458003a40 con 0x7f246806f5f0 2024-09-13T23:56:34.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.676+0000 7f2466ffd700 1 -- 172.21.15.87:0/1702138797 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2458003d00 con 0x7f246806f5f0 2024-09-13T23:56:34.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.680+0000 7f246d3df700 1 -- 172.21.15.87:0/1702138797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f246806f5f0 msgr2=0x7f2468136620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:34.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.680+0000 7f246d3df700 1 --2- 172.21.15.87:0/1702138797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f246806f5f0 0x7f2468136620 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2458009e50 tx=0x7f245800b330 comp rx=0 tx=0).stop 2024-09-13T23:56:34.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.680+0000 7f246d3df700 1 -- 172.21.15.87:0/1702138797 shutdown_connections 2024-09-13T23:56:34.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.680+0000 7f246d3df700 1 --2- 172.21.15.87:0/1702138797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f246806f5f0 0x7f2468136620 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:34.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.680+0000 7f246d3df700 1 -- 172.21.15.87:0/1702138797 >> 172.21.15.87:0/1702138797 conn(0x7f24680991a0 msgr2=0x7f24680995b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:34.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.680+0000 7f246d3df700 1 -- 172.21.15.87:0/1702138797 shutdown_connections 2024-09-13T23:56:34.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.680+0000 7f246d3df700 1 -- 172.21.15.87:0/1702138797 wait complete. 2024-09-13T23:56:34.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.680+0000 7f246d3df700 1 Processor -- start 2024-09-13T23:56:34.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.680+0000 7f246d3df700 1 -- start start 2024-09-13T23:56:34.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.680+0000 7f246d3df700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f246806f5f0 0x7f2468130150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:34.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.680+0000 7f246d3df700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2468121db0 con 0x7f246806f5f0 2024-09-13T23:56:34.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.680+0000 7f2467fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f246806f5f0 0x7f2468130150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:34.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.680+0000 7f2467fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f246806f5f0 0x7f2468130150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40306/0 (socket says 172.21.15.87:40306) 2024-09-13T23:56:34.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.680+0000 7f2467fff700 1 -- 172.21.15.87:0/1179777581 learned_addr learned my addr 172.21.15.87:0/1179777581 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:34.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.680+0000 7f2467fff700 1 -- 172.21.15.87:0/1179777581 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2458009b30 con 0x7f246806f5f0 2024-09-13T23:56:34.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.680+0000 7f2467fff700 1 --2- 172.21.15.87:0/1179777581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f246806f5f0 0x7f2468130150 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f245000c480 tx=0x7f245000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:34.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.680+0000 7f2464ff9700 1 -- 172.21.15.87:0/1179777581 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2450005150 con 0x7f246806f5f0 2024-09-13T23:56:34.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.680+0000 7f2464ff9700 1 -- 172.21.15.87:0/1179777581 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24500052b0 con 0x7f246806f5f0 2024-09-13T23:56:34.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.680+0000 7f246d3df700 1 -- 172.21.15.87:0/1179777581 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24680716c0 con 0x7f246806f5f0 2024-09-13T23:56:34.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.680+0000 7f2464ff9700 1 -- 172.21.15.87:0/1179777581 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2450005590 con 0x7f246806f5f0 2024-09-13T23:56:34.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.680+0000 7f246d3df700 1 -- 172.21.15.87:0/1179777581 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24681239f0 con 0x7f246806f5f0 2024-09-13T23:56:34.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.684+0000 7f2464ff9700 1 -- 172.21.15.87:0/1179777581 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f2450006880 con 0x7f246806f5f0 2024-09-13T23:56:34.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.684+0000 7f246d3df700 1 -- 172.21.15.87:0/1179777581 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2468122da0 con 0x7f246806f5f0 2024-09-13T23:56:34.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.684+0000 7f2464ff9700 1 --2- 172.21.15.87:0/1179777581 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f24480354a0 0x7f2448037960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:34.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.684+0000 7f2464ff9700 1 -- 172.21.15.87:0/1179777581 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3538+0+0 (secure 0 0 0) 0x7f2450046b70 con 0x7f246806f5f0 2024-09-13T23:56:34.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.684+0000 7f24677fe700 1 --2- 172.21.15.87:0/1179777581 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f24480354a0 0x7f2448037960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:34.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.684+0000 7f24677fe700 1 --2- 172.21.15.87:0/1179777581 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f24480354a0 0x7f2448037960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f246806fa40 tx=0x7f2458009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:34.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.688+0000 7f2464ff9700 1 -- 172.21.15.87:0/1179777581 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f24500104c0 con 0x7f246806f5f0 2024-09-13T23:56:34.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.856+0000 7f246d3df700 1 -- 172.21.15.87:0/1179777581 --> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2468070820 con 0x7f24480354a0 2024-09-13T23:56:34.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.856+0000 7f2464ff9700 1 -- 172.21.15.87:0/1179777581 <== mgr.4099 v2:172.21.15.173:6824/884576791 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34963 (secure 0 0 0) 0x7f2458003e70 con 0x7f24480354a0 2024-09-13T23:56:34.868 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:56:34.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.860+0000 7f246d3df700 1 -- 172.21.15.87:0/1179777581 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f24480354a0 msgr2=0x7f2448037960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:34.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.860+0000 7f246d3df700 1 --2- 172.21.15.87:0/1179777581 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f24480354a0 0x7f2448037960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f246806fa40 tx=0x7f2458009000 comp rx=0 tx=0).stop 2024-09-13T23:56:34.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.860+0000 7f246d3df700 1 -- 172.21.15.87:0/1179777581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f246806f5f0 msgr2=0x7f2468130150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:34.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.860+0000 7f246d3df700 1 --2- 172.21.15.87:0/1179777581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f246806f5f0 0x7f2468130150 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f245000c480 tx=0x7f245000c840 comp rx=0 tx=0).stop 2024-09-13T23:56:34.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.860+0000 7f246d3df700 1 -- 172.21.15.87:0/1179777581 shutdown_connections 2024-09-13T23:56:34.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.860+0000 7f246d3df700 1 --2- 172.21.15.87:0/1179777581 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f24480354a0 0x7f2448037960 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:34.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.860+0000 7f246d3df700 1 --2- 172.21.15.87:0/1179777581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f246806f5f0 0x7f2468130150 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:34.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.860+0000 7f246d3df700 1 -- 172.21.15.87:0/1179777581 >> 172.21.15.87:0/1179777581 conn(0x7f24680991a0 msgr2=0x7f246806cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:34.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.860+0000 7f246d3df700 1 -- 172.21.15.87:0/1179777581 shutdown_connections 2024-09-13T23:56:34.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.860+0000 7f246d3df700 1 -- 172.21.15.87:0/1179777581 wait complete. 2024-09-13T23:56:34.871 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-13T23:56:34.882 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-13T23:56:32.919212+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109816,"kb_used_data":1724,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377544,"statfs":{"total":386547056640,"available":386434605056,"internally_reserved":0,"allocated":1765376,"data_stored":1364227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110618394},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.552249"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:56:30.384561+0000","last_change":"2024-09-13T23:56:30.384561+0000","last_active":"2024-09-13T23:56:30.384561+0000","last_peered":"2024-09-13T23:56:30.384561+0000","last_clean":"2024-09-13T23:56:30.384561+0000","last_became_active":"2024-09-13T23:56:28.378616+0000","last_became_peered":"2024-09-13T23:56:28.378616+0000","last_unstale":"2024-09-13T23:56:30.384561+0000","last_undegraded":"2024-09-13T23:56:30.384561+0000","last_fullsized":"2024-09-13T23:56:30.384561+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_clean_scrub_stamp":"2024-09-13T23:56:27.359602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:47.690249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026646209999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:56:30.378316+0000","last_change":"2024-09-13T23:56:30.378316+0000","last_active":"2024-09-13T23:56:30.378316+0000","last_peered":"2024-09-13T23:56:30.378316+0000","last_clean":"2024-09-13T23:56:30.378316+0000","last_became_active":"2024-09-13T23:56:28.383230+0000","last_became_peered":"2024-09-13T23:56:28.383230+0000","last_unstale":"2024-09-13T23:56:30.378316+0000","last_undegraded":"2024-09-13T23:56:30.378316+0000","last_fullsized":"2024-09-13T23:56:30.378316+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_clean_scrub_stamp":"2024-09-13T23:56:27.359602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:54:38.551368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030469,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:56:30.384259+0000","last_change":"2024-09-13T23:56:30.384259+0000","last_active":"2024-09-13T23:56:30.384259+0000","last_peered":"2024-09-13T23:56:30.384259+0000","last_clean":"2024-09-13T23:56:30.384259+0000","last_became_active":"2024-09-13T23:56:28.379368+0000","last_became_peered":"2024-09-13T23:56:28.379368+0000","last_unstale":"2024-09-13T23:56:30.384259+0000","last_undegraded":"2024-09-13T23:56:30.384259+0000","last_fullsized":"2024-09-13T23:56:30.384259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_clean_scrub_stamp":"2024-09-13T23:56:27.359602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:30:10.561258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024026479999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:56:30.378288+0000","last_change":"2024-09-13T23:56:30.378288+0000","last_active":"2024-09-13T23:56:30.378288+0000","last_peered":"2024-09-13T23:56:30.378288+0000","last_clean":"2024-09-13T23:56:30.378288+0000","last_became_active":"2024-09-13T23:56:28.891600+0000","last_became_peered":"2024-09-13T23:56:28.891600+0000","last_unstale":"2024-09-13T23:56:30.378288+0000","last_undegraded":"2024-09-13T23:56:30.378288+0000","last_fullsized":"2024-09-13T23:56:30.378288+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_clean_scrub_stamp":"2024-09-13T23:56:27.359602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:34.508344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099431499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:56:30.386254+0000","last_change":"2024-09-13T23:56:30.383761+0000","last_active":"2024-09-13T23:56:30.386254+0000","last_peered":"2024-09-13T23:56:30.386254+0000","last_clean":"2024-09-13T23:56:30.386254+0000","last_became_active":"2024-09-13T23:56:28.378831+0000","last_became_peered":"2024-09-13T23:56:28.378831+0000","last_unstale":"2024-09-13T23:56:30.386254+0000","last_undegraded":"2024-09-13T23:56:30.386254+0000","last_fullsized":"2024-09-13T23:56:30.386254+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_clean_scrub_stamp":"2024-09-13T23:56:27.359602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:48:53.059671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020022939999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:56:31.049489+0000","last_change":"2024-09-13T23:56:31.049489+0000","last_active":"2024-09-13T23:56:31.049489+0000","last_peered":"2024-09-13T23:56:31.049489+0000","last_clean":"2024-09-13T23:56:31.049489+0000","last_became_active":"2024-09-13T23:56:28.891453+0000","last_became_peered":"2024-09-13T23:56:28.891453+0000","last_unstale":"2024-09-13T23:56:31.049489+0000","last_undegraded":"2024-09-13T23:56:31.049489+0000","last_fullsized":"2024-09-13T23:56:31.049489+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_clean_scrub_stamp":"2024-09-13T23:56:27.359602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:34:26.332906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064139700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:56:30.382395+0000","last_change":"2024-09-13T23:56:30.382395+0000","last_active":"2024-09-13T23:56:30.382395+0000","last_peered":"2024-09-13T23:56:30.382395+0000","last_clean":"2024-09-13T23:56:30.382395+0000","last_became_active":"2024-09-13T23:56:28.378678+0000","last_became_peered":"2024-09-13T23:56:28.378678+0000","last_unstale":"2024-09-13T23:56:30.382395+0000","last_undegraded":"2024-09-13T23:56:30.382395+0000","last_fullsized":"2024-09-13T23:56:30.382395+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_clean_scrub_stamp":"2024-09-13T23:56:27.359602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:20:09.816095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000667926,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:56:30.383757+0000","last_change":"2024-09-13T23:56:30.383757+0000","last_active":"2024-09-13T23:56:30.383757+0000","last_peered":"2024-09-13T23:56:30.383757+0000","last_clean":"2024-09-13T23:56:30.383757+0000","last_became_active":"2024-09-13T23:56:28.377349+0000","last_became_peered":"2024-09-13T23:56:28.377349+0000","last_unstale":"2024-09-13T23:56:30.383757+0000","last_undegraded":"2024-09-13T23:56:30.383757+0000","last_fullsized":"2024-09-13T23:56:30.383757+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_clean_scrub_stamp":"2024-09-13T23:56:27.359602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:07:07.159438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019455849999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'117","reported_seq":164,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T23:56:29.381195+0000","last_change":"2024-09-13T23:56:24.916971+0000","last_active":"2024-09-13T23:56:29.381195+0000","last_peered":"2024-09-13T23:56:29.381195+0000","last_clean":"2024-09-13T23:56:29.381195+0000","last_became_active":"2024-09-13T23:56:24.914946+0000","last_became_peered":"2024-09-13T23:56:24.914946+0000","last_unstale":"2024-09-13T23:56:29.381195+0000","last_undegraded":"2024-09-13T23:56:29.381195+0000","last_fullsized":"2024-09-13T23:56:29.381195+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:56:23.252347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:56:23.252347+0000","last_clean_scrub_stamp":"2024-09-13T23:56:23.252347+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:09:53.271433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":147456,"data_stored":48049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":720896,"data_stored":629674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":745472,"data_stored":638436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":151552,"data_stored":48068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:56:34.884 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T23:56:34.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.984+0000 7f595254e700 1 Processor -- start 2024-09-13T23:56:34.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.984+0000 7f595254e700 1 -- start start 2024-09-13T23:56:34.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.984+0000 7f595254e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f594c06f920 0x7f594c12b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:34.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.984+0000 7f595254e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f594c06c230 con 0x7f594c12ad60 2024-09-13T23:56:34.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.984+0000 7f595254e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f594c111d80 con 0x7f594c06f920 2024-09-13T23:56:34.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.984+0000 7f595154c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f594c06f920 0x7f594c12b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:34.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.984+0000 7f5950d4b700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f594c12ad60 0x7f594c127570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45430/0 (socket says 172.21.15.87:45430) 2024-09-13T23:56:34.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.984+0000 7f5950d4b700 1 -- 172.21.15.87:0/2315649052 learned_addr learned my addr 172.21.15.87:0/2315649052 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T23:56:34.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.984+0000 7f595154c700 1 -- 172.21.15.87:0/2315649052 >> v1:172.21.15.87:6789/0 conn(0x7f594c12ad60 legacy=0x7f594c127570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:34.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.984+0000 7f595154c700 1 -- 172.21.15.87:0/2315649052 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594c112450 con 0x7f594c06f920 2024-09-13T23:56:34.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.984+0000 7f595154c700 1 --2- 172.21.15.87:0/2315649052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f594c06f920 0x7f594c12b210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f59480097d0 tx=0x7f5948009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cad378ead820478 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:34.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.984+0000 7f5943fff700 1 -- 172.21.15.87:0/2315649052 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59480041c0 con 0x7f594c06f920 2024-09-13T23:56:34.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.984+0000 7f5943fff700 1 -- 172.21.15.87:0/2315649052 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5948004320 con 0x7f594c06f920 2024-09-13T23:56:34.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.984+0000 7f5943fff700 1 -- 172.21.15.87:0/2315649052 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59480036c0 con 0x7f594c06f920 2024-09-13T23:56:34.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.988+0000 7f595254e700 1 -- 172.21.15.87:0/2315649052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f594c06f920 msgr2=0x7f594c12b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:34.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.988+0000 7f595254e700 1 --2- 172.21.15.87:0/2315649052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f594c06f920 0x7f594c12b210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f59480097d0 tx=0x7f5948009ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:34.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.988+0000 7f595254e700 1 -- 172.21.15.87:0/2315649052 shutdown_connections 2024-09-13T23:56:34.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.988+0000 7f595254e700 1 --2- 172.21.15.87:0/2315649052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f594c06f920 0x7f594c12b210 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:34.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.988+0000 7f595254e700 1 -- 172.21.15.87:0/2315649052 >> 172.21.15.87:0/2315649052 conn(0x7f594c0991a0 msgr2=0x7f594c0995b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:34.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.988+0000 7f595254e700 1 -- 172.21.15.87:0/2315649052 shutdown_connections 2024-09-13T23:56:34.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.988+0000 7f595254e700 1 -- 172.21.15.87:0/2315649052 wait complete. 2024-09-13T23:56:34.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.988+0000 7f595254e700 1 Processor -- start 2024-09-13T23:56:34.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.988+0000 7f595254e700 1 -- start start 2024-09-13T23:56:34.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.988+0000 7f595254e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f594c06f920 0x7f594c1c1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:34.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.988+0000 7f595254e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594c11a4b0 con 0x7f594c06f920 2024-09-13T23:56:34.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.988+0000 7f595154c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f594c06f920 0x7f594c1c1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:34.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.988+0000 7f595154c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f594c06f920 0x7f594c1c1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40316/0 (socket says 172.21.15.87:40316) 2024-09-13T23:56:34.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.988+0000 7f595154c700 1 -- 172.21.15.87:0/1011529287 learned_addr learned my addr 172.21.15.87:0/1011529287 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:34.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.988+0000 7f595154c700 1 -- 172.21.15.87:0/1011529287 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59480094b0 con 0x7f594c06f920 2024-09-13T23:56:34.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.988+0000 7f595154c700 1 --2- 172.21.15.87:0/1011529287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f594c06f920 0x7f594c1c1b70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f59480090b0 tx=0x7f5948004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:35.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.988+0000 7f5941ffb700 1 -- 172.21.15.87:0/1011529287 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5948006ea0 con 0x7f594c06f920 2024-09-13T23:56:35.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.988+0000 7f5941ffb700 1 -- 172.21.15.87:0/1011529287 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5948003e10 con 0x7f594c06f920 2024-09-13T23:56:35.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.988+0000 7f595254e700 1 -- 172.21.15.87:0/1011529287 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f594c11af60 con 0x7f594c06f920 2024-09-13T23:56:35.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.988+0000 7f5941ffb700 1 -- 172.21.15.87:0/1011529287 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59480119b0 con 0x7f594c06f920 2024-09-13T23:56:35.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.988+0000 7f595254e700 1 -- 172.21.15.87:0/1011529287 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f594c119210 con 0x7f594c06f920 2024-09-13T23:56:35.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.992+0000 7f595254e700 1 -- 172.21.15.87:0/1011529287 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f594c1281c0 con 0x7f594c06f920 2024-09-13T23:56:35.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.992+0000 7f5941ffb700 1 -- 172.21.15.87:0/1011529287 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f5948018050 con 0x7f594c06f920 2024-09-13T23:56:35.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.992+0000 7f5941ffb700 1 --2- 172.21.15.87:0/1011529287 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f59300354f0 0x7f59300379b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:35.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.992+0000 7f5941ffb700 1 -- 172.21.15.87:0/1011529287 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3538+0+0 (secure 0 0 0) 0x7f59480484d0 con 0x7f594c06f920 2024-09-13T23:56:35.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.992+0000 7f5950d4b700 1 --2- 172.21.15.87:0/1011529287 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f59300354f0 0x7f59300379b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:35.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:34.992+0000 7f5950d4b700 1 --2- 172.21.15.87:0/1011529287 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f59300354f0 0x7f59300379b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f594c128630 tx=0x7f593c007b70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:35.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.000+0000 7f5941ffb700 1 -- 172.21.15.87:0/1011529287 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f59480257c0 con 0x7f594c06f920 2024-09-13T23:56:35.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.168+0000 7f595254e700 1 -- 172.21.15.87:0/1011529287 --> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f594c11b0f0 con 0x7f59300354f0 2024-09-13T23:56:35.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.172+0000 7f5941ffb700 1 -- 172.21.15.87:0/1011529287 <== mgr.4099 v2:172.21.15.173:6824/884576791 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34963 (secure 0 0 0) 0x7f593c005960 con 0x7f59300354f0 2024-09-13T23:56:35.181 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:56:35.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.172+0000 7f595254e700 1 -- 172.21.15.87:0/1011529287 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f59300354f0 msgr2=0x7f59300379b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:35.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.172+0000 7f595254e700 1 --2- 172.21.15.87:0/1011529287 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f59300354f0 0x7f59300379b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f594c128630 tx=0x7f593c007b70 comp rx=0 tx=0).stop 2024-09-13T23:56:35.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.172+0000 7f595254e700 1 -- 172.21.15.87:0/1011529287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f594c06f920 msgr2=0x7f594c1c1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:35.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.172+0000 7f595254e700 1 --2- 172.21.15.87:0/1011529287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f594c06f920 0x7f594c1c1b70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f59480090b0 tx=0x7f5948004770 comp rx=0 tx=0).stop 2024-09-13T23:56:35.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.172+0000 7f595254e700 1 -- 172.21.15.87:0/1011529287 shutdown_connections 2024-09-13T23:56:35.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.172+0000 7f595254e700 1 --2- 172.21.15.87:0/1011529287 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f59300354f0 0x7f59300379b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:35.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.172+0000 7f595254e700 1 --2- 172.21.15.87:0/1011529287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f594c06f920 0x7f594c1c1b70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:35.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.172+0000 7f595254e700 1 -- 172.21.15.87:0/1011529287 >> 172.21.15.87:0/1011529287 conn(0x7f594c0991a0 msgr2=0x7f594c126d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:35.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.172+0000 7f595254e700 1 -- 172.21.15.87:0/1011529287 shutdown_connections 2024-09-13T23:56:35.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.172+0000 7f595254e700 1 -- 172.21.15.87:0/1011529287 wait complete. 2024-09-13T23:56:35.184 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-13T23:56:35.195 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-13T23:56:34.919764+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109816,"kb_used_data":1724,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377544,"statfs":{"total":386547056640,"available":386434605056,"internally_reserved":0,"allocated":1765376,"data_stored":1364227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110618394},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.549077"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:56:30.384561+0000","last_change":"2024-09-13T23:56:30.384561+0000","last_active":"2024-09-13T23:56:30.384561+0000","last_peered":"2024-09-13T23:56:30.384561+0000","last_clean":"2024-09-13T23:56:30.384561+0000","last_became_active":"2024-09-13T23:56:28.378616+0000","last_became_peered":"2024-09-13T23:56:28.378616+0000","last_unstale":"2024-09-13T23:56:30.384561+0000","last_undegraded":"2024-09-13T23:56:30.384561+0000","last_fullsized":"2024-09-13T23:56:30.384561+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_clean_scrub_stamp":"2024-09-13T23:56:27.359602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:47.690249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026646209999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:56:30.378316+0000","last_change":"2024-09-13T23:56:30.378316+0000","last_active":"2024-09-13T23:56:30.378316+0000","last_peered":"2024-09-13T23:56:30.378316+0000","last_clean":"2024-09-13T23:56:30.378316+0000","last_became_active":"2024-09-13T23:56:28.383230+0000","last_became_peered":"2024-09-13T23:56:28.383230+0000","last_unstale":"2024-09-13T23:56:30.378316+0000","last_undegraded":"2024-09-13T23:56:30.378316+0000","last_fullsized":"2024-09-13T23:56:30.378316+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_clean_scrub_stamp":"2024-09-13T23:56:27.359602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:54:38.551368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001030469,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:56:30.384259+0000","last_change":"2024-09-13T23:56:30.384259+0000","last_active":"2024-09-13T23:56:30.384259+0000","last_peered":"2024-09-13T23:56:30.384259+0000","last_clean":"2024-09-13T23:56:30.384259+0000","last_became_active":"2024-09-13T23:56:28.379368+0000","last_became_peered":"2024-09-13T23:56:28.379368+0000","last_unstale":"2024-09-13T23:56:30.384259+0000","last_undegraded":"2024-09-13T23:56:30.384259+0000","last_fullsized":"2024-09-13T23:56:30.384259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_clean_scrub_stamp":"2024-09-13T23:56:27.359602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:30:10.561258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024026479999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:56:30.378288+0000","last_change":"2024-09-13T23:56:30.378288+0000","last_active":"2024-09-13T23:56:30.378288+0000","last_peered":"2024-09-13T23:56:30.378288+0000","last_clean":"2024-09-13T23:56:30.378288+0000","last_became_active":"2024-09-13T23:56:28.891600+0000","last_became_peered":"2024-09-13T23:56:28.891600+0000","last_unstale":"2024-09-13T23:56:30.378288+0000","last_undegraded":"2024-09-13T23:56:30.378288+0000","last_fullsized":"2024-09-13T23:56:30.378288+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_clean_scrub_stamp":"2024-09-13T23:56:27.359602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:34.508344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099431499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:56:30.386254+0000","last_change":"2024-09-13T23:56:30.383761+0000","last_active":"2024-09-13T23:56:30.386254+0000","last_peered":"2024-09-13T23:56:30.386254+0000","last_clean":"2024-09-13T23:56:30.386254+0000","last_became_active":"2024-09-13T23:56:28.378831+0000","last_became_peered":"2024-09-13T23:56:28.378831+0000","last_unstale":"2024-09-13T23:56:30.386254+0000","last_undegraded":"2024-09-13T23:56:30.386254+0000","last_fullsized":"2024-09-13T23:56:30.386254+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_clean_scrub_stamp":"2024-09-13T23:56:27.359602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:48:53.059671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020022939999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:56:31.049489+0000","last_change":"2024-09-13T23:56:31.049489+0000","last_active":"2024-09-13T23:56:31.049489+0000","last_peered":"2024-09-13T23:56:31.049489+0000","last_clean":"2024-09-13T23:56:31.049489+0000","last_became_active":"2024-09-13T23:56:28.891453+0000","last_became_peered":"2024-09-13T23:56:28.891453+0000","last_unstale":"2024-09-13T23:56:31.049489+0000","last_undegraded":"2024-09-13T23:56:31.049489+0000","last_fullsized":"2024-09-13T23:56:31.049489+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_clean_scrub_stamp":"2024-09-13T23:56:27.359602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:34:26.332906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064139700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:56:30.382395+0000","last_change":"2024-09-13T23:56:30.382395+0000","last_active":"2024-09-13T23:56:30.382395+0000","last_peered":"2024-09-13T23:56:30.382395+0000","last_clean":"2024-09-13T23:56:30.382395+0000","last_became_active":"2024-09-13T23:56:28.378678+0000","last_became_peered":"2024-09-13T23:56:28.378678+0000","last_unstale":"2024-09-13T23:56:30.382395+0000","last_undegraded":"2024-09-13T23:56:30.382395+0000","last_fullsized":"2024-09-13T23:56:30.382395+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_clean_scrub_stamp":"2024-09-13T23:56:27.359602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:20:09.816095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000667926,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:56:30.383757+0000","last_change":"2024-09-13T23:56:30.383757+0000","last_active":"2024-09-13T23:56:30.383757+0000","last_peered":"2024-09-13T23:56:30.383757+0000","last_clean":"2024-09-13T23:56:30.383757+0000","last_became_active":"2024-09-13T23:56:28.377349+0000","last_became_peered":"2024-09-13T23:56:28.377349+0000","last_unstale":"2024-09-13T23:56:30.383757+0000","last_undegraded":"2024-09-13T23:56:30.383757+0000","last_fullsized":"2024-09-13T23:56:30.383757+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:56:27.359602+0000","last_clean_scrub_stamp":"2024-09-13T23:56:27.359602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:07:07.159438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019455849999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'117","reported_seq":164,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T23:56:29.381195+0000","last_change":"2024-09-13T23:56:24.916971+0000","last_active":"2024-09-13T23:56:29.381195+0000","last_peered":"2024-09-13T23:56:29.381195+0000","last_clean":"2024-09-13T23:56:29.381195+0000","last_became_active":"2024-09-13T23:56:24.914946+0000","last_became_peered":"2024-09-13T23:56:24.914946+0000","last_unstale":"2024-09-13T23:56:29.381195+0000","last_undegraded":"2024-09-13T23:56:29.381195+0000","last_fullsized":"2024-09-13T23:56:29.381195+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:56:23.252347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:56:23.252347+0000","last_clean_scrub_stamp":"2024-09-13T23:56:23.252347+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:09:53.271433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":147456,"data_stored":48049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":720896,"data_stored":629674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":745472,"data_stored":638436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":151552,"data_stored":48068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:56:35.196 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T23:56:35.197 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T23:56:35.197 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T23:56:35.197 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T23:56:35.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.292+0000 7f39db59e700 1 Processor -- start 2024-09-13T23:56:35.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.292+0000 7f39db59e700 1 -- start start 2024-09-13T23:56:35.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.292+0000 7f39db59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f39dc131840 0x7f39dc131c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:35.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.292+0000 7f39db59e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39dc0718d0 con 0x7f39dc132160 2024-09-13T23:56:35.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.292+0000 7f39db59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39dc0714a0 con 0x7f39dc131840 2024-09-13T23:56:35.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.292+0000 7f39da59c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f39dc131840 0x7f39dc131c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:35.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.296+0000 7f39d9d9b700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f39dc132160 0x7f39dc06e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45438/0 (socket says 172.21.15.87:45438) 2024-09-13T23:56:35.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.296+0000 7f39d9d9b700 1 -- 172.21.15.87:0/3476333514 learned_addr learned my addr 172.21.15.87:0/3476333514 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T23:56:35.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.296+0000 7f39da59c700 1 -- 172.21.15.87:0/3476333514 >> v1:172.21.15.87:6789/0 conn(0x7f39dc132160 legacy=0x7f39dc06e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:35.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.296+0000 7f39da59c700 1 -- 172.21.15.87:0/3476333514 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39dc06c380 con 0x7f39dc131840 2024-09-13T23:56:35.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.296+0000 7f39d959a700 1 -- 172.21.15.87:0/3476333514 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 228627147 0 0) 0x7f39dc0718d0 con 0x7f39dc132160 2024-09-13T23:56:35.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.296+0000 7f39da59c700 1 --2- 172.21.15.87:0/3476333514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39dc131840 0x7f39dc131c20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f39d4009d90 tx=0x7f39d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8779f41a912d7c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:35.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.296+0000 7f39d959a700 1 -- 172.21.15.87:0/3476333514 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f39d400e070 con 0x7f39dc131840 2024-09-13T23:56:35.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.296+0000 7f39d959a700 1 -- 172.21.15.87:0/3476333514 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d400bc80 con 0x7f39dc131840 2024-09-13T23:56:35.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.296+0000 7f39d959a700 1 -- 172.21.15.87:0/3476333514 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f39d4003a40 con 0x7f39dc131840 2024-09-13T23:56:35.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.296+0000 7f39db59e700 1 -- 172.21.15.87:0/3476333514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39dc131840 msgr2=0x7f39dc131c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:35.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.296+0000 7f39db59e700 1 --2- 172.21.15.87:0/3476333514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39dc131840 0x7f39dc131c20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f39d4009d90 tx=0x7f39d400b330 comp rx=0 tx=0).stop 2024-09-13T23:56:35.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.296+0000 7f39db59e700 1 -- 172.21.15.87:0/3476333514 shutdown_connections 2024-09-13T23:56:35.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.296+0000 7f39db59e700 1 --2- 172.21.15.87:0/3476333514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39dc131840 0x7f39dc131c20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:35.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.296+0000 7f39db59e700 1 -- 172.21.15.87:0/3476333514 >> 172.21.15.87:0/3476333514 conn(0x7f39dc0991a0 msgr2=0x7f39dc0995b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:35.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.296+0000 7f39db59e700 1 -- 172.21.15.87:0/3476333514 shutdown_connections 2024-09-13T23:56:35.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.296+0000 7f39db59e700 1 -- 172.21.15.87:0/3476333514 wait complete. 2024-09-13T23:56:35.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.296+0000 7f39db59e700 1 Processor -- start 2024-09-13T23:56:35.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.296+0000 7f39db59e700 1 -- start start 2024-09-13T23:56:35.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.296+0000 7f39db59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39dc131840 0x7f39dc121720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:35.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.296+0000 7f39db59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc1240e0 con 0x7f39dc131840 2024-09-13T23:56:35.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.296+0000 7f39da59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39dc131840 0x7f39dc121720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:35.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.296+0000 7f39da59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39dc131840 0x7f39dc121720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40336/0 (socket says 172.21.15.87:40336) 2024-09-13T23:56:35.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.296+0000 7f39da59c700 1 -- 172.21.15.87:0/842138749 learned_addr learned my addr 172.21.15.87:0/842138749 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:56:35.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.300+0000 7f39da59c700 1 -- 172.21.15.87:0/842138749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d4009a70 con 0x7f39dc131840 2024-09-13T23:56:35.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.300+0000 7f39da59c700 1 --2- 172.21.15.87:0/842138749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39dc131840 0x7f39dc121720 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f39dc0715e0 tx=0x7f39d4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:35.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.300+0000 7f39caffd700 1 -- 172.21.15.87:0/842138749 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f39d4004840 con 0x7f39dc131840 2024-09-13T23:56:35.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.300+0000 7f39caffd700 1 -- 172.21.15.87:0/842138749 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d4012430 con 0x7f39dc131840 2024-09-13T23:56:35.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.300+0000 7f39caffd700 1 -- 172.21.15.87:0/842138749 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f39d40126f0 con 0x7f39dc131840 2024-09-13T23:56:35.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.300+0000 7f39db59e700 1 -- 172.21.15.87:0/842138749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39dc122880 con 0x7f39dc131840 2024-09-13T23:56:35.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.300+0000 7f39db59e700 1 -- 172.21.15.87:0/842138749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39dc124980 con 0x7f39dc131840 2024-09-13T23:56:35.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.300+0000 7f39db59e700 1 -- 172.21.15.87:0/842138749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39dc131c20 con 0x7f39dc131840 2024-09-13T23:56:35.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.300+0000 7f39caffd700 1 -- 172.21.15.87:0/842138749 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f39d4012850 con 0x7f39dc131840 2024-09-13T23:56:35.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.300+0000 7f39caffd700 1 --2- 172.21.15.87:0/842138749 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f39bc0354e0 0x7f39bc0379a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:35.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.300+0000 7f39caffd700 1 -- 172.21.15.87:0/842138749 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3538+0+0 (secure 0 0 0) 0x7f39d4049cc0 con 0x7f39dc131840 2024-09-13T23:56:35.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.300+0000 7f39d9d9b700 1 --2- 172.21.15.87:0/842138749 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f39bc0354e0 0x7f39bc0379a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:35.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.304+0000 7f39d9d9b700 1 --2- 172.21.15.87:0/842138749 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f39bc0354e0 0x7f39bc0379a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f39d0000c00 tx=0x7f39d0007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:35.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.312+0000 7f39caffd700 1 -- 172.21.15.87:0/842138749 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f39d401cd80 con 0x7f39dc131840 2024-09-13T23:56:35.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.516+0000 7f39db59e700 1 -- 172.21.15.87:0/842138749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f39dc124220 con 0x7f39dc131840 2024-09-13T23:56:35.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.516+0000 7f39caffd700 1 -- 172.21.15.87:0/842138749 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f39d401cba0 con 0x7f39dc131840 2024-09-13T23:56:35.525 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T23:56:35.525 INFO:teuthology.orchestra.run.smithi087.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T23:56:35.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.516+0000 7f39db59e700 1 -- 172.21.15.87:0/842138749 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f39bc0354e0 msgr2=0x7f39bc0379a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:35.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.516+0000 7f39db59e700 1 --2- 172.21.15.87:0/842138749 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f39bc0354e0 0x7f39bc0379a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f39d0000c00 tx=0x7f39d0007a20 comp rx=0 tx=0).stop 2024-09-13T23:56:35.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.516+0000 7f39db59e700 1 -- 172.21.15.87:0/842138749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39dc131840 msgr2=0x7f39dc121720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:35.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.516+0000 7f39db59e700 1 --2- 172.21.15.87:0/842138749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39dc131840 0x7f39dc121720 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f39dc0715e0 tx=0x7f39d4004af0 comp rx=0 tx=0).stop 2024-09-13T23:56:35.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.520+0000 7f39db59e700 1 -- 172.21.15.87:0/842138749 shutdown_connections 2024-09-13T23:56:35.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.520+0000 7f39db59e700 1 --2- 172.21.15.87:0/842138749 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f39bc0354e0 0x7f39bc0379a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:35.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.520+0000 7f39db59e700 1 --2- 172.21.15.87:0/842138749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39dc131840 0x7f39dc121720 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:35.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.520+0000 7f39db59e700 1 -- 172.21.15.87:0/842138749 >> 172.21.15.87:0/842138749 conn(0x7f39dc0991a0 msgr2=0x7f39dc06c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:35.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.520+0000 7f39db59e700 1 -- 172.21.15.87:0/842138749 shutdown_connections 2024-09-13T23:56:35.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:56:35.520+0000 7f39db59e700 1 -- 172.21.15.87:0/842138749 wait complete. 2024-09-13T23:56:35.539 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T23:56:35.540 INFO:teuthology.run_tasks:Running task rgw... 2024-09-13T23:56:35.558 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-13T23:56:35.558 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-13T23:56:35.558 INFO:tasks.rgw:Creating data pools 2024-09-13T23:56:35.559 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-13T23:56:35.559 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-09-13T23:56:35.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.674+0000 7f9086917700 1 Processor -- start 2024-09-13T23:56:35.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.674+0000 7f9086917700 1 -- start start 2024-09-13T23:56:35.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.674+0000 7f9086917700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f90801146a0 0x7f9080114a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:35.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.674+0000 7f9086917700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9080115140 con 0x7f908010cd60 2024-09-13T23:56:35.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.674+0000 7f9086917700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f908010d920 con 0x7f90801146a0 2024-09-13T23:56:35.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.678+0000 7f907ffff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f90801146a0 0x7f9080114a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:35.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.678+0000 7f907ffff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f90801146a0 0x7f9080114a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35334/0 (socket says 172.21.15.173:35334) 2024-09-13T23:56:35.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.678+0000 7f907f7fe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f908010cd60 0x7f908010d210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:49484/0 (socket says 172.21.15.173:49484) 2024-09-13T23:56:35.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.678+0000 7f907ffff700 1 -- 172.21.15.173:0/3591891283 learned_addr learned my addr 172.21.15.173:0/3591891283 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:35.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.678+0000 7f907ffff700 1 -- 172.21.15.173:0/3591891283 >> v1:172.21.15.87:6789/0 conn(0x7f908010cd60 legacy=0x7f908010d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:35.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.678+0000 7f907effd700 1 -- 172.21.15.173:0/3591891283 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820390506 0 0) 0x7f9080115140 con 0x7f908010cd60 2024-09-13T23:56:35.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.678+0000 7f907ffff700 1 -- 172.21.15.173:0/3591891283 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908010da90 con 0x7f90801146a0 2024-09-13T23:56:35.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.678+0000 7f907ffff700 1 --2- 172.21.15.173:0/3591891283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90801146a0 0x7f9080114a80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9070009e50 tx=0x7f907000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b96a7d331acffe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:35.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.678+0000 7f907effd700 1 -- 172.21.15.173:0/3591891283 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f907000e070 con 0x7f90801146a0 2024-09-13T23:56:35.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.678+0000 7f907effd700 1 -- 172.21.15.173:0/3591891283 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9070003a40 con 0x7f90801146a0 2024-09-13T23:56:35.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.678+0000 7f907effd700 1 -- 172.21.15.173:0/3591891283 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9070003d00 con 0x7f90801146a0 2024-09-13T23:56:35.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.678+0000 7f9086917700 1 -- 172.21.15.173:0/3591891283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90801146a0 msgr2=0x7f9080114a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:35.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.678+0000 7f9086917700 1 --2- 172.21.15.173:0/3591891283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90801146a0 0x7f9080114a80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9070009e50 tx=0x7f907000b330 comp rx=0 tx=0).stop 2024-09-13T23:56:35.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.678+0000 7f9086917700 1 -- 172.21.15.173:0/3591891283 shutdown_connections 2024-09-13T23:56:35.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.678+0000 7f9086917700 1 --2- 172.21.15.173:0/3591891283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90801146a0 0x7f9080114a80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:35.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.678+0000 7f9086917700 1 -- 172.21.15.173:0/3591891283 >> 172.21.15.173:0/3591891283 conn(0x7f908006e7b0 msgr2=0x7f9080070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:35.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.678+0000 7f9086917700 1 -- 172.21.15.173:0/3591891283 shutdown_connections 2024-09-13T23:56:35.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.678+0000 7f9086917700 1 -- 172.21.15.173:0/3591891283 wait complete. 2024-09-13T23:56:35.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.682+0000 7f9086917700 1 Processor -- start 2024-09-13T23:56:35.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.682+0000 7f9086917700 1 -- start start 2024-09-13T23:56:35.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.682+0000 7f9086917700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f908010cd60 0x7f90801a2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:35.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.682+0000 7f9086917700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90801a3300 con 0x7f908010cd60 2024-09-13T23:56:35.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.682+0000 7f907ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f908010cd60 0x7f90801a2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:35.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.682+0000 7f907ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f908010cd60 0x7f90801a2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35350/0 (socket says 172.21.15.173:35350) 2024-09-13T23:56:35.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.682+0000 7f907ffff700 1 -- 172.21.15.173:0/2439334625 learned_addr learned my addr 172.21.15.173:0/2439334625 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:35.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.682+0000 7f907ffff700 1 -- 172.21.15.173:0/2439334625 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9070009b30 con 0x7f908010cd60 2024-09-13T23:56:35.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.682+0000 7f907ffff700 1 --2- 172.21.15.173:0/2439334625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f908010cd60 0x7f90801a2dc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f908010da60 tx=0x7f9070004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:35.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.682+0000 7f907cff9700 1 -- 172.21.15.173:0/2439334625 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9070004480 con 0x7f908010cd60 2024-09-13T23:56:35.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.682+0000 7f907cff9700 1 -- 172.21.15.173:0/2439334625 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90700045e0 con 0x7f908010cd60 2024-09-13T23:56:35.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.682+0000 7f9086917700 1 -- 172.21.15.173:0/2439334625 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90801a3500 con 0x7f908010cd60 2024-09-13T23:56:35.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.682+0000 7f907cff9700 1 -- 172.21.15.173:0/2439334625 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90700048c0 con 0x7f908010cd60 2024-09-13T23:56:35.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.682+0000 7f9086917700 1 -- 172.21.15.173:0/2439334625 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90801a74a0 con 0x7f908010cd60 2024-09-13T23:56:35.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.686+0000 7f9086917700 1 -- 172.21.15.173:0/2439334625 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90801a3930 con 0x7f908010cd60 2024-09-13T23:56:35.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.686+0000 7f907cff9700 1 -- 172.21.15.173:0/2439334625 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f9070019070 con 0x7f908010cd60 2024-09-13T23:56:35.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.686+0000 7f907cff9700 1 --2- 172.21.15.173:0/2439334625 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f906c0354a0 0x7f906c037960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:35.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.686+0000 7f907cff9700 1 -- 172.21.15.173:0/2439334625 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3538+0+0 (secure 0 0 0) 0x7f9070048c20 con 0x7f908010cd60 2024-09-13T23:56:35.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.686+0000 7f907f7fe700 1 --2- 172.21.15.173:0/2439334625 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f906c0354a0 0x7f906c037960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:35.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.686+0000 7f907f7fe700 1 --2- 172.21.15.173:0/2439334625 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f906c0354a0 0x7f906c037960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9074000c00 tx=0x7f90740079c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:35.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.694+0000 7f907cff9700 1 -- 172.21.15.173:0/2439334625 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9070019320 con 0x7f908010cd60 2024-09-13T23:56:35.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:35.874+0000 7f9086917700 1 -- 172.21.15.173:0/2439334625 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f908011a630 con 0x7f908010cd60 2024-09-13T23:56:36.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.402+0000 7f907cff9700 1 -- 172.21.15.173:0/2439334625 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]=0 v18) v1 ==== 151+0+0 (secure 0 0 0) 0x7f907002db40 con 0x7f908010cd60 2024-09-13T23:56:36.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.406+0000 7f9086917700 1 -- 172.21.15.173:0/2439334625 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f906c0354a0 msgr2=0x7f906c037960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:36.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.406+0000 7f9086917700 1 --2- 172.21.15.173:0/2439334625 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f906c0354a0 0x7f906c037960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9074000c00 tx=0x7f90740079c0 comp rx=0 tx=0).stop 2024-09-13T23:56:36.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.406+0000 7f9086917700 1 -- 172.21.15.173:0/2439334625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f908010cd60 msgr2=0x7f90801a2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:36.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.406+0000 7f9086917700 1 --2- 172.21.15.173:0/2439334625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f908010cd60 0x7f90801a2dc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f908010da60 tx=0x7f9070004af0 comp rx=0 tx=0).stop 2024-09-13T23:56:36.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.406+0000 7f9086917700 1 -- 172.21.15.173:0/2439334625 shutdown_connections 2024-09-13T23:56:36.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.406+0000 7f9086917700 1 --2- 172.21.15.173:0/2439334625 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f906c0354a0 0x7f906c037960 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:36.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.406+0000 7f9086917700 1 --2- 172.21.15.173:0/2439334625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f908010cd60 0x7f90801a2dc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:36.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.406+0000 7f9086917700 1 -- 172.21.15.173:0/2439334625 >> 172.21.15.173:0/2439334625 conn(0x7f908006e7b0 msgr2=0x7f90801103a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:36.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.406+0000 7f9086917700 1 -- 172.21.15.173:0/2439334625 shutdown_connections 2024-09-13T23:56:36.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.406+0000 7f9086917700 1 -- 172.21.15.173:0/2439334625 wait complete. 2024-09-13T23:56:36.426 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-13T23:56:36.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.550+0000 7f4306df6700 1 Processor -- start 2024-09-13T23:56:36.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.550+0000 7f4306df6700 1 -- start start 2024-09-13T23:56:36.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.550+0000 7f4306df6700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f430010d470 0x7f430011bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:36.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.550+0000 7f4306df6700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f430010d980 con 0x7f4300110410 2024-09-13T23:56:36.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.550+0000 7f4306df6700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430010db10 con 0x7f430010d470 2024-09-13T23:56:36.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.550+0000 7f43055f3700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f430010d470 0x7f430011bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:36.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.550+0000 7f43055f3700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f430010d470 0x7f430011bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35356/0 (socket says 172.21.15.173:35356) 2024-09-13T23:56:36.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.550+0000 7f43055f3700 1 -- 172.21.15.173:0/3939375899 learned_addr learned my addr 172.21.15.173:0/3939375899 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:36.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.550+0000 7f43055f3700 1 -- 172.21.15.173:0/3939375899 >> v1:172.21.15.87:6789/0 conn(0x7f4300110410 legacy=0x7f430010cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:36.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.550+0000 7f43055f3700 1 -- 172.21.15.173:0/3939375899 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430011d2c0 con 0x7f430010d470 2024-09-13T23:56:36.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.550+0000 7f43055f3700 1 --2- 172.21.15.173:0/3939375899 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f430010d470 0x7f430011bd70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009890 tx=0x7f42f0009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d2c9a94e205c75 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:36.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.550+0000 7f4304df2700 1 -- 172.21.15.173:0/3939375899 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42f0004160 con 0x7f430010d470 2024-09-13T23:56:36.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.550+0000 7f4304df2700 1 -- 172.21.15.173:0/3939375899 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f00042c0 con 0x7f430010d470 2024-09-13T23:56:36.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.550+0000 7f4304df2700 1 -- 172.21.15.173:0/3939375899 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42f0004580 con 0x7f430010d470 2024-09-13T23:56:36.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.550+0000 7f4306df6700 1 -- 172.21.15.173:0/3939375899 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f430010d470 msgr2=0x7f430011bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:36.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.550+0000 7f4306df6700 1 --2- 172.21.15.173:0/3939375899 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f430010d470 0x7f430011bd70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009890 tx=0x7f42f0009ba0 comp rx=0 tx=0).stop 2024-09-13T23:56:36.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.550+0000 7f4306df6700 1 -- 172.21.15.173:0/3939375899 shutdown_connections 2024-09-13T23:56:36.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.550+0000 7f4306df6700 1 --2- 172.21.15.173:0/3939375899 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f430010d470 0x7f430011bd70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:36.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.550+0000 7f4306df6700 1 -- 172.21.15.173:0/3939375899 >> 172.21.15.173:0/3939375899 conn(0x7f430006e550 msgr2=0x7f4300070970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:36.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.550+0000 7f4306df6700 1 -- 172.21.15.173:0/3939375899 shutdown_connections 2024-09-13T23:56:36.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.550+0000 7f4306df6700 1 -- 172.21.15.173:0/3939375899 wait complete. 2024-09-13T23:56:36.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.554+0000 7f4306df6700 1 Processor -- start 2024-09-13T23:56:36.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.554+0000 7f4306df6700 1 -- start start 2024-09-13T23:56:36.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.554+0000 7f4306df6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f430010d470 0x7f43001aad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:36.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.554+0000 7f4306df6700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43001ab2d0 con 0x7f430010d470 2024-09-13T23:56:36.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.554+0000 7f4305df4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f430010d470 0x7f43001aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:36.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.554+0000 7f4305df4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f430010d470 0x7f43001aad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35370/0 (socket says 172.21.15.173:35370) 2024-09-13T23:56:36.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.554+0000 7f4305df4700 1 -- 172.21.15.173:0/786840366 learned_addr learned my addr 172.21.15.173:0/786840366 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:36.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.554+0000 7f4305df4700 1 -- 172.21.15.173:0/786840366 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f0009570 con 0x7f430010d470 2024-09-13T23:56:36.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.554+0000 7f4305df4700 1 --2- 172.21.15.173:0/786840366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f430010d470 0x7f43001aad00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f42fc00c480 tx=0x7f42fc00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:36.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.554+0000 7f42f67fc700 1 -- 172.21.15.173:0/786840366 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42fc005150 con 0x7f430010d470 2024-09-13T23:56:36.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.554+0000 7f4306df6700 1 -- 172.21.15.173:0/786840366 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43001ab4d0 con 0x7f430010d470 2024-09-13T23:56:36.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.554+0000 7f42f67fc700 1 -- 172.21.15.173:0/786840366 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42fc0052b0 con 0x7f430010d470 2024-09-13T23:56:36.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.554+0000 7f4306df6700 1 -- 172.21.15.173:0/786840366 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43001a4d20 con 0x7f430010d470 2024-09-13T23:56:36.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.554+0000 7f42f67fc700 1 -- 172.21.15.173:0/786840366 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42fc0055a0 con 0x7f430010d470 2024-09-13T23:56:36.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.558+0000 7f42f67fc700 1 -- 172.21.15.173:0/786840366 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f42fc006880 con 0x7f430010d470 2024-09-13T23:56:36.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.558+0000 7f42f67fc700 1 --2- 172.21.15.173:0/786840366 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f42e4035450 0x7f42e4037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:36.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.558+0000 7f42f67fc700 1 -- 172.21.15.173:0/786840366 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3730+0+0 (secure 0 0 0) 0x7f42fc046c70 con 0x7f430010d470 2024-09-13T23:56:36.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.558+0000 7f43055f3700 1 --2- 172.21.15.173:0/786840366 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f42e4035450 0x7f42e4037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:36.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.558+0000 7f4306df6700 1 -- 172.21.15.173:0/786840366 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f430004f020 con 0x7f430010d470 2024-09-13T23:56:36.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.558+0000 7f43055f3700 1 --2- 172.21.15.173:0/786840366 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f42e4035450 0x7f42e4037910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009fd0 tx=0x7f42f0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:36.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.566+0000 7f42f67fc700 1 -- 172.21.15.173:0/786840366 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f42fc019b70 con 0x7f430010d470 2024-09-13T23:56:36.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:36.750+0000 7f4306df6700 1 -- 172.21.15.173:0/786840366 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) v1 -- 0x7f430011cc80 con 0x7f430010d470 2024-09-13T23:56:38.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.586+0000 7f42f67fc700 1 -- 172.21.15.173:0/786840366 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v21) v1 ==== 227+0+0 (secure 0 0 0) 0x7f42fc019780 con 0x7f430010d470 2024-09-13T23:56:38.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.594+0000 7f4306df6700 1 -- 172.21.15.173:0/786840366 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f42e4035450 msgr2=0x7f42e4037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:38.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.594+0000 7f4306df6700 1 --2- 172.21.15.173:0/786840366 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f42e4035450 0x7f42e4037910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009fd0 tx=0x7f42f0008030 comp rx=0 tx=0).stop 2024-09-13T23:56:38.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.594+0000 7f4306df6700 1 -- 172.21.15.173:0/786840366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f430010d470 msgr2=0x7f43001aad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:38.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.594+0000 7f4306df6700 1 --2- 172.21.15.173:0/786840366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f430010d470 0x7f43001aad00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f42fc00c480 tx=0x7f42fc00c840 comp rx=0 tx=0).stop 2024-09-13T23:56:38.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.594+0000 7f4306df6700 1 -- 172.21.15.173:0/786840366 shutdown_connections 2024-09-13T23:56:38.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.594+0000 7f4306df6700 1 --2- 172.21.15.173:0/786840366 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f42e4035450 0x7f42e4037910 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:38.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.594+0000 7f4306df6700 1 --2- 172.21.15.173:0/786840366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f430010d470 0x7f43001aad00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:38.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.594+0000 7f4306df6700 1 -- 172.21.15.173:0/786840366 >> 172.21.15.173:0/786840366 conn(0x7f430006e550 msgr2=0x7f430006f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:38.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.594+0000 7f4306df6700 1 -- 172.21.15.173:0/786840366 shutdown_connections 2024-09-13T23:56:38.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.594+0000 7f4306df6700 1 -- 172.21.15.173:0/786840366 wait complete. 2024-09-13T23:56:38.608 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'default.rgw.buckets.data' created 2024-09-13T23:56:38.623 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-13T23:56:38.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.730+0000 7f8a0bfff700 1 Processor -- start 2024-09-13T23:56:38.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.730+0000 7f8a0bfff700 1 -- start start 2024-09-13T23:56:38.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.730+0000 7f8a0bfff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8a0c110860 0x7f8a0c110c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:38.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.730+0000 7f8a0bfff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a0c1112d0 con 0x7f8a0c1152d0 2024-09-13T23:56:38.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.730+0000 7f8a0bfff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0c115e70 con 0x7f8a0c110860 2024-09-13T23:56:38.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.730+0000 7f8a0affd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8a0c110860 0x7f8a0c110c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:38.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.730+0000 7f8a0a7fc700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8a0c1152d0 0x7f8a0c115760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:49500/0 (socket says 172.21.15.173:49500) 2024-09-13T23:56:38.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.730+0000 7f8a0a7fc700 1 -- 172.21.15.173:0/3416696054 learned_addr learned my addr 172.21.15.173:0/3416696054 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:56:38.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.730+0000 7f8a0affd700 1 -- 172.21.15.173:0/3416696054 >> v1:172.21.15.87:6789/0 conn(0x7f8a0c1152d0 legacy=0x7f8a0c115760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:38.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.734+0000 7f8a0affd700 1 -- 172.21.15.173:0/3416696054 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c115fe0 con 0x7f8a0c110860 2024-09-13T23:56:38.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.734+0000 7f8a09ffb700 1 -- 172.21.15.173:0/3416696054 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165372266 0 0) 0x7f8a0c1112d0 con 0x7f8a0c1152d0 2024-09-13T23:56:38.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.734+0000 7f8a0affd700 1 --2- 172.21.15.173:0/3416696054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a0c110860 0x7f8a0c110c40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8a000097d0 tx=0x7f8a00009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc2c4b5b8f92290 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:38.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.734+0000 7f8a09ffb700 1 -- 172.21.15.173:0/3416696054 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a000041c0 con 0x7f8a0c110860 2024-09-13T23:56:38.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.734+0000 7f8a09ffb700 1 -- 172.21.15.173:0/3416696054 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a00004320 con 0x7f8a0c110860 2024-09-13T23:56:38.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.734+0000 7f8a09ffb700 1 -- 172.21.15.173:0/3416696054 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a000036c0 con 0x7f8a0c110860 2024-09-13T23:56:38.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.734+0000 7f8a0bfff700 1 -- 172.21.15.173:0/3416696054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a0c110860 msgr2=0x7f8a0c110c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:38.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.734+0000 7f8a0bfff700 1 --2- 172.21.15.173:0/3416696054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a0c110860 0x7f8a0c110c40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8a000097d0 tx=0x7f8a00009ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:38.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.734+0000 7f8a0bfff700 1 -- 172.21.15.173:0/3416696054 shutdown_connections 2024-09-13T23:56:38.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.734+0000 7f8a0bfff700 1 --2- 172.21.15.173:0/3416696054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a0c110860 0x7f8a0c110c40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:38.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.734+0000 7f8a0bfff700 1 -- 172.21.15.173:0/3416696054 >> 172.21.15.173:0/3416696054 conn(0x7f8a0c06d610 msgr2=0x7f8a0c10ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:38.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.734+0000 7f8a0bfff700 1 -- 172.21.15.173:0/3416696054 shutdown_connections 2024-09-13T23:56:38.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.734+0000 7f8a0bfff700 1 -- 172.21.15.173:0/3416696054 wait complete. 2024-09-13T23:56:38.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.734+0000 7f8a0bfff700 1 Processor -- start 2024-09-13T23:56:38.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.734+0000 7f8a0bfff700 1 -- start start 2024-09-13T23:56:38.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.734+0000 7f8a0bfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a0c110860 0x7f8a0c1aab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:38.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.734+0000 7f8a0bfff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c1ab160 con 0x7f8a0c110860 2024-09-13T23:56:38.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.734+0000 7f8a0affd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a0c110860 0x7f8a0c1aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:38.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.734+0000 7f8a0affd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a0c110860 0x7f8a0c1aab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35384/0 (socket says 172.21.15.173:35384) 2024-09-13T23:56:38.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.734+0000 7f8a0affd700 1 -- 172.21.15.173:0/3656622111 learned_addr learned my addr 172.21.15.173:0/3656622111 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:38.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.738+0000 7f8a0affd700 1 -- 172.21.15.173:0/3656622111 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a000094b0 con 0x7f8a0c110860 2024-09-13T23:56:38.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.738+0000 7f8a0affd700 1 --2- 172.21.15.173:0/3656622111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a0c110860 0x7f8a0c1aab90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8a000090b0 tx=0x7f8a00004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:38.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.738+0000 7f89f37fe700 1 -- 172.21.15.173:0/3656622111 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a00006ea0 con 0x7f8a0c110860 2024-09-13T23:56:38.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.738+0000 7f89f37fe700 1 -- 172.21.15.173:0/3656622111 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a00011760 con 0x7f8a0c110860 2024-09-13T23:56:38.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.738+0000 7f8a0bfff700 1 -- 172.21.15.173:0/3656622111 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0c1ab300 con 0x7f8a0c110860 2024-09-13T23:56:38.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.738+0000 7f89f37fe700 1 -- 172.21.15.173:0/3656622111 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a00011a20 con 0x7f8a0c110860 2024-09-13T23:56:38.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.738+0000 7f8a0bfff700 1 -- 172.21.15.173:0/3656622111 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0c1a4bb0 con 0x7f8a0c110860 2024-09-13T23:56:38.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.738+0000 7f8a0bfff700 1 -- 172.21.15.173:0/3656622111 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a0c110c40 con 0x7f8a0c110860 2024-09-13T23:56:38.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.738+0000 7f89f37fe700 1 -- 172.21.15.173:0/3656622111 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f8a00018050 con 0x7f8a0c110860 2024-09-13T23:56:38.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.738+0000 7f89f37fe700 1 --2- 172.21.15.173:0/3656622111 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f89f80354a0 0x7f89f8037960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:38.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.738+0000 7f89f37fe700 1 -- 172.21.15.173:0/3656622111 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4177+0+0 (secure 0 0 0) 0x7f8a000487e0 con 0x7f8a0c110860 2024-09-13T23:56:38.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.738+0000 7f8a0a7fc700 1 --2- 172.21.15.173:0/3656622111 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f89f80354a0 0x7f89f8037960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:38.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.742+0000 7f8a0a7fc700 1 --2- 172.21.15.173:0/3656622111 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f89f80354a0 0x7f89f8037960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f89fc000c00 tx=0x7f89fc007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:38.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.750+0000 7f89f37fe700 1 -- 172.21.15.173:0/3656622111 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8a00024950 con 0x7f8a0c110860 2024-09-13T23:56:38.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:38.922+0000 7f8a0bfff700 1 -- 172.21.15.173:0/3656622111 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) v1 -- 0x7f8a0c1152d0 con 0x7f8a0c110860 2024-09-13T23:56:39.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.598+0000 7f89f37fe700 1 -- 172.21.15.173:0/3656622111 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v22) v1 ==== 185+0+0 (secure 0 0 0) 0x7f8a0002b070 con 0x7f8a0c110860 2024-09-13T23:56:39.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.630+0000 7f8a0bfff700 1 -- 172.21.15.173:0/3656622111 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f89f80354a0 msgr2=0x7f89f8037960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:39.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.630+0000 7f8a0bfff700 1 --2- 172.21.15.173:0/3656622111 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f89f80354a0 0x7f89f8037960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f89fc000c00 tx=0x7f89fc007a20 comp rx=0 tx=0).stop 2024-09-13T23:56:39.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.630+0000 7f8a0bfff700 1 -- 172.21.15.173:0/3656622111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a0c110860 msgr2=0x7f8a0c1aab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:39.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.630+0000 7f8a0bfff700 1 --2- 172.21.15.173:0/3656622111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a0c110860 0x7f8a0c1aab90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8a000090b0 tx=0x7f8a00004770 comp rx=0 tx=0).stop 2024-09-13T23:56:39.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.630+0000 7f8a0bfff700 1 -- 172.21.15.173:0/3656622111 shutdown_connections 2024-09-13T23:56:39.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.630+0000 7f8a0bfff700 1 --2- 172.21.15.173:0/3656622111 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f89f80354a0 0x7f89f8037960 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:39.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.630+0000 7f8a0bfff700 1 --2- 172.21.15.173:0/3656622111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a0c110860 0x7f8a0c1aab90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:39.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.630+0000 7f8a0bfff700 1 -- 172.21.15.173:0/3656622111 >> 172.21.15.173:0/3656622111 conn(0x7f8a0c06d610 msgr2=0x7f8a0c10f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:39.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.630+0000 7f8a0bfff700 1 -- 172.21.15.173:0/3656622111 shutdown_connections 2024-09-13T23:56:39.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.630+0000 7f8a0bfff700 1 -- 172.21.15.173:0/3656622111 wait complete. 2024-09-13T23:56:39.640 INFO:teuthology.orchestra.run.smithi173.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-13T23:56:39.657 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-13T23:56:39.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.758+0000 7fb46a90c700 1 Processor -- start 2024-09-13T23:56:39.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.758+0000 7fb46a90c700 1 -- start start 2024-09-13T23:56:39.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.762+0000 7fb46a90c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb4641157a0 0x7fb464117b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:39.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.762+0000 7fb46a90c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4641180d0 con 0x7fb4641117d0 2024-09-13T23:56:39.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.762+0000 7fb46a90c700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb464119270 con 0x7fb4641157a0 2024-09-13T23:56:39.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.762+0000 7fb469109700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb4641157a0 0x7fb464117b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:39.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.762+0000 7fb46990a700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb4641117d0 0x7fb464111bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:49510/0 (socket says 172.21.15.173:49510) 2024-09-13T23:56:39.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.762+0000 7fb469109700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb4641157a0 0x7fb464117b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35388/0 (socket says 172.21.15.173:35388) 2024-09-13T23:56:39.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.762+0000 7fb46990a700 1 -- 172.21.15.173:0/278924862 learned_addr learned my addr 172.21.15.173:0/278924862 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:56:39.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.762+0000 7fb469109700 1 -- 172.21.15.173:0/278924862 >> v1:172.21.15.87:6789/0 conn(0x7fb4641117d0 legacy=0x7fb464111bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:39.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.762+0000 7fb468908700 1 -- 172.21.15.173:0/278924862 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3395077742 0 0) 0x7fb4641180d0 con 0x7fb4641117d0 2024-09-13T23:56:39.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.762+0000 7fb469109700 1 -- 172.21.15.173:0/278924862 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4641193b0 con 0x7fb4641157a0 2024-09-13T23:56:39.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.762+0000 7fb469109700 1 --2- 172.21.15.173:0/278924862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4641157a0 0x7fb464117b90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb45400a970 tx=0x7fb45400ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c361a66f73bcd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:39.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.762+0000 7fb468908700 1 -- 172.21.15.173:0/278924862 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb45400c970 con 0x7fb4641157a0 2024-09-13T23:56:39.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.762+0000 7fb468908700 1 -- 172.21.15.173:0/278924862 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45400cad0 con 0x7fb4641157a0 2024-09-13T23:56:39.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.762+0000 7fb468908700 1 -- 172.21.15.173:0/278924862 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb45400cd90 con 0x7fb4641157a0 2024-09-13T23:56:39.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.762+0000 7fb46a90c700 1 -- 172.21.15.173:0/278924862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4641157a0 msgr2=0x7fb464117b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:39.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.762+0000 7fb46a90c700 1 --2- 172.21.15.173:0/278924862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4641157a0 0x7fb464117b90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb45400a970 tx=0x7fb45400ac80 comp rx=0 tx=0).stop 2024-09-13T23:56:39.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.762+0000 7fb46a90c700 1 -- 172.21.15.173:0/278924862 shutdown_connections 2024-09-13T23:56:39.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.762+0000 7fb46a90c700 1 --2- 172.21.15.173:0/278924862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4641157a0 0x7fb464117b90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:39.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.762+0000 7fb46a90c700 1 -- 172.21.15.173:0/278924862 >> 172.21.15.173:0/278924862 conn(0x7fb46406e6a0 msgr2=0x7fb464070ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:39.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.762+0000 7fb46a90c700 1 -- 172.21.15.173:0/278924862 shutdown_connections 2024-09-13T23:56:39.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.762+0000 7fb46a90c700 1 -- 172.21.15.173:0/278924862 wait complete. 2024-09-13T23:56:39.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.766+0000 7fb46a90c700 1 Processor -- start 2024-09-13T23:56:39.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.766+0000 7fb46a90c700 1 -- start start 2024-09-13T23:56:39.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.766+0000 7fb46a90c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4641117d0 0x7fb4641a4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:39.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.766+0000 7fb46a90c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4641a52c0 con 0x7fb4641117d0 2024-09-13T23:56:39.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.766+0000 7fb46990a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4641117d0 0x7fb4641a4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:39.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.766+0000 7fb46990a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4641117d0 0x7fb4641a4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35398/0 (socket says 172.21.15.173:35398) 2024-09-13T23:56:39.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.766+0000 7fb46990a700 1 -- 172.21.15.173:0/1521501914 learned_addr learned my addr 172.21.15.173:0/1521501914 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:39.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.766+0000 7fb46990a700 1 -- 172.21.15.173:0/1521501914 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45400a650 con 0x7fb4641117d0 2024-09-13T23:56:39.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.766+0000 7fb46990a700 1 --2- 172.21.15.173:0/1521501914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4641117d0 0x7fb4641a4d80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb46000c4a0 tx=0x7fb46000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:39.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.766+0000 7fb45a7fc700 1 -- 172.21.15.173:0/1521501914 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb460004bd0 con 0x7fb4641117d0 2024-09-13T23:56:39.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.766+0000 7fb45a7fc700 1 -- 172.21.15.173:0/1521501914 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb460004d30 con 0x7fb4641117d0 2024-09-13T23:56:39.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.766+0000 7fb45a7fc700 1 -- 172.21.15.173:0/1521501914 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4600070d0 con 0x7fb4641117d0 2024-09-13T23:56:39.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.766+0000 7fb46a90c700 1 -- 172.21.15.173:0/1521501914 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4641a5520 con 0x7fb4641117d0 2024-09-13T23:56:39.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.766+0000 7fb46a90c700 1 -- 172.21.15.173:0/1521501914 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4641a94e0 con 0x7fb4641117d0 2024-09-13T23:56:39.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.770+0000 7fb46a90c700 1 -- 172.21.15.173:0/1521501914 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb464111c30 con 0x7fb4641117d0 2024-09-13T23:56:39.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.770+0000 7fb45a7fc700 1 -- 172.21.15.173:0/1521501914 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7fb460007300 con 0x7fb4641117d0 2024-09-13T23:56:39.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.770+0000 7fb45a7fc700 1 --2- 172.21.15.173:0/1521501914 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fb4480354f0 0x7fb4480379b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:39.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.770+0000 7fb45a7fc700 1 -- 172.21.15.173:0/1521501914 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4188+0+0 (secure 0 0 0) 0x7fb4600476b0 con 0x7fb4641117d0 2024-09-13T23:56:39.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.770+0000 7fb469109700 1 --2- 172.21.15.173:0/1521501914 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fb4480354f0 0x7fb4480379b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:39.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.770+0000 7fb469109700 1 --2- 172.21.15.173:0/1521501914 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fb4480354f0 0x7fb4480379b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb46404e9a0 tx=0x7fb454012000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:39.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.782+0000 7fb45a7fc700 1 -- 172.21.15.173:0/1521501914 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb4600102c0 con 0x7fb4641117d0 2024-09-13T23:56:39.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:39.950+0000 7fb46a90c700 1 -- 172.21.15.173:0/1521501914 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) v1 -- 0x7fb4641157a0 con 0x7fb4641117d0 2024-09-13T23:56:40.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.606+0000 7fb45a7fc700 1 -- 172.21.15.173:0/1521501914 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb46001bb30 con 0x7fb4641117d0 2024-09-13T23:56:40.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.618+0000 7fb46a90c700 1 -- 172.21.15.173:0/1521501914 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fb4480354f0 msgr2=0x7fb4480379b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:40.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.618+0000 7fb46a90c700 1 --2- 172.21.15.173:0/1521501914 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fb4480354f0 0x7fb4480379b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb46404e9a0 tx=0x7fb454012000 comp rx=0 tx=0).stop 2024-09-13T23:56:40.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.618+0000 7fb46a90c700 1 -- 172.21.15.173:0/1521501914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4641117d0 msgr2=0x7fb4641a4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:40.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.618+0000 7fb46a90c700 1 --2- 172.21.15.173:0/1521501914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4641117d0 0x7fb4641a4d80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb46000c4a0 tx=0x7fb46000c860 comp rx=0 tx=0).stop 2024-09-13T23:56:40.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.618+0000 7fb46a90c700 1 -- 172.21.15.173:0/1521501914 shutdown_connections 2024-09-13T23:56:40.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.618+0000 7fb46a90c700 1 --2- 172.21.15.173:0/1521501914 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7fb4480354f0 0x7fb4480379b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:40.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.618+0000 7fb46a90c700 1 --2- 172.21.15.173:0/1521501914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4641117d0 0x7fb4641a4d80 secure :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb46000c4a0 tx=0x7fb46000c860 comp rx=0 tx=0).stop 2024-09-13T23:56:40.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.618+0000 7fb46a90c700 1 -- 172.21.15.173:0/1521501914 >> 172.21.15.173:0/1521501914 conn(0x7fb46406e6a0 msgr2=0x7fb464114310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:40.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.622+0000 7fb46a90c700 1 -- 172.21.15.173:0/1521501914 shutdown_connections 2024-09-13T23:56:40.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.622+0000 7fb46a90c700 1 -- 172.21.15.173:0/1521501914 wait complete. 2024-09-13T23:56:40.632 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'default.rgw.buckets.index' created 2024-09-13T23:56:40.644 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-13T23:56:40.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.750+0000 7f2acdced700 1 Processor -- start 2024-09-13T23:56:40.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.750+0000 7f2acdced700 1 -- start start 2024-09-13T23:56:40.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.750+0000 7f2acdced700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2ac8112c10 0x7f2ac8112ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:40.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.750+0000 7f2acdced700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac81136b0 con 0x7f2ac810d5f0 2024-09-13T23:56:40.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.750+0000 7f2acdced700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac810e190 con 0x7f2ac8112c10 2024-09-13T23:56:40.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.750+0000 7f2accceb700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2ac8112c10 0x7f2ac8112ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:40.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.750+0000 7f2ac7fff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f2ac810d5f0 0x7f2ac810da80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:49520/0 (socket says 172.21.15.173:49520) 2024-09-13T23:56:40.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.750+0000 7f2ac7fff700 1 -- 172.21.15.173:0/4064020803 learned_addr learned my addr 172.21.15.173:0/4064020803 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:56:40.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.750+0000 7f2ac77fe700 1 -- 172.21.15.173:0/4064020803 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749744337 0 0) 0x7f2ac81136b0 con 0x7f2ac810d5f0 2024-09-13T23:56:40.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.750+0000 7f2ac77fe700 1 -- 172.21.15.173:0/4064020803 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ab00035d0 con 0x7f2ac810d5f0 2024-09-13T23:56:40.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.750+0000 7f2accceb700 1 -- 172.21.15.173:0/4064020803 >> v1:172.21.15.87:6789/0 conn(0x7f2ac810d5f0 legacy=0x7f2ac810da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:40.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.750+0000 7f2accceb700 1 -- 172.21.15.173:0/4064020803 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac810e300 con 0x7f2ac8112c10 2024-09-13T23:56:40.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.754+0000 7f2accceb700 1 --2- 172.21.15.173:0/4064020803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac8112c10 0x7f2ac8112ff0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0097d0 tx=0x7f2abc009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477254bea86b4a73 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:40.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.754+0000 7f2ac77fe700 1 -- 172.21.15.173:0/4064020803 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2abc004160 con 0x7f2ac8112c10 2024-09-13T23:56:40.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.754+0000 7f2ac77fe700 1 -- 172.21.15.173:0/4064020803 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc0042c0 con 0x7f2ac8112c10 2024-09-13T23:56:40.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.754+0000 7f2ac77fe700 1 -- 172.21.15.173:0/4064020803 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2abc004580 con 0x7f2ac8112c10 2024-09-13T23:56:40.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.754+0000 7f2acdced700 1 -- 172.21.15.173:0/4064020803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac8112c10 msgr2=0x7f2ac8112ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:40.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.754+0000 7f2acdced700 1 --2- 172.21.15.173:0/4064020803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac8112c10 0x7f2ac8112ff0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0097d0 tx=0x7f2abc009ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:40.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.754+0000 7f2acdced700 1 -- 172.21.15.173:0/4064020803 shutdown_connections 2024-09-13T23:56:40.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.754+0000 7f2acdced700 1 --2- 172.21.15.173:0/4064020803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac8112c10 0x7f2ac8112ff0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:40.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.754+0000 7f2acdced700 1 -- 172.21.15.173:0/4064020803 >> 172.21.15.173:0/4064020803 conn(0x7f2ac806e550 msgr2=0x7f2ac8070970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:40.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.754+0000 7f2acdced700 1 -- 172.21.15.173:0/4064020803 shutdown_connections 2024-09-13T23:56:40.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.754+0000 7f2acdced700 1 -- 172.21.15.173:0/4064020803 wait complete. 2024-09-13T23:56:40.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.754+0000 7f2acdced700 1 Processor -- start 2024-09-13T23:56:40.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.754+0000 7f2acdced700 1 -- start start 2024-09-13T23:56:40.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.754+0000 7f2acdced700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac810d5f0 0x7f2ac81a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:40.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.754+0000 7f2acdced700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac81a3300 con 0x7f2ac810d5f0 2024-09-13T23:56:40.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.754+0000 7f2accceb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac810d5f0 0x7f2ac81a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:40.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.754+0000 7f2accceb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac810d5f0 0x7f2ac81a2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35412/0 (socket says 172.21.15.173:35412) 2024-09-13T23:56:40.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.754+0000 7f2accceb700 1 -- 172.21.15.173:0/4276320035 learned_addr learned my addr 172.21.15.173:0/4276320035 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:40.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.758+0000 7f2accceb700 1 -- 172.21.15.173:0/4276320035 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc0094b0 con 0x7f2ac810d5f0 2024-09-13T23:56:40.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.758+0000 7f2accceb700 1 --2- 172.21.15.173:0/4276320035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac810d5f0 0x7f2ac81a2d30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2abc009b20 tx=0x7f2abc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:40.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.758+0000 7f2ac57fa700 1 -- 172.21.15.173:0/4276320035 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2abc006ea0 con 0x7f2ac810d5f0 2024-09-13T23:56:40.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.758+0000 7f2ac57fa700 1 -- 172.21.15.173:0/4276320035 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc01f070 con 0x7f2ac810d5f0 2024-09-13T23:56:40.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.758+0000 7f2acdced700 1 -- 172.21.15.173:0/4276320035 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac81a3500 con 0x7f2ac810d5f0 2024-09-13T23:56:40.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.758+0000 7f2ac57fa700 1 -- 172.21.15.173:0/4276320035 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2abc003e60 con 0x7f2ac810d5f0 2024-09-13T23:56:40.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.758+0000 7f2acdced700 1 -- 172.21.15.173:0/4276320035 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac81a7470 con 0x7f2ac810d5f0 2024-09-13T23:56:40.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.758+0000 7f2acdced700 1 -- 172.21.15.173:0/4276320035 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac804f020 con 0x7f2ac810d5f0 2024-09-13T23:56:40.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.758+0000 7f2ac57fa700 1 -- 172.21.15.173:0/4276320035 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f2abc021030 con 0x7f2ac810d5f0 2024-09-13T23:56:40.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.758+0000 7f2ac57fa700 1 --2- 172.21.15.173:0/4276320035 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f2ab40354e0 0x7f2ab40379a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:40.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.758+0000 7f2ac57fa700 1 -- 172.21.15.173:0/4276320035 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f2abc049020 con 0x7f2ac810d5f0 2024-09-13T23:56:40.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.758+0000 7f2ac7fff700 1 --2- 172.21.15.173:0/4276320035 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f2ab40354e0 0x7f2ab40379a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:40.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.758+0000 7f2ac7fff700 1 --2- 172.21.15.173:0/4276320035 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f2ab40354e0 0x7f2ab40379a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8000f60 tx=0x7f2ab80010a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:40.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.770+0000 7f2ac57fa700 1 -- 172.21.15.173:0/4276320035 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2abc019780 con 0x7f2ac810d5f0 2024-09-13T23:56:40.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:40.938+0000 7f2acdced700 1 -- 172.21.15.173:0/4276320035 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) v1 -- 0x7f2ac810d2d0 con 0x7f2ac810d5f0 2024-09-13T23:56:41.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:41.614+0000 7f2ac57fa700 1 -- 172.21.15.173:0/4276320035 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v24) v1 ==== 187+0+0 (secure 0 0 0) 0x7f2abc0193c0 con 0x7f2ac810d5f0 2024-09-13T23:56:41.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:41.626+0000 7f2acdced700 1 -- 172.21.15.173:0/4276320035 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f2ab40354e0 msgr2=0x7f2ab40379a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:41.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:41.626+0000 7f2acdced700 1 --2- 172.21.15.173:0/4276320035 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f2ab40354e0 0x7f2ab40379a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8000f60 tx=0x7f2ab80010a0 comp rx=0 tx=0).stop 2024-09-13T23:56:41.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:41.626+0000 7f2acdced700 1 -- 172.21.15.173:0/4276320035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac810d5f0 msgr2=0x7f2ac81a2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:41.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:41.626+0000 7f2acdced700 1 --2- 172.21.15.173:0/4276320035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac810d5f0 0x7f2ac81a2d30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2abc009b20 tx=0x7f2abc004770 comp rx=0 tx=0).stop 2024-09-13T23:56:41.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:41.630+0000 7f2acdced700 1 -- 172.21.15.173:0/4276320035 shutdown_connections 2024-09-13T23:56:41.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:41.630+0000 7f2acdced700 1 --2- 172.21.15.173:0/4276320035 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f2ab40354e0 0x7f2ab40379a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:41.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:41.630+0000 7f2acdced700 1 --2- 172.21.15.173:0/4276320035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac810d5f0 0x7f2ac81a2d30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:41.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:41.630+0000 7f2acdced700 1 -- 172.21.15.173:0/4276320035 >> 172.21.15.173:0/4276320035 conn(0x7f2ac806e550 msgr2=0x7f2ac810e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:41.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:41.630+0000 7f2acdced700 1 -- 172.21.15.173:0/4276320035 shutdown_connections 2024-09-13T23:56:41.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:41.630+0000 7f2acdced700 1 -- 172.21.15.173:0/4276320035 wait complete. 2024-09-13T23:56:41.639 INFO:teuthology.orchestra.run.smithi173.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-13T23:56:41.660 DEBUG:tasks.rgw:Pools created 2024-09-13T23:56:41.660 INFO:tasks.rgw:Starting rgw... 2024-09-13T23:56:41.660 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-13T23:56:41.660 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-13T23:56:41.660 DEBUG:teuthology.orchestra.run.smithi173:> sudo echo -n http://smithi173.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-13T23:56:41.670 INFO:teuthology.orchestra.run.smithi173.stdout:http://smithi173.front.sepia.ceph.com:80 2024-09-13T23:56:41.670 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-13T23:56:41.729 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-13T23:56:41.729 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-13T23:56:41.731 INFO:tasks.rgw.client.0:Started 2024-09-13T23:56:41.732 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi173.front.sepia.ceph.com:80/ 2024-09-13T23:56:41.732 DEBUG:teuthology.orchestra.run.smithi173:> curl http://smithi173.front.sepia.ceph.com:80/ 2024-09-13T23:56:41.761 INFO:teuthology.orchestra.run.smithi173.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T23:56:41.761 INFO:teuthology.orchestra.run.smithi173.stderr: Dload Upload Total Spent Left Speed 2024-09-13T23:56:41.761 INFO:teuthology.orchestra.run.smithi173.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T23:56:41.761 INFO:teuthology.orchestra.run.smithi173.stderr:curl: (7) Failed to connect to smithi173.front.sepia.ceph.com port 80: Connection refused 2024-09-13T23:56:41.762 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T23:56:42.764 DEBUG:teuthology.orchestra.run.smithi173:> curl http://smithi173.front.sepia.ceph.com:80/ 2024-09-13T23:56:42.780 INFO:teuthology.orchestra.run.smithi173.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T23:56:42.781 INFO:teuthology.orchestra.run.smithi173.stderr: Dload Upload Total Spent Left Speed 2024-09-13T23:56:42.781 INFO:teuthology.orchestra.run.smithi173.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T23:56:42.781 INFO:teuthology.orchestra.run.smithi173.stderr:curl: (7) Failed to connect to smithi173.front.sepia.ceph.com port 80: Connection refused 2024-09-13T23:56:42.782 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T23:56:44.783 DEBUG:teuthology.orchestra.run.smithi173:> curl http://smithi173.front.sepia.ceph.com:80/ 2024-09-13T23:56:44.800 INFO:teuthology.orchestra.run.smithi173.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T23:56:44.800 INFO:teuthology.orchestra.run.smithi173.stderr: Dload Upload Total Spent Left Speed 2024-09-13T23:56:44.801 INFO:teuthology.orchestra.run.smithi173.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T23:56:44.801 INFO:teuthology.orchestra.run.smithi173.stderr:curl: (7) Failed to connect to smithi173.front.sepia.ceph.com port 80: Connection refused 2024-09-13T23:56:44.801 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T23:56:48.803 DEBUG:teuthology.orchestra.run.smithi173:> curl http://smithi173.front.sepia.ceph.com:80/ 2024-09-13T23:56:48.822 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T23:56:48.822 INFO:teuthology.orchestra.run.smithi173.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T23:56:48.822 INFO:teuthology.orchestra.run.smithi173.stderr: Dload Upload Total Spent Left Speed 2024-09-13T23:56:48.822 INFO:teuthology.orchestra.run.smithi173.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T23:56:48.822 INFO:teuthology.orchestra.run.smithi173.stderr:curl: (7) Failed to connect to smithi173.front.sepia.ceph.com port 80: Connection refused 2024-09-13T23:56:56.823 DEBUG:teuthology.orchestra.run.smithi173:> curl http://smithi173.front.sepia.ceph.com:80/ 2024-09-13T23:56:56.839 INFO:teuthology.orchestra.run.smithi173.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T23:56:56.839 INFO:teuthology.orchestra.run.smithi173.stderr: Dload Upload Total Spent Left Speed 2024-09-13T23:56:56.842 INFO:teuthology.orchestra.run.smithi173.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 71333 0 --:--:-- --:--:-- --:--:-- 71333 2024-09-13T23:56:56.843 INFO:teuthology.orchestra.run.smithi173.stdout:anonymous 2024-09-13T23:56:56.843 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-13T23:56:56.935 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-13T23:56:56.935 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-13T23:56:56.935 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-13T23:56:56.936 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-13T23:56:56.976 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:56:56.976 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:56:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.970+0000 7f6ed242ef40 1 Processor -- start 2024-09-13T23:56:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.970+0000 7f6ed242ef40 1 -- start start 2024-09-13T23:56:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.970+0000 7f6ed242ef40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55589ee59400 0x55589f13e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.970+0000 7f6ed242ef40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55589ef1d500 con 0x55589ee59000 2024-09-13T23:56:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.970+0000 7f6ed242ef40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55589eee6a00 con 0x55589ee59400 2024-09-13T23:56:56.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.974+0000 7f6ed03e6700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55589ee59400 0x55589f13e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:56.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.974+0000 7f6ed0be7700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55589ee59000 0x55589ef58800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:57754/0 (socket says 172.21.15.173:57754) 2024-09-13T23:56:56.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.974+0000 7f6ed0be7700 1 -- 172.21.15.173:0/437825948 learned_addr learned my addr 172.21.15.173:0/437825948 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:56:56.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.974+0000 7f6ed03e6700 1 -- 172.21.15.173:0/437825948 >> v1:172.21.15.87:6789/0 conn(0x55589ee59000 legacy=0x55589ef58800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:56.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.974+0000 7f6ecfbe5700 1 -- 172.21.15.173:0/437825948 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 885089350 0 0) 0x55589efb4000 con 0x55589ee59000 2024-09-13T23:56:56.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.974+0000 7f6ed03e6700 1 -- 172.21.15.173:0/437825948 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55589ee6bd40 con 0x55589ee59400 2024-09-13T23:56:56.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.974+0000 7f6ed03e6700 1 --2- 172.21.15.173:0/437825948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59400 0x55589f13e580 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55589f139920 tx=0x55589ef5d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b654e24e245a1cc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:56.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.974+0000 7f6ecfbe5700 1 -- 172.21.15.173:0/437825948 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55589eefd4a0 con 0x55589ee59400 2024-09-13T23:56:56.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.974+0000 7f6ecfbe5700 1 -- 172.21.15.173:0/437825948 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55589ef1d800 con 0x55589ee59400 2024-09-13T23:56:56.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.974+0000 7f6ecfbe5700 1 -- 172.21.15.173:0/437825948 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55589eefd600 con 0x55589ee59400 2024-09-13T23:56:56.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.974+0000 7f6ed242ef40 1 -- 172.21.15.173:0/437825948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59400 msgr2=0x55589f13e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:56.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.974+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/437825948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59400 0x55589f13e580 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55589f139920 tx=0x55589ef5d920 comp rx=0 tx=0).stop 2024-09-13T23:56:56.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.974+0000 7f6ed242ef40 1 -- 172.21.15.173:0/437825948 shutdown_connections 2024-09-13T23:56:56.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.974+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/437825948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59400 0x55589f13e580 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:56.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.974+0000 7f6ed242ef40 1 -- 172.21.15.173:0/437825948 >> 172.21.15.173:0/437825948 conn(0x55589ee58c00 msgr2=0x55589ef58000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:56.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.974+0000 7f6ed242ef40 1 -- 172.21.15.173:0/437825948 shutdown_connections 2024-09-13T23:56:56.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.974+0000 7f6ed242ef40 1 -- 172.21.15.173:0/437825948 wait complete. 2024-09-13T23:56:56.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.974+0000 7f6ed242ef40 1 Processor -- start 2024-09-13T23:56:56.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.974+0000 7f6ed242ef40 1 -- start start 2024-09-13T23:56:56.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.974+0000 7f6ed242ef40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59000 0x55589f13e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:56.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.974+0000 7f6ed242ef40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55589eee6500 con 0x55589ee59000 2024-09-13T23:56:56.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.978+0000 7f6ed0be7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59000 0x55589f13e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:56.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.978+0000 7f6ed0be7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59000 0x55589f13e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:57790/0 (socket says 172.21.15.173:57790) 2024-09-13T23:56:56.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.978+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1462472175 learned_addr learned my addr 172.21.15.173:0/1462472175 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:56.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.978+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1462472175 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55589ee6bba0 con 0x55589ee59000 2024-09-13T23:56:56.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.978+0000 7f6ed0be7700 1 --2- 172.21.15.173:0/1462472175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59000 0x55589f13e580 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55589fc23d70 tx=0x55589ef5db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8bb07b31b40a5c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.978+0000 7f6ecf3e4700 1 -- 172.21.15.173:0/1462472175 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55589eefd4a0 con 0x55589ee59000 2024-09-13T23:56:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.978+0000 7f6ecf3e4700 1 -- 172.21.15.173:0/1462472175 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55589ef1db00 con 0x55589ee59000 2024-09-13T23:56:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ecf3e4700 1 -- 172.21.15.173:0/1462472175 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55589eefd600 con 0x55589ee59000 2024-09-13T23:56:56.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1462472175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59000 msgr2=0x55589f13e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:56.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/1462472175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59000 0x55589f13e580 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55589fc23d70 tx=0x55589ef5db60 comp rx=0 tx=0).stop 2024-09-13T23:56:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1462472175 shutdown_connections 2024-09-13T23:56:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/1462472175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59000 0x55589f13e580 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1462472175 >> 172.21.15.173:0/1462472175 conn(0x55589ee58c00 msgr2=0x55589ef59000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1462472175 shutdown_connections 2024-09-13T23:56:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1462472175 wait complete. 2024-09-13T23:56:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ed242ef40 1 Processor -- start 2024-09-13T23:56:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ed242ef40 1 -- start start 2024-09-13T23:56:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ed242ef40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59000 0x55589f13e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ed242ef40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55589eee63c0 con 0x55589ee59000 2024-09-13T23:56:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ed0be7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59000 0x55589f13e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ed0be7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59000 0x55589f13e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:57804/0 (socket says 172.21.15.173:57804) 2024-09-13T23:56:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ed0be7700 1 -- 172.21.15.173:0/3180284509 learned_addr learned my addr 172.21.15.173:0/3180284509 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ed0be7700 1 -- 172.21.15.173:0/3180284509 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55589ee6ba00 con 0x55589ee59000 2024-09-13T23:56:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ed0be7700 1 --2- 172.21.15.173:0/3180284509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59000 0x55589f13e580 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55589fc23e00 tx=0x55589ef5da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:56.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ecdbe1700 1 -- 172.21.15.173:0/3180284509 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55589eefd8c0 con 0x55589ee59000 2024-09-13T23:56:56.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ed242ef40 1 -- 172.21.15.173:0/3180284509 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55589ee6b860 con 0x55589ee59000 2024-09-13T23:56:56.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ecdbe1700 1 -- 172.21.15.173:0/3180284509 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55589ef1dc80 con 0x55589ee59000 2024-09-13T23:56:56.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ecdbe1700 1 -- 172.21.15.173:0/3180284509 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55589eefd4a0 con 0x55589ee59000 2024-09-13T23:56:56.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ed242ef40 1 -- 172.21.15.173:0/3180284509 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55589ee6b6c0 con 0x55589ee59000 2024-09-13T23:56:56.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ed242ef40 1 Processor -- start 2024-09-13T23:56:56.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ed242ef40 1 -- start start 2024-09-13T23:56:56.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.982+0000 7f6ed242ef40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59800 0x55589f13eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:56.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.986+0000 7f6ed242ef40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55589eee6000 con 0x55589ee59800 2024-09-13T23:56:56.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.986+0000 7f6ed13e8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59800 0x55589f13eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:56.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.986+0000 7f6ed13e8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59800 0x55589f13eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:57810/0 (socket says 172.21.15.173:57810) 2024-09-13T23:56:56.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.986+0000 7f6ed13e8700 1 -- 172.21.15.173:0/2206655811 learned_addr learned my addr 172.21.15.173:0/2206655811 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:56.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.986+0000 7f6ecdbe1700 1 -- 172.21.15.173:0/3180284509 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55589ef52b00 con 0x55589ee59000 2024-09-13T23:56:56.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.986+0000 7f6ed13e8700 1 -- 172.21.15.173:0/2206655811 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55589ee6a000 con 0x55589ee59800 2024-09-13T23:56:56.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.986+0000 7f6ecdbe1700 1 --2- 172.21.15.173:0/3180284509 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55589f206000 0x55589f13f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:56.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.986+0000 7f6ed13e8700 1 --2- 172.21.15.173:0/2206655811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59800 0x55589f13eb00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55589f180c30 tx=0x55589f1c8840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c120e35ba7dc9ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:56.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.986+0000 7f6ecdbe1700 1 -- 172.21.15.173:0/3180284509 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55589eebf180 con 0x55589ee59000 2024-09-13T23:56:56.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.986+0000 7f6ed0be7700 1 --2- 172.21.15.173:0/3180284509 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55589f206000 0x55589f13f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:56.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.986+0000 7f6ecb3dc700 1 -- 172.21.15.173:0/2206655811 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55589eefd8c0 con 0x55589ee59800 2024-09-13T23:56:56.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.986+0000 7f6ecb3dc700 1 -- 172.21.15.173:0/2206655811 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55589f1ba000 con 0x55589ee59800 2024-09-13T23:56:56.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.986+0000 7f6ecb3dc700 1 -- 172.21.15.173:0/2206655811 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55589eefd4a0 con 0x55589ee59800 2024-09-13T23:56:56.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.986+0000 7f6ed0be7700 1 --2- 172.21.15.173:0/3180284509 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55589f206000 0x55589f13f080 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55589f181080 tx=0x55589f1c8ae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:56.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.986+0000 7f6ed242ef40 1 -- 172.21.15.173:0/2206655811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59800 msgr2=0x55589f13eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:56.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.986+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/2206655811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59800 0x55589f13eb00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55589f180c30 tx=0x55589f1c8840 comp rx=0 tx=0).stop 2024-09-13T23:56:56.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.986+0000 7f6ed242ef40 1 -- 172.21.15.173:0/2206655811 shutdown_connections 2024-09-13T23:56:56.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.986+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/2206655811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59800 0x55589f13eb00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:56.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.986+0000 7f6ed242ef40 1 -- 172.21.15.173:0/2206655811 >> 172.21.15.173:0/2206655811 conn(0x55589ee59400 msgr2=0x55589ef59800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:56.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.986+0000 7f6ed242ef40 1 -- 172.21.15.173:0/2206655811 shutdown_connections 2024-09-13T23:56:56.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.986+0000 7f6ed242ef40 1 -- 172.21.15.173:0/2206655811 wait complete. 2024-09-13T23:56:56.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.990+0000 7f6ed242ef40 1 Processor -- start 2024-09-13T23:56:56.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.990+0000 7f6ed242ef40 1 -- start start 2024-09-13T23:56:56.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.990+0000 7f6ed242ef40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59800 0x55589f13eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:56.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.990+0000 7f6ed242ef40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55589ee7e640 con 0x55589ee59800 2024-09-13T23:56:56.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.990+0000 7f6ed13e8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59800 0x55589f13eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:56.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.990+0000 7f6ed13e8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59800 0x55589f13eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:57822/0 (socket says 172.21.15.173:57822) 2024-09-13T23:56:56.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.990+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 learned_addr learned my addr 172.21.15.173:0/1621264455 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:56.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.990+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55589ee6aea0 con 0x55589ee59800 2024-09-13T23:56:56.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.990+0000 7f6ed13e8700 1 --2- 172.21.15.173:0/1621264455 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59800 0x55589f13eb00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55589f180300 tx=0x55589ef5dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:56.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.990+0000 7f6ec9bd9700 1 -- 172.21.15.173:0/1621264455 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55589eefdb80 con 0x55589ee59800 2024-09-13T23:56:56.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.990+0000 7f6ec9bd9700 1 -- 172.21.15.173:0/1621264455 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55589f1ba180 con 0x55589ee59800 2024-09-13T23:56:56.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.990+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55589ee6a820 con 0x55589ee59800 2024-09-13T23:56:56.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.990+0000 7f6ec9bd9700 1 -- 172.21.15.173:0/1621264455 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55589eefd8c0 con 0x55589ee59800 2024-09-13T23:56:56.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.990+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55589ee6a9c0 con 0x55589ee59800 2024-09-13T23:56:56.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ec9bd9700 1 -- 172.21.15.173:0/1621264455 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55589ef52dc0 con 0x55589ee59800 2024-09-13T23:56:56.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ec9bd9700 1 --2- 172.21.15.173:0/1621264455 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55589f206c00 0x55589f13f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:56.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ed242ef40 20 rados->read ofs=0 len=0 2024-09-13T23:56:56.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ec9bd9700 1 -- 172.21.15.173:0/1621264455 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55589eebf340 con 0x55589ee59800 2024-09-13T23:56:56.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ed03e6700 1 --2- 172.21.15.173:0/1621264455 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55589f206c00 0x55589f13f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:56.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/1621264455 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55589f207000 0x55589f13fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:56.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207400 con 0x55589f207000 2024-09-13T23:56:56.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ed13e8700 1 --2- 172.21.15.173:0/1621264455 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55589f207000 0x55589f13fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:56.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ed03e6700 1 --2- 172.21.15.173:0/1621264455 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55589f206c00 0x55589f13f600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x55589f139920 tx=0x55589ef5d800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:56.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ed13e8700 1 --2- 172.21.15.173:0/1621264455 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55589f207000 0x55589f13fb80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ed242ef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ed242ef40 20 realm 2024-09-13T23:56:57.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ed242ef40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207000 2024-09-13T23:56:57.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ed242ef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ed242ef40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:56:57.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ed242ef40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207c00 con 0x55589f207000 2024-09-13T23:56:57.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ed242ef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ed242ef40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/1621264455 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55589f207400 0x55589f140100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.994+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207400 2024-09-13T23:56:57.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.998+0000 7f6ed0be7700 1 --2- 172.21.15.173:0/1621264455 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55589f207400 0x55589f140100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.998+0000 7f6ed0be7700 1 --2- 172.21.15.173:0/1621264455 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55589f207400 0x55589f140100 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.998+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.998+0000 7f6ed242ef40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:57.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.998+0000 7f6ed242ef40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.998+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/1621264455 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55589f207c00 0x55589f140680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.998+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4000 con 0x55589f207c00 2024-09-13T23:56:57.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.998+0000 7f6ed03e6700 1 --2- 172.21.15.173:0/1621264455 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55589f207c00 0x55589f140680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.998+0000 7f6ed03e6700 1 --2- 172.21.15.173:0/1621264455 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55589f207c00 0x55589f140680 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.998+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.998+0000 7f6ed242ef40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:56:57.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.998+0000 7f6ed242ef40 20 searching for the correct realm 2024-09-13T23:56:57.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.998+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4400 con 0x55589f207c00 2024-09-13T23:56:57.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.998+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:56.998+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4000 con 0x55589f207400 2024-09-13T23:56:57.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.002+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.002+0000 7f6ed0be7700 1 --2- 172.21.15.173:0/1621264455 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55589f2b4000 0x55589f140c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.002+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f2b4000 2024-09-13T23:56:57.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.002+0000 7f6ed13e8700 1 --2- 172.21.15.173:0/1621264455 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55589f2b4000 0x55589f140c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.002+0000 7f6ed13e8700 1 --2- 172.21.15.173:0/1621264455 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55589f2b4000 0x55589f140c00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.002+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f2b4000 2024-09-13T23:56:57.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.002+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207000 2024-09-13T23:56:57.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.002+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.002+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207000 2024-09-13T23:56:57.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.002+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.002+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207c00 2024-09-13T23:56:57.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.002+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.002+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207000 2024-09-13T23:56:57.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.006+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.006+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207400 2024-09-13T23:56:57.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.006+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.006+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207400 2024-09-13T23:56:57.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.006+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.006+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207000 2024-09-13T23:56:57.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.006+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.006+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f2b4000 2024-09-13T23:56:57.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.006+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f2b4000 2024-09-13T23:56:57.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.006+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207000 2024-09-13T23:56:57.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.006+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.006+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f2b4000 2024-09-13T23:56:57.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.006+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f2b4000 2024-09-13T23:56:57.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.006+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207400 2024-09-13T23:56:57.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.010+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.010+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207c00 2024-09-13T23:56:57.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.010+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.010+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207000 2024-09-13T23:56:57.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.010+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.010+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207400 2024-09-13T23:56:57.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.010+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.010+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207c00 2024-09-13T23:56:57.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.010+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.010+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207000 2024-09-13T23:56:57.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.010+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.010+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207000 2024-09-13T23:56:57.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.010+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.010+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207000 2024-09-13T23:56:57.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.014+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.014+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207c00 2024-09-13T23:56:57.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.014+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.014+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f2b4000 2024-09-13T23:56:57.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.014+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f2b4000 2024-09-13T23:56:57.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.014+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207000 2024-09-13T23:56:57.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.014+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.014+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f2b4000 2024-09-13T23:56:57.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.014+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f2b4000 2024-09-13T23:56:57.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.014+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207c00 2024-09-13T23:56:57.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.014+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.014+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f2b4000 2024-09-13T23:56:57.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.014+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f2b4000 2024-09-13T23:56:57.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.014+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207400 2024-09-13T23:56:57.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.018+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.018+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207400 2024-09-13T23:56:57.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.018+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.018+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207c00 2024-09-13T23:56:57.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.018+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.018+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207400 2024-09-13T23:56:57.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.018+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.018+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f207400 2024-09-13T23:56:57.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.018+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.018+0000 7f6ed242ef40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:56:57.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.018+0000 7f6ed242ef40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:56:57.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.018+0000 7f6ed242ef40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:56:57.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.018+0000 7f6ed242ef40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:56:57.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.018+0000 7f6ed242ef40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.018+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207000 2024-09-13T23:56:57.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed242ef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed242ef40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4c00 con 0x55589f207400 2024-09-13T23:56:57.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed242ef40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:57.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed242ef40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b5000 con 0x55589f207000 2024-09-13T23:56:57.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed242ef40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:56:57.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed242ef40 20 zone default found 2024-09-13T23:56:57.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed242ef40 4 Realm: () 2024-09-13T23:56:57.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed242ef40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:56:57.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed242ef40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:56:57.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed242ef40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:56:57.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed242ef40 20 zonegroup default 2024-09-13T23:56:57.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed242ef40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b5400 con 0x55589f2b4000 2024-09-13T23:56:57.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f2b4000 2024-09-13T23:56:57.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed242ef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed242ef40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b5800 con 0x55589f207c00 2024-09-13T23:56:57.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed242ef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed242ef40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.022+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b5c00 con 0x55589f207c00 2024-09-13T23:56:57.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.026+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.026+0000 7f6ed242ef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.026+0000 7f6ed242ef40 20 started sync module instance, tier type = 2024-09-13T23:56:57.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.026+0000 7f6ed242ef40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:56:57.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.026+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2c0000 con 0x55589f207400 2024-09-13T23:56:57.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.026+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.026+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93839114328832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2c0400 con 0x55589f207400 2024-09-13T23:56:57.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.026+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2c0800 con 0x55589f207000 2024-09-13T23:56:57.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.030+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.030+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93839114329984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2c0c00 con 0x55589f207000 2024-09-13T23:56:57.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.030+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2c1000 con 0x55589f207400 2024-09-13T23:56:57.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.030+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93839114328832] v33'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.034+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93839114329984] v33'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.034+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.034+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93839114331136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2c1400 con 0x55589f207400 2024-09-13T23:56:57.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.034+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2c1800 con 0x55589f2b4000 2024-09-13T23:56:57.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.034+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93839114331136] v33'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.038+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f2b4000 2024-09-13T23:56:57.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.038+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93839114332288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2c1c00 con 0x55589f2b4000 2024-09-13T23:56:57.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.038+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2c0800 con 0x55589f207400 2024-09-13T23:56:57.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.042+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93839114332288] v33'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f2b4000 2024-09-13T23:56:57.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.042+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.046+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93839114333440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2c0000 con 0x55589f207400 2024-09-13T23:56:57.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.046+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207c00 2024-09-13T23:56:57.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.046+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.046+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93839114334592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b5000 con 0x55589f207c00 2024-09-13T23:56:57.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.046+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b5400 con 0x55589f207c00 2024-09-13T23:56:57.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.046+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93839114333440] v33'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.050+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v33'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.050+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93839114335744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4c00 con 0x55589f207c00 2024-09-13T23:56:57.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.050+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f207800 con 0x55589f2b4000 2024-09-13T23:56:57.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.050+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93839114334592] v33'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.050+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f2b4000 2024-09-13T23:56:57.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.050+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93839114336896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2c0400 con 0x55589f2b4000 2024-09-13T23:56:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.050+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93839114335744] v33'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.050+0000 7f6ed242ef40 20 add_watcher() i=0 2024-09-13T23:56:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.050+0000 7f6ed242ef40 20 add_watcher() i=1 2024-09-13T23:56:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.050+0000 7f6ed242ef40 20 add_watcher() i=2 2024-09-13T23:56:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.050+0000 7f6ed242ef40 20 add_watcher() i=3 2024-09-13T23:56:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.050+0000 7f6ed242ef40 20 add_watcher() i=4 2024-09-13T23:56:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.050+0000 7f6ed242ef40 20 add_watcher() i=5 2024-09-13T23:56:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.050+0000 7f6ed242ef40 20 add_watcher() i=6 2024-09-13T23:56:57.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.054+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93839114336896] v33'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f2b4000 2024-09-13T23:56:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.054+0000 7f6ed242ef40 20 add_watcher() i=7 2024-09-13T23:56:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.054+0000 7f6ed242ef40 2 all 8 watchers are set, enabling cache 2024-09-13T23:56:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.054+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2c1000 con 0x55589f207000 2024-09-13T23:56:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.054+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.054+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93839115968512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2c1400 con 0x55589f207000 2024-09-13T23:56:57.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.058+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93839115968512] v33'24 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.058+0000 7f6eb7bb5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:57.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.058+0000 7f6ed242ef40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:56:57.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.058+0000 7f6ed242ef40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:56:57.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.058+0000 7f6ed242ef40 1 Processor -- start 2024-09-13T23:56:57.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.058+0000 7f6ed242ef40 1 -- start start 2024-09-13T23:56:57.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.058+0000 7f6ed242ef40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589f2b4400 0x55589f141180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.058+0000 7f6ed242ef40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55589ee7e780 con 0x55589f2b4400 2024-09-13T23:56:57.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.058+0000 7f6ed03e6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589f2b4400 0x55589f141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.058+0000 7f6ed03e6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589f2b4400 0x55589f141180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:57838/0 (socket says 172.21.15.173:57838) 2024-09-13T23:56:57.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.058+0000 7f6ed03e6700 1 -- 172.21.15.173:0/3453782313 learned_addr learned my addr 172.21.15.173:0/3453782313 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.058+0000 7f6ed03e6700 1 -- 172.21.15.173:0/3453782313 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55589ee6ab60 con 0x55589f2b4400 2024-09-13T23:56:57.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.058+0000 7f6ed03e6700 1 --2- 172.21.15.173:0/3453782313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589f2b4400 0x55589f141180 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55589f2ce030 tx=0x55589ef5d980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f4eb981d5b08df0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.058+0000 7f6eb73b4700 1 -- 172.21.15.173:0/3453782313 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55589eefd760 con 0x55589f2b4400 2024-09-13T23:56:57.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.058+0000 7f6eb73b4700 1 -- 172.21.15.173:0/3453782313 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55589f1ba600 con 0x55589f2b4400 2024-09-13T23:56:57.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.058+0000 7f6eb73b4700 1 -- 172.21.15.173:0/3453782313 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55589f2d6000 con 0x55589f2b4400 2024-09-13T23:56:57.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.062+0000 7f6ed242ef40 1 -- 172.21.15.173:0/3453782313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589f2b4400 msgr2=0x55589f141180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.062+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/3453782313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589f2b4400 0x55589f141180 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55589f2ce030 tx=0x55589ef5d980 comp rx=0 tx=0).stop 2024-09-13T23:56:57.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.062+0000 7f6ed242ef40 1 -- 172.21.15.173:0/3453782313 shutdown_connections 2024-09-13T23:56:57.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.062+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/3453782313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589f2b4400 0x55589f141180 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.062+0000 7f6ed242ef40 1 -- 172.21.15.173:0/3453782313 >> 172.21.15.173:0/3453782313 conn(0x55589f2c0800 msgr2=0x55589ef5a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.062+0000 7f6ed242ef40 1 -- 172.21.15.173:0/3453782313 shutdown_connections 2024-09-13T23:56:57.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.062+0000 7f6ed242ef40 1 -- 172.21.15.173:0/3453782313 wait complete. 2024-09-13T23:56:57.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.062+0000 7f6ed242ef40 1 Processor -- start 2024-09-13T23:56:57.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.062+0000 7f6ed242ef40 1 -- start start 2024-09-13T23:56:57.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.062+0000 7f6ed242ef40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589f2b4400 0x55589f141180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.062+0000 7f6ed242ef40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55589eee6000 con 0x55589f2b4400 2024-09-13T23:56:57.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.062+0000 7f6ed03e6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589f2b4400 0x55589f141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.062+0000 7f6ed03e6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589f2b4400 0x55589f141180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:57850/0 (socket says 172.21.15.173:57850) 2024-09-13T23:56:57.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.062+0000 7f6ed03e6700 1 -- 172.21.15.173:0/298620771 learned_addr learned my addr 172.21.15.173:0/298620771 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.062+0000 7f6ed03e6700 1 -- 172.21.15.173:0/298620771 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55589ee6ad00 con 0x55589f2b4400 2024-09-13T23:56:57.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.062+0000 7f6ed03e6700 1 --2- 172.21.15.173:0/298620771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589f2b4400 0x55589f141180 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55589f2ce240 tx=0x55589f1c9b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.062+0000 7f6eb5bb1700 1 -- 172.21.15.173:0/298620771 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55589f2d6160 con 0x55589f2b4400 2024-09-13T23:56:57.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.062+0000 7f6eb5bb1700 1 -- 172.21.15.173:0/298620771 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55589f1ba300 con 0x55589f2b4400 2024-09-13T23:56:57.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.062+0000 7f6ed242ef40 1 -- 172.21.15.173:0/298620771 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55589ee6a340 con 0x55589f2b4400 2024-09-13T23:56:57.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.062+0000 7f6eb5bb1700 1 -- 172.21.15.173:0/298620771 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55589f2d62c0 con 0x55589f2b4400 2024-09-13T23:56:57.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.062+0000 7f6ed242ef40 1 -- 172.21.15.173:0/298620771 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55589ee6bd40 con 0x55589f2b4400 2024-09-13T23:56:57.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.066+0000 7f6eb5bb1700 1 -- 172.21.15.173:0/298620771 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55589ef53b80 con 0x55589f2b4400 2024-09-13T23:56:57.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.066+0000 7f6eb5bb1700 1 --2- 172.21.15.173:0/298620771 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55589f207800 0x55589f352000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.066+0000 7f6eb5bb1700 1 -- 172.21.15.173:0/298620771 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55589eebf500 con 0x55589f2b4400 2024-09-13T23:56:57.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.066+0000 7f6ed13e8700 1 --2- 172.21.15.173:0/298620771 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55589f207800 0x55589f352000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.066+0000 7f6ed242ef40 5 note: GC not initialized 2024-09-13T23:56:57.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.066+0000 7f6ed13e8700 1 --2- 172.21.15.173:0/298620771 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55589f207800 0x55589f352000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x55589f201440 tx=0x55589f314660 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.066+0000 7f6eb33ac700 20 reqs_thread_entry: start 2024-09-13T23:56:57.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.066+0000 7f6ed242ef40 20 init_complete bucket index max shards: 11 2024-09-13T23:56:57.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.066+0000 7f6ed242ef40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:56:57.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.066+0000 7f6eb13a8700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:27 2024 2024-09-13T23:56:57.073 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:56:57.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.066+0000 7f6eb0b86700 20 reqs_thread_entry: start 2024-09-13T23:56:57.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.066+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207c00 2024-09-13T23:56:57.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.070+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(62 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.070+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207400 2024-09-13T23:56:57.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.070+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(63 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.070+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207000 2024-09-13T23:56:57.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.070+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(64 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.070+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207000 2024-09-13T23:56:57.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.070+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(65 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.070+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f2b4000 2024-09-13T23:56:57.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.070+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(66 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f2b4000 2024-09-13T23:56:57.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.070+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207400 2024-09-13T23:56:57.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.070+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(67 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.070+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207000 2024-09-13T23:56:57.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.074+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(68 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.074+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207c00 2024-09-13T23:56:57.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.074+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(69 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.074+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f2b4000 2024-09-13T23:56:57.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.074+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(70 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f2b4000 2024-09-13T23:56:57.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.074+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207400 2024-09-13T23:56:57.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.074+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(71 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.074+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207000 2024-09-13T23:56:57.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.074+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(72 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.074+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207c00 2024-09-13T23:56:57.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.074+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(73 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.074+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207000 2024-09-13T23:56:57.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.078+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 24 ==== osd_op_reply(74 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.078+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207c00 2024-09-13T23:56:57.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.078+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(75 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.078+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f2b4000 2024-09-13T23:56:57.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.078+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(76 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f2b4000 2024-09-13T23:56:57.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.078+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207c00 2024-09-13T23:56:57.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.078+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== osd_op_reply(77 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.078+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207000 2024-09-13T23:56:57.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.078+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 25 ==== osd_op_reply(78 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.078+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207400 2024-09-13T23:56:57.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.078+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(79 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.078+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f2b4000 2024-09-13T23:56:57.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.082+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(80 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f2b4000 2024-09-13T23:56:57.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.082+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207400 2024-09-13T23:56:57.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.082+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(81 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.082+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207000 2024-09-13T23:56:57.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.082+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 26 ==== osd_op_reply(82 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.082+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207c00 2024-09-13T23:56:57.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.082+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 20 ==== osd_op_reply(83 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.082+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f2b4000 2024-09-13T23:56:57.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.082+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(84 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f2b4000 2024-09-13T23:56:57.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.082+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207000 2024-09-13T23:56:57.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.082+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 27 ==== osd_op_reply(85 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.082+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207000 2024-09-13T23:56:57.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.082+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 28 ==== osd_op_reply(86 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.082+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207c00 2024-09-13T23:56:57.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.086+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 21 ==== osd_op_reply(87 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.086+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207c00 2024-09-13T23:56:57.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.086+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 22 ==== osd_op_reply(88 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.086+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f2b4000 2024-09-13T23:56:57.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.086+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(89 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f2b4000 2024-09-13T23:56:57.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.086+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207000 2024-09-13T23:56:57.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.086+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 29 ==== osd_op_reply(90 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.086+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207400 2024-09-13T23:56:57.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.086+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(91 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.086+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f207c00 2024-09-13T23:56:57.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.086+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 23 ==== osd_op_reply(92 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.086+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2b4800 con 0x55589f2b4000 2024-09-13T23:56:57.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.090+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.2 v2:172.21.15.173:6809/889985573 18 ==== osd_op_reply(93 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f2b4000 2024-09-13T23:56:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.090+0000 7f6eb7bb5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.090+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93839115968512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2c0c00 con 0x55589f207000 2024-09-13T23:56:57.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.094+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93839115968512] v33'25 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.094+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93839114328832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2c1800 con 0x55589f207400 2024-09-13T23:56:57.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.094+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93839114328832] v33'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.094+0000 7f6ed242ef40 20 remove_watcher() i=0 2024-09-13T23:56:57.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.094+0000 7f6ed242ef40 2 removed watcher, disabling cache 2024-09-13T23:56:57.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.094+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93839114329984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2c1c00 con 0x55589f207000 2024-09-13T23:56:57.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.098+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.1 v2:172.21.15.173:6808/3256211813 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93839114329984] v33'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f207000 2024-09-13T23:56:57.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.098+0000 7f6ed242ef40 20 remove_watcher() i=1 2024-09-13T23:56:57.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.098+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93839114331136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f2c0400 con 0x55589f207400 2024-09-13T23:56:57.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.102+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93839114331136] v33'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.102+0000 7f6ed242ef40 20 remove_watcher() i=2 2024-09-13T23:56:57.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.102+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93839114332288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f220000 con 0x55589f2b4000 2024-09-13T23:56:57.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.102+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.2 v2:172.21.15.173:6809/889985573 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93839114332288] v33'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f2b4000 2024-09-13T23:56:57.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.102+0000 7f6ed242ef40 20 remove_watcher() i=3 2024-09-13T23:56:57.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.102+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93839114333440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f220400 con 0x55589f207400 2024-09-13T23:56:57.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.106+0000 7f6ed0be7700 1 -- 172.21.15.173:0/1621264455 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93839114333440] v33'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55589f2a7200 con 0x55589f207400 2024-09-13T23:56:57.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.106+0000 7f6ed242ef40 20 remove_watcher() i=4 2024-09-13T23:56:57.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.106+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93839114334592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f220800 con 0x55589f207c00 2024-09-13T23:56:57.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.110+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93839114334592] v33'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.110+0000 7f6ed242ef40 20 remove_watcher() i=5 2024-09-13T23:56:57.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.110+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93839114335744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f220c00 con 0x55589f207c00 2024-09-13T23:56:57.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.110+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 <== osd.3 v2:172.21.15.173:6800/4020038786 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93839114335744] v33'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55589f2a7440 con 0x55589f207c00 2024-09-13T23:56:57.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.114+0000 7f6ed242ef40 20 remove_watcher() i=6 2024-09-13T23:56:57.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.114+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93839114336896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589f221000 con 0x55589f2b4000 2024-09-13T23:56:57.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.114+0000 7f6ed13e8700 1 -- 172.21.15.173:0/1621264455 <== osd.2 v2:172.21.15.173:6809/889985573 20 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93839114336896] v33'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55589f2a6b40 con 0x55589f2b4000 2024-09-13T23:56:57.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.114+0000 7f6ed242ef40 20 remove_watcher() i=7 2024-09-13T23:56:57.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.114+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55589f207400 msgr2=0x55589f140100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.114+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/1621264455 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55589f207400 0x55589f140100 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.114+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55589f207000 msgr2=0x55589f13fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.114+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/1621264455 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55589f207000 0x55589f13fb80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.114+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55589f2b4000 msgr2=0x55589f140c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.114+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/1621264455 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55589f2b4000 0x55589f140c00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.114+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55589f207c00 msgr2=0x55589f140680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.114+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/1621264455 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55589f207c00 0x55589f140680 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.114+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55589f206c00 msgr2=0x55589f13f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.114+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/1621264455 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55589f206c00 0x55589f13f600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x55589f139920 tx=0x55589ef5d800 comp rx=0 tx=0).stop 2024-09-13T23:56:57.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.114+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59800 msgr2=0x55589f13eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.114+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/1621264455 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59800 0x55589f13eb00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55589f180300 tx=0x55589ef5dda0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.114+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 reap_dead start 2024-09-13T23:56:57.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.114+0000 7f6ed03e6700 1 -- 172.21.15.173:0/1621264455 reap_dead start 2024-09-13T23:56:57.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.114+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 shutdown_connections 2024-09-13T23:56:57.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.114+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 >> 172.21.15.173:0/1621264455 conn(0x55589ee59400 msgr2=0x55589ef59800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.114+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 shutdown_connections 2024-09-13T23:56:57.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.114+0000 7f6ed242ef40 1 -- 172.21.15.173:0/1621264455 wait complete. 2024-09-13T23:56:57.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.118+0000 7f6ed242ef40 1 -- 172.21.15.173:0/298620771 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55589f207800 msgr2=0x55589f352000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.118+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/298620771 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55589f207800 0x55589f352000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x55589f201440 tx=0x55589f314660 comp rx=0 tx=0).stop 2024-09-13T23:56:57.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.118+0000 7f6ed242ef40 1 -- 172.21.15.173:0/298620771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589f2b4400 msgr2=0x55589f141180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.118+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/298620771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589f2b4400 0x55589f141180 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55589f2ce240 tx=0x55589f1c9b00 comp rx=0 tx=0).stop 2024-09-13T23:56:57.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.118+0000 7f6ed242ef40 1 -- 172.21.15.173:0/298620771 shutdown_connections 2024-09-13T23:56:57.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.118+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/298620771 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55589f207800 0x55589f352000 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.118+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/298620771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589f2b4400 0x55589f141180 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.118+0000 7f6ed242ef40 1 -- 172.21.15.173:0/298620771 >> 172.21.15.173:0/298620771 conn(0x55589f2c0800 msgr2=0x55589ef5a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.118+0000 7f6ed242ef40 1 -- 172.21.15.173:0/298620771 shutdown_connections 2024-09-13T23:56:57.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.118+0000 7f6ed242ef40 1 -- 172.21.15.173:0/298620771 wait complete. 2024-09-13T23:56:57.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.118+0000 7f6ed242ef40 1 -- 172.21.15.173:0/3180284509 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55589f206000 msgr2=0x55589f13f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.118+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/3180284509 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55589f206000 0x55589f13f080 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55589f181080 tx=0x55589f1c8ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.118+0000 7f6ed242ef40 1 -- 172.21.15.173:0/3180284509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59000 msgr2=0x55589f13e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.118+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/3180284509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59000 0x55589f13e580 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55589fc23e00 tx=0x55589ef5da40 comp rx=0 tx=0).stop 2024-09-13T23:56:57.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.118+0000 7f6ed242ef40 1 -- 172.21.15.173:0/3180284509 shutdown_connections 2024-09-13T23:56:57.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.118+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/3180284509 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55589f206000 0x55589f13f080 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.118+0000 7f6ed242ef40 1 --2- 172.21.15.173:0/3180284509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55589ee59000 0x55589f13e580 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.118+0000 7f6ed242ef40 1 -- 172.21.15.173:0/3180284509 >> 172.21.15.173:0/3180284509 conn(0x55589ee58c00 msgr2=0x55589ef59000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.118+0000 7f6ed242ef40 1 -- 172.21.15.173:0/3180284509 shutdown_connections 2024-09-13T23:56:57.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.118+0000 7f6ed242ef40 1 -- 172.21.15.173:0/3180284509 wait complete. 2024-09-13T23:56:57.126 INFO:teuthology.orchestra.run.smithi173.stdout:[] 2024-09-13T23:56:57.127 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T23:56:57.128 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-13T23:56:57.128 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-13T23:56:57.128 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-13T23:56:57.209 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:56:57.209 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:56:57.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.206+0000 7fec27ee1f40 1 Processor -- start 2024-09-13T23:56:57.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.206+0000 7fec27ee1f40 1 -- start start 2024-09-13T23:56:57.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.206+0000 7fec27ee1f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x563e3bfeb000 0x563e3c2d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.206+0000 7fec27ee1f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563e3c0af500 con 0x563e3bfeb400 2024-09-13T23:56:57.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.206+0000 7fec27ee1f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x563e3c078a00 con 0x563e3bfeb000 2024-09-13T23:56:57.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.206+0000 7fec2669a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x563e3bfeb000 0x563e3c2d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.206+0000 7fec25e99700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x563e3bfeb400 0x563e3c0ea800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:57764/0 (socket says 172.21.15.173:57764) 2024-09-13T23:56:57.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.206+0000 7fec2669a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x563e3bfeb000 0x563e3c2d0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:57866/0 (socket says 172.21.15.173:57866) 2024-09-13T23:56:57.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.206+0000 7fec25e99700 1 -- 172.21.15.173:0/2489438749 learned_addr learned my addr 172.21.15.173:0/2489438749 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:56:57.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.206+0000 7fec25698700 1 -- 172.21.15.173:0/2489438749 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757585132 0 0) 0x563e3c146000 con 0x563e3bfeb400 2024-09-13T23:56:57.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.206+0000 7fec25698700 1 -- 172.21.15.173:0/2489438749 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x563e3c0af800 con 0x563e3bfeb400 2024-09-13T23:56:57.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.206+0000 7fec2669a700 1 -- 172.21.15.173:0/2489438749 >> v1:172.21.15.87:6789/0 conn(0x563e3bfeb400 legacy=0x563e3c0ea800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.206+0000 7fec2669a700 1 -- 172.21.15.173:0/2489438749 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e3bffdd40 con 0x563e3bfeb000 2024-09-13T23:56:57.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.206+0000 7fec2669a700 1 --2- 172.21.15.173:0/2489438749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb000 0x563e3c2d0580 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x563e3c2cba70 tx=0x563e3c0ef980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817a007adb852343 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.206+0000 7fec25698700 1 -- 172.21.15.173:0/2489438749 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563e3c08f4a0 con 0x563e3bfeb000 2024-09-13T23:56:57.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.206+0000 7fec25698700 1 -- 172.21.15.173:0/2489438749 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563e3c0af500 con 0x563e3bfeb000 2024-09-13T23:56:57.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.206+0000 7fec25698700 1 -- 172.21.15.173:0/2489438749 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563e3c08f600 con 0x563e3bfeb000 2024-09-13T23:56:57.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.206+0000 7fec27ee1f40 1 -- 172.21.15.173:0/2489438749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb000 msgr2=0x563e3c2d0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.206+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/2489438749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb000 0x563e3c2d0580 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x563e3c2cba70 tx=0x563e3c0ef980 comp rx=0 tx=0).stop 2024-09-13T23:56:57.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.206+0000 7fec27ee1f40 1 -- 172.21.15.173:0/2489438749 shutdown_connections 2024-09-13T23:56:57.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.206+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/2489438749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb000 0x563e3c2d0580 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.206+0000 7fec27ee1f40 1 -- 172.21.15.173:0/2489438749 >> 172.21.15.173:0/2489438749 conn(0x563e3bfeac00 msgr2=0x563e3c0ea000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.206+0000 7fec27ee1f40 1 -- 172.21.15.173:0/2489438749 shutdown_connections 2024-09-13T23:56:57.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.206+0000 7fec27ee1f40 1 -- 172.21.15.173:0/2489438749 wait complete. 2024-09-13T23:56:57.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.210+0000 7fec27ee1f40 1 Processor -- start 2024-09-13T23:56:57.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.210+0000 7fec27ee1f40 1 -- start start 2024-09-13T23:56:57.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.210+0000 7fec27ee1f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb000 0x563e3c2d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.210+0000 7fec27ee1f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e3c078500 con 0x563e3bfeb000 2024-09-13T23:56:57.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.210+0000 7fec2669a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb000 0x563e3c2d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.210+0000 7fec2669a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb000 0x563e3c2d0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:57868/0 (socket says 172.21.15.173:57868) 2024-09-13T23:56:57.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.210+0000 7fec2669a700 1 -- 172.21.15.173:0/1575626365 learned_addr learned my addr 172.21.15.173:0/1575626365 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.210+0000 7fec2669a700 1 -- 172.21.15.173:0/1575626365 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e3bffdba0 con 0x563e3bfeb000 2024-09-13T23:56:57.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.210+0000 7fec2669a700 1 --2- 172.21.15.173:0/1575626365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb000 0x563e3c2d0580 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x563e3cdb5e00 tx=0x563e3c0ef800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33094d90836214eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.210+0000 7fec24e97700 1 -- 172.21.15.173:0/1575626365 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563e3c08f760 con 0x563e3bfeb000 2024-09-13T23:56:57.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.210+0000 7fec24e97700 1 -- 172.21.15.173:0/1575626365 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563e3c0af980 con 0x563e3bfeb000 2024-09-13T23:56:57.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.210+0000 7fec24e97700 1 -- 172.21.15.173:0/1575626365 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563e3c08f1e0 con 0x563e3bfeb000 2024-09-13T23:56:57.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.210+0000 7fec27ee1f40 1 -- 172.21.15.173:0/1575626365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb000 msgr2=0x563e3c2d0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.210+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/1575626365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb000 0x563e3c2d0580 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x563e3cdb5e00 tx=0x563e3c0ef800 comp rx=0 tx=0).stop 2024-09-13T23:56:57.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.210+0000 7fec27ee1f40 1 -- 172.21.15.173:0/1575626365 shutdown_connections 2024-09-13T23:56:57.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.210+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/1575626365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb000 0x563e3c2d0580 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.210+0000 7fec27ee1f40 1 -- 172.21.15.173:0/1575626365 >> 172.21.15.173:0/1575626365 conn(0x563e3bfeac00 msgr2=0x563e3c0eb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.210+0000 7fec27ee1f40 1 -- 172.21.15.173:0/1575626365 shutdown_connections 2024-09-13T23:56:57.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.210+0000 7fec27ee1f40 1 -- 172.21.15.173:0/1575626365 wait complete. 2024-09-13T23:56:57.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.210+0000 7fec27ee1f40 1 Processor -- start 2024-09-13T23:56:57.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.210+0000 7fec27ee1f40 1 -- start start 2024-09-13T23:56:57.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.210+0000 7fec27ee1f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb000 0x563e3c2d0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.210+0000 7fec27ee1f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e3c0783c0 con 0x563e3bfeb000 2024-09-13T23:56:57.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.214+0000 7fec2669a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb000 0x563e3c2d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.214+0000 7fec2669a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb000 0x563e3c2d0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:57874/0 (socket says 172.21.15.173:57874) 2024-09-13T23:56:57.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.214+0000 7fec2669a700 1 -- 172.21.15.173:0/2924754267 learned_addr learned my addr 172.21.15.173:0/2924754267 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.214+0000 7fec2669a700 1 -- 172.21.15.173:0/2924754267 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e3bffda00 con 0x563e3bfeb000 2024-09-13T23:56:57.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.214+0000 7fec2669a700 1 --2- 172.21.15.173:0/2924754267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb000 0x563e3c2d0580 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x563e3cdb5ef0 tx=0x563e3c0ef980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.214+0000 7fec23694700 1 -- 172.21.15.173:0/2924754267 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563e3c08f4a0 con 0x563e3bfeb000 2024-09-13T23:56:57.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.214+0000 7fec23694700 1 -- 172.21.15.173:0/2924754267 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563e3c0afb00 con 0x563e3bfeb000 2024-09-13T23:56:57.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.214+0000 7fec27ee1f40 1 -- 172.21.15.173:0/2924754267 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563e3bffd860 con 0x563e3bfeb000 2024-09-13T23:56:57.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.214+0000 7fec23694700 1 -- 172.21.15.173:0/2924754267 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563e3c08f600 con 0x563e3bfeb000 2024-09-13T23:56:57.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.214+0000 7fec27ee1f40 1 -- 172.21.15.173:0/2924754267 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563e3bffd6c0 con 0x563e3bfeb000 2024-09-13T23:56:57.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.214+0000 7fec27ee1f40 1 Processor -- start 2024-09-13T23:56:57.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.214+0000 7fec27ee1f40 1 -- start start 2024-09-13T23:56:57.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.214+0000 7fec27ee1f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb800 0x563e3c2d0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.214+0000 7fec27ee1f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e3c010640 con 0x563e3bfeb800 2024-09-13T23:56:57.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.214+0000 7fec23694700 1 -- 172.21.15.173:0/2924754267 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x563e3c0e4b00 con 0x563e3bfeb000 2024-09-13T23:56:57.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.214+0000 7fec26e9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb800 0x563e3c2d0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.214+0000 7fec26e9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb800 0x563e3c2d0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:57886/0 (socket says 172.21.15.173:57886) 2024-09-13T23:56:57.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.214+0000 7fec26e9b700 1 -- 172.21.15.173:0/731738431 learned_addr learned my addr 172.21.15.173:0/731738431 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.214+0000 7fec23694700 1 --2- 172.21.15.173:0/2924754267 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563e3c38e000 0x563e3c2d1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.214+0000 7fec23694700 1 -- 172.21.15.173:0/2924754267 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x563e3c051180 con 0x563e3bfeb000 2024-09-13T23:56:57.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.214+0000 7fec2669a700 1 --2- 172.21.15.173:0/2924754267 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563e3c38e000 0x563e3c2d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.218+0000 7fec26e9b700 1 -- 172.21.15.173:0/731738431 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e3bffc000 con 0x563e3bfeb800 2024-09-13T23:56:57.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.218+0000 7fec26e9b700 1 --2- 172.21.15.173:0/731738431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb800 0x563e3c2d0b00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x563e3c36e510 tx=0x563e3c34c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8575e80d69d60f32 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.218+0000 7fec20e8f700 1 -- 172.21.15.173:0/731738431 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563e3c08f4a0 con 0x563e3bfeb800 2024-09-13T23:56:57.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.218+0000 7fec20e8f700 1 -- 172.21.15.173:0/731738431 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563e3c0afb00 con 0x563e3bfeb800 2024-09-13T23:56:57.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.218+0000 7fec2669a700 1 --2- 172.21.15.173:0/2924754267 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563e3c38e000 0x563e3c2d1080 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x563e3c305590 tx=0x563e3c34c8a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.218+0000 7fec20e8f700 1 -- 172.21.15.173:0/731738431 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563e3c08f600 con 0x563e3bfeb800 2024-09-13T23:56:57.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.218+0000 7fec27ee1f40 1 -- 172.21.15.173:0/731738431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb800 msgr2=0x563e3c2d0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.218+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/731738431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb800 0x563e3c2d0b00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x563e3c36e510 tx=0x563e3c34c780 comp rx=0 tx=0).stop 2024-09-13T23:56:57.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.218+0000 7fec27ee1f40 1 -- 172.21.15.173:0/731738431 shutdown_connections 2024-09-13T23:56:57.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.218+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/731738431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb800 0x563e3c2d0b00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.218+0000 7fec27ee1f40 1 -- 172.21.15.173:0/731738431 >> 172.21.15.173:0/731738431 conn(0x563e3bfeb400 msgr2=0x563e3c0eb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.218+0000 7fec27ee1f40 1 -- 172.21.15.173:0/731738431 shutdown_connections 2024-09-13T23:56:57.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.218+0000 7fec27ee1f40 1 -- 172.21.15.173:0/731738431 wait complete. 2024-09-13T23:56:57.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.218+0000 7fec27ee1f40 1 Processor -- start 2024-09-13T23:56:57.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.218+0000 7fec27ee1f40 1 -- start start 2024-09-13T23:56:57.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.218+0000 7fec27ee1f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb800 0x563e3c2d0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.218+0000 7fec27ee1f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e3c0108c0 con 0x563e3bfeb800 2024-09-13T23:56:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.218+0000 7fec26e9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb800 0x563e3c2d0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.218+0000 7fec26e9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb800 0x563e3c2d0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:57896/0 (socket says 172.21.15.173:57896) 2024-09-13T23:56:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.218+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 learned_addr learned my addr 172.21.15.173:0/729647477 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.222+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e3bffcea0 con 0x563e3bfeb800 2024-09-13T23:56:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.222+0000 7fec26e9b700 1 --2- 172.21.15.173:0/729647477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb800 0x563e3c2d0b00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x563e3c304420 tx=0x563e3c34c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.222+0000 7fec1f68c700 1 -- 172.21.15.173:0/729647477 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563e3c08f760 con 0x563e3bfeb800 2024-09-13T23:56:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.222+0000 7fec1f68c700 1 -- 172.21.15.173:0/729647477 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563e3c3ae000 con 0x563e3bfeb800 2024-09-13T23:56:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.222+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563e3bffc820 con 0x563e3bfeb800 2024-09-13T23:56:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.222+0000 7fec1f68c700 1 -- 172.21.15.173:0/729647477 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563e3c08f4a0 con 0x563e3bfeb800 2024-09-13T23:56:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.222+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563e3bffc9c0 con 0x563e3bfeb800 2024-09-13T23:56:57.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.222+0000 7fec1f68c700 1 -- 172.21.15.173:0/729647477 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x563e3c0e4dc0 con 0x563e3bfeb800 2024-09-13T23:56:57.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.222+0000 7fec1f68c700 1 --2- 172.21.15.173:0/729647477 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563e3c38ec00 0x563e3c2d1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.222+0000 7fec1f68c700 1 -- 172.21.15.173:0/729647477 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x563e3c051340 con 0x563e3bfeb800 2024-09-13T23:56:57.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.222+0000 7fec25e99700 1 --2- 172.21.15.173:0/729647477 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563e3c38ec00 0x563e3c2d1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.222+0000 7fec27ee1f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.222+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/729647477 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563e3c38f000 0x563e3c2d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.222+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f400 con 0x563e3c38f000 2024-09-13T23:56:57.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec26e9b700 1 --2- 172.21.15.173:0/729647477 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563e3c38f000 0x563e3c2d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec25e99700 1 --2- 172.21.15.173:0/729647477 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563e3c38ec00 0x563e3c2d1600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x563e3cdb4030 tx=0x563e3c34d920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec26e9b700 1 --2- 172.21.15.173:0/729647477 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563e3c38f000 0x563e3c2d1b80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c38f000 2024-09-13T23:56:57.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec27ee1f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec27ee1f40 20 realm 2024-09-13T23:56:57.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec27ee1f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38f000 2024-09-13T23:56:57.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c38f000 2024-09-13T23:56:57.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec27ee1f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec27ee1f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:56:57.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec27ee1f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38fc00 con 0x563e3c38f000 2024-09-13T23:56:57.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c38f000 2024-09-13T23:56:57.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec27ee1f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec27ee1f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/729647477 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563e3c38f400 0x563e3c2d2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38f400 2024-09-13T23:56:57.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec2669a700 1 --2- 172.21.15.173:0/729647477 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563e3c38f400 0x563e3c2d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec2669a700 1 --2- 172.21.15.173:0/729647477 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563e3c38f400 0x563e3c2d2100 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c38f400 2024-09-13T23:56:57.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec27ee1f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:57.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec27ee1f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/729647477 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563e3c38fc00 0x563e3c2d2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.226+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c442000 con 0x563e3c38fc00 2024-09-13T23:56:57.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.230+0000 7fec25e99700 1 --2- 172.21.15.173:0/729647477 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563e3c38fc00 0x563e3c2d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.230+0000 7fec25e99700 1 --2- 172.21.15.173:0/729647477 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563e3c38fc00 0x563e3c2d2680 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.230+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x563e3c43f440 con 0x563e3c38fc00 2024-09-13T23:56:57.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.230+0000 7fec27ee1f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:56:57.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.230+0000 7fec27ee1f40 20 searching for the correct realm 2024-09-13T23:56:57.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.230+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c442400 con 0x563e3c38fc00 2024-09-13T23:56:57.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.230+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x563e3c43f440 con 0x563e3c38fc00 2024-09-13T23:56:57.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.230+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c442000 con 0x563e3c38f400 2024-09-13T23:56:57.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.230+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c38f400 2024-09-13T23:56:57.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.230+0000 7fec2669a700 1 --2- 172.21.15.173:0/729647477 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563e3c442000 0x563e3c2d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.230+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c442000 2024-09-13T23:56:57.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.230+0000 7fec26e9b700 1 --2- 172.21.15.173:0/729647477 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563e3c442000 0x563e3c2d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.230+0000 7fec26e9b700 1 --2- 172.21.15.173:0/729647477 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563e3c442000 0x563e3c2d2c00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.230+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c442000 2024-09-13T23:56:57.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.230+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38f000 2024-09-13T23:56:57.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.230+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c38f000 2024-09-13T23:56:57.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.234+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38f000 2024-09-13T23:56:57.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.234+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c38f000 2024-09-13T23:56:57.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.234+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38fc00 2024-09-13T23:56:57.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.234+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43f440 con 0x563e3c38fc00 2024-09-13T23:56:57.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.234+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38f000 2024-09-13T23:56:57.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.234+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c38f000 2024-09-13T23:56:57.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.234+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38f400 2024-09-13T23:56:57.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.234+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c38f400 2024-09-13T23:56:57.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.234+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38f400 2024-09-13T23:56:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.234+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c38f400 2024-09-13T23:56:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.234+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38f000 2024-09-13T23:56:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.234+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c38f000 2024-09-13T23:56:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.234+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c442000 2024-09-13T23:56:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.234+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c442000 2024-09-13T23:56:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.234+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38f000 2024-09-13T23:56:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.238+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c38f000 2024-09-13T23:56:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.238+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c442000 2024-09-13T23:56:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.238+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c442000 2024-09-13T23:56:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.238+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38f400 2024-09-13T23:56:57.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.238+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c38f400 2024-09-13T23:56:57.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.238+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38fc00 2024-09-13T23:56:57.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.238+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43f440 con 0x563e3c38fc00 2024-09-13T23:56:57.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.238+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38f000 2024-09-13T23:56:57.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.238+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c38f000 2024-09-13T23:56:57.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.238+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38f400 2024-09-13T23:56:57.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.238+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c38f400 2024-09-13T23:56:57.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.238+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38fc00 2024-09-13T23:56:57.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.242+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43f440 con 0x563e3c38fc00 2024-09-13T23:56:57.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.242+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38f000 2024-09-13T23:56:57.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.242+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c38f000 2024-09-13T23:56:57.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.242+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38f000 2024-09-13T23:56:57.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.242+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c38f000 2024-09-13T23:56:57.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.242+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38f000 2024-09-13T23:56:57.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.242+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c38f000 2024-09-13T23:56:57.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.242+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38fc00 2024-09-13T23:56:57.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.242+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43f440 con 0x563e3c38fc00 2024-09-13T23:56:57.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.242+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c442000 2024-09-13T23:56:57.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.242+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c442000 2024-09-13T23:56:57.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.242+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38f000 2024-09-13T23:56:57.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.242+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c38f000 2024-09-13T23:56:57.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.242+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c442000 2024-09-13T23:56:57.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.246+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c442000 2024-09-13T23:56:57.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.246+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38fc00 2024-09-13T23:56:57.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.246+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43f440 con 0x563e3c38fc00 2024-09-13T23:56:57.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.246+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c442000 2024-09-13T23:56:57.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.246+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c442000 2024-09-13T23:56:57.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.246+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38f400 2024-09-13T23:56:57.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.246+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c38f400 2024-09-13T23:56:57.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.246+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38f400 2024-09-13T23:56:57.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.246+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c38f400 2024-09-13T23:56:57.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.246+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38fc00 2024-09-13T23:56:57.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.246+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43f440 con 0x563e3c38fc00 2024-09-13T23:56:57.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.246+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38f400 2024-09-13T23:56:57.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c38f400 2024-09-13T23:56:57.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c38f400 2024-09-13T23:56:57.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c38f400 2024-09-13T23:56:57.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec27ee1f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:56:57.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec27ee1f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:56:57.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec27ee1f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:56:57.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec27ee1f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:56:57.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec27ee1f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c442800 con 0x563e3c38f000 2024-09-13T23:56:57.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c38f000 2024-09-13T23:56:57.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec27ee1f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec27ee1f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c442c00 con 0x563e3c38f400 2024-09-13T23:56:57.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c38f400 2024-09-13T23:56:57.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec27ee1f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:57.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec27ee1f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c443000 con 0x563e3c38f000 2024-09-13T23:56:57.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c38f000 2024-09-13T23:56:57.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec27ee1f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:56:57.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec27ee1f40 20 zone default found 2024-09-13T23:56:57.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec27ee1f40 4 Realm: () 2024-09-13T23:56:57.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec27ee1f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:56:57.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec27ee1f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:56:57.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec27ee1f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:56:57.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec27ee1f40 20 zonegroup default 2024-09-13T23:56:57.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec27ee1f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c443400 con 0x563e3c442000 2024-09-13T23:56:57.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.250+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c442000 2024-09-13T23:56:57.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.254+0000 7fec27ee1f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.254+0000 7fec27ee1f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.254+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c443800 con 0x563e3c38fc00 2024-09-13T23:56:57.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.254+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x563e3c43f440 con 0x563e3c38fc00 2024-09-13T23:56:57.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.254+0000 7fec27ee1f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.254+0000 7fec27ee1f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.254+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c443c00 con 0x563e3c38fc00 2024-09-13T23:56:57.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.254+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x563e3c43f440 con 0x563e3c38fc00 2024-09-13T23:56:57.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.254+0000 7fec27ee1f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.254+0000 7fec27ee1f40 20 started sync module instance, tier type = 2024-09-13T23:56:57.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.254+0000 7fec27ee1f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:56:57.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.254+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c44c000 con 0x563e3c38f400 2024-09-13T23:56:57.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.258+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c38f400 2024-09-13T23:56:57.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.258+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94825297509120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c44c400 con 0x563e3c38f400 2024-09-13T23:56:57.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.258+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c44c800 con 0x563e3c38f000 2024-09-13T23:56:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.258+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c38f000 2024-09-13T23:56:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.258+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94825297510272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c44cc00 con 0x563e3c38f000 2024-09-13T23:56:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.258+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c44d000 con 0x563e3c38f400 2024-09-13T23:56:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.258+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94825297509120] v33'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c38f400 2024-09-13T23:56:57.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.262+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94825297510272] v33'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c38f000 2024-09-13T23:56:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.262+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c38f400 2024-09-13T23:56:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.262+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94825297511424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c44d400 con 0x563e3c38f400 2024-09-13T23:56:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.262+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c44d800 con 0x563e3c442000 2024-09-13T23:56:57.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.266+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c442000 2024-09-13T23:56:57.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.266+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94825297512576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c44dc00 con 0x563e3c442000 2024-09-13T23:56:57.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.266+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c44c800 con 0x563e3c38f400 2024-09-13T23:56:57.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.266+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94825297511424] v33'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c38f400 2024-09-13T23:56:57.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.266+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94825297512576] v33'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c442000 2024-09-13T23:56:57.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.266+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c38f400 2024-09-13T23:56:57.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.266+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94825297513728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c44c000 con 0x563e3c38f400 2024-09-13T23:56:57.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.266+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c442800 con 0x563e3c38fc00 2024-09-13T23:56:57.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.270+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563e3c43f440 con 0x563e3c38fc00 2024-09-13T23:56:57.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.270+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94825297514880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c443000 con 0x563e3c38fc00 2024-09-13T23:56:57.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.270+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c443400 con 0x563e3c38fc00 2024-09-13T23:56:57.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.270+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94825297513728] v33'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c38f400 2024-09-13T23:56:57.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.274+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v33'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563e3c43f440 con 0x563e3c38fc00 2024-09-13T23:56:57.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.274+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94825297516032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c442c00 con 0x563e3c38fc00 2024-09-13T23:56:57.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.274+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c38f800 con 0x563e3c442000 2024-09-13T23:56:57.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.274+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94825297514880] v33'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563e3c43f440 con 0x563e3c38fc00 2024-09-13T23:56:57.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.274+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94825297516032] v33'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563e3c43f440 con 0x563e3c38fc00 2024-09-13T23:56:57.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.278+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c442000 2024-09-13T23:56:57.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.278+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94825297517184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c44c400 con 0x563e3c442000 2024-09-13T23:56:57.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.278+0000 7fec27ee1f40 20 add_watcher() i=0 2024-09-13T23:56:57.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.278+0000 7fec27ee1f40 20 add_watcher() i=1 2024-09-13T23:56:57.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.278+0000 7fec27ee1f40 20 add_watcher() i=2 2024-09-13T23:56:57.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.278+0000 7fec27ee1f40 20 add_watcher() i=3 2024-09-13T23:56:57.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.278+0000 7fec27ee1f40 20 add_watcher() i=4 2024-09-13T23:56:57.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.278+0000 7fec27ee1f40 20 add_watcher() i=5 2024-09-13T23:56:57.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.278+0000 7fec27ee1f40 20 add_watcher() i=6 2024-09-13T23:56:57.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.278+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94825297517184] v33'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c442000 2024-09-13T23:56:57.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.278+0000 7fec27ee1f40 20 add_watcher() i=7 2024-09-13T23:56:57.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.278+0000 7fec27ee1f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:56:57.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.278+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c44d000 con 0x563e3c38f000 2024-09-13T23:56:57.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.278+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c38f000 2024-09-13T23:56:57.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.278+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94825299124224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c44d400 con 0x563e3c38f000 2024-09-13T23:56:57.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.282+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94825299124224] v33'26 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c38f000 2024-09-13T23:56:57.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.282+0000 7fec0d668700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:57.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.282+0000 7fec27ee1f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:56:57.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.282+0000 7fec27ee1f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:56:57.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.282+0000 7fec27ee1f40 1 Processor -- start 2024-09-13T23:56:57.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.282+0000 7fec27ee1f40 1 -- start start 2024-09-13T23:56:57.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.282+0000 7fec27ee1f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3c442400 0x563e3c2d3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.282+0000 7fec27ee1f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e3c0783c0 con 0x563e3c442400 2024-09-13T23:56:57.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.282+0000 7fec25e99700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3c442400 0x563e3c2d3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.282+0000 7fec25e99700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3c442400 0x563e3c2d3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:57906/0 (socket says 172.21.15.173:57906) 2024-09-13T23:56:57.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.282+0000 7fec25e99700 1 -- 172.21.15.173:0/2987847426 learned_addr learned my addr 172.21.15.173:0/2987847426 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.282+0000 7fec25e99700 1 -- 172.21.15.173:0/2987847426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e3bffcb60 con 0x563e3c442400 2024-09-13T23:56:57.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.282+0000 7fec25e99700 1 --2- 172.21.15.173:0/2987847426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3c442400 0x563e3c2d3180 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x563e3c45a0c0 tx=0x563e3c34d8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1019959ebef5ad7b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.282+0000 7fec0ce67700 1 -- 172.21.15.173:0/2987847426 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563e3c45e000 con 0x563e3c442400 2024-09-13T23:56:57.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.286+0000 7fec0ce67700 1 -- 172.21.15.173:0/2987847426 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563e3c3ae480 con 0x563e3c442400 2024-09-13T23:56:57.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.286+0000 7fec0ce67700 1 -- 172.21.15.173:0/2987847426 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563e3c45e160 con 0x563e3c442400 2024-09-13T23:56:57.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.286+0000 7fec27ee1f40 1 -- 172.21.15.173:0/2987847426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3c442400 msgr2=0x563e3c2d3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.286+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/2987847426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3c442400 0x563e3c2d3180 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x563e3c45a0c0 tx=0x563e3c34d8c0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.286+0000 7fec27ee1f40 1 -- 172.21.15.173:0/2987847426 shutdown_connections 2024-09-13T23:56:57.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.286+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/2987847426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3c442400 0x563e3c2d3180 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.286+0000 7fec27ee1f40 1 -- 172.21.15.173:0/2987847426 >> 172.21.15.173:0/2987847426 conn(0x563e3c44c800 msgr2=0x563e3c0ec000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.286+0000 7fec27ee1f40 1 -- 172.21.15.173:0/2987847426 shutdown_connections 2024-09-13T23:56:57.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.286+0000 7fec27ee1f40 1 -- 172.21.15.173:0/2987847426 wait complete. 2024-09-13T23:56:57.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.286+0000 7fec27ee1f40 1 Processor -- start 2024-09-13T23:56:57.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.286+0000 7fec27ee1f40 1 -- start start 2024-09-13T23:56:57.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.286+0000 7fec27ee1f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3c442400 0x563e3c2d3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.286+0000 7fec27ee1f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e3c078500 con 0x563e3c442400 2024-09-13T23:56:57.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.286+0000 7fec25e99700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3c442400 0x563e3c2d3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.286+0000 7fec25e99700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3c442400 0x563e3c2d3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:57912/0 (socket says 172.21.15.173:57912) 2024-09-13T23:56:57.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.286+0000 7fec25e99700 1 -- 172.21.15.173:0/3609215982 learned_addr learned my addr 172.21.15.173:0/3609215982 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.286+0000 7fec25e99700 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e3bffcd00 con 0x563e3c442400 2024-09-13T23:56:57.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.286+0000 7fec25e99700 1 --2- 172.21.15.173:0/3609215982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3c442400 0x563e3c2d3180 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x563e3c45a2d0 tx=0x563e3c34da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.286+0000 7fec0b664700 1 -- 172.21.15.173:0/3609215982 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563e3c45e2c0 con 0x563e3c442400 2024-09-13T23:56:57.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.286+0000 7fec0b664700 1 -- 172.21.15.173:0/3609215982 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563e3c3ae600 con 0x563e3c442400 2024-09-13T23:56:57.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.286+0000 7fec0b664700 1 -- 172.21.15.173:0/3609215982 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563e3c45e000 con 0x563e3c442400 2024-09-13T23:56:57.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.286+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563e3bffc340 con 0x563e3c442400 2024-09-13T23:56:57.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.290+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563e3bffcb60 con 0x563e3c442400 2024-09-13T23:56:57.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.290+0000 7fec0b664700 1 -- 172.21.15.173:0/3609215982 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x563e3c0e5b80 con 0x563e3c442400 2024-09-13T23:56:57.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.290+0000 7fec0b664700 1 --2- 172.21.15.173:0/3609215982 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563e3c38f800 0x563e3c4e6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.290+0000 7fec0b664700 1 -- 172.21.15.173:0/3609215982 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x563e3c051500 con 0x563e3c442400 2024-09-13T23:56:57.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.290+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/3609215982 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563e3c443800 0x563e3c2d3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.290+0000 7fec26e9b700 1 --2- 172.21.15.173:0/3609215982 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563e3c38f800 0x563e3c4e6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.290+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c443c00 con 0x563e3c443800 2024-09-13T23:56:57.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.290+0000 7fec2669a700 1 --2- 172.21.15.173:0/3609215982 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563e3c443800 0x563e3c2d3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.290+0000 7fec26e9b700 1 --2- 172.21.15.173:0/3609215982 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563e3c38f800 0x563e3c4e6000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x563e3c3e7740 tx=0x563e3c4ac660 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.290+0000 7fec2669a700 1 --2- 172.21.15.173:0/3609215982 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563e3c443800 0x563e3c2d3700 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.294+0000 7fec2669a700 1 -- 172.21.15.173:0/3609215982 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v33'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c443800 2024-09-13T23:56:57.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.294+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/3609215982 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563e3c442800 0x563e3c4e6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.294+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c44cc00 con 0x563e3c442800 2024-09-13T23:56:57.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.294+0000 7fec25e99700 1 --2- 172.21.15.173:0/3609215982 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563e3c442800 0x563e3c4e6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.294+0000 7fec25e99700 1 --2- 172.21.15.173:0/3609215982 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563e3c442800 0x563e3c4e6580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.298+0000 7fec25e99700 1 -- 172.21.15.173:0/3609215982 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v33'10 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563e3c43f440 con 0x563e3c442800 2024-09-13T23:56:57.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.298+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/3609215982 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563e3c44d800 0x563e3c4e6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.298+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c44dc00 con 0x563e3c44d800 2024-09-13T23:56:57.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.298+0000 7fec26e9b700 1 --2- 172.21.15.173:0/3609215982 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563e3c44d800 0x563e3c4e6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.298+0000 7fec26e9b700 1 --2- 172.21.15.173:0/3609215982 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563e3c44d800 0x563e3c4e6b00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.298+0000 7fec26e9b700 1 -- 172.21.15.173:0/3609215982 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v33'10 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c44d800 2024-09-13T23:56:57.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.298+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/3609215982 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563e3c44c400 0x563e3c4e7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.298+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c51a000 con 0x563e3c44c400 2024-09-13T23:56:57.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.302+0000 7fec2669a700 1 --2- 172.21.15.173:0/3609215982 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563e3c44c400 0x563e3c4e7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.302+0000 7fec2669a700 1 --2- 172.21.15.173:0/3609215982 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563e3c44c400 0x563e3c4e7080 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.302+0000 7fec2669a700 1 -- 172.21.15.173:0/3609215982 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v33'27 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c44c400 2024-09-13T23:56:57.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.302+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c51a400 con 0x563e3c443800 2024-09-13T23:56:57.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.306+0000 7fec2669a700 1 -- 172.21.15.173:0/3609215982 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v33'20 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c443800 2024-09-13T23:56:57.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.306+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c51a800 con 0x563e3c44d800 2024-09-13T23:56:57.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.306+0000 7fec26e9b700 1 -- 172.21.15.173:0/3609215982 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v33'13 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c44d800 2024-09-13T23:56:57.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.310+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c51ac00 con 0x563e3c443800 2024-09-13T23:56:57.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.310+0000 7fec2669a700 1 -- 172.21.15.173:0/3609215982 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v33'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c443800 2024-09-13T23:56:57.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.310+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c51b000 con 0x563e3c44c400 2024-09-13T23:56:57.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.314+0000 7fec2669a700 1 -- 172.21.15.173:0/3609215982 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v33'13 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c44c400 2024-09-13T23:56:57.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.314+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c51b400 con 0x563e3c443800 2024-09-13T23:56:57.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.314+0000 7fec2669a700 1 -- 172.21.15.173:0/3609215982 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v33'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c443800 2024-09-13T23:56:57.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.314+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c51b800 con 0x563e3c443800 2024-09-13T23:56:57.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.318+0000 7fec2669a700 1 -- 172.21.15.173:0/3609215982 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c443800 2024-09-13T23:56:57.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.318+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c51bc00 con 0x563e3c443800 2024-09-13T23:56:57.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.322+0000 7fec2669a700 1 -- 172.21.15.173:0/3609215982 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v33'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c443800 2024-09-13T23:56:57.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.322+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c51a000 con 0x563e3c44d800 2024-09-13T23:56:57.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.326+0000 7fec26e9b700 1 -- 172.21.15.173:0/3609215982 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v33'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c44d800 2024-09-13T23:56:57.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.326+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c51a400 con 0x563e3c443800 2024-09-13T23:56:57.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.326+0000 7fec2669a700 1 -- 172.21.15.173:0/3609215982 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v33'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c443800 2024-09-13T23:56:57.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.326+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c51ac00 con 0x563e3c44c400 2024-09-13T23:56:57.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.330+0000 7fec2669a700 1 -- 172.21.15.173:0/3609215982 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v33'19 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c44c400 2024-09-13T23:56:57.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.330+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c443c00 con 0x563e3c44c400 2024-09-13T23:56:57.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.334+0000 7fec2669a700 1 -- 172.21.15.173:0/3609215982 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v33'28 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c44c400 2024-09-13T23:56:57.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.334+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c44c000 con 0x563e3c443800 2024-09-13T23:56:57.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.334+0000 7fec2669a700 1 -- 172.21.15.173:0/3609215982 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v33'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c443800 2024-09-13T23:56:57.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.334+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c51b000 con 0x563e3c443800 2024-09-13T23:56:57.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.338+0000 7fec2669a700 1 -- 172.21.15.173:0/3609215982 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v33'22 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c443800 2024-09-13T23:56:57.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.338+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c51b400 con 0x563e3c44d800 2024-09-13T23:56:57.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.342+0000 7fec26e9b700 1 -- 172.21.15.173:0/3609215982 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v33'10 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c44d800 2024-09-13T23:56:57.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.342+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c51b800 con 0x563e3c443800 2024-09-13T23:56:57.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.342+0000 7fec2669a700 1 -- 172.21.15.173:0/3609215982 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c443800 2024-09-13T23:56:57.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.342+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c51bc00 con 0x563e3c44c400 2024-09-13T23:56:57.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.346+0000 7fec2669a700 1 -- 172.21.15.173:0/3609215982 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v33'29 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c44c400 2024-09-13T23:56:57.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.346+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c51a400 con 0x563e3c443800 2024-09-13T23:56:57.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.350+0000 7fec2669a700 1 -- 172.21.15.173:0/3609215982 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v33'15 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c443800 2024-09-13T23:56:57.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.350+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c51ac00 con 0x563e3c443800 2024-09-13T23:56:57.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.354+0000 7fec2669a700 1 -- 172.21.15.173:0/3609215982 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v33'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c443800 2024-09-13T23:56:57.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.354+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c44c000 con 0x563e3c44d800 2024-09-13T23:56:57.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.354+0000 7fec26e9b700 1 -- 172.21.15.173:0/3609215982 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v33'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c44d800 2024-09-13T23:56:57.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.354+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c44d000 con 0x563e3c443800 2024-09-13T23:56:57.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.358+0000 7fec2669a700 1 -- 172.21.15.173:0/3609215982 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v33'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c443800 2024-09-13T23:56:57.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.358+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c44d400 con 0x563e3c44d800 2024-09-13T23:56:57.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.362+0000 7fec26e9b700 1 -- 172.21.15.173:0/3609215982 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v33'6 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c44d800 2024-09-13T23:56:57.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.362+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c44dc00 con 0x563e3c44d800 2024-09-13T23:56:57.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.362+0000 7fec26e9b700 1 -- 172.21.15.173:0/3609215982 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v33'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c44d800 2024-09-13T23:56:57.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.362+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c443c00 con 0x563e3c44d800 2024-09-13T23:56:57.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.366+0000 7fec26e9b700 1 -- 172.21.15.173:0/3609215982 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v33'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c44d800 2024-09-13T23:56:57.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.366+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c52a000 con 0x563e3c443800 2024-09-13T23:56:57.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.370+0000 7fec2669a700 1 -- 172.21.15.173:0/3609215982 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v33'10 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c443800 2024-09-13T23:56:57.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.370+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c52a400 con 0x563e3c44c400 2024-09-13T23:56:57.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.370+0000 7fec2669a700 1 -- 172.21.15.173:0/3609215982 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v33'14 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c44c400 2024-09-13T23:56:57.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.370+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c52a800 con 0x563e3c443800 2024-09-13T23:56:57.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.374+0000 7fec2669a700 1 -- 172.21.15.173:0/3609215982 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v33'16 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c443800 2024-09-13T23:56:57.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.374+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c52ac00 con 0x563e3c44c400 2024-09-13T23:56:57.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.378+0000 7fec2669a700 1 -- 172.21.15.173:0/3609215982 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v33'20 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c44c400 2024-09-13T23:56:57.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.378+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c52b000 con 0x563e3c442800 2024-09-13T23:56:57.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.382+0000 7fec25e99700 1 -- 172.21.15.173:0/3609215982 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v33'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563e3c43f440 con 0x563e3c442800 2024-09-13T23:56:57.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.382+0000 7fec08e5f700 20 reqs_thread_entry: start 2024-09-13T23:56:57.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.382+0000 7fec27ee1f40 20 init_complete bucket index max shards: 11 2024-09-13T23:56:57.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.382+0000 7fec27ee1f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:56:57.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.382+0000 7fec06e5b700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:27 2024 2024-09-13T23:56:57.389 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:56:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.382+0000 7fec06639700 20 reqs_thread_entry: start 2024-09-13T23:56:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.382+0000 7fec27ee1f40 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-13T23:56:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.382+0000 7fec27ee1f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.382+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c52bc00 con 0x563e3c442000 2024-09-13T23:56:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.386+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(62 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c442000 2024-09-13T23:56:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.386+0000 7fec27ee1f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.386+0000 7fec27ee1f40 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-13T23:56:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.386+0000 7fec27ee1f40 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T23:56:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T23:56:57.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.386+0000 7fec0d668700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:57.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.386+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94825299124224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c438000 con 0x563e3c38f000 2024-09-13T23:56:57.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.390+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94825299124224] v33'30 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c38f000 2024-09-13T23:56:57.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.390+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94825297509120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c438400 con 0x563e3c38f400 2024-09-13T23:56:57.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.390+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94825297509120] v33'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c38f400 2024-09-13T23:56:57.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.390+0000 7fec27ee1f40 20 remove_watcher() i=0 2024-09-13T23:56:57.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.390+0000 7fec27ee1f40 2 removed watcher, disabling cache 2024-09-13T23:56:57.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.390+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94825297510272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c438800 con 0x563e3c38f000 2024-09-13T23:56:57.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.394+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94825297510272] v33'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c38f000 2024-09-13T23:56:57.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.394+0000 7fec27ee1f40 20 remove_watcher() i=1 2024-09-13T23:56:57.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.394+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94825297511424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c438c00 con 0x563e3c38f400 2024-09-13T23:56:57.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.398+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94825297511424] v33'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c38f400 2024-09-13T23:56:57.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.398+0000 7fec27ee1f40 20 remove_watcher() i=2 2024-09-13T23:56:57.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.398+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94825297512576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c439000 con 0x563e3c442000 2024-09-13T23:56:57.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.398+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94825297512576] v33'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c442000 2024-09-13T23:56:57.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.398+0000 7fec27ee1f40 20 remove_watcher() i=3 2024-09-13T23:56:57.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.398+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94825297513728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c439400 con 0x563e3c38f400 2024-09-13T23:56:57.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.402+0000 7fec2669a700 1 -- 172.21.15.173:0/729647477 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94825297513728] v33'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563e3c43f200 con 0x563e3c38f400 2024-09-13T23:56:57.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.402+0000 7fec27ee1f40 20 remove_watcher() i=4 2024-09-13T23:56:57.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.402+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94825297514880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c439800 con 0x563e3c38fc00 2024-09-13T23:56:57.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.406+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94825297514880] v33'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563e3c43f440 con 0x563e3c38fc00 2024-09-13T23:56:57.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.406+0000 7fec27ee1f40 20 remove_watcher() i=5 2024-09-13T23:56:57.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.406+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94825297516032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c439c00 con 0x563e3c38fc00 2024-09-13T23:56:57.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.406+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94825297516032] v33'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563e3c43f440 con 0x563e3c38fc00 2024-09-13T23:56:57.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.406+0000 7fec27ee1f40 20 remove_watcher() i=6 2024-09-13T23:56:57.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.406+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94825297517184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563e3c439800 con 0x563e3c442000 2024-09-13T23:56:57.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec26e9b700 1 -- 172.21.15.173:0/729647477 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94825297517184] v33'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563e3c43eb40 con 0x563e3c442000 2024-09-13T23:56:57.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 20 remove_watcher() i=7 2024-09-13T23:56:57.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563e3c38f400 msgr2=0x563e3c2d2100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/729647477 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563e3c38f400 0x563e3c2d2100 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563e3c38f000 msgr2=0x563e3c2d1b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/729647477 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563e3c38f000 0x563e3c2d1b80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563e3c442000 msgr2=0x563e3c2d2c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/729647477 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563e3c442000 0x563e3c2d2c00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563e3c38fc00 msgr2=0x563e3c2d2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/729647477 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563e3c38fc00 0x563e3c2d2680 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563e3c38ec00 msgr2=0x563e3c2d1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/729647477 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563e3c38ec00 0x563e3c2d1600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x563e3cdb4030 tx=0x563e3c34d920 comp rx=0 tx=0).stop 2024-09-13T23:56:57.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb800 msgr2=0x563e3c2d0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/729647477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb800 0x563e3c2d0b00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x563e3c304420 tx=0x563e3c34c5a0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 reap_dead start 2024-09-13T23:56:57.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec25e99700 1 -- 172.21.15.173:0/729647477 reap_dead start 2024-09-13T23:56:57.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 shutdown_connections 2024-09-13T23:56:57.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 >> 172.21.15.173:0/729647477 conn(0x563e3bfeb400 msgr2=0x563e3c0eb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 shutdown_connections 2024-09-13T23:56:57.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 -- 172.21.15.173:0/729647477 wait complete. 2024-09-13T23:56:57.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563e3c443800 msgr2=0x563e3c2d3700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/3609215982 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563e3c443800 0x563e3c2d3700 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563e3c44c400 msgr2=0x563e3c4e7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/3609215982 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563e3c44c400 0x563e3c4e7080 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563e3c442800 msgr2=0x563e3c4e6580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/3609215982 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563e3c442800 0x563e3c4e6580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563e3c44d800 msgr2=0x563e3c4e6b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/3609215982 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563e3c44d800 0x563e3c4e6b00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563e3c38f800 msgr2=0x563e3c4e6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/3609215982 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563e3c38f800 0x563e3c4e6000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x563e3c3e7740 tx=0x563e3c4ac660 comp rx=0 tx=0).stop 2024-09-13T23:56:57.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3c442400 msgr2=0x563e3c2d3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/3609215982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3c442400 0x563e3c2d3180 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x563e3c45a2d0 tx=0x563e3c34da40 comp rx=0 tx=0).stop 2024-09-13T23:56:57.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec2669a700 1 -- 172.21.15.173:0/3609215982 reap_dead start 2024-09-13T23:56:57.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 shutdown_connections 2024-09-13T23:56:57.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/3609215982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3c442400 0x563e3c2d3180 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 >> 172.21.15.173:0/3609215982 conn(0x563e3c44c800 msgr2=0x563e3c0ec000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 shutdown_connections 2024-09-13T23:56:57.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.410+0000 7fec27ee1f40 1 -- 172.21.15.173:0/3609215982 wait complete. 2024-09-13T23:56:57.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.414+0000 7fec27ee1f40 1 -- 172.21.15.173:0/2924754267 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563e3c38e000 msgr2=0x563e3c2d1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.414+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/2924754267 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563e3c38e000 0x563e3c2d1080 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x563e3c305590 tx=0x563e3c34c8a0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.414+0000 7fec27ee1f40 1 -- 172.21.15.173:0/2924754267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb000 msgr2=0x563e3c2d0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.414+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/2924754267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb000 0x563e3c2d0580 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x563e3cdb5ef0 tx=0x563e3c0ef980 comp rx=0 tx=0).stop 2024-09-13T23:56:57.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.414+0000 7fec27ee1f40 1 -- 172.21.15.173:0/2924754267 shutdown_connections 2024-09-13T23:56:57.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.414+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/2924754267 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563e3c38e000 0x563e3c2d1080 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.414+0000 7fec27ee1f40 1 --2- 172.21.15.173:0/2924754267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e3bfeb000 0x563e3c2d0580 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.414+0000 7fec27ee1f40 1 -- 172.21.15.173:0/2924754267 >> 172.21.15.173:0/2924754267 conn(0x563e3bfeac00 msgr2=0x563e3c0eb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.414+0000 7fec27ee1f40 1 -- 172.21.15.173:0/2924754267 shutdown_connections 2024-09-13T23:56:57.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.414+0000 7fec27ee1f40 1 -- 172.21.15.173:0/2924754267 wait complete. 2024-09-13T23:56:57.423 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T23:56:57.423 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-13T23:56:57.423 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-13T23:56:57.423 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-13T23:56:57.464 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:56:57.464 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:56:57.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.458+0000 7f282a53df40 1 Processor -- start 2024-09-13T23:56:57.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.458+0000 7f282a53df40 1 -- start start 2024-09-13T23:56:57.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.462+0000 7f282a53df40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55f0ce691400 0x55f0ce976580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.462+0000 7f282a53df40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f0ce755500 con 0x55f0ce691000 2024-09-13T23:56:57.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.462+0000 7f282a53df40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f0ce71ea00 con 0x55f0ce691400 2024-09-13T23:56:57.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.462+0000 7f28284f5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55f0ce691400 0x55f0ce976580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.462+0000 7f2828cf6700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55f0ce691000 0x55f0ce790800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:57768/0 (socket says 172.21.15.173:57768) 2024-09-13T23:56:57.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.462+0000 7f28284f5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55f0ce691400 0x55f0ce976580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:57922/0 (socket says 172.21.15.173:57922) 2024-09-13T23:56:57.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.462+0000 7f2828cf6700 1 -- 172.21.15.173:0/321814075 learned_addr learned my addr 172.21.15.173:0/321814075 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:56:57.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.462+0000 7f28284f5700 1 -- 172.21.15.173:0/321814075 >> v1:172.21.15.87:6789/0 conn(0x55f0ce691000 legacy=0x55f0ce790800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.462+0000 7f28284f5700 1 -- 172.21.15.173:0/321814075 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0ce6a3d40 con 0x55f0ce691400 2024-09-13T23:56:57.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.462+0000 7f28284f5700 1 --2- 172.21.15.173:0/321814075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691400 0x55f0ce976580 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55f0ce971920 tx=0x55f0ce795920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ad4c0326003b0d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.462+0000 7f2827cf4700 1 -- 172.21.15.173:0/321814075 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f0ce7354a0 con 0x55f0ce691400 2024-09-13T23:56:57.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.462+0000 7f2827cf4700 1 -- 172.21.15.173:0/321814075 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f0ce755800 con 0x55f0ce691400 2024-09-13T23:56:57.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.462+0000 7f2827cf4700 1 -- 172.21.15.173:0/321814075 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f0ce735600 con 0x55f0ce691400 2024-09-13T23:56:57.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.462+0000 7f282a53df40 1 -- 172.21.15.173:0/321814075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691400 msgr2=0x55f0ce976580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.462+0000 7f282a53df40 1 --2- 172.21.15.173:0/321814075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691400 0x55f0ce976580 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55f0ce971920 tx=0x55f0ce795920 comp rx=0 tx=0).stop 2024-09-13T23:56:57.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.462+0000 7f282a53df40 1 -- 172.21.15.173:0/321814075 shutdown_connections 2024-09-13T23:56:57.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.462+0000 7f282a53df40 1 --2- 172.21.15.173:0/321814075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691400 0x55f0ce976580 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.462+0000 7f282a53df40 1 -- 172.21.15.173:0/321814075 >> 172.21.15.173:0/321814075 conn(0x55f0ce690c00 msgr2=0x55f0ce790000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.462+0000 7f282a53df40 1 -- 172.21.15.173:0/321814075 shutdown_connections 2024-09-13T23:56:57.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.462+0000 7f282a53df40 1 -- 172.21.15.173:0/321814075 wait complete. 2024-09-13T23:56:57.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.462+0000 7f282a53df40 1 Processor -- start 2024-09-13T23:56:57.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.462+0000 7f282a53df40 1 -- start start 2024-09-13T23:56:57.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.462+0000 7f282a53df40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691000 0x55f0ce976580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.462+0000 7f282a53df40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0ce71e500 con 0x55f0ce691000 2024-09-13T23:56:57.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.466+0000 7f2828cf6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691000 0x55f0ce976580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.466+0000 7f2828cf6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691000 0x55f0ce976580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:57928/0 (socket says 172.21.15.173:57928) 2024-09-13T23:56:57.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.466+0000 7f2828cf6700 1 -- 172.21.15.173:0/9454086 learned_addr learned my addr 172.21.15.173:0/9454086 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.466+0000 7f2828cf6700 1 -- 172.21.15.173:0/9454086 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0ce6a3ba0 con 0x55f0ce691000 2024-09-13T23:56:57.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.466+0000 7f2828cf6700 1 --2- 172.21.15.173:0/9454086 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691000 0x55f0ce976580 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55f0ce7ede00 tx=0x55f0ce795b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5157bc27e8a63599 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.466+0000 7f28274f3700 1 -- 172.21.15.173:0/9454086 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f0ce7354a0 con 0x55f0ce691000 2024-09-13T23:56:57.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.466+0000 7f28274f3700 1 -- 172.21.15.173:0/9454086 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f0ce755b00 con 0x55f0ce691000 2024-09-13T23:56:57.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.466+0000 7f28274f3700 1 -- 172.21.15.173:0/9454086 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f0ce735600 con 0x55f0ce691000 2024-09-13T23:56:57.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.466+0000 7f282a53df40 1 -- 172.21.15.173:0/9454086 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691000 msgr2=0x55f0ce976580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.466+0000 7f282a53df40 1 --2- 172.21.15.173:0/9454086 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691000 0x55f0ce976580 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55f0ce7ede00 tx=0x55f0ce795b60 comp rx=0 tx=0).stop 2024-09-13T23:56:57.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.466+0000 7f282a53df40 1 -- 172.21.15.173:0/9454086 shutdown_connections 2024-09-13T23:56:57.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.466+0000 7f282a53df40 1 --2- 172.21.15.173:0/9454086 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691000 0x55f0ce976580 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.466+0000 7f282a53df40 1 -- 172.21.15.173:0/9454086 >> 172.21.15.173:0/9454086 conn(0x55f0ce690c00 msgr2=0x55f0ce791000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.466+0000 7f282a53df40 1 -- 172.21.15.173:0/9454086 shutdown_connections 2024-09-13T23:56:57.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.466+0000 7f282a53df40 1 -- 172.21.15.173:0/9454086 wait complete. 2024-09-13T23:56:57.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.466+0000 7f282a53df40 1 Processor -- start 2024-09-13T23:56:57.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.466+0000 7f282a53df40 1 -- start start 2024-09-13T23:56:57.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.466+0000 7f282a53df40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691000 0x55f0ce976580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.466+0000 7f282a53df40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0ce71e3c0 con 0x55f0ce691000 2024-09-13T23:56:57.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.466+0000 7f2828cf6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691000 0x55f0ce976580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.466+0000 7f2828cf6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691000 0x55f0ce976580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:57942/0 (socket says 172.21.15.173:57942) 2024-09-13T23:56:57.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.466+0000 7f2828cf6700 1 -- 172.21.15.173:0/2500653700 learned_addr learned my addr 172.21.15.173:0/2500653700 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.466+0000 7f2828cf6700 1 -- 172.21.15.173:0/2500653700 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0ce6a3a00 con 0x55f0ce691000 2024-09-13T23:56:57.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.470+0000 7f2828cf6700 1 --2- 172.21.15.173:0/2500653700 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691000 0x55f0ce976580 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55f0ce7ede60 tx=0x55f0ce795a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.470+0000 7f2825cf0700 1 -- 172.21.15.173:0/2500653700 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f0ce7358c0 con 0x55f0ce691000 2024-09-13T23:56:57.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.470+0000 7f2825cf0700 1 -- 172.21.15.173:0/2500653700 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f0ce755c80 con 0x55f0ce691000 2024-09-13T23:56:57.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.470+0000 7f282a53df40 1 -- 172.21.15.173:0/2500653700 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f0ce6a3860 con 0x55f0ce691000 2024-09-13T23:56:57.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.470+0000 7f2825cf0700 1 -- 172.21.15.173:0/2500653700 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f0ce7354a0 con 0x55f0ce691000 2024-09-13T23:56:57.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.470+0000 7f282a53df40 1 -- 172.21.15.173:0/2500653700 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0ce6a36c0 con 0x55f0ce691000 2024-09-13T23:56:57.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.470+0000 7f282a53df40 1 Processor -- start 2024-09-13T23:56:57.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.470+0000 7f282a53df40 1 -- start start 2024-09-13T23:56:57.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.470+0000 7f282a53df40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691800 0x55f0ce976b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.470+0000 7f282a53df40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0ce6b6640 con 0x55f0ce691800 2024-09-13T23:56:57.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.470+0000 7f2825cf0700 1 -- 172.21.15.173:0/2500653700 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55f0ce78ab00 con 0x55f0ce691000 2024-09-13T23:56:57.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.470+0000 7f28294f7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691800 0x55f0ce976b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.470+0000 7f2825cf0700 1 --2- 172.21.15.173:0/2500653700 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f0cea32000 0x55f0ce977080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.470+0000 7f28294f7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691800 0x55f0ce976b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:57946/0 (socket says 172.21.15.173:57946) 2024-09-13T23:56:57.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.470+0000 7f28294f7700 1 -- 172.21.15.173:0/1426531883 learned_addr learned my addr 172.21.15.173:0/1426531883 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.470+0000 7f2825cf0700 1 -- 172.21.15.173:0/2500653700 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55f0ce6f7180 con 0x55f0ce691000 2024-09-13T23:56:57.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.470+0000 7f2828cf6700 1 --2- 172.21.15.173:0/2500653700 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f0cea32000 0x55f0ce977080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.470+0000 7f28294f7700 1 -- 172.21.15.173:0/1426531883 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0ce6a2000 con 0x55f0ce691800 2024-09-13T23:56:57.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.470+0000 7f28294f7700 1 --2- 172.21.15.173:0/1426531883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691800 0x55f0ce976b00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55f0cea0a780 tx=0x55f0ce9f0a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4f56fc46762219 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f2828cf6700 1 --2- 172.21.15.173:0/2500653700 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f0cea32000 0x55f0ce977080 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55f0cf509560 tx=0x55f0ce9f0240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f28234eb700 1 -- 172.21.15.173:0/1426531883 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f0ce7358c0 con 0x55f0ce691800 2024-09-13T23:56:57.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f28234eb700 1 -- 172.21.15.173:0/1426531883 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f0cea38000 con 0x55f0ce691800 2024-09-13T23:56:57.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f28234eb700 1 -- 172.21.15.173:0/1426531883 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f0ce7354a0 con 0x55f0ce691800 2024-09-13T23:56:57.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f282a53df40 1 -- 172.21.15.173:0/1426531883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691800 msgr2=0x55f0ce976b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f282a53df40 1 --2- 172.21.15.173:0/1426531883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691800 0x55f0ce976b00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55f0cea0a780 tx=0x55f0ce9f0a20 comp rx=0 tx=0).stop 2024-09-13T23:56:57.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f282a53df40 1 -- 172.21.15.173:0/1426531883 shutdown_connections 2024-09-13T23:56:57.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f282a53df40 1 --2- 172.21.15.173:0/1426531883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691800 0x55f0ce976b00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f282a53df40 1 -- 172.21.15.173:0/1426531883 >> 172.21.15.173:0/1426531883 conn(0x55f0ce691400 msgr2=0x55f0ce791800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f282a53df40 1 -- 172.21.15.173:0/1426531883 shutdown_connections 2024-09-13T23:56:57.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f282a53df40 1 -- 172.21.15.173:0/1426531883 wait complete. 2024-09-13T23:56:57.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f282a53df40 1 Processor -- start 2024-09-13T23:56:57.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f282a53df40 1 -- start start 2024-09-13T23:56:57.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f282a53df40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691800 0x55f0ce976b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f282a53df40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0ce6b68c0 con 0x55f0ce691800 2024-09-13T23:56:57.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f28294f7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691800 0x55f0ce976b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f28294f7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691800 0x55f0ce976b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:57962/0 (socket says 172.21.15.173:57962) 2024-09-13T23:56:57.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 learned_addr learned my addr 172.21.15.173:0/1212236916 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0ce6a2ea0 con 0x55f0ce691800 2024-09-13T23:56:57.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f28294f7700 1 --2- 172.21.15.173:0/1212236916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691800 0x55f0ce976b00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55f0cf508300 tx=0x55f0ce9f0840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f2821ce8700 1 -- 172.21.15.173:0/1212236916 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f0ce735b80 con 0x55f0ce691800 2024-09-13T23:56:57.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f2821ce8700 1 -- 172.21.15.173:0/1212236916 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f0cea38180 con 0x55f0ce691800 2024-09-13T23:56:57.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f0ce6a2820 con 0x55f0ce691800 2024-09-13T23:56:57.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f2821ce8700 1 -- 172.21.15.173:0/1212236916 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f0ce7358c0 con 0x55f0ce691800 2024-09-13T23:56:57.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.474+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0ce6a29c0 con 0x55f0ce691800 2024-09-13T23:56:57.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f282a53df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f2821ce8700 1 -- 172.21.15.173:0/1212236916 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55f0ce78b080 con 0x55f0ce691800 2024-09-13T23:56:57.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f2821ce8700 1 --2- 172.21.15.173:0/1212236916 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f0cea32c00 0x55f0ce977600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f2821ce8700 1 -- 172.21.15.173:0/1212236916 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55f0ce6f7340 con 0x55f0ce691800 2024-09-13T23:56:57.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f28284f5700 1 --2- 172.21.15.173:0/1212236916 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f0cea32c00 0x55f0ce977600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f282a53df40 1 --2- 172.21.15.173:0/1212236916 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f0cea33000 0x55f0ce977b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33400 con 0x55f0cea33000 2024-09-13T23:56:57.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f28294f7700 1 --2- 172.21.15.173:0/1212236916 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f0cea33000 0x55f0ce977b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f28284f5700 1 --2- 172.21.15.173:0/1212236916 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f0cea32c00 0x55f0ce977600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55f0ce971920 tx=0x55f0ce795800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f28294f7700 1 --2- 172.21.15.173:0/1212236916 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f0cea33000 0x55f0ce977b80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0cea33000 2024-09-13T23:56:57.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f282a53df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f282a53df40 20 realm 2024-09-13T23:56:57.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f282a53df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33000 2024-09-13T23:56:57.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0cea33000 2024-09-13T23:56:57.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f282a53df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f282a53df40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:56:57.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f282a53df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33c00 con 0x55f0cea33000 2024-09-13T23:56:57.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0cea33000 2024-09-13T23:56:57.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f282a53df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f282a53df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f282a53df40 1 --2- 172.21.15.173:0/1212236916 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f0cea33400 0x55f0ce978100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.478+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33400 2024-09-13T23:56:57.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.482+0000 7f2828cf6700 1 --2- 172.21.15.173:0/1212236916 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f0cea33400 0x55f0ce978100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.482+0000 7f2828cf6700 1 --2- 172.21.15.173:0/1212236916 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f0cea33400 0x55f0ce978100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.482+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55f0cea95200 con 0x55f0cea33400 2024-09-13T23:56:57.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.482+0000 7f282a53df40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:57.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.482+0000 7f282a53df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.482+0000 7f282a53df40 1 --2- 172.21.15.173:0/1212236916 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f0cea33c00 0x55f0ce978680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.482+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ceaf2000 con 0x55f0cea33c00 2024-09-13T23:56:57.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.482+0000 7f28284f5700 1 --2- 172.21.15.173:0/1212236916 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f0cea33c00 0x55f0ce978680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.482+0000 7f28284f5700 1 --2- 172.21.15.173:0/1212236916 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f0cea33c00 0x55f0ce978680 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.482+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55f0cea95440 con 0x55f0cea33c00 2024-09-13T23:56:57.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.482+0000 7f282a53df40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:56:57.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.482+0000 7f282a53df40 20 searching for the correct realm 2024-09-13T23:56:57.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.482+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ceaf2400 con 0x55f0cea33c00 2024-09-13T23:56:57.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.482+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55f0cea95440 con 0x55f0cea33c00 2024-09-13T23:56:57.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.482+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ceaf2000 con 0x55f0cea33400 2024-09-13T23:56:57.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.486+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea95200 con 0x55f0cea33400 2024-09-13T23:56:57.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.486+0000 7f2828cf6700 1 --2- 172.21.15.173:0/1212236916 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f0ceaf2000 0x55f0ce978c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.486+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0ceaf2000 2024-09-13T23:56:57.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.486+0000 7f28294f7700 1 --2- 172.21.15.173:0/1212236916 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f0ceaf2000 0x55f0ce978c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.486+0000 7f28294f7700 1 --2- 172.21.15.173:0/1212236916 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f0ceaf2000 0x55f0ce978c00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.486+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0ceaf2000 2024-09-13T23:56:57.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.486+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33000 2024-09-13T23:56:57.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.486+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0cea33000 2024-09-13T23:56:57.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.486+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33000 2024-09-13T23:56:57.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.486+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0cea33000 2024-09-13T23:56:57.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.486+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33c00 2024-09-13T23:56:57.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.486+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea95440 con 0x55f0cea33c00 2024-09-13T23:56:57.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.486+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33000 2024-09-13T23:56:57.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.486+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0cea33000 2024-09-13T23:56:57.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.486+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33400 2024-09-13T23:56:57.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.490+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea95200 con 0x55f0cea33400 2024-09-13T23:56:57.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.490+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33400 2024-09-13T23:56:57.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.490+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea95200 con 0x55f0cea33400 2024-09-13T23:56:57.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.490+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33000 2024-09-13T23:56:57.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.490+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0cea33000 2024-09-13T23:56:57.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.490+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0ceaf2000 2024-09-13T23:56:57.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.490+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0ceaf2000 2024-09-13T23:56:57.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.490+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33000 2024-09-13T23:56:57.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.490+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0cea33000 2024-09-13T23:56:57.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.490+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0ceaf2000 2024-09-13T23:56:57.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.490+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0ceaf2000 2024-09-13T23:56:57.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.494+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33400 2024-09-13T23:56:57.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.494+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea95200 con 0x55f0cea33400 2024-09-13T23:56:57.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.494+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33c00 2024-09-13T23:56:57.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.494+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea95440 con 0x55f0cea33c00 2024-09-13T23:56:57.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.494+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33000 2024-09-13T23:56:57.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.494+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0cea33000 2024-09-13T23:56:57.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.494+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33400 2024-09-13T23:56:57.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.494+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea95200 con 0x55f0cea33400 2024-09-13T23:56:57.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.494+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33c00 2024-09-13T23:56:57.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.494+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea95440 con 0x55f0cea33c00 2024-09-13T23:56:57.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.494+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33000 2024-09-13T23:56:57.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.498+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0cea33000 2024-09-13T23:56:57.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.498+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33000 2024-09-13T23:56:57.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.498+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0cea33000 2024-09-13T23:56:57.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.498+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33000 2024-09-13T23:56:57.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.498+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0cea33000 2024-09-13T23:56:57.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.498+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33c00 2024-09-13T23:56:57.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.498+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea95440 con 0x55f0cea33c00 2024-09-13T23:56:57.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.498+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0ceaf2000 2024-09-13T23:56:57.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.498+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0ceaf2000 2024-09-13T23:56:57.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.498+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33000 2024-09-13T23:56:57.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.498+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0cea33000 2024-09-13T23:56:57.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.498+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0ceaf2000 2024-09-13T23:56:57.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.498+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0ceaf2000 2024-09-13T23:56:57.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.498+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33c00 2024-09-13T23:56:57.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.502+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea95440 con 0x55f0cea33c00 2024-09-13T23:56:57.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.502+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0ceaf2000 2024-09-13T23:56:57.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.502+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0ceaf2000 2024-09-13T23:56:57.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.502+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33400 2024-09-13T23:56:57.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.502+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea95200 con 0x55f0cea33400 2024-09-13T23:56:57.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.502+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33400 2024-09-13T23:56:57.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.502+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea95200 con 0x55f0cea33400 2024-09-13T23:56:57.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.502+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33c00 2024-09-13T23:56:57.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.502+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea95440 con 0x55f0cea33c00 2024-09-13T23:56:57.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.502+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33400 2024-09-13T23:56:57.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.502+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55f0cea95200 con 0x55f0cea33400 2024-09-13T23:56:57.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.502+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0cea33400 2024-09-13T23:56:57.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f0cea95200 con 0x55f0cea33400 2024-09-13T23:56:57.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:56:57.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:56:57.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:56:57.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:56:57.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ceaf2800 con 0x55f0cea33000 2024-09-13T23:56:57.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0cea33000 2024-09-13T23:56:57.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ceaf2c00 con 0x55f0cea33400 2024-09-13T23:56:57.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55f0cea95200 con 0x55f0cea33400 2024-09-13T23:56:57.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:57.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ceaf3000 con 0x55f0cea33000 2024-09-13T23:56:57.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0cea33000 2024-09-13T23:56:57.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:56:57.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 20 zone default found 2024-09-13T23:56:57.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 4 Realm: () 2024-09-13T23:56:57.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:56:57.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:56:57.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:56:57.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 20 zonegroup default 2024-09-13T23:56:57.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ceaf3400 con 0x55f0ceaf2000 2024-09-13T23:56:57.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0ceaf2000 2024-09-13T23:56:57.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ceaf3800 con 0x55f0cea33c00 2024-09-13T23:56:57.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55f0cea95440 con 0x55f0cea33c00 2024-09-13T23:56:57.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.506+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ceaf3c00 con 0x55f0cea33c00 2024-09-13T23:56:57.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.510+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55f0cea95440 con 0x55f0cea33c00 2024-09-13T23:56:57.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.510+0000 7f282a53df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.510+0000 7f282a53df40 20 started sync module instance, tier type = 2024-09-13T23:56:57.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.510+0000 7f282a53df40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:56:57.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.510+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ce9da000 con 0x55f0cea33400 2024-09-13T23:56:57.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.510+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0cea33400 2024-09-13T23:56:57.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.514+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94492746504960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ce9da400 con 0x55f0cea33400 2024-09-13T23:56:57.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.514+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ce9da800 con 0x55f0cea33000 2024-09-13T23:56:57.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.514+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0cea33000 2024-09-13T23:56:57.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.514+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94492746506112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ce9dac00 con 0x55f0cea33000 2024-09-13T23:56:57.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.514+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ce9db000 con 0x55f0cea33400 2024-09-13T23:56:57.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.514+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94492746504960] v33'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0cea33400 2024-09-13T23:56:57.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.518+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94492746506112] v33'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0cea33000 2024-09-13T23:56:57.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.518+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0cea33400 2024-09-13T23:56:57.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.518+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94492746507264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ce9db400 con 0x55f0cea33400 2024-09-13T23:56:57.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.518+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ce9db800 con 0x55f0ceaf2000 2024-09-13T23:56:57.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.522+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94492746507264] v33'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0cea33400 2024-09-13T23:56:57.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.522+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0ceaf2000 2024-09-13T23:56:57.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.522+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94492746508416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ce9dbc00 con 0x55f0ceaf2000 2024-09-13T23:56:57.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.522+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ce9da800 con 0x55f0cea33400 2024-09-13T23:56:57.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.522+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94492746508416] v33'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0ceaf2000 2024-09-13T23:56:57.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.526+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0cea33400 2024-09-13T23:56:57.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.526+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94492746509568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ce9da000 con 0x55f0cea33400 2024-09-13T23:56:57.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.526+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ceaf2800 con 0x55f0cea33c00 2024-09-13T23:56:57.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.526+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f0cea95440 con 0x55f0cea33c00 2024-09-13T23:56:57.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.526+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94492746510720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ceaf3000 con 0x55f0cea33c00 2024-09-13T23:56:57.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.526+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ceaf3400 con 0x55f0cea33c00 2024-09-13T23:56:57.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.526+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94492746509568] v33'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0cea33400 2024-09-13T23:56:57.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.530+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v33'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f0cea95440 con 0x55f0cea33c00 2024-09-13T23:56:57.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.530+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94492746511872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ceaf2c00 con 0x55f0cea33c00 2024-09-13T23:56:57.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.530+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea33800 con 0x55f0ceaf2000 2024-09-13T23:56:57.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.530+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94492746510720] v33'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f0cea95440 con 0x55f0cea33c00 2024-09-13T23:56:57.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.530+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0ceaf2000 2024-09-13T23:56:57.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.530+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94492746513024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ce9da400 con 0x55f0ceaf2000 2024-09-13T23:56:57.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.530+0000 7f282a53df40 20 add_watcher() i=0 2024-09-13T23:56:57.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.530+0000 7f282a53df40 20 add_watcher() i=1 2024-09-13T23:56:57.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.530+0000 7f282a53df40 20 add_watcher() i=2 2024-09-13T23:56:57.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.530+0000 7f282a53df40 20 add_watcher() i=3 2024-09-13T23:56:57.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.530+0000 7f282a53df40 20 add_watcher() i=4 2024-09-13T23:56:57.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.530+0000 7f282a53df40 20 add_watcher() i=5 2024-09-13T23:56:57.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.530+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94492746511872] v33'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f0cea95440 con 0x55f0cea33c00 2024-09-13T23:56:57.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.530+0000 7f282a53df40 20 add_watcher() i=6 2024-09-13T23:56:57.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.534+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94492746513024] v33'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0ceaf2000 2024-09-13T23:56:57.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.534+0000 7f282a53df40 20 add_watcher() i=7 2024-09-13T23:56:57.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.534+0000 7f282a53df40 2 all 8 watchers are set, enabling cache 2024-09-13T23:56:57.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.534+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ce9db000 con 0x55f0cea33000 2024-09-13T23:56:57.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.534+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0cea33000 2024-09-13T23:56:57.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.534+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94492748152832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ce9db400 con 0x55f0cea33000 2024-09-13T23:56:57.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.534+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94492748152832] v33'31 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0cea33000 2024-09-13T23:56:57.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.534+0000 7f280fcc4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:57.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.534+0000 7f282a53df40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:56:57.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.534+0000 7f282a53df40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:56:57.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.538+0000 7f282a53df40 1 Processor -- start 2024-09-13T23:56:57.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.538+0000 7f282a53df40 1 -- start start 2024-09-13T23:56:57.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.538+0000 7f282a53df40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ceaf2400 0x55f0ce979180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.538+0000 7f282a53df40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0ce71e3c0 con 0x55f0ceaf2400 2024-09-13T23:56:57.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.538+0000 7f28284f5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ceaf2400 0x55f0ce979180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.538+0000 7f28284f5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ceaf2400 0x55f0ce979180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:57966/0 (socket says 172.21.15.173:57966) 2024-09-13T23:56:57.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.538+0000 7f28284f5700 1 -- 172.21.15.173:0/4155037722 learned_addr learned my addr 172.21.15.173:0/4155037722 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.538+0000 7f28284f5700 1 -- 172.21.15.173:0/4155037722 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0ce6a2b60 con 0x55f0ceaf2400 2024-09-13T23:56:57.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.538+0000 7f28284f5700 1 --2- 172.21.15.173:0/4155037722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ceaf2400 0x55f0ce979180 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55f0ceb080f0 tx=0x55f0ce795980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3023ed204cbe371 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.538+0000 7f280f4c3700 1 -- 172.21.15.173:0/4155037722 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f0ce735760 con 0x55f0ceaf2400 2024-09-13T23:56:57.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.538+0000 7f280f4c3700 1 -- 172.21.15.173:0/4155037722 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f0cea38600 con 0x55f0ceaf2400 2024-09-13T23:56:57.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.538+0000 7f280f4c3700 1 -- 172.21.15.173:0/4155037722 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f0ceb12000 con 0x55f0ceaf2400 2024-09-13T23:56:57.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.538+0000 7f282a53df40 1 -- 172.21.15.173:0/4155037722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ceaf2400 msgr2=0x55f0ce979180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.538+0000 7f282a53df40 1 --2- 172.21.15.173:0/4155037722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ceaf2400 0x55f0ce979180 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55f0ceb080f0 tx=0x55f0ce795980 comp rx=0 tx=0).stop 2024-09-13T23:56:57.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.538+0000 7f282a53df40 1 -- 172.21.15.173:0/4155037722 shutdown_connections 2024-09-13T23:56:57.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.538+0000 7f282a53df40 1 --2- 172.21.15.173:0/4155037722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ceaf2400 0x55f0ce979180 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.538+0000 7f282a53df40 1 -- 172.21.15.173:0/4155037722 >> 172.21.15.173:0/4155037722 conn(0x55f0ce9da800 msgr2=0x55f0ce792000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.538+0000 7f282a53df40 1 -- 172.21.15.173:0/4155037722 shutdown_connections 2024-09-13T23:56:57.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.538+0000 7f282a53df40 1 -- 172.21.15.173:0/4155037722 wait complete. 2024-09-13T23:56:57.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.538+0000 7f282a53df40 1 Processor -- start 2024-09-13T23:56:57.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.542+0000 7f282a53df40 1 -- start start 2024-09-13T23:56:57.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.542+0000 7f282a53df40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ceaf2400 0x55f0ce979180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.542+0000 7f282a53df40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0ce71e500 con 0x55f0ceaf2400 2024-09-13T23:56:57.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.542+0000 7f28284f5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ceaf2400 0x55f0ce979180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.542+0000 7f28284f5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ceaf2400 0x55f0ce979180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:57974/0 (socket says 172.21.15.173:57974) 2024-09-13T23:56:57.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.542+0000 7f28284f5700 1 -- 172.21.15.173:0/1234033763 learned_addr learned my addr 172.21.15.173:0/1234033763 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.542+0000 7f28284f5700 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0ce6a2d00 con 0x55f0ceaf2400 2024-09-13T23:56:57.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.542+0000 7f28284f5700 1 --2- 172.21.15.173:0/1234033763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ceaf2400 0x55f0ce979180 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x55f0ceb08300 tx=0x55f0ce9f1c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.542+0000 7f280dcc0700 1 -- 172.21.15.173:0/1234033763 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f0ceb12160 con 0x55f0ceaf2400 2024-09-13T23:56:57.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.542+0000 7f280dcc0700 1 -- 172.21.15.173:0/1234033763 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f0cea38300 con 0x55f0ceaf2400 2024-09-13T23:56:57.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.542+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f0ce6a2340 con 0x55f0ceaf2400 2024-09-13T23:56:57.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.542+0000 7f280dcc0700 1 -- 172.21.15.173:0/1234033763 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f0ceb122c0 con 0x55f0ceaf2400 2024-09-13T23:56:57.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.542+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0ce6a3d40 con 0x55f0ceaf2400 2024-09-13T23:56:57.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.542+0000 7f280dcc0700 1 -- 172.21.15.173:0/1234033763 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55f0ce78bb80 con 0x55f0ceaf2400 2024-09-13T23:56:57.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.542+0000 7f280dcc0700 1 --2- 172.21.15.173:0/1234033763 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f0cea33800 0x55f0ceb8a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.542+0000 7f280dcc0700 1 -- 172.21.15.173:0/1234033763 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55f0ce6f7500 con 0x55f0ceaf2400 2024-09-13T23:56:57.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.542+0000 7f28294f7700 1 --2- 172.21.15.173:0/1234033763 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f0cea33800 0x55f0ceb8a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.542+0000 7f282a53df40 1 --2- 172.21.15.173:0/1234033763 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f0ceaf3800 0x55f0ce979700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.542+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ceaf3c00 con 0x55f0ceaf3800 2024-09-13T23:56:57.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.546+0000 7f2828cf6700 1 --2- 172.21.15.173:0/1234033763 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f0ceaf3800 0x55f0ce979700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.546+0000 7f28294f7700 1 --2- 172.21.15.173:0/1234033763 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f0cea33800 0x55f0ceb8a000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55f0cea9d7a0 tx=0x55f0ceb50ae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.546+0000 7f2828cf6700 1 --2- 172.21.15.173:0/1234033763 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f0ceaf3800 0x55f0ce979700 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.546+0000 7f2828cf6700 1 -- 172.21.15.173:0/1234033763 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v33'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0ceaf3800 2024-09-13T23:56:57.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.546+0000 7f282a53df40 1 --2- 172.21.15.173:0/1234033763 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f0ceaf2800 0x55f0ceb8a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.546+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ce9dac00 con 0x55f0ceaf2800 2024-09-13T23:56:57.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.546+0000 7f28284f5700 1 --2- 172.21.15.173:0/1234033763 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f0ceaf2800 0x55f0ceb8a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.546+0000 7f28284f5700 1 --2- 172.21.15.173:0/1234033763 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f0ceaf2800 0x55f0ceb8a580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.550+0000 7f28284f5700 1 -- 172.21.15.173:0/1234033763 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v33'11 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55f0cea95440 con 0x55f0ceaf2800 2024-09-13T23:56:57.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.550+0000 7f282a53df40 1 --2- 172.21.15.173:0/1234033763 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f0ce9db800 0x55f0ceb8ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.550+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ce9dbc00 con 0x55f0ce9db800 2024-09-13T23:56:57.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.550+0000 7f28294f7700 1 --2- 172.21.15.173:0/1234033763 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f0ce9db800 0x55f0ceb8ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.550+0000 7f28294f7700 1 --2- 172.21.15.173:0/1234033763 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f0ce9db800 0x55f0ceb8ab00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.554+0000 7f28294f7700 1 -- 172.21.15.173:0/1234033763 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v33'11 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0ce9db800 2024-09-13T23:56:57.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.554+0000 7f282a53df40 1 --2- 172.21.15.173:0/1234033763 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f0ce9da400 0x55f0ceb8b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.554+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cebb8000 con 0x55f0ce9da400 2024-09-13T23:56:57.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.554+0000 7f2828cf6700 1 --2- 172.21.15.173:0/1234033763 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f0ce9da400 0x55f0ceb8b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.554+0000 7f2828cf6700 1 --2- 172.21.15.173:0/1234033763 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f0ce9da400 0x55f0ceb8b080 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.554+0000 7f2828cf6700 1 -- 172.21.15.173:0/1234033763 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v33'32 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0ce9da400 2024-09-13T23:56:57.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.554+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cebb8400 con 0x55f0ceaf3800 2024-09-13T23:56:57.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.558+0000 7f2828cf6700 1 -- 172.21.15.173:0/1234033763 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v33'23 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0ceaf3800 2024-09-13T23:56:57.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.558+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cebb8800 con 0x55f0ce9db800 2024-09-13T23:56:57.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.562+0000 7f28294f7700 1 -- 172.21.15.173:0/1234033763 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v33'15 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0ce9db800 2024-09-13T23:56:57.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.562+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cebb8c00 con 0x55f0ceaf3800 2024-09-13T23:56:57.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.562+0000 7f2828cf6700 1 -- 172.21.15.173:0/1234033763 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v33'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0ceaf3800 2024-09-13T23:56:57.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.562+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cebb9000 con 0x55f0ce9da400 2024-09-13T23:56:57.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.566+0000 7f2828cf6700 1 -- 172.21.15.173:0/1234033763 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v33'15 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0ce9da400 2024-09-13T23:56:57.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.566+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cebb9400 con 0x55f0ceaf3800 2024-09-13T23:56:57.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.570+0000 7f2828cf6700 1 -- 172.21.15.173:0/1234033763 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v33'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0ceaf3800 2024-09-13T23:56:57.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.570+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cebb9800 con 0x55f0ceaf3800 2024-09-13T23:56:57.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.570+0000 7f2828cf6700 1 -- 172.21.15.173:0/1234033763 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0ceaf3800 2024-09-13T23:56:57.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.570+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cebb9c00 con 0x55f0ceaf3800 2024-09-13T23:56:57.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.574+0000 7f2828cf6700 1 -- 172.21.15.173:0/1234033763 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v33'24 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0ceaf3800 2024-09-13T23:56:57.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.574+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cebb8000 con 0x55f0ce9db800 2024-09-13T23:56:57.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.578+0000 7f28294f7700 1 -- 172.21.15.173:0/1234033763 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v33'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0ce9db800 2024-09-13T23:56:57.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.578+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cebb8400 con 0x55f0ceaf3800 2024-09-13T23:56:57.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.582+0000 7f2828cf6700 1 -- 172.21.15.173:0/1234033763 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v33'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0ceaf3800 2024-09-13T23:56:57.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.582+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cebb8c00 con 0x55f0ce9da400 2024-09-13T23:56:57.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.582+0000 7f2828cf6700 1 -- 172.21.15.173:0/1234033763 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v33'21 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0ce9da400 2024-09-13T23:56:57.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.582+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ceaf3c00 con 0x55f0ce9da400 2024-09-13T23:56:57.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.586+0000 7f2828cf6700 1 -- 172.21.15.173:0/1234033763 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v33'33 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0ce9da400 2024-09-13T23:56:57.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.586+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ce9da000 con 0x55f0ceaf3800 2024-09-13T23:56:57.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.590+0000 7f2828cf6700 1 -- 172.21.15.173:0/1234033763 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v33'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0ceaf3800 2024-09-13T23:56:57.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.590+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cebb9000 con 0x55f0ceaf3800 2024-09-13T23:56:57.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.590+0000 7f2828cf6700 1 -- 172.21.15.173:0/1234033763 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v33'25 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0ceaf3800 2024-09-13T23:56:57.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.590+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cebb9400 con 0x55f0ce9db800 2024-09-13T23:56:57.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.594+0000 7f28294f7700 1 -- 172.21.15.173:0/1234033763 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v33'11 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0ce9db800 2024-09-13T23:56:57.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.594+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cebb9800 con 0x55f0ceaf3800 2024-09-13T23:56:57.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.598+0000 7f2828cf6700 1 -- 172.21.15.173:0/1234033763 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0ceaf3800 2024-09-13T23:56:57.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.598+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cebb9c00 con 0x55f0ce9da400 2024-09-13T23:56:57.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.598+0000 7f2828cf6700 1 -- 172.21.15.173:0/1234033763 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v33'34 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0ce9da400 2024-09-13T23:56:57.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.598+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cebb8400 con 0x55f0ceaf3800 2024-09-13T23:56:57.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.602+0000 7f2828cf6700 1 -- 172.21.15.173:0/1234033763 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v33'18 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0ceaf3800 2024-09-13T23:56:57.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.602+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cebb8c00 con 0x55f0ceaf3800 2024-09-13T23:56:57.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.606+0000 7f2828cf6700 1 -- 172.21.15.173:0/1234033763 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v33'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0ceaf3800 2024-09-13T23:56:57.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.606+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ce9da000 con 0x55f0ce9db800 2024-09-13T23:56:57.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.610+0000 7f28294f7700 1 -- 172.21.15.173:0/1234033763 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v33'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0ce9db800 2024-09-13T23:56:57.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.610+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ce9db000 con 0x55f0ceaf3800 2024-09-13T23:56:57.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.610+0000 7f2828cf6700 1 -- 172.21.15.173:0/1234033763 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v33'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0ceaf3800 2024-09-13T23:56:57.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.610+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ce9db400 con 0x55f0ce9db800 2024-09-13T23:56:57.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.614+0000 7f28294f7700 1 -- 172.21.15.173:0/1234033763 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v33'7 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0ce9db800 2024-09-13T23:56:57.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.614+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ce9dbc00 con 0x55f0ce9db800 2024-09-13T23:56:57.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.618+0000 7f28294f7700 1 -- 172.21.15.173:0/1234033763 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v33'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0ce9db800 2024-09-13T23:56:57.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.618+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0ceaf3c00 con 0x55f0ce9db800 2024-09-13T23:56:57.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.618+0000 7f28294f7700 1 -- 172.21.15.173:0/1234033763 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v33'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0ce9db800 2024-09-13T23:56:57.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.618+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cebe0000 con 0x55f0ceaf3800 2024-09-13T23:56:57.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.622+0000 7f2828cf6700 1 -- 172.21.15.173:0/1234033763 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v33'11 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0ceaf3800 2024-09-13T23:56:57.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.622+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cebe0400 con 0x55f0ce9da400 2024-09-13T23:56:57.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.626+0000 7f2828cf6700 1 -- 172.21.15.173:0/1234033763 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v33'16 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0ce9da400 2024-09-13T23:56:57.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.626+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cebe0800 con 0x55f0ceaf3800 2024-09-13T23:56:57.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.626+0000 7f2828cf6700 1 -- 172.21.15.173:0/1234033763 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v33'19 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0ceaf3800 2024-09-13T23:56:57.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.626+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cebe0c00 con 0x55f0ce9da400 2024-09-13T23:56:57.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.630+0000 7f2828cf6700 1 -- 172.21.15.173:0/1234033763 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v33'22 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0ce9da400 2024-09-13T23:56:57.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.630+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cebe1000 con 0x55f0ceaf2800 2024-09-13T23:56:57.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.634+0000 7f28284f5700 1 -- 172.21.15.173:0/1234033763 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v33'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55f0cea95440 con 0x55f0ceaf2800 2024-09-13T23:56:57.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.638+0000 7f280b4bb700 20 reqs_thread_entry: start 2024-09-13T23:56:57.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.638+0000 7f282a53df40 20 init_complete bucket index max shards: 11 2024-09-13T23:56:57.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.638+0000 7f282a53df40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:56:57.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.638+0000 7f28094b7700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:27 2024 2024-09-13T23:56:57.643 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:56:57.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.638+0000 7f2808c95700 20 reqs_thread_entry: start 2024-09-13T23:56:57.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.638+0000 7f282a53df40 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-13T23:56:57.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.638+0000 7f282a53df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.638+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cebe1c00 con 0x55f0ceaf2000 2024-09-13T23:56:57.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.638+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0ceaf2000 2024-09-13T23:56:57.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.638+0000 7f282a53df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.638+0000 7f282a53df40 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-13T23:56:57.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.638+0000 7f282a53df40 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T23:56:57.644 INFO:teuthology.orchestra.run.smithi173.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T23:56:57.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.638+0000 7f280fcc4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:57.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.638+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94492748152832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea58000 con 0x55f0cea33000 2024-09-13T23:56:57.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.642+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94492748152832] v33'35 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0cea33000 2024-09-13T23:56:57.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.642+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94492746504960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea58400 con 0x55f0cea33400 2024-09-13T23:56:57.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.646+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94492746504960] v33'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0cea33400 2024-09-13T23:56:57.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.646+0000 7f282a53df40 20 remove_watcher() i=0 2024-09-13T23:56:57.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.646+0000 7f282a53df40 2 removed watcher, disabling cache 2024-09-13T23:56:57.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.646+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94492746506112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea58800 con 0x55f0cea33000 2024-09-13T23:56:57.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.646+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94492746506112] v33'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0cea33000 2024-09-13T23:56:57.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.646+0000 7f282a53df40 20 remove_watcher() i=1 2024-09-13T23:56:57.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.646+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94492746507264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea58c00 con 0x55f0cea33400 2024-09-13T23:56:57.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.650+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94492746507264] v33'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0cea33400 2024-09-13T23:56:57.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.650+0000 7f282a53df40 20 remove_watcher() i=2 2024-09-13T23:56:57.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.650+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94492746508416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea59000 con 0x55f0ceaf2000 2024-09-13T23:56:57.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.650+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94492746508416] v33'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0ceaf2000 2024-09-13T23:56:57.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.650+0000 7f282a53df40 20 remove_watcher() i=3 2024-09-13T23:56:57.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.650+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94492746509568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea59400 con 0x55f0cea33400 2024-09-13T23:56:57.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.654+0000 7f2828cf6700 1 -- 172.21.15.173:0/1212236916 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94492746509568] v33'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f0cea95200 con 0x55f0cea33400 2024-09-13T23:56:57.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.654+0000 7f282a53df40 20 remove_watcher() i=4 2024-09-13T23:56:57.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.654+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94492746510720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea59800 con 0x55f0cea33c00 2024-09-13T23:56:57.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.654+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94492746510720] v33'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f0cea95440 con 0x55f0cea33c00 2024-09-13T23:56:57.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.654+0000 7f282a53df40 20 remove_watcher() i=5 2024-09-13T23:56:57.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.654+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94492746511872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea59c00 con 0x55f0cea33c00 2024-09-13T23:56:57.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94492746511872] v33'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f0cea95440 con 0x55f0cea33c00 2024-09-13T23:56:57.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 20 remove_watcher() i=6 2024-09-13T23:56:57.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94492746513024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f0cea59800 con 0x55f0ceaf2000 2024-09-13T23:56:57.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f28294f7700 1 -- 172.21.15.173:0/1212236916 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94492746513024] v33'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f0cea94b40 con 0x55f0ceaf2000 2024-09-13T23:56:57.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 20 remove_watcher() i=7 2024-09-13T23:56:57.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f0cea33400 msgr2=0x55f0ce978100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 --2- 172.21.15.173:0/1212236916 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f0cea33400 0x55f0ce978100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f0cea33000 msgr2=0x55f0ce977b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 --2- 172.21.15.173:0/1212236916 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f0cea33000 0x55f0ce977b80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f0ceaf2000 msgr2=0x55f0ce978c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 --2- 172.21.15.173:0/1212236916 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f0ceaf2000 0x55f0ce978c00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f0cea33c00 msgr2=0x55f0ce978680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 --2- 172.21.15.173:0/1212236916 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f0cea33c00 0x55f0ce978680 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f0cea32c00 msgr2=0x55f0ce977600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 --2- 172.21.15.173:0/1212236916 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f0cea32c00 0x55f0ce977600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55f0ce971920 tx=0x55f0ce795800 comp rx=0 tx=0).stop 2024-09-13T23:56:57.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691800 msgr2=0x55f0ce976b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 --2- 172.21.15.173:0/1212236916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691800 0x55f0ce976b00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55f0cf508300 tx=0x55f0ce9f0840 comp rx=0 tx=0).stop 2024-09-13T23:56:57.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 reap_dead start 2024-09-13T23:56:57.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f28284f5700 1 -- 172.21.15.173:0/1212236916 reap_dead start 2024-09-13T23:56:57.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 shutdown_connections 2024-09-13T23:56:57.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 >> 172.21.15.173:0/1212236916 conn(0x55f0ce691400 msgr2=0x55f0ce791800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 shutdown_connections 2024-09-13T23:56:57.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 -- 172.21.15.173:0/1212236916 wait complete. 2024-09-13T23:56:57.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f0ceaf3800 msgr2=0x55f0ce979700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 --2- 172.21.15.173:0/1234033763 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f0ceaf3800 0x55f0ce979700 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f0ce9da400 msgr2=0x55f0ceb8b080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 --2- 172.21.15.173:0/1234033763 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f0ce9da400 0x55f0ceb8b080 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f0ceaf2800 msgr2=0x55f0ceb8a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 --2- 172.21.15.173:0/1234033763 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f0ceaf2800 0x55f0ceb8a580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f0ce9db800 msgr2=0x55f0ceb8ab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 --2- 172.21.15.173:0/1234033763 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f0ce9db800 0x55f0ceb8ab00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f0cea33800 msgr2=0x55f0ceb8a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 --2- 172.21.15.173:0/1234033763 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f0cea33800 0x55f0ceb8a000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55f0cea9d7a0 tx=0x55f0ceb50ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ceaf2400 msgr2=0x55f0ce979180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f2828cf6700 1 -- 172.21.15.173:0/1234033763 reap_dead start 2024-09-13T23:56:57.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.658+0000 7f282a53df40 1 --2- 172.21.15.173:0/1234033763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ceaf2400 0x55f0ce979180 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x55f0ceb08300 tx=0x55f0ce9f1c20 comp rx=0 tx=0).stop 2024-09-13T23:56:57.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.662+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 shutdown_connections 2024-09-13T23:56:57.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.662+0000 7f282a53df40 1 --2- 172.21.15.173:0/1234033763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ceaf2400 0x55f0ce979180 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.662+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 >> 172.21.15.173:0/1234033763 conn(0x55f0ce9da800 msgr2=0x55f0ce792000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.662+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 shutdown_connections 2024-09-13T23:56:57.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.662+0000 7f282a53df40 1 -- 172.21.15.173:0/1234033763 wait complete. 2024-09-13T23:56:57.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.662+0000 7f282a53df40 1 -- 172.21.15.173:0/2500653700 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f0cea32000 msgr2=0x55f0ce977080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.662+0000 7f282a53df40 1 --2- 172.21.15.173:0/2500653700 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f0cea32000 0x55f0ce977080 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55f0cf509560 tx=0x55f0ce9f0240 comp rx=0 tx=0).stop 2024-09-13T23:56:57.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.662+0000 7f282a53df40 1 -- 172.21.15.173:0/2500653700 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691000 msgr2=0x55f0ce976580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.662+0000 7f282a53df40 1 --2- 172.21.15.173:0/2500653700 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691000 0x55f0ce976580 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55f0ce7ede60 tx=0x55f0ce795a40 comp rx=0 tx=0).stop 2024-09-13T23:56:57.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.662+0000 7f282a53df40 1 -- 172.21.15.173:0/2500653700 shutdown_connections 2024-09-13T23:56:57.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.662+0000 7f282a53df40 1 --2- 172.21.15.173:0/2500653700 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f0cea32000 0x55f0ce977080 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.662+0000 7f282a53df40 1 --2- 172.21.15.173:0/2500653700 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f0ce691000 0x55f0ce976580 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.662+0000 7f282a53df40 1 -- 172.21.15.173:0/2500653700 >> 172.21.15.173:0/2500653700 conn(0x55f0ce690c00 msgr2=0x55f0ce791000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.662+0000 7f282a53df40 1 -- 172.21.15.173:0/2500653700 shutdown_connections 2024-09-13T23:56:57.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.662+0000 7f282a53df40 1 -- 172.21.15.173:0/2500653700 wait complete. 2024-09-13T23:56:57.671 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T23:56:57.672 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-13T23:56:57.672 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-13T23:56:57.672 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-13T23:56:57.715 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:56:57.715 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:56:57.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.710+0000 7f1dc85abf40 1 Processor -- start 2024-09-13T23:56:57.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.710+0000 7f1dc85abf40 1 -- start start 2024-09-13T23:56:57.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.710+0000 7f1dc85abf40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x559f22c61000 0x559f22f46580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.710+0000 7f1dc85abf40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559f22d25500 con 0x559f22c61400 2024-09-13T23:56:57.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.710+0000 7f1dc85abf40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x559f22ceea00 con 0x559f22c61000 2024-09-13T23:56:57.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.710+0000 7f1dc6d64700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x559f22c61000 0x559f22f46580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.710+0000 7f1dc6d64700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x559f22c61000 0x559f22f46580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:57990/0 (socket says 172.21.15.173:57990) 2024-09-13T23:56:57.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.710+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4149249767 learned_addr learned my addr 172.21.15.173:0/4149249767 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.710+0000 7f1dc6563700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x559f22c61400 0x559f22d60800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:57784/0 (socket says 172.21.15.173:57784) 2024-09-13T23:56:57.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.710+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4149249767 >> v1:172.21.15.87:6789/0 conn(0x559f22c61400 legacy=0x559f22d60800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.710+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4149249767 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f22c73d40 con 0x559f22c61000 2024-09-13T23:56:57.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.710+0000 7f1dc6d64700 1 --2- 172.21.15.173:0/4149249767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61000 0x559f22f46580 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x559f22f41a70 tx=0x559f22d65920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427c6f4364e8bd29 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.714+0000 7f1dc5d62700 1 -- 172.21.15.173:0/4149249767 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559f22d054a0 con 0x559f22c61000 2024-09-13T23:56:57.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.714+0000 7f1dc5d62700 1 -- 172.21.15.173:0/4149249767 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559f22d25800 con 0x559f22c61000 2024-09-13T23:56:57.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.714+0000 7f1dc5d62700 1 -- 172.21.15.173:0/4149249767 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559f22d05600 con 0x559f22c61000 2024-09-13T23:56:57.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.714+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4149249767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61000 msgr2=0x559f22f46580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.714+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/4149249767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61000 0x559f22f46580 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x559f22f41a70 tx=0x559f22d65920 comp rx=0 tx=0).stop 2024-09-13T23:56:57.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.714+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4149249767 shutdown_connections 2024-09-13T23:56:57.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.714+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/4149249767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61000 0x559f22f46580 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.714+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4149249767 >> 172.21.15.173:0/4149249767 conn(0x559f22c60c00 msgr2=0x559f22d60000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.714+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4149249767 shutdown_connections 2024-09-13T23:56:57.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.714+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4149249767 wait complete. 2024-09-13T23:56:57.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.714+0000 7f1dc85abf40 1 Processor -- start 2024-09-13T23:56:57.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.714+0000 7f1dc85abf40 1 -- start start 2024-09-13T23:56:57.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.714+0000 7f1dc85abf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61000 0x559f22f46580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.714+0000 7f1dc85abf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f22cee500 con 0x559f22c61000 2024-09-13T23:56:57.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.714+0000 7f1dc6d64700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61000 0x559f22f46580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.714+0000 7f1dc6d64700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61000 0x559f22f46580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:57998/0 (socket says 172.21.15.173:57998) 2024-09-13T23:56:57.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.714+0000 7f1dc6d64700 1 -- 172.21.15.173:0/3082796363 learned_addr learned my addr 172.21.15.173:0/3082796363 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.714+0000 7f1dc6d64700 1 -- 172.21.15.173:0/3082796363 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f22c73ba0 con 0x559f22c61000 2024-09-13T23:56:57.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.714+0000 7f1dc6d64700 1 --2- 172.21.15.173:0/3082796363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61000 0x559f22f46580 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x559f22dbc1b0 tx=0x559f22d65800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3b66010461d320 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.714+0000 7f1dc5561700 1 -- 172.21.15.173:0/3082796363 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559f22d05760 con 0x559f22c61000 2024-09-13T23:56:57.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.714+0000 7f1dc5561700 1 -- 172.21.15.173:0/3082796363 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559f22d25b00 con 0x559f22c61000 2024-09-13T23:56:57.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.714+0000 7f1dc5561700 1 -- 172.21.15.173:0/3082796363 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559f22d054a0 con 0x559f22c61000 2024-09-13T23:56:57.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.714+0000 7f1dc85abf40 1 -- 172.21.15.173:0/3082796363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61000 msgr2=0x559f22f46580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.714+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/3082796363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61000 0x559f22f46580 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x559f22dbc1b0 tx=0x559f22d65800 comp rx=0 tx=0).stop 2024-09-13T23:56:57.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.718+0000 7f1dc85abf40 1 -- 172.21.15.173:0/3082796363 shutdown_connections 2024-09-13T23:56:57.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.718+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/3082796363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61000 0x559f22f46580 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.718+0000 7f1dc85abf40 1 -- 172.21.15.173:0/3082796363 >> 172.21.15.173:0/3082796363 conn(0x559f22c60c00 msgr2=0x559f22d61000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.718+0000 7f1dc85abf40 1 -- 172.21.15.173:0/3082796363 shutdown_connections 2024-09-13T23:56:57.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.718+0000 7f1dc85abf40 1 -- 172.21.15.173:0/3082796363 wait complete. 2024-09-13T23:56:57.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.718+0000 7f1dc85abf40 1 Processor -- start 2024-09-13T23:56:57.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.718+0000 7f1dc85abf40 1 -- start start 2024-09-13T23:56:57.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.718+0000 7f1dc85abf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61000 0x559f22f46580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.718+0000 7f1dc85abf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f22cee3c0 con 0x559f22c61000 2024-09-13T23:56:57.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.718+0000 7f1dc6d64700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61000 0x559f22f46580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.718+0000 7f1dc6d64700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61000 0x559f22f46580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58002/0 (socket says 172.21.15.173:58002) 2024-09-13T23:56:57.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.718+0000 7f1dc6d64700 1 -- 172.21.15.173:0/3993193546 learned_addr learned my addr 172.21.15.173:0/3993193546 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.718+0000 7f1dc6d64700 1 -- 172.21.15.173:0/3993193546 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f22c73a00 con 0x559f22c61000 2024-09-13T23:56:57.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.718+0000 7f1dc6d64700 1 --2- 172.21.15.173:0/3993193546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61000 0x559f22f46580 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x559f22dbde90 tx=0x559f22d65920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.718+0000 7f1dc3d5e700 1 -- 172.21.15.173:0/3993193546 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559f22d05600 con 0x559f22c61000 2024-09-13T23:56:57.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.718+0000 7f1dc3d5e700 1 -- 172.21.15.173:0/3993193546 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559f22d25c80 con 0x559f22c61000 2024-09-13T23:56:57.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.718+0000 7f1dc85abf40 1 -- 172.21.15.173:0/3993193546 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559f22c73860 con 0x559f22c61000 2024-09-13T23:56:57.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.718+0000 7f1dc3d5e700 1 -- 172.21.15.173:0/3993193546 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559f22d058c0 con 0x559f22c61000 2024-09-13T23:56:57.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.718+0000 7f1dc85abf40 1 -- 172.21.15.173:0/3993193546 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f22c736c0 con 0x559f22c61000 2024-09-13T23:56:57.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc85abf40 1 Processor -- start 2024-09-13T23:56:57.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc85abf40 1 -- start start 2024-09-13T23:56:57.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc85abf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61800 0x559f22f46b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc85abf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f22c86640 con 0x559f22c61800 2024-09-13T23:56:57.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc3d5e700 1 -- 172.21.15.173:0/3993193546 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x559f22d5ab00 con 0x559f22c61000 2024-09-13T23:56:57.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc7565700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61800 0x559f22f46b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc7565700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61800 0x559f22f46b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58016/0 (socket says 172.21.15.173:58016) 2024-09-13T23:56:57.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc7565700 1 -- 172.21.15.173:0/3437689024 learned_addr learned my addr 172.21.15.173:0/3437689024 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc3d5e700 1 --2- 172.21.15.173:0/3993193546 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559f22ffc000 0x559f22f47080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc3d5e700 1 -- 172.21.15.173:0/3993193546 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x559f22cc7180 con 0x559f22c61000 2024-09-13T23:56:57.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc6d64700 1 --2- 172.21.15.173:0/3993193546 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559f22ffc000 0x559f22f47080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc7565700 1 -- 172.21.15.173:0/3437689024 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f22c72000 con 0x559f22c61800 2024-09-13T23:56:57.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc6d64700 1 --2- 172.21.15.173:0/3993193546 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559f22ffc000 0x559f22f47080 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x559f22f85500 tx=0x559f22fbe780 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc7565700 1 --2- 172.21.15.173:0/3437689024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61800 0x559f22f46b00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x559f22fd8510 tx=0x559f22fbea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f241d6bbba7073 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc1559700 1 -- 172.21.15.173:0/3437689024 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559f22d05600 con 0x559f22c61800 2024-09-13T23:56:57.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc1559700 1 -- 172.21.15.173:0/3437689024 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559f23000000 con 0x559f22c61800 2024-09-13T23:56:57.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc1559700 1 -- 172.21.15.173:0/3437689024 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559f22d058c0 con 0x559f22c61800 2024-09-13T23:56:57.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc85abf40 1 -- 172.21.15.173:0/3437689024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61800 msgr2=0x559f22f46b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/3437689024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61800 0x559f22f46b00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x559f22fd8510 tx=0x559f22fbea80 comp rx=0 tx=0).stop 2024-09-13T23:56:57.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc85abf40 1 -- 172.21.15.173:0/3437689024 shutdown_connections 2024-09-13T23:56:57.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/3437689024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61800 0x559f22f46b00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc85abf40 1 -- 172.21.15.173:0/3437689024 >> 172.21.15.173:0/3437689024 conn(0x559f22c61400 msgr2=0x559f22d61800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc85abf40 1 -- 172.21.15.173:0/3437689024 shutdown_connections 2024-09-13T23:56:57.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc85abf40 1 -- 172.21.15.173:0/3437689024 wait complete. 2024-09-13T23:56:57.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.722+0000 7f1dc85abf40 1 Processor -- start 2024-09-13T23:56:57.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.726+0000 7f1dc85abf40 1 -- start start 2024-09-13T23:56:57.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.726+0000 7f1dc85abf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61800 0x559f22f46b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.726+0000 7f1dc85abf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f22c868c0 con 0x559f22c61800 2024-09-13T23:56:57.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.726+0000 7f1dc7565700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61800 0x559f22f46b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.726+0000 7f1dc7565700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61800 0x559f22f46b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58026/0 (socket says 172.21.15.173:58026) 2024-09-13T23:56:57.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.726+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 learned_addr learned my addr 172.21.15.173:0/2736303850 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.726+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f22c72ea0 con 0x559f22c61800 2024-09-13T23:56:57.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.726+0000 7f1dc7565700 1 --2- 172.21.15.173:0/2736303850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61800 0x559f22f46b00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x559f22f848a0 tx=0x559f22fbe5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.726+0000 7f1dbfd56700 1 -- 172.21.15.173:0/2736303850 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559f22d05760 con 0x559f22c61800 2024-09-13T23:56:57.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.726+0000 7f1dbfd56700 1 -- 172.21.15.173:0/2736303850 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559f23000180 con 0x559f22c61800 2024-09-13T23:56:57.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.726+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559f22c72820 con 0x559f22c61800 2024-09-13T23:56:57.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.726+0000 7f1dbfd56700 1 -- 172.21.15.173:0/2736303850 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559f22d05600 con 0x559f22c61800 2024-09-13T23:56:57.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.726+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f22c729c0 con 0x559f22c61800 2024-09-13T23:56:57.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.726+0000 7f1dc85abf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dbfd56700 1 -- 172.21.15.173:0/2736303850 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x559f22d5b080 con 0x559f22c61800 2024-09-13T23:56:57.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dbfd56700 1 --2- 172.21.15.173:0/2736303850 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559f22ffcc00 0x559f22f47600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dbfd56700 1 -- 172.21.15.173:0/2736303850 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x559f22cc7340 con 0x559f22c61800 2024-09-13T23:56:57.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/2736303850 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559f22ffd000 0x559f22f47b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dc6563700 1 --2- 172.21.15.173:0/2736303850 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559f22ffcc00 0x559f22f47600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd400 con 0x559f22ffd000 2024-09-13T23:56:57.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dc7565700 1 --2- 172.21.15.173:0/2736303850 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559f22ffd000 0x559f22f47b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dc6563700 1 --2- 172.21.15.173:0/2736303850 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559f22ffcc00 0x559f22f47600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x559f22f41f80 tx=0x559f22fbf920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dc7565700 1 --2- 172.21.15.173:0/2736303850 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559f22ffd000 0x559f22f47b80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f22ffd000 2024-09-13T23:56:57.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dc85abf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dc85abf40 20 realm 2024-09-13T23:56:57.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dc85abf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffd000 2024-09-13T23:56:57.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f22ffd000 2024-09-13T23:56:57.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dc85abf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dc85abf40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:56:57.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dc85abf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffdc00 con 0x559f22ffd000 2024-09-13T23:56:57.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f22ffd000 2024-09-13T23:56:57.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dc85abf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dc85abf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/2736303850 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559f22ffd400 0x559f22f48100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffd400 2024-09-13T23:56:57.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.730+0000 7f1dc6d64700 1 --2- 172.21.15.173:0/2736303850 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559f22ffd400 0x559f22f48100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.734+0000 7f1dc6d64700 1 --2- 172.21.15.173:0/2736303850 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559f22ffd400 0x559f22f48100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.734+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x559f23067200 con 0x559f22ffd400 2024-09-13T23:56:57.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.734+0000 7f1dc85abf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:57.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.734+0000 7f1dc85abf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.734+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/2736303850 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559f22ffdc00 0x559f22f48680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.734+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230bc000 con 0x559f22ffdc00 2024-09-13T23:56:57.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.734+0000 7f1dc6563700 1 --2- 172.21.15.173:0/2736303850 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559f22ffdc00 0x559f22f48680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.734+0000 7f1dc6563700 1 --2- 172.21.15.173:0/2736303850 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559f22ffdc00 0x559f22f48680 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.734+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x559f23067440 con 0x559f22ffdc00 2024-09-13T23:56:57.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.734+0000 7f1dc85abf40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:56:57.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.734+0000 7f1dc85abf40 20 searching for the correct realm 2024-09-13T23:56:57.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.734+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230bc400 con 0x559f22ffdc00 2024-09-13T23:56:57.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.734+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x559f23067440 con 0x559f22ffdc00 2024-09-13T23:56:57.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.734+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230bc000 con 0x559f22ffd400 2024-09-13T23:56:57.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.734+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23067200 con 0x559f22ffd400 2024-09-13T23:56:57.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.734+0000 7f1dc6d64700 1 --2- 172.21.15.173:0/2736303850 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559f230bc000 0x559f22f48c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.734+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f230bc000 2024-09-13T23:56:57.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.738+0000 7f1dc7565700 1 --2- 172.21.15.173:0/2736303850 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559f230bc000 0x559f22f48c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.738+0000 7f1dc7565700 1 --2- 172.21.15.173:0/2736303850 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559f230bc000 0x559f22f48c00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.738+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23066b40 con 0x559f230bc000 2024-09-13T23:56:57.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.738+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffd000 2024-09-13T23:56:57.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.738+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x559f23066b40 con 0x559f22ffd000 2024-09-13T23:56:57.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.738+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffd000 2024-09-13T23:56:57.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.738+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23066b40 con 0x559f22ffd000 2024-09-13T23:56:57.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.738+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffdc00 2024-09-13T23:56:57.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.738+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23067440 con 0x559f22ffdc00 2024-09-13T23:56:57.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.738+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffd000 2024-09-13T23:56:57.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.738+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23066b40 con 0x559f22ffd000 2024-09-13T23:56:57.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.738+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffd400 2024-09-13T23:56:57.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.738+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23067200 con 0x559f22ffd400 2024-09-13T23:56:57.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.742+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffd400 2024-09-13T23:56:57.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.742+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23067200 con 0x559f22ffd400 2024-09-13T23:56:57.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.742+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffd000 2024-09-13T23:56:57.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.742+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23066b40 con 0x559f22ffd000 2024-09-13T23:56:57.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.742+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f230bc000 2024-09-13T23:56:57.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.742+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23066b40 con 0x559f230bc000 2024-09-13T23:56:57.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.742+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffd000 2024-09-13T23:56:57.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.742+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23066b40 con 0x559f22ffd000 2024-09-13T23:56:57.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.742+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f230bc000 2024-09-13T23:56:57.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.742+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23066b40 con 0x559f230bc000 2024-09-13T23:56:57.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.742+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffd400 2024-09-13T23:56:57.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.742+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23067200 con 0x559f22ffd400 2024-09-13T23:56:57.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.742+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffdc00 2024-09-13T23:56:57.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.746+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23067440 con 0x559f22ffdc00 2024-09-13T23:56:57.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.746+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffd000 2024-09-13T23:56:57.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.746+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23066b40 con 0x559f22ffd000 2024-09-13T23:56:57.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.746+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffd400 2024-09-13T23:56:57.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.746+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23067200 con 0x559f22ffd400 2024-09-13T23:56:57.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.746+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffdc00 2024-09-13T23:56:57.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.746+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23067440 con 0x559f22ffdc00 2024-09-13T23:56:57.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.746+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffd000 2024-09-13T23:56:57.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.746+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23066b40 con 0x559f22ffd000 2024-09-13T23:56:57.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.746+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffd000 2024-09-13T23:56:57.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.746+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23066b40 con 0x559f22ffd000 2024-09-13T23:56:57.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.746+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffd000 2024-09-13T23:56:57.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.746+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23066b40 con 0x559f22ffd000 2024-09-13T23:56:57.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.746+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffdc00 2024-09-13T23:56:57.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.750+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23067440 con 0x559f22ffdc00 2024-09-13T23:56:57.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.750+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f230bc000 2024-09-13T23:56:57.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.750+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23066b40 con 0x559f230bc000 2024-09-13T23:56:57.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.750+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffd000 2024-09-13T23:56:57.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.750+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23066b40 con 0x559f22ffd000 2024-09-13T23:56:57.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.750+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f230bc000 2024-09-13T23:56:57.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.750+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23066b40 con 0x559f230bc000 2024-09-13T23:56:57.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.750+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffdc00 2024-09-13T23:56:57.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.750+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23067440 con 0x559f22ffdc00 2024-09-13T23:56:57.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.750+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f230bc000 2024-09-13T23:56:57.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.750+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23066b40 con 0x559f230bc000 2024-09-13T23:56:57.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.750+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffd400 2024-09-13T23:56:57.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.750+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23067200 con 0x559f22ffd400 2024-09-13T23:56:57.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.750+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffd400 2024-09-13T23:56:57.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.754+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23067200 con 0x559f22ffd400 2024-09-13T23:56:57.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.754+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffdc00 2024-09-13T23:56:57.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.754+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23067440 con 0x559f22ffdc00 2024-09-13T23:56:57.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.754+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffd400 2024-09-13T23:56:57.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.754+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x559f23067200 con 0x559f22ffd400 2024-09-13T23:56:57.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.754+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f22ffd400 2024-09-13T23:56:57.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.754+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559f23067200 con 0x559f22ffd400 2024-09-13T23:56:57.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.754+0000 7f1dc85abf40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:56:57.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.754+0000 7f1dc85abf40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:56:57.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.754+0000 7f1dc85abf40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:56:57.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.754+0000 7f1dc85abf40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:56:57.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.754+0000 7f1dc85abf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.754+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230bc800 con 0x559f22ffd000 2024-09-13T23:56:57.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.754+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f22ffd000 2024-09-13T23:56:57.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.754+0000 7f1dc85abf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.754+0000 7f1dc85abf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.754+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230bcc00 con 0x559f22ffd400 2024-09-13T23:56:57.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x559f23067200 con 0x559f22ffd400 2024-09-13T23:56:57.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc85abf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:57.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc85abf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230bd000 con 0x559f22ffd000 2024-09-13T23:56:57.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x559f23066b40 con 0x559f22ffd000 2024-09-13T23:56:57.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc85abf40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:56:57.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc85abf40 20 zone default found 2024-09-13T23:56:57.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc85abf40 4 Realm: () 2024-09-13T23:56:57.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc85abf40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:56:57.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc85abf40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:56:57.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc85abf40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:56:57.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc85abf40 20 zonegroup default 2024-09-13T23:56:57.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc85abf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230bd400 con 0x559f230bc000 2024-09-13T23:56:57.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f230bc000 2024-09-13T23:56:57.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc85abf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc85abf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230bd800 con 0x559f22ffdc00 2024-09-13T23:56:57.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x559f23067440 con 0x559f22ffdc00 2024-09-13T23:56:57.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc85abf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc85abf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230bdc00 con 0x559f22ffdc00 2024-09-13T23:56:57.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x559f23067440 con 0x559f22ffdc00 2024-09-13T23:56:57.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc85abf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc85abf40 20 started sync module instance, tier type = 2024-09-13T23:56:57.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc85abf40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:56:57.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.758+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230c2000 con 0x559f22ffd400 2024-09-13T23:56:57.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.762+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f22ffd400 2024-09-13T23:56:57.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.762+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94141974567680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230c2400 con 0x559f22ffd400 2024-09-13T23:56:57.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.762+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230c2800 con 0x559f22ffd000 2024-09-13T23:56:57.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.766+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f22ffd000 2024-09-13T23:56:57.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.766+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94141974568832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230c2c00 con 0x559f22ffd000 2024-09-13T23:56:57.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.766+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230c3000 con 0x559f22ffd400 2024-09-13T23:56:57.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.766+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94141974567680] v33'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f22ffd400 2024-09-13T23:56:57.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.770+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94141974568832] v33'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f22ffd000 2024-09-13T23:56:57.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.770+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f22ffd400 2024-09-13T23:56:57.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.770+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94141974569984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230c3400 con 0x559f22ffd400 2024-09-13T23:56:57.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.770+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230c3800 con 0x559f230bc000 2024-09-13T23:56:57.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.774+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94141974569984] v33'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f22ffd400 2024-09-13T23:56:57.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.774+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f230bc000 2024-09-13T23:56:57.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.774+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94141974571136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230c3c00 con 0x559f230bc000 2024-09-13T23:56:57.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.774+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230c2800 con 0x559f22ffd400 2024-09-13T23:56:57.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.778+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94141974571136] v33'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f230bc000 2024-09-13T23:56:57.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.778+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f22ffd400 2024-09-13T23:56:57.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.778+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94141974572288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230c2000 con 0x559f22ffd400 2024-09-13T23:56:57.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.778+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230bc800 con 0x559f22ffdc00 2024-09-13T23:56:57.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.778+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559f23067440 con 0x559f22ffdc00 2024-09-13T23:56:57.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.778+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94141974573440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230bd000 con 0x559f22ffdc00 2024-09-13T23:56:57.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.778+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230bd400 con 0x559f22ffdc00 2024-09-13T23:56:57.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.782+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94141974572288] v33'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f22ffd400 2024-09-13T23:56:57.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.782+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94141974573440] v33'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559f23067440 con 0x559f22ffdc00 2024-09-13T23:56:57.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.782+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559f23067440 con 0x559f22ffdc00 2024-09-13T23:56:57.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.782+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94141974574592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230bcc00 con 0x559f22ffdc00 2024-09-13T23:56:57.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.782+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f22ffd800 con 0x559f230bc000 2024-09-13T23:56:57.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.786+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94141974574592] v33'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559f23067440 con 0x559f22ffdc00 2024-09-13T23:56:57.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.786+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f230bc000 2024-09-13T23:56:57.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.786+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94141974575744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230c2400 con 0x559f230bc000 2024-09-13T23:56:57.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.786+0000 7f1dc85abf40 20 add_watcher() i=0 2024-09-13T23:56:57.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.786+0000 7f1dc85abf40 20 add_watcher() i=1 2024-09-13T23:56:57.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.786+0000 7f1dc85abf40 20 add_watcher() i=2 2024-09-13T23:56:57.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.786+0000 7f1dc85abf40 20 add_watcher() i=3 2024-09-13T23:56:57.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.786+0000 7f1dc85abf40 20 add_watcher() i=4 2024-09-13T23:56:57.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.786+0000 7f1dc85abf40 20 add_watcher() i=5 2024-09-13T23:56:57.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.786+0000 7f1dc85abf40 20 add_watcher() i=6 2024-09-13T23:56:57.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.786+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94141974575744] v33'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f230bc000 2024-09-13T23:56:57.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.786+0000 7f1dc85abf40 20 add_watcher() i=7 2024-09-13T23:56:57.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.786+0000 7f1dc85abf40 2 all 8 watchers are set, enabling cache 2024-09-13T23:56:57.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.786+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230c3000 con 0x559f22ffd000 2024-09-13T23:56:57.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.786+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x559f23066b40 con 0x559f22ffd000 2024-09-13T23:56:57.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.786+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94141976182784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230c3400 con 0x559f22ffd000 2024-09-13T23:56:57.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.790+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94141976182784] v33'36 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f22ffd000 2024-09-13T23:56:57.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.790+0000 7f1dc85abf40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:56:57.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.790+0000 7f1dc85abf40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:56:57.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.790+0000 7f1dc85abf40 1 Processor -- start 2024-09-13T23:56:57.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.790+0000 7f1dadd32700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:57.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.790+0000 7f1dc85abf40 1 -- start start 2024-09-13T23:56:57.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.790+0000 7f1dc85abf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f230bc400 0x559f22f49180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.790+0000 7f1dc85abf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f22cee3c0 con 0x559f230bc400 2024-09-13T23:56:57.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.790+0000 7f1dc6563700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f230bc400 0x559f22f49180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.790+0000 7f1dc6563700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f230bc400 0x559f22f49180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58036/0 (socket says 172.21.15.173:58036) 2024-09-13T23:56:57.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.790+0000 7f1dc6563700 1 -- 172.21.15.173:0/2438459111 learned_addr learned my addr 172.21.15.173:0/2438459111 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.790+0000 7f1dc6563700 1 -- 172.21.15.173:0/2438459111 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f22c72b60 con 0x559f230bc400 2024-09-13T23:56:57.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.794+0000 7f1dc6563700 1 --2- 172.21.15.173:0/2438459111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f230bc400 0x559f22f49180 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x559f230d2000 tx=0x559f22fbf8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e60a0ab3a574f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.794+0000 7f1dad531700 1 -- 172.21.15.173:0/2438459111 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559f230da000 con 0x559f230bc400 2024-09-13T23:56:57.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.794+0000 7f1dad531700 1 -- 172.21.15.173:0/2438459111 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559f23000600 con 0x559f230bc400 2024-09-13T23:56:57.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.794+0000 7f1dad531700 1 -- 172.21.15.173:0/2438459111 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559f230da160 con 0x559f230bc400 2024-09-13T23:56:57.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.794+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2438459111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f230bc400 msgr2=0x559f22f49180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.794+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/2438459111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f230bc400 0x559f22f49180 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x559f230d2000 tx=0x559f22fbf8c0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.794+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2438459111 shutdown_connections 2024-09-13T23:56:57.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.794+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/2438459111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f230bc400 0x559f22f49180 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.794+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2438459111 >> 172.21.15.173:0/2438459111 conn(0x559f230c2800 msgr2=0x559f22d62000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.794+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2438459111 shutdown_connections 2024-09-13T23:56:57.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.794+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2438459111 wait complete. 2024-09-13T23:56:57.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.794+0000 7f1dc85abf40 1 Processor -- start 2024-09-13T23:56:57.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.794+0000 7f1dc85abf40 1 -- start start 2024-09-13T23:56:57.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.794+0000 7f1dc85abf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f230bc400 0x559f22f49180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.794+0000 7f1dc85abf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f22cee500 con 0x559f230bc400 2024-09-13T23:56:57.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.794+0000 7f1dc6563700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f230bc400 0x559f22f49180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.794+0000 7f1dc6563700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f230bc400 0x559f22f49180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58044/0 (socket says 172.21.15.173:58044) 2024-09-13T23:56:57.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.794+0000 7f1dc6563700 1 -- 172.21.15.173:0/4112239524 learned_addr learned my addr 172.21.15.173:0/4112239524 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.794+0000 7f1dc6563700 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f22c72d00 con 0x559f230bc400 2024-09-13T23:56:57.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.798+0000 7f1dc6563700 1 --2- 172.21.15.173:0/4112239524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f230bc400 0x559f22f49180 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x559f230d2210 tx=0x559f22fbfa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.798+0000 7f1dabd2e700 1 -- 172.21.15.173:0/4112239524 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559f230da2c0 con 0x559f230bc400 2024-09-13T23:56:57.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.798+0000 7f1dabd2e700 1 -- 172.21.15.173:0/4112239524 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559f23000300 con 0x559f230bc400 2024-09-13T23:56:57.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.798+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559f22c72340 con 0x559f230bc400 2024-09-13T23:56:57.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.798+0000 7f1dabd2e700 1 -- 172.21.15.173:0/4112239524 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559f230da000 con 0x559f230bc400 2024-09-13T23:56:57.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.798+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f22c72b60 con 0x559f230bc400 2024-09-13T23:56:57.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.798+0000 7f1dabd2e700 1 -- 172.21.15.173:0/4112239524 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x559f22d5bb80 con 0x559f230bc400 2024-09-13T23:56:57.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.798+0000 7f1dabd2e700 1 --2- 172.21.15.173:0/4112239524 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559f22ffd800 0x559f2315c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.798+0000 7f1dabd2e700 1 -- 172.21.15.173:0/4112239524 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x559f22cc7500 con 0x559f230bc400 2024-09-13T23:56:57.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.798+0000 7f1dc7565700 1 --2- 172.21.15.173:0/4112239524 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559f22ffd800 0x559f2315c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.798+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/4112239524 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559f230bd800 0x559f22f49700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.798+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230bdc00 con 0x559f230bd800 2024-09-13T23:56:57.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.798+0000 7f1dc6d64700 1 --2- 172.21.15.173:0/4112239524 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559f230bd800 0x559f22f49700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.798+0000 7f1dc7565700 1 --2- 172.21.15.173:0/4112239524 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559f22ffd800 0x559f2315c000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x559f23073560 tx=0x559f23122660 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.798+0000 7f1dc6d64700 1 --2- 172.21.15.173:0/4112239524 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559f230bd800 0x559f22f49700 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.802+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4112239524 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f230bd800 2024-09-13T23:56:57.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.802+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/4112239524 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559f230bc800 0x559f2315c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.802+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230c2c00 con 0x559f230bc800 2024-09-13T23:56:57.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.802+0000 7f1dc6563700 1 --2- 172.21.15.173:0/4112239524 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559f230bc800 0x559f2315c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.802+0000 7f1dc6563700 1 --2- 172.21.15.173:0/4112239524 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559f230bc800 0x559f2315c580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.806+0000 7f1dc6563700 1 -- 172.21.15.173:0/4112239524 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v33'12 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559f23067440 con 0x559f230bc800 2024-09-13T23:56:57.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.806+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/4112239524 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559f230c3800 0x559f2315cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.806+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230c3c00 con 0x559f230c3800 2024-09-13T23:56:57.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.806+0000 7f1dc7565700 1 --2- 172.21.15.173:0/4112239524 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559f230c3800 0x559f2315cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.806+0000 7f1dc7565700 1 --2- 172.21.15.173:0/4112239524 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559f230c3800 0x559f2315cb00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.810+0000 7f1dc7565700 1 -- 172.21.15.173:0/4112239524 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v33'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f230c3800 2024-09-13T23:56:57.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.810+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/4112239524 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559f230c2400 0x559f2315d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.810+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23180000 con 0x559f230c2400 2024-09-13T23:56:57.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.810+0000 7f1dc6d64700 1 --2- 172.21.15.173:0/4112239524 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559f230c2400 0x559f2315d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.810+0000 7f1dc6d64700 1 --2- 172.21.15.173:0/4112239524 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559f230c2400 0x559f2315d080 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.810+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4112239524 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v33'37 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f230c2400 2024-09-13T23:56:57.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.814+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23180400 con 0x559f230bd800 2024-09-13T23:56:57.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.814+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4112239524 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v33'26 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f230bd800 2024-09-13T23:56:57.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.814+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23180800 con 0x559f230c3800 2024-09-13T23:56:57.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.818+0000 7f1dc7565700 1 -- 172.21.15.173:0/4112239524 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v33'17 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f230c3800 2024-09-13T23:56:57.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.818+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23180c00 con 0x559f230bd800 2024-09-13T23:56:57.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.818+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4112239524 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v33'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f230bd800 2024-09-13T23:56:57.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.818+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23181000 con 0x559f230c2400 2024-09-13T23:56:57.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.822+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4112239524 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v33'17 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f230c2400 2024-09-13T23:56:57.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.822+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23181400 con 0x559f230bd800 2024-09-13T23:56:57.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.826+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4112239524 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v33'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f230bd800 2024-09-13T23:56:57.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.826+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23181800 con 0x559f230bd800 2024-09-13T23:56:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.830+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4112239524 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f230bd800 2024-09-13T23:56:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.830+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23181c00 con 0x559f230bd800 2024-09-13T23:56:57.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.830+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4112239524 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v33'27 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f230bd800 2024-09-13T23:56:57.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.830+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23180000 con 0x559f230c3800 2024-09-13T23:56:57.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.834+0000 7f1dc7565700 1 -- 172.21.15.173:0/4112239524 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v33'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f230c3800 2024-09-13T23:56:57.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.834+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23180400 con 0x559f230bd800 2024-09-13T23:56:57.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.834+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4112239524 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v33'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f230bd800 2024-09-13T23:56:57.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.838+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23180c00 con 0x559f230c2400 2024-09-13T23:56:57.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.838+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4112239524 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v33'23 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f230c2400 2024-09-13T23:56:57.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.838+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230bdc00 con 0x559f230c2400 2024-09-13T23:56:57.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.842+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4112239524 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v33'38 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f230c2400 2024-09-13T23:56:57.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.842+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230c2000 con 0x559f230bd800 2024-09-13T23:56:57.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.846+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4112239524 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v33'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f230bd800 2024-09-13T23:56:57.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.846+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23181000 con 0x559f230bd800 2024-09-13T23:56:57.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.846+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4112239524 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v33'28 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f230bd800 2024-09-13T23:56:57.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.846+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23181400 con 0x559f230c3800 2024-09-13T23:56:57.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.850+0000 7f1dc7565700 1 -- 172.21.15.173:0/4112239524 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v33'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f230c3800 2024-09-13T23:56:57.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.850+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23181800 con 0x559f230bd800 2024-09-13T23:56:57.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.854+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4112239524 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v33'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f230bd800 2024-09-13T23:56:57.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.854+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23181c00 con 0x559f230c2400 2024-09-13T23:56:57.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.854+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4112239524 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v33'39 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f230c2400 2024-09-13T23:56:57.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.854+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23180400 con 0x559f230bd800 2024-09-13T23:56:57.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.858+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4112239524 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v33'21 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f230bd800 2024-09-13T23:56:57.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.858+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23180c00 con 0x559f230bd800 2024-09-13T23:56:57.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.862+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4112239524 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v33'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f230bd800 2024-09-13T23:56:57.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.862+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230c2000 con 0x559f230c3800 2024-09-13T23:56:57.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.866+0000 7f1dc7565700 1 -- 172.21.15.173:0/4112239524 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v33'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f230c3800 2024-09-13T23:56:57.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.866+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230c3000 con 0x559f230bd800 2024-09-13T23:56:57.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.866+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4112239524 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f230bd800 2024-09-13T23:56:57.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.866+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230c3400 con 0x559f230c3800 2024-09-13T23:56:57.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.870+0000 7f1dc7565700 1 -- 172.21.15.173:0/4112239524 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v33'8 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f230c3800 2024-09-13T23:56:57.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.870+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230c3c00 con 0x559f230c3800 2024-09-13T23:56:57.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.874+0000 7f1dc7565700 1 -- 172.21.15.173:0/4112239524 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v33'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f230c3800 2024-09-13T23:56:57.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.874+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f230bdc00 con 0x559f230c3800 2024-09-13T23:56:57.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.874+0000 7f1dc7565700 1 -- 172.21.15.173:0/4112239524 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v33'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f230c3800 2024-09-13T23:56:57.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.874+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f231b0000 con 0x559f230bd800 2024-09-13T23:56:57.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.878+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4112239524 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v33'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f230bd800 2024-09-13T23:56:57.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.878+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f231b0400 con 0x559f230c2400 2024-09-13T23:56:57.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.882+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4112239524 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v33'18 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f230c2400 2024-09-13T23:56:57.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.882+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f231b0800 con 0x559f230bd800 2024-09-13T23:56:57.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.886+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4112239524 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v33'22 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f230bd800 2024-09-13T23:56:57.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.886+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f231b0c00 con 0x559f230c2400 2024-09-13T23:56:57.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.886+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4112239524 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v33'24 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f230c2400 2024-09-13T23:56:57.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.886+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f231b1000 con 0x559f230bc800 2024-09-13T23:56:57.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.890+0000 7f1dc6563700 1 -- 172.21.15.173:0/4112239524 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559f23067440 con 0x559f230bc800 2024-09-13T23:56:57.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.890+0000 7f1da9529700 20 reqs_thread_entry: start 2024-09-13T23:56:57.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.894+0000 7f1dc85abf40 20 init_complete bucket index max shards: 11 2024-09-13T23:56:57.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.894+0000 7f1dc85abf40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:56:57.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.894+0000 7f1da7525700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:28 2024 2024-09-13T23:56:57.898 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:56:57.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.894+0000 7f1da6d03700 20 reqs_thread_entry: start 2024-09-13T23:56:57.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.894+0000 7f1dc85abf40 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:56:57.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.894+0000 7f1dc85abf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:57.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.894+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f231b1c00 con 0x559f230bc000 2024-09-13T23:56:57.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.894+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f230bc000 2024-09-13T23:56:57.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.894+0000 7f1dc85abf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:57.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.894+0000 7f1dc85abf40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T23:56:57.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.894+0000 7f1dc85abf40 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:56:57.900 INFO:teuthology.orchestra.run.smithi173.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T23:56:57.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.894+0000 7f1dadd32700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:57.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.894+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94141976182784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23044000 con 0x559f22ffd000 2024-09-13T23:56:57.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.898+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94141976182784] v33'40 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f22ffd000 2024-09-13T23:56:57.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.898+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94141974567680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23044400 con 0x559f22ffd400 2024-09-13T23:56:57.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.902+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94141974567680] v33'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f22ffd400 2024-09-13T23:56:57.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.902+0000 7f1dc85abf40 20 remove_watcher() i=0 2024-09-13T23:56:57.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.902+0000 7f1dc85abf40 2 removed watcher, disabling cache 2024-09-13T23:56:57.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.902+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94141974568832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23044800 con 0x559f22ffd000 2024-09-13T23:56:57.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.902+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94141974568832] v33'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f22ffd000 2024-09-13T23:56:57.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.902+0000 7f1dc85abf40 20 remove_watcher() i=1 2024-09-13T23:56:57.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.902+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94141974569984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23044c00 con 0x559f22ffd400 2024-09-13T23:56:57.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.906+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94141974569984] v33'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f22ffd400 2024-09-13T23:56:57.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.906+0000 7f1dc85abf40 20 remove_watcher() i=2 2024-09-13T23:56:57.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.906+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94141974571136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23045000 con 0x559f230bc000 2024-09-13T23:56:57.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.910+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94141974571136] v33'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f230bc000 2024-09-13T23:56:57.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.910+0000 7f1dc85abf40 20 remove_watcher() i=3 2024-09-13T23:56:57.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.910+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94141974572288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23045400 con 0x559f22ffd400 2024-09-13T23:56:57.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.914+0000 7f1dc6d64700 1 -- 172.21.15.173:0/2736303850 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94141974572288] v33'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559f23067200 con 0x559f22ffd400 2024-09-13T23:56:57.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.914+0000 7f1dc85abf40 20 remove_watcher() i=4 2024-09-13T23:56:57.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.914+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94141974573440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23045800 con 0x559f22ffdc00 2024-09-13T23:56:57.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.914+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94141974573440] v33'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559f23067440 con 0x559f22ffdc00 2024-09-13T23:56:57.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.914+0000 7f1dc85abf40 20 remove_watcher() i=5 2024-09-13T23:56:57.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.914+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94141974574592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23045c00 con 0x559f22ffdc00 2024-09-13T23:56:57.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.918+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94141974574592] v33'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559f23067440 con 0x559f22ffdc00 2024-09-13T23:56:57.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.918+0000 7f1dc85abf40 20 remove_watcher() i=6 2024-09-13T23:56:57.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.918+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94141974575744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559f23045800 con 0x559f230bc000 2024-09-13T23:56:57.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.918+0000 7f1dc7565700 1 -- 172.21.15.173:0/2736303850 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94141974575744] v33'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559f23066b40 con 0x559f230bc000 2024-09-13T23:56:57.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.918+0000 7f1dc85abf40 20 remove_watcher() i=7 2024-09-13T23:56:57.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.918+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559f22ffd400 msgr2=0x559f22f48100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.918+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/2736303850 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559f22ffd400 0x559f22f48100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.918+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559f22ffd000 msgr2=0x559f22f47b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.918+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/2736303850 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559f22ffd000 0x559f22f47b80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.918+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559f230bc000 msgr2=0x559f22f48c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.918+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/2736303850 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559f230bc000 0x559f22f48c00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.918+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559f22ffdc00 msgr2=0x559f22f48680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.918+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/2736303850 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559f22ffdc00 0x559f22f48680 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559f22ffcc00 msgr2=0x559f22f47600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/2736303850 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559f22ffcc00 0x559f22f47600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x559f22f41f80 tx=0x559f22fbf920 comp rx=0 tx=0).stop 2024-09-13T23:56:57.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61800 msgr2=0x559f22f46b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/2736303850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61800 0x559f22f46b00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x559f22f848a0 tx=0x559f22fbe5a0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 reap_dead start 2024-09-13T23:56:57.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc6563700 1 -- 172.21.15.173:0/2736303850 reap_dead start 2024-09-13T23:56:57.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 shutdown_connections 2024-09-13T23:56:57.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 >> 172.21.15.173:0/2736303850 conn(0x559f22c61400 msgr2=0x559f22d61800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 shutdown_connections 2024-09-13T23:56:57.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 -- 172.21.15.173:0/2736303850 wait complete. 2024-09-13T23:56:57.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559f230bd800 msgr2=0x559f22f49700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/4112239524 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559f230bd800 0x559f22f49700 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559f230c2400 msgr2=0x559f2315d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/4112239524 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559f230c2400 0x559f2315d080 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559f230bc800 msgr2=0x559f2315c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/4112239524 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559f230bc800 0x559f2315c580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559f230c3800 msgr2=0x559f2315cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/4112239524 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559f230c3800 0x559f2315cb00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559f22ffd800 msgr2=0x559f2315c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/4112239524 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559f22ffd800 0x559f2315c000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x559f23073560 tx=0x559f23122660 comp rx=0 tx=0).stop 2024-09-13T23:56:57.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f230bc400 msgr2=0x559f22f49180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc6d64700 1 -- 172.21.15.173:0/4112239524 reap_dead start 2024-09-13T23:56:57.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/4112239524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f230bc400 0x559f22f49180 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x559f230d2210 tx=0x559f22fbfa40 comp rx=0 tx=0).stop 2024-09-13T23:56:57.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 shutdown_connections 2024-09-13T23:56:57.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/4112239524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f230bc400 0x559f22f49180 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 >> 172.21.15.173:0/4112239524 conn(0x559f230c2800 msgr2=0x559f22d62000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 shutdown_connections 2024-09-13T23:56:57.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 -- 172.21.15.173:0/4112239524 wait complete. 2024-09-13T23:56:57.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 -- 172.21.15.173:0/3993193546 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559f22ffc000 msgr2=0x559f22f47080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/3993193546 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559f22ffc000 0x559f22f47080 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x559f22f85500 tx=0x559f22fbe780 comp rx=0 tx=0).stop 2024-09-13T23:56:57.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 -- 172.21.15.173:0/3993193546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61000 msgr2=0x559f22f46580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/3993193546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61000 0x559f22f46580 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x559f22dbde90 tx=0x559f22d65920 comp rx=0 tx=0).stop 2024-09-13T23:56:57.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 -- 172.21.15.173:0/3993193546 shutdown_connections 2024-09-13T23:56:57.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/3993193546 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559f22ffc000 0x559f22f47080 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 --2- 172.21.15.173:0/3993193546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559f22c61000 0x559f22f46580 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 -- 172.21.15.173:0/3993193546 >> 172.21.15.173:0/3993193546 conn(0x559f22c60c00 msgr2=0x559f22d61000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 -- 172.21.15.173:0/3993193546 shutdown_connections 2024-09-13T23:56:57.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.922+0000 7f1dc85abf40 1 -- 172.21.15.173:0/3993193546 wait complete. 2024-09-13T23:56:57.932 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T23:56:57.933 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-13T23:56:57.933 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-13T23:56:57.933 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-13T23:56:57.975 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:56:57.975 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:56:57.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.970+0000 7fc5ae318f40 1 Processor -- start 2024-09-13T23:56:57.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.970+0000 7fc5ae318f40 1 -- start start 2024-09-13T23:56:57.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.970+0000 7fc5ae318f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x560ee8d75400 0x560ee905a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.970+0000 7fc5ae318f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560ee8e39500 con 0x560ee8d75000 2024-09-13T23:56:57.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.970+0000 7fc5ae318f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x560ee8e02a00 con 0x560ee8d75400 2024-09-13T23:56:57.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.970+0000 7fc5ac2d0700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x560ee8d75400 0x560ee905a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.970+0000 7fc5ac2d0700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x560ee8d75400 0x560ee905a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58060/0 (socket says 172.21.15.173:58060) 2024-09-13T23:56:57.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.970+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2362257391 learned_addr learned my addr 172.21.15.173:0/2362257391 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.970+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2362257391 >> v1:172.21.15.87:6789/0 conn(0x560ee8d75000 legacy=0x560ee8e74800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.970+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2362257391 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ee8d87d40 con 0x560ee8d75400 2024-09-13T23:56:57.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.974+0000 7fc5ac2d0700 1 --2- 172.21.15.173:0/2362257391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75400 0x560ee905a580 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x560ee9055920 tx=0x560ee8e79920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f392519848106b90 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.974+0000 7fc5abacf700 1 -- 172.21.15.173:0/2362257391 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560ee8e194a0 con 0x560ee8d75400 2024-09-13T23:56:57.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.974+0000 7fc5abacf700 1 -- 172.21.15.173:0/2362257391 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560ee8e39800 con 0x560ee8d75400 2024-09-13T23:56:57.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.974+0000 7fc5abacf700 1 -- 172.21.15.173:0/2362257391 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560ee8e19600 con 0x560ee8d75400 2024-09-13T23:56:57.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.974+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2362257391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75400 msgr2=0x560ee905a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.974+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/2362257391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75400 0x560ee905a580 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x560ee9055920 tx=0x560ee8e79920 comp rx=0 tx=0).stop 2024-09-13T23:56:57.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.974+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2362257391 shutdown_connections 2024-09-13T23:56:57.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.974+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/2362257391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75400 0x560ee905a580 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.974+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2362257391 >> 172.21.15.173:0/2362257391 conn(0x560ee8d74c00 msgr2=0x560ee8e74000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.974+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2362257391 shutdown_connections 2024-09-13T23:56:57.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.974+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2362257391 wait complete. 2024-09-13T23:56:57.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.974+0000 7fc5ae318f40 1 Processor -- start 2024-09-13T23:56:57.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.974+0000 7fc5ae318f40 1 -- start start 2024-09-13T23:56:57.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.974+0000 7fc5ae318f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75000 0x560ee905a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.974+0000 7fc5ae318f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ee8e02500 con 0x560ee8d75000 2024-09-13T23:56:57.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.974+0000 7fc5acad1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75000 0x560ee905a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.974+0000 7fc5acad1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75000 0x560ee905a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58062/0 (socket says 172.21.15.173:58062) 2024-09-13T23:56:57.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.974+0000 7fc5acad1700 1 -- 172.21.15.173:0/3126047022 learned_addr learned my addr 172.21.15.173:0/3126047022 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.974+0000 7fc5acad1700 1 -- 172.21.15.173:0/3126047022 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ee8d87ba0 con 0x560ee8d75000 2024-09-13T23:56:57.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.974+0000 7fc5acad1700 1 --2- 172.21.15.173:0/3126047022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75000 0x560ee905a580 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x560ee8ed1e90 tx=0x560ee8e79b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696ef3b940cbd2de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.978+0000 7fc5ab2ce700 1 -- 172.21.15.173:0/3126047022 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560ee8e194a0 con 0x560ee8d75000 2024-09-13T23:56:57.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.978+0000 7fc5ab2ce700 1 -- 172.21.15.173:0/3126047022 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560ee8e39b00 con 0x560ee8d75000 2024-09-13T23:56:57.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.978+0000 7fc5ab2ce700 1 -- 172.21.15.173:0/3126047022 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560ee8e19600 con 0x560ee8d75000 2024-09-13T23:56:57.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.978+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3126047022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75000 msgr2=0x560ee905a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.978+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/3126047022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75000 0x560ee905a580 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x560ee8ed1e90 tx=0x560ee8e79b60 comp rx=0 tx=0).stop 2024-09-13T23:56:57.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.978+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3126047022 shutdown_connections 2024-09-13T23:56:57.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.978+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/3126047022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75000 0x560ee905a580 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.978+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3126047022 >> 172.21.15.173:0/3126047022 conn(0x560ee8d74c00 msgr2=0x560ee8e75000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.978+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3126047022 shutdown_connections 2024-09-13T23:56:57.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.978+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3126047022 wait complete. 2024-09-13T23:56:57.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.978+0000 7fc5ae318f40 1 Processor -- start 2024-09-13T23:56:57.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.978+0000 7fc5ae318f40 1 -- start start 2024-09-13T23:56:57.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.978+0000 7fc5ae318f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75400 0x560ee905ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.978+0000 7fc5ae318f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ee8e023c0 con 0x560ee8d75400 2024-09-13T23:56:57.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.978+0000 7fc5acad1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75400 0x560ee905ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.978+0000 7fc5acad1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75400 0x560ee905ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58068/0 (socket says 172.21.15.173:58068) 2024-09-13T23:56:57.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.978+0000 7fc5acad1700 1 -- 172.21.15.173:0/2502782607 learned_addr learned my addr 172.21.15.173:0/2502782607 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.978+0000 7fc5acad1700 1 -- 172.21.15.173:0/2502782607 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ee8d87a00 con 0x560ee8d75400 2024-09-13T23:56:57.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.978+0000 7fc5acad1700 1 --2- 172.21.15.173:0/2502782607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75400 0x560ee905ab00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x560ee8ed1f80 tx=0x560ee8e79a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.982+0000 7fc5a9acb700 1 -- 172.21.15.173:0/2502782607 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560ee8e198c0 con 0x560ee8d75400 2024-09-13T23:56:57.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.982+0000 7fc5a9acb700 1 -- 172.21.15.173:0/2502782607 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560ee8e39c80 con 0x560ee8d75400 2024-09-13T23:56:57.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.982+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2502782607 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560ee8d87860 con 0x560ee8d75400 2024-09-13T23:56:57.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.982+0000 7fc5a9acb700 1 -- 172.21.15.173:0/2502782607 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560ee8e194a0 con 0x560ee8d75400 2024-09-13T23:56:57.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.982+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2502782607 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560ee8d876c0 con 0x560ee8d75400 2024-09-13T23:56:57.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.986+0000 7fc5ae318f40 1 Processor -- start 2024-09-13T23:56:57.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.986+0000 7fc5ae318f40 1 -- start start 2024-09-13T23:56:57.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.986+0000 7fc5ae318f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75c00 0x560ee905b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.986+0000 7fc5ae318f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ee8d9a640 con 0x560ee8d75c00 2024-09-13T23:56:57.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.986+0000 7fc5a9acb700 1 -- 172.21.15.173:0/2502782607 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x560ee8e6eb00 con 0x560ee8d75400 2024-09-13T23:56:57.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.986+0000 7fc5ad2d2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75c00 0x560ee905b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.986+0000 7fc5ad2d2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75c00 0x560ee905b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58078/0 (socket says 172.21.15.173:58078) 2024-09-13T23:56:57.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.986+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/1654445882 learned_addr learned my addr 172.21.15.173:0/1654445882 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.986+0000 7fc5a9acb700 1 --2- 172.21.15.173:0/2502782607 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560ee911e000 0x560ee905c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.986+0000 7fc5a9acb700 1 -- 172.21.15.173:0/2502782607 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x560ee8ddb180 con 0x560ee8d75400 2024-09-13T23:56:57.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.986+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/1654445882 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ee8d86000 con 0x560ee8d75c00 2024-09-13T23:56:57.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.986+0000 7fc5acad1700 1 --2- 172.21.15.173:0/2502782607 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560ee911e000 0x560ee905c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.986+0000 7fc5ad2d2700 1 --2- 172.21.15.173:0/1654445882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75c00 0x560ee905b080 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x560ee9bedce0 tx=0x560ee8e79f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb86eb3adf98eed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.986+0000 7fc5a72c6700 1 -- 172.21.15.173:0/1654445882 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560ee8e198c0 con 0x560ee8d75c00 2024-09-13T23:56:57.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.986+0000 7fc5a72c6700 1 -- 172.21.15.173:0/1654445882 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560ee910c000 con 0x560ee8d75c00 2024-09-13T23:56:57.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.986+0000 7fc5a72c6700 1 -- 172.21.15.173:0/1654445882 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560ee8e194a0 con 0x560ee8d75c00 2024-09-13T23:56:57.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.990+0000 7fc5ae318f40 1 -- 172.21.15.173:0/1654445882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75c00 msgr2=0x560ee905b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:57.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.990+0000 7fc5acad1700 1 --2- 172.21.15.173:0/2502782607 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560ee911e000 0x560ee905c100 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x560ee9bed710 tx=0x560ee90dc240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.990+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/1654445882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75c00 0x560ee905b080 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x560ee9bedce0 tx=0x560ee8e79f20 comp rx=0 tx=0).stop 2024-09-13T23:56:57.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.990+0000 7fc5ae318f40 1 -- 172.21.15.173:0/1654445882 shutdown_connections 2024-09-13T23:56:57.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.990+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/1654445882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75c00 0x560ee905b080 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:57.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.990+0000 7fc5ae318f40 1 -- 172.21.15.173:0/1654445882 >> 172.21.15.173:0/1654445882 conn(0x560ee8d75800 msgr2=0x560ee8e75800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:57.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.990+0000 7fc5ae318f40 1 -- 172.21.15.173:0/1654445882 shutdown_connections 2024-09-13T23:56:57.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.990+0000 7fc5ae318f40 1 -- 172.21.15.173:0/1654445882 wait complete. 2024-09-13T23:56:57.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.990+0000 7fc5ae318f40 1 Processor -- start 2024-09-13T23:56:57.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.990+0000 7fc5ae318f40 1 -- start start 2024-09-13T23:56:57.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.990+0000 7fc5ae318f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75c00 0x560ee905b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:57.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.990+0000 7fc5ae318f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ee8d9a8c0 con 0x560ee8d75c00 2024-09-13T23:56:57.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.990+0000 7fc5ad2d2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75c00 0x560ee905b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:57.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.990+0000 7fc5ad2d2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75c00 0x560ee905b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58080/0 (socket says 172.21.15.173:58080) 2024-09-13T23:56:57.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.990+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 learned_addr learned my addr 172.21.15.173:0/2505689732 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:57.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.990+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ee8d86ea0 con 0x560ee8d75c00 2024-09-13T23:56:57.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.990+0000 7fc5ad2d2700 1 --2- 172.21.15.173:0/2505689732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75c00 0x560ee905b080 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x560ee9bec210 tx=0x560ee90dc900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:57.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.990+0000 7fc5a5ac3700 1 -- 172.21.15.173:0/2505689732 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560ee8e19b80 con 0x560ee8d75c00 2024-09-13T23:56:57.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.990+0000 7fc5a5ac3700 1 -- 172.21.15.173:0/2505689732 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560ee910c180 con 0x560ee8d75c00 2024-09-13T23:56:57.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.990+0000 7fc5a5ac3700 1 -- 172.21.15.173:0/2505689732 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560ee8e198c0 con 0x560ee8d75c00 2024-09-13T23:56:57.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.990+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560ee8d86820 con 0x560ee8d75c00 2024-09-13T23:56:57.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.994+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560ee8d869c0 con 0x560ee8d75c00 2024-09-13T23:56:58.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.994+0000 7fc5a5ac3700 1 -- 172.21.15.173:0/2505689732 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x560ee8e6f080 con 0x560ee8d75c00 2024-09-13T23:56:58.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.994+0000 7fc5ae318f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.994+0000 7fc5a5ac3700 1 --2- 172.21.15.173:0/2505689732 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560ee911ec00 0x560ee905c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.994+0000 7fc5a5ac3700 1 -- 172.21.15.173:0/2505689732 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x560ee8ddb340 con 0x560ee8d75c00 2024-09-13T23:56:58.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.994+0000 7fc5ac2d0700 1 --2- 172.21.15.173:0/2505689732 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560ee911ec00 0x560ee905c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.994+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/2505689732 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560ee911f000 0x560ee905b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.994+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f400 con 0x560ee911f000 2024-09-13T23:56:58.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.994+0000 7fc5ad2d2700 1 --2- 172.21.15.173:0/2505689732 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560ee911f000 0x560ee905b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.994+0000 7fc5ac2d0700 1 --2- 172.21.15.173:0/2505689732 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560ee911ec00 0x560ee905c680 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x560ee9055920 tx=0x560ee8e79800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.998+0000 7fc5ad2d2700 1 --2- 172.21.15.173:0/2505689732 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560ee911f000 0x560ee905b600 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.998+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f000 2024-09-13T23:56:58.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.998+0000 7fc5ae318f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.998+0000 7fc5ae318f40 20 realm 2024-09-13T23:56:58.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.998+0000 7fc5ae318f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.998+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911f000 2024-09-13T23:56:58.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.998+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f000 2024-09-13T23:56:58.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.998+0000 7fc5ae318f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.998+0000 7fc5ae318f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:56:58.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.998+0000 7fc5ae318f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.998+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911fc00 con 0x560ee911f000 2024-09-13T23:56:58.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.998+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f000 2024-09-13T23:56:58.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.998+0000 7fc5ae318f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.998+0000 7fc5ae318f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.998+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/2505689732 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560ee911f400 0x560ee905bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.998+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911f400 2024-09-13T23:56:58.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.998+0000 7fc5acad1700 1 --2- 172.21.15.173:0/2505689732 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560ee911f400 0x560ee905bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.998+0000 7fc5acad1700 1 --2- 172.21.15.173:0/2505689732 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560ee911f400 0x560ee905bb80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.998+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x560ee91c9200 con 0x560ee911f400 2024-09-13T23:56:58.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.998+0000 7fc5ae318f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:58.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.998+0000 7fc5ae318f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.998+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/2505689732 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560ee911fc00 0x560ee905cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.998+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee91da000 con 0x560ee911fc00 2024-09-13T23:56:58.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:57.998+0000 7fc5ac2d0700 1 --2- 172.21.15.173:0/2505689732 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560ee911fc00 0x560ee905cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.002+0000 7fc5ac2d0700 1 --2- 172.21.15.173:0/2505689732 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560ee911fc00 0x560ee905cc00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.002+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2505689732 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x560ee91c9440 con 0x560ee911fc00 2024-09-13T23:56:58.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.002+0000 7fc5ae318f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:56:58.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.002+0000 7fc5ae318f40 20 searching for the correct realm 2024-09-13T23:56:58.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.002+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee91da400 con 0x560ee911fc00 2024-09-13T23:56:58.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.002+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2505689732 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x560ee91c9440 con 0x560ee911fc00 2024-09-13T23:56:58.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.002+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee91da000 con 0x560ee911f400 2024-09-13T23:56:58.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.002+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c9200 con 0x560ee911f400 2024-09-13T23:56:58.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.002+0000 7fc5acad1700 1 --2- 172.21.15.173:0/2505689732 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560ee91da000 0x560ee905a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.002+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee91da000 2024-09-13T23:56:58.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.002+0000 7fc5ad2d2700 1 --2- 172.21.15.173:0/2505689732 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560ee91da000 0x560ee905a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.002+0000 7fc5ad2d2700 1 --2- 172.21.15.173:0/2505689732 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560ee91da000 0x560ee905a580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.002+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee91da000 2024-09-13T23:56:58.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.002+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911f000 2024-09-13T23:56:58.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.006+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f000 2024-09-13T23:56:58.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.006+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911f000 2024-09-13T23:56:58.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.006+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f000 2024-09-13T23:56:58.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.006+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911fc00 2024-09-13T23:56:58.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.006+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2505689732 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c9440 con 0x560ee911fc00 2024-09-13T23:56:58.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.006+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911f000 2024-09-13T23:56:58.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.006+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f000 2024-09-13T23:56:58.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.006+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911f400 2024-09-13T23:56:58.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.006+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c9200 con 0x560ee911f400 2024-09-13T23:56:58.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.006+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911f400 2024-09-13T23:56:58.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.006+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c9200 con 0x560ee911f400 2024-09-13T23:56:58.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.006+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911f000 2024-09-13T23:56:58.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.010+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f000 2024-09-13T23:56:58.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.010+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee91da000 2024-09-13T23:56:58.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.010+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee91da000 2024-09-13T23:56:58.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.010+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911f000 2024-09-13T23:56:58.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.010+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f000 2024-09-13T23:56:58.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.010+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee91da000 2024-09-13T23:56:58.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.010+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee91da000 2024-09-13T23:56:58.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.010+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911f400 2024-09-13T23:56:58.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.010+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c9200 con 0x560ee911f400 2024-09-13T23:56:58.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.010+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911fc00 2024-09-13T23:56:58.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.010+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2505689732 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c9440 con 0x560ee911fc00 2024-09-13T23:56:58.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.010+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911f000 2024-09-13T23:56:58.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.010+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f000 2024-09-13T23:56:58.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.010+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911f400 2024-09-13T23:56:58.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.014+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c9200 con 0x560ee911f400 2024-09-13T23:56:58.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.014+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911fc00 2024-09-13T23:56:58.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.014+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2505689732 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c9440 con 0x560ee911fc00 2024-09-13T23:56:58.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.014+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911f000 2024-09-13T23:56:58.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.014+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f000 2024-09-13T23:56:58.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.014+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911f000 2024-09-13T23:56:58.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.014+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f000 2024-09-13T23:56:58.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.014+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911f000 2024-09-13T23:56:58.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.014+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f000 2024-09-13T23:56:58.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.014+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911fc00 2024-09-13T23:56:58.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.014+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2505689732 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c9440 con 0x560ee911fc00 2024-09-13T23:56:58.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.014+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee91da000 2024-09-13T23:56:58.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.018+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee91da000 2024-09-13T23:56:58.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.018+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911f000 2024-09-13T23:56:58.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.018+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f000 2024-09-13T23:56:58.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.018+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee91da000 2024-09-13T23:56:58.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.018+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee91da000 2024-09-13T23:56:58.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.018+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911fc00 2024-09-13T23:56:58.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.018+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2505689732 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c9440 con 0x560ee911fc00 2024-09-13T23:56:58.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.018+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee91da000 2024-09-13T23:56:58.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.018+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee91da000 2024-09-13T23:56:58.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.018+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911f400 2024-09-13T23:56:58.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.018+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c9200 con 0x560ee911f400 2024-09-13T23:56:58.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.018+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911f400 2024-09-13T23:56:58.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.018+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c9200 con 0x560ee911f400 2024-09-13T23:56:58.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.018+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911fc00 2024-09-13T23:56:58.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.022+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2505689732 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c9440 con 0x560ee911fc00 2024-09-13T23:56:58.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.022+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911f400 2024-09-13T23:56:58.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.022+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x560ee91c9200 con 0x560ee911f400 2024-09-13T23:56:58.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.022+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee911f400 2024-09-13T23:56:58.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.022+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560ee91c9200 con 0x560ee911f400 2024-09-13T23:56:58.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.022+0000 7fc5ae318f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:56:58.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.022+0000 7fc5ae318f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:56:58.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.022+0000 7fc5ae318f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:56:58.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.022+0000 7fc5ae318f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:56:58.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.022+0000 7fc5ae318f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.022+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee91da800 con 0x560ee911f000 2024-09-13T23:56:58.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.022+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f000 2024-09-13T23:56:58.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.022+0000 7fc5ae318f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.022+0000 7fc5ae318f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.022+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee91dac00 con 0x560ee911f400 2024-09-13T23:56:58.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.022+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x560ee91c9200 con 0x560ee911f400 2024-09-13T23:56:58.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.022+0000 7fc5ae318f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:58.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.022+0000 7fc5ae318f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.022+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee91db000 con 0x560ee911f000 2024-09-13T23:56:58.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.026+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f000 2024-09-13T23:56:58.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.026+0000 7fc5ae318f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:56:58.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.026+0000 7fc5ae318f40 20 zone default found 2024-09-13T23:56:58.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.026+0000 7fc5ae318f40 4 Realm: () 2024-09-13T23:56:58.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.026+0000 7fc5ae318f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:56:58.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.026+0000 7fc5ae318f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:56:58.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.026+0000 7fc5ae318f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:56:58.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.026+0000 7fc5ae318f40 20 zonegroup default 2024-09-13T23:56:58.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.026+0000 7fc5ae318f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.026+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee91db400 con 0x560ee91da000 2024-09-13T23:56:58.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.026+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee91da000 2024-09-13T23:56:58.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.026+0000 7fc5ae318f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.026+0000 7fc5ae318f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.026+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee91db800 con 0x560ee911fc00 2024-09-13T23:56:58.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.026+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2505689732 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x560ee91c9440 con 0x560ee911fc00 2024-09-13T23:56:58.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.026+0000 7fc5ae318f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.026+0000 7fc5ae318f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.026+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee91dbc00 con 0x560ee911fc00 2024-09-13T23:56:58.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.026+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2505689732 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x560ee91c9440 con 0x560ee911fc00 2024-09-13T23:56:58.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.026+0000 7fc5ae318f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.026+0000 7fc5ae318f40 20 started sync module instance, tier type = 2024-09-13T23:56:58.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.026+0000 7fc5ae318f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:56:58.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.026+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b2000 con 0x560ee911f400 2024-09-13T23:56:58.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.030+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee911f400 2024-09-13T23:56:58.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.030+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94622038956800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b2400 con 0x560ee911f400 2024-09-13T23:56:58.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.030+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b2800 con 0x560ee911f000 2024-09-13T23:56:58.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.034+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f000 2024-09-13T23:56:58.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.034+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94622038957952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b2c00 con 0x560ee911f000 2024-09-13T23:56:58.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.034+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b3000 con 0x560ee911f400 2024-09-13T23:56:58.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.034+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94622038956800] v33'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee911f400 2024-09-13T23:56:58.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.034+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94622038957952] v33'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f000 2024-09-13T23:56:58.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.034+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee911f400 2024-09-13T23:56:58.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.038+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94622038959104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b3400 con 0x560ee911f400 2024-09-13T23:56:58.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.038+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b3800 con 0x560ee91da000 2024-09-13T23:56:58.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.038+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee91da000 2024-09-13T23:56:58.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.038+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94622038960256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b3c00 con 0x560ee91da000 2024-09-13T23:56:58.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.038+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b2800 con 0x560ee911f400 2024-09-13T23:56:58.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.038+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94622038959104] v33'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee911f400 2024-09-13T23:56:58.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.042+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94622038960256] v33'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee91da000 2024-09-13T23:56:58.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.042+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee911f400 2024-09-13T23:56:58.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.042+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94622038961408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b2000 con 0x560ee911f400 2024-09-13T23:56:58.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.042+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b2400 con 0x560ee911fc00 2024-09-13T23:56:58.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.042+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2505689732 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560ee91c9440 con 0x560ee911fc00 2024-09-13T23:56:58.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.042+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94622038962560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee91da800 con 0x560ee911fc00 2024-09-13T23:56:58.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.042+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee91db000 con 0x560ee911fc00 2024-09-13T23:56:58.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.046+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94622038961408] v33'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee911f400 2024-09-13T23:56:58.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.050+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2505689732 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v33'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560ee91c9440 con 0x560ee911fc00 2024-09-13T23:56:58.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.050+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94622038963712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee91db400 con 0x560ee911fc00 2024-09-13T23:56:58.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.050+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee91dac00 con 0x560ee91da000 2024-09-13T23:56:58.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.050+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2505689732 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94622038962560] v33'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560ee91c9440 con 0x560ee911fc00 2024-09-13T23:56:58.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.054+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee91da000 2024-09-13T23:56:58.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.054+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94622038964864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee911f800 con 0x560ee91da000 2024-09-13T23:56:58.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.054+0000 7fc5ae318f40 20 add_watcher() i=0 2024-09-13T23:56:58.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.054+0000 7fc5ae318f40 20 add_watcher() i=1 2024-09-13T23:56:58.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.054+0000 7fc5ae318f40 20 add_watcher() i=2 2024-09-13T23:56:58.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.054+0000 7fc5ae318f40 20 add_watcher() i=3 2024-09-13T23:56:58.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.054+0000 7fc5ae318f40 20 add_watcher() i=4 2024-09-13T23:56:58.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.054+0000 7fc5ae318f40 20 add_watcher() i=5 2024-09-13T23:56:58.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.054+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2505689732 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94622038963712] v33'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560ee91c9440 con 0x560ee911fc00 2024-09-13T23:56:58.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.054+0000 7fc5ae318f40 20 add_watcher() i=6 2024-09-13T23:56:58.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.058+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94622038964864] v33'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee91da000 2024-09-13T23:56:58.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.058+0000 7fc5ae318f40 20 add_watcher() i=7 2024-09-13T23:56:58.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.058+0000 7fc5ae318f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:56:58.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.058+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b2c00 con 0x560ee911f000 2024-09-13T23:56:58.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.062+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f000 2024-09-13T23:56:58.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.062+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94622040621056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b3800 con 0x560ee911f000 2024-09-13T23:56:58.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.062+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94622040621056] v33'41 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f000 2024-09-13T23:56:58.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.062+0000 7fc593a9f700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:58.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.062+0000 7fc5ae318f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:56:58.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.062+0000 7fc5ae318f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:56:58.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.062+0000 7fc5ae318f40 1 Processor -- start 2024-09-13T23:56:58.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.062+0000 7fc5ae318f40 1 -- start start 2024-09-13T23:56:58.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.062+0000 7fc5ae318f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee90b2400 0x560ee905d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.062+0000 7fc5ae318f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ee8e023c0 con 0x560ee90b2400 2024-09-13T23:56:58.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.066+0000 7fc5ac2d0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee90b2400 0x560ee905d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.066+0000 7fc5ac2d0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee90b2400 0x560ee905d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58090/0 (socket says 172.21.15.173:58090) 2024-09-13T23:56:58.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.066+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2055115908 learned_addr learned my addr 172.21.15.173:0/2055115908 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.066+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2055115908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ee8d86b60 con 0x560ee90b2400 2024-09-13T23:56:58.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.066+0000 7fc5ac2d0700 1 --2- 172.21.15.173:0/2055115908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee90b2400 0x560ee905d180 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x560ee91f00f0 tx=0x560ee8e79980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad95c73dd266f80 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.066+0000 7fc59329e700 1 -- 172.21.15.173:0/2055115908 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560ee8e19760 con 0x560ee90b2400 2024-09-13T23:56:58.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.066+0000 7fc59329e700 1 -- 172.21.15.173:0/2055115908 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560ee910c600 con 0x560ee90b2400 2024-09-13T23:56:58.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.066+0000 7fc59329e700 1 -- 172.21.15.173:0/2055115908 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560ee91f8000 con 0x560ee90b2400 2024-09-13T23:56:58.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.066+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2055115908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee90b2400 msgr2=0x560ee905d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.066+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/2055115908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee90b2400 0x560ee905d180 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x560ee91f00f0 tx=0x560ee8e79980 comp rx=0 tx=0).stop 2024-09-13T23:56:58.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.066+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2055115908 shutdown_connections 2024-09-13T23:56:58.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.066+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/2055115908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee90b2400 0x560ee905d180 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.066+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2055115908 >> 172.21.15.173:0/2055115908 conn(0x560ee90b3c00 msgr2=0x560ee8e76000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.066+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2055115908 shutdown_connections 2024-09-13T23:56:58.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.066+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2055115908 wait complete. 2024-09-13T23:56:58.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.066+0000 7fc5ae318f40 1 Processor -- start 2024-09-13T23:56:58.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.066+0000 7fc5ae318f40 1 -- start start 2024-09-13T23:56:58.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.066+0000 7fc5ae318f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee90b2400 0x560ee905d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.066+0000 7fc5ae318f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ee8e02500 con 0x560ee90b2400 2024-09-13T23:56:58.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.070+0000 7fc5ac2d0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee90b2400 0x560ee905d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.070+0000 7fc5ac2d0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee90b2400 0x560ee905d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58104/0 (socket says 172.21.15.173:58104) 2024-09-13T23:56:58.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.070+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/3222985816 learned_addr learned my addr 172.21.15.173:0/3222985816 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.070+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ee8d86d00 con 0x560ee90b2400 2024-09-13T23:56:58.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.070+0000 7fc5ac2d0700 1 --2- 172.21.15.173:0/3222985816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee90b2400 0x560ee905d180 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x560ee91f0390 tx=0x560ee90ddc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.070+0000 7fc591a9b700 1 -- 172.21.15.173:0/3222985816 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560ee91f8160 con 0x560ee90b2400 2024-09-13T23:56:58.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.070+0000 7fc591a9b700 1 -- 172.21.15.173:0/3222985816 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560ee910c300 con 0x560ee90b2400 2024-09-13T23:56:58.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.070+0000 7fc591a9b700 1 -- 172.21.15.173:0/3222985816 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560ee91f82c0 con 0x560ee90b2400 2024-09-13T23:56:58.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.070+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560ee8d86340 con 0x560ee90b2400 2024-09-13T23:56:58.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.070+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560ee8d87d40 con 0x560ee90b2400 2024-09-13T23:56:58.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.070+0000 7fc591a9b700 1 -- 172.21.15.173:0/3222985816 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x560ee8e6fb80 con 0x560ee90b2400 2024-09-13T23:56:58.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.074+0000 7fc591a9b700 1 --2- 172.21.15.173:0/3222985816 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560ee926c000 0x560ee9272000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.074+0000 7fc591a9b700 1 -- 172.21.15.173:0/3222985816 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x560ee8ddb500 con 0x560ee90b2400 2024-09-13T23:56:58.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.074+0000 7fc5ad2d2700 1 --2- 172.21.15.173:0/3222985816 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560ee926c000 0x560ee9272000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.074+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/3222985816 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560ee91dac00 0x560ee905d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.074+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee91da400 con 0x560ee91dac00 2024-09-13T23:56:58.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.074+0000 7fc5acad1700 1 --2- 172.21.15.173:0/3222985816 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560ee91dac00 0x560ee905d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.074+0000 7fc5ad2d2700 1 --2- 172.21.15.173:0/3222985816 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560ee926c000 0x560ee9272000 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x560ee9173b90 tx=0x560ee9236ae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.074+0000 7fc5acad1700 1 --2- 172.21.15.173:0/3222985816 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560ee91dac00 0x560ee905d700 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.078+0000 7fc5acad1700 1 -- 172.21.15.173:0/3222985816 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee91dac00 2024-09-13T23:56:58.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.078+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/3222985816 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560ee91db800 0x560ee9272580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.078+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee91dbc00 con 0x560ee91db800 2024-09-13T23:56:58.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.078+0000 7fc5ac2d0700 1 --2- 172.21.15.173:0/3222985816 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560ee91db800 0x560ee9272580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.078+0000 7fc5ac2d0700 1 --2- 172.21.15.173:0/3222985816 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560ee91db800 0x560ee9272580 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.082+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/3222985816 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v33'13 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x560ee91c9440 con 0x560ee91db800 2024-09-13T23:56:58.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.082+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/3222985816 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560ee911f800 0x560ee9272b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.082+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee926c400 con 0x560ee911f800 2024-09-13T23:56:58.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.082+0000 7fc5ad2d2700 1 --2- 172.21.15.173:0/3222985816 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560ee911f800 0x560ee9272b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.082+0000 7fc5ad2d2700 1 --2- 172.21.15.173:0/3222985816 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560ee911f800 0x560ee9272b00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.082+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/3222985816 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v33'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f800 2024-09-13T23:56:58.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.082+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/3222985816 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560ee926c800 0x560ee9273080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.082+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee926cc00 con 0x560ee926c800 2024-09-13T23:56:58.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.086+0000 7fc5acad1700 1 --2- 172.21.15.173:0/3222985816 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560ee926c800 0x560ee9273080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.086+0000 7fc5acad1700 1 --2- 172.21.15.173:0/3222985816 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560ee926c800 0x560ee9273080 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.086+0000 7fc5acad1700 1 -- 172.21.15.173:0/3222985816 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v33'42 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee926c800 2024-09-13T23:56:58.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.086+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee926d000 con 0x560ee91dac00 2024-09-13T23:56:58.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.090+0000 7fc5acad1700 1 -- 172.21.15.173:0/3222985816 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v33'29 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee91dac00 2024-09-13T23:56:58.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.090+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee926d400 con 0x560ee911f800 2024-09-13T23:56:58.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.094+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/3222985816 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v33'19 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f800 2024-09-13T23:56:58.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.094+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee926d800 con 0x560ee91dac00 2024-09-13T23:56:58.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.094+0000 7fc5acad1700 1 -- 172.21.15.173:0/3222985816 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v33'15 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee91dac00 2024-09-13T23:56:58.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.094+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee926dc00 con 0x560ee926c800 2024-09-13T23:56:58.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.098+0000 7fc5acad1700 1 -- 172.21.15.173:0/3222985816 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v33'19 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee926c800 2024-09-13T23:56:58.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.098+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee91da400 con 0x560ee91dac00 2024-09-13T23:56:58.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.102+0000 7fc5acad1700 1 -- 172.21.15.173:0/3222985816 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v33'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee91dac00 2024-09-13T23:56:58.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.102+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b3000 con 0x560ee91dac00 2024-09-13T23:56:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.102+0000 7fc5acad1700 1 -- 172.21.15.173:0/3222985816 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee91dac00 2024-09-13T23:56:58.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.102+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b3400 con 0x560ee91dac00 2024-09-13T23:56:58.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.106+0000 7fc5acad1700 1 -- 172.21.15.173:0/3222985816 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v33'30 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee91dac00 2024-09-13T23:56:58.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.106+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b2800 con 0x560ee911f800 2024-09-13T23:56:58.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.110+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/3222985816 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f800 2024-09-13T23:56:58.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.110+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b2000 con 0x560ee91dac00 2024-09-13T23:56:58.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.110+0000 7fc5acad1700 1 -- 172.21.15.173:0/3222985816 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v33'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee91dac00 2024-09-13T23:56:58.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.110+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b3000 con 0x560ee926c800 2024-09-13T23:56:58.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.114+0000 7fc5acad1700 1 -- 172.21.15.173:0/3222985816 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v33'25 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee926c800 2024-09-13T23:56:58.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.114+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee91da400 con 0x560ee926c800 2024-09-13T23:56:58.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.118+0000 7fc5acad1700 1 -- 172.21.15.173:0/3222985816 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v33'43 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee926c800 2024-09-13T23:56:58.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.118+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee926cc00 con 0x560ee91dac00 2024-09-13T23:56:58.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.118+0000 7fc5acad1700 1 -- 172.21.15.173:0/3222985816 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v33'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee91dac00 2024-09-13T23:56:58.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.118+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee926d000 con 0x560ee91dac00 2024-09-13T23:56:58.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.122+0000 7fc5acad1700 1 -- 172.21.15.173:0/3222985816 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v33'31 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee91dac00 2024-09-13T23:56:58.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.122+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee926d800 con 0x560ee911f800 2024-09-13T23:56:58.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.126+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/3222985816 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v33'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f800 2024-09-13T23:56:58.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.126+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee926dc00 con 0x560ee91dac00 2024-09-13T23:56:58.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.130+0000 7fc5acad1700 1 -- 172.21.15.173:0/3222985816 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v33'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee91dac00 2024-09-13T23:56:58.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.130+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee926cc00 con 0x560ee926c800 2024-09-13T23:56:58.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.134+0000 7fc5acad1700 1 -- 172.21.15.173:0/3222985816 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v33'44 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee926c800 2024-09-13T23:56:58.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.134+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee926d000 con 0x560ee91dac00 2024-09-13T23:56:58.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.134+0000 7fc5acad1700 1 -- 172.21.15.173:0/3222985816 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v33'24 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee91dac00 2024-09-13T23:56:58.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.134+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee926dc00 con 0x560ee91dac00 2024-09-13T23:56:58.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.138+0000 7fc5acad1700 1 -- 172.21.15.173:0/3222985816 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v33'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee91dac00 2024-09-13T23:56:58.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.138+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee926c400 con 0x560ee911f800 2024-09-13T23:56:58.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.142+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/3222985816 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f800 2024-09-13T23:56:58.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.142+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee926d400 con 0x560ee91dac00 2024-09-13T23:56:58.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.142+0000 7fc5acad1700 1 -- 172.21.15.173:0/3222985816 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee91dac00 2024-09-13T23:56:58.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.142+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee926d800 con 0x560ee911f800 2024-09-13T23:56:58.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.146+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/3222985816 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v33'9 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f800 2024-09-13T23:56:58.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.146+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b3400 con 0x560ee911f800 2024-09-13T23:56:58.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.150+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/3222985816 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v33'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f800 2024-09-13T23:56:58.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.150+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b2000 con 0x560ee911f800 2024-09-13T23:56:58.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.150+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/3222985816 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f800 2024-09-13T23:56:58.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.150+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b3000 con 0x560ee91dac00 2024-09-13T23:56:58.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.154+0000 7fc5acad1700 1 -- 172.21.15.173:0/3222985816 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v33'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee91dac00 2024-09-13T23:56:58.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.154+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b2c00 con 0x560ee926c800 2024-09-13T23:56:58.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.158+0000 7fc5acad1700 1 -- 172.21.15.173:0/3222985816 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v33'20 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee926c800 2024-09-13T23:56:58.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.158+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b3800 con 0x560ee91dac00 2024-09-13T23:56:58.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.162+0000 7fc5acad1700 1 -- 172.21.15.173:0/3222985816 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v33'25 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee91dac00 2024-09-13T23:56:58.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.162+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b2800 con 0x560ee926c800 2024-09-13T23:56:58.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.162+0000 7fc5acad1700 1 -- 172.21.15.173:0/3222985816 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v33'26 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee926c800 2024-09-13T23:56:58.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.162+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee91da400 con 0x560ee91db800 2024-09-13T23:56:58.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.166+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/3222985816 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560ee91c9440 con 0x560ee91db800 2024-09-13T23:56:58.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.170+0000 7fc58f296700 20 reqs_thread_entry: start 2024-09-13T23:56:58.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.170+0000 7fc5ae318f40 20 init_complete bucket index max shards: 11 2024-09-13T23:56:58.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.170+0000 7fc5ae318f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:56:58.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.170+0000 7fc58d292700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:28 2024 2024-09-13T23:56:58.175 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:56:58.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.170+0000 7fc5ae318f40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:56:58.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.170+0000 7fc5ae318f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.170+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b3800 con 0x560ee911f000 2024-09-13T23:56:58.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.170+0000 7fc58ca70700 20 reqs_thread_entry: start 2024-09-13T23:56:58.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.170+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f000 2024-09-13T23:56:58.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.170+0000 7fc5ae318f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.170+0000 7fc5ae318f40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-13T23:56:58.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.170+0000 7fc5ae318f40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:56:58.177 INFO:teuthology.orchestra.run.smithi173.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T23:56:58.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.174+0000 7fc593a9f700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:58.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.174+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94622040621056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b2800 con 0x560ee911f000 2024-09-13T23:56:58.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.174+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94622040621056] v33'45 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f000 2024-09-13T23:56:58.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.174+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94622038956800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee926cc00 con 0x560ee911f400 2024-09-13T23:56:58.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.178+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94622038956800] v33'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee911f400 2024-09-13T23:56:58.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.178+0000 7fc5ae318f40 20 remove_watcher() i=0 2024-09-13T23:56:58.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.178+0000 7fc5ae318f40 2 removed watcher, disabling cache 2024-09-13T23:56:58.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.178+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94622038957952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee926d000 con 0x560ee911f000 2024-09-13T23:56:58.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.178+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94622038957952] v33'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee911f000 2024-09-13T23:56:58.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.178+0000 7fc5ae318f40 20 remove_watcher() i=1 2024-09-13T23:56:58.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.178+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94622038959104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee926dc00 con 0x560ee911f400 2024-09-13T23:56:58.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.182+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94622038959104] v33'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee911f400 2024-09-13T23:56:58.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.182+0000 7fc5ae318f40 20 remove_watcher() i=2 2024-09-13T23:56:58.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.182+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94622038960256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee926d400 con 0x560ee91da000 2024-09-13T23:56:58.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.186+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94622038960256] v33'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee91da000 2024-09-13T23:56:58.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.186+0000 7fc5ae318f40 20 remove_watcher() i=3 2024-09-13T23:56:58.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.186+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94622038961408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee926c400 con 0x560ee911f400 2024-09-13T23:56:58.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.190+0000 7fc5acad1700 1 -- 172.21.15.173:0/2505689732 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94622038961408] v33'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560ee91c9200 con 0x560ee911f400 2024-09-13T23:56:58.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.190+0000 7fc5ae318f40 20 remove_watcher() i=4 2024-09-13T23:56:58.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.190+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94622038962560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee926d800 con 0x560ee911fc00 2024-09-13T23:56:58.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.190+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2505689732 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94622038962560] v33'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560ee91c9440 con 0x560ee911fc00 2024-09-13T23:56:58.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.190+0000 7fc5ae318f40 20 remove_watcher() i=5 2024-09-13T23:56:58.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.190+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94622038963712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee926d000 con 0x560ee911fc00 2024-09-13T23:56:58.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.194+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2505689732 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94622038963712] v33'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560ee91c9440 con 0x560ee911fc00 2024-09-13T23:56:58.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.194+0000 7fc5ae318f40 20 remove_watcher() i=6 2024-09-13T23:56:58.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.194+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94622038964864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560ee90b3400 con 0x560ee91da000 2024-09-13T23:56:58.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.194+0000 7fc5ad2d2700 1 -- 172.21.15.173:0/2505689732 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94622038964864] v33'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560ee91c8b40 con 0x560ee91da000 2024-09-13T23:56:58.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.194+0000 7fc5ae318f40 20 remove_watcher() i=7 2024-09-13T23:56:58.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560ee911f400 msgr2=0x560ee905bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/2505689732 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560ee911f400 0x560ee905bb80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560ee911f000 msgr2=0x560ee905b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/2505689732 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560ee911f000 0x560ee905b600 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560ee91da000 msgr2=0x560ee905a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/2505689732 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560ee91da000 0x560ee905a580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560ee911fc00 msgr2=0x560ee905cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/2505689732 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560ee911fc00 0x560ee905cc00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560ee911ec00 msgr2=0x560ee905c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/2505689732 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560ee911ec00 0x560ee905c680 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x560ee9055920 tx=0x560ee8e79800 comp rx=0 tx=0).stop 2024-09-13T23:56:58.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75c00 msgr2=0x560ee905b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/2505689732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75c00 0x560ee905b080 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x560ee9bec210 tx=0x560ee90dc900 comp rx=0 tx=0).stop 2024-09-13T23:56:58.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ac2d0700 1 -- 172.21.15.173:0/2505689732 reap_dead start 2024-09-13T23:56:58.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 shutdown_connections 2024-09-13T23:56:58.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/2505689732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75c00 0x560ee905b080 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 >> 172.21.15.173:0/2505689732 conn(0x560ee8d75800 msgr2=0x560ee8e75800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 shutdown_connections 2024-09-13T23:56:58.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2505689732 wait complete. 2024-09-13T23:56:58.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560ee91dac00 msgr2=0x560ee905d700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/3222985816 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560ee91dac00 0x560ee905d700 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560ee926c800 msgr2=0x560ee9273080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/3222985816 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560ee926c800 0x560ee9273080 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560ee91db800 msgr2=0x560ee9272580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/3222985816 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560ee91db800 0x560ee9272580 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560ee911f800 msgr2=0x560ee9272b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/3222985816 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560ee911f800 0x560ee9272b00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560ee926c000 msgr2=0x560ee9272000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/3222985816 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560ee926c000 0x560ee9272000 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x560ee9173b90 tx=0x560ee9236ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee90b2400 msgr2=0x560ee905d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5acad1700 1 -- 172.21.15.173:0/3222985816 reap_dead start 2024-09-13T23:56:58.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/3222985816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee90b2400 0x560ee905d180 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x560ee91f0390 tx=0x560ee90ddc20 comp rx=0 tx=0).stop 2024-09-13T23:56:58.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 shutdown_connections 2024-09-13T23:56:58.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/3222985816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee90b2400 0x560ee905d180 secure :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0x560ee91f0390 tx=0x560ee90ddc20 comp rx=0 tx=0).stop 2024-09-13T23:56:58.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 >> 172.21.15.173:0/3222985816 conn(0x560ee90b3c00 msgr2=0x560ee8e76000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 shutdown_connections 2024-09-13T23:56:58.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/3222985816 wait complete. 2024-09-13T23:56:58.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2502782607 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560ee911e000 msgr2=0x560ee905c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/2502782607 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560ee911e000 0x560ee905c100 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x560ee9bed710 tx=0x560ee90dc240 comp rx=0 tx=0).stop 2024-09-13T23:56:58.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2502782607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75400 msgr2=0x560ee905ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/2502782607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75400 0x560ee905ab00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x560ee8ed1f80 tx=0x560ee8e79a40 comp rx=0 tx=0).stop 2024-09-13T23:56:58.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2502782607 shutdown_connections 2024-09-13T23:56:58.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/2502782607 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560ee911e000 0x560ee905c100 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 --2- 172.21.15.173:0/2502782607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560ee8d75400 0x560ee905ab00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2502782607 >> 172.21.15.173:0/2502782607 conn(0x560ee8d74c00 msgr2=0x560ee8e75000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2502782607 shutdown_connections 2024-09-13T23:56:58.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.198+0000 7fc5ae318f40 1 -- 172.21.15.173:0/2502782607 wait complete. 2024-09-13T23:56:58.209 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T23:56:58.210 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T23:56:58.210 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T23:56:58.210 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-13T23:56:58.298 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:56:58.298 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:56:58.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.294+0000 7f9858681f40 1 Processor -- start 2024-09-13T23:56:58.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.294+0000 7f9858681f40 1 -- start start 2024-09-13T23:56:58.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.294+0000 7f9858681f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x560d20eff400 0x560d211e4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.294+0000 7f9858681f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560d20fc3500 con 0x560d20eff000 2024-09-13T23:56:58.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.294+0000 7f9858681f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x560d20f8ca00 con 0x560d20eff400 2024-09-13T23:56:58.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.294+0000 7f9856639700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x560d20eff400 0x560d211e4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.294+0000 7f9856e3a700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x560d20eff000 0x560d20ffe800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:57796/0 (socket says 172.21.15.173:57796) 2024-09-13T23:56:58.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.294+0000 7f9856e3a700 1 -- 172.21.15.173:0/544618120 learned_addr learned my addr 172.21.15.173:0/544618120 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:56:58.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.294+0000 7f9856639700 1 -- 172.21.15.173:0/544618120 >> v1:172.21.15.87:6789/0 conn(0x560d20eff000 legacy=0x560d20ffe800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.294+0000 7f9856639700 1 -- 172.21.15.173:0/544618120 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d20f11d40 con 0x560d20eff400 2024-09-13T23:56:58.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.294+0000 7f9856639700 1 --2- 172.21.15.173:0/544618120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff400 0x560d211e4580 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x560d211df920 tx=0x560d21003920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318c629ba90ac992 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.298+0000 7f9855e38700 1 -- 172.21.15.173:0/544618120 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560d20fa34a0 con 0x560d20eff400 2024-09-13T23:56:58.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.298+0000 7f9855e38700 1 -- 172.21.15.173:0/544618120 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560d20fc3800 con 0x560d20eff400 2024-09-13T23:56:58.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.298+0000 7f9855e38700 1 -- 172.21.15.173:0/544618120 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560d20fa3600 con 0x560d20eff400 2024-09-13T23:56:58.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.298+0000 7f9858681f40 1 -- 172.21.15.173:0/544618120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff400 msgr2=0x560d211e4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.298+0000 7f9858681f40 1 --2- 172.21.15.173:0/544618120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff400 0x560d211e4580 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x560d211df920 tx=0x560d21003920 comp rx=0 tx=0).stop 2024-09-13T23:56:58.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.298+0000 7f9858681f40 1 -- 172.21.15.173:0/544618120 shutdown_connections 2024-09-13T23:56:58.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.298+0000 7f9858681f40 1 --2- 172.21.15.173:0/544618120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff400 0x560d211e4580 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.298+0000 7f9858681f40 1 -- 172.21.15.173:0/544618120 >> 172.21.15.173:0/544618120 conn(0x560d20efec00 msgr2=0x560d20ffe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.298+0000 7f9858681f40 1 -- 172.21.15.173:0/544618120 shutdown_connections 2024-09-13T23:56:58.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.298+0000 7f9858681f40 1 -- 172.21.15.173:0/544618120 wait complete. 2024-09-13T23:56:58.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.298+0000 7f9858681f40 1 Processor -- start 2024-09-13T23:56:58.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.298+0000 7f9858681f40 1 -- start start 2024-09-13T23:56:58.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.298+0000 7f9858681f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff000 0x560d211e4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.298+0000 7f9858681f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d20f8c500 con 0x560d20eff000 2024-09-13T23:56:58.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.298+0000 7f9856e3a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff000 0x560d211e4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.298+0000 7f9856e3a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff000 0x560d211e4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58120/0 (socket says 172.21.15.173:58120) 2024-09-13T23:56:58.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.298+0000 7f9856e3a700 1 -- 172.21.15.173:0/2604863486 learned_addr learned my addr 172.21.15.173:0/2604863486 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.298+0000 7f9856e3a700 1 -- 172.21.15.173:0/2604863486 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d20f11ba0 con 0x560d20eff000 2024-09-13T23:56:58.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.298+0000 7f9856e3a700 1 --2- 172.21.15.173:0/2604863486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff000 0x560d211e4580 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x560d21d578c0 tx=0x560d21003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5445433bd03b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.298+0000 7f9855637700 1 -- 172.21.15.173:0/2604863486 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560d20fa34a0 con 0x560d20eff000 2024-09-13T23:56:58.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.298+0000 7f9855637700 1 -- 172.21.15.173:0/2604863486 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560d20fc3b00 con 0x560d20eff000 2024-09-13T23:56:58.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.298+0000 7f9855637700 1 -- 172.21.15.173:0/2604863486 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560d20fa3600 con 0x560d20eff000 2024-09-13T23:56:58.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.302+0000 7f9858681f40 1 -- 172.21.15.173:0/2604863486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff000 msgr2=0x560d211e4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.302+0000 7f9858681f40 1 --2- 172.21.15.173:0/2604863486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff000 0x560d211e4580 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x560d21d578c0 tx=0x560d21003b60 comp rx=0 tx=0).stop 2024-09-13T23:56:58.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.302+0000 7f9858681f40 1 -- 172.21.15.173:0/2604863486 shutdown_connections 2024-09-13T23:56:58.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.302+0000 7f9858681f40 1 --2- 172.21.15.173:0/2604863486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff000 0x560d211e4580 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.302+0000 7f9858681f40 1 -- 172.21.15.173:0/2604863486 >> 172.21.15.173:0/2604863486 conn(0x560d20efec00 msgr2=0x560d20fff000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.302+0000 7f9858681f40 1 -- 172.21.15.173:0/2604863486 shutdown_connections 2024-09-13T23:56:58.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.302+0000 7f9858681f40 1 -- 172.21.15.173:0/2604863486 wait complete. 2024-09-13T23:56:58.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.302+0000 7f9858681f40 1 Processor -- start 2024-09-13T23:56:58.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.302+0000 7f9858681f40 1 -- start start 2024-09-13T23:56:58.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.302+0000 7f9858681f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff000 0x560d211e4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.302+0000 7f9858681f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d20f8c3c0 con 0x560d20eff000 2024-09-13T23:56:58.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.302+0000 7f9856e3a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff000 0x560d211e4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.302+0000 7f9856e3a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff000 0x560d211e4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58130/0 (socket says 172.21.15.173:58130) 2024-09-13T23:56:58.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.302+0000 7f9856e3a700 1 -- 172.21.15.173:0/1317785148 learned_addr learned my addr 172.21.15.173:0/1317785148 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.302+0000 7f9856e3a700 1 -- 172.21.15.173:0/1317785148 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d20f11a00 con 0x560d20eff000 2024-09-13T23:56:58.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.302+0000 7f9856e3a700 1 --2- 172.21.15.173:0/1317785148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff000 0x560d211e4580 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x560d21d57aa0 tx=0x560d21003a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.302+0000 7f9853e34700 1 -- 172.21.15.173:0/1317785148 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560d20fa38c0 con 0x560d20eff000 2024-09-13T23:56:58.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.302+0000 7f9853e34700 1 -- 172.21.15.173:0/1317785148 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560d20fc3c80 con 0x560d20eff000 2024-09-13T23:56:58.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.302+0000 7f9853e34700 1 -- 172.21.15.173:0/1317785148 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560d20fa34a0 con 0x560d20eff000 2024-09-13T23:56:58.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.302+0000 7f9858681f40 1 -- 172.21.15.173:0/1317785148 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560d20f11860 con 0x560d20eff000 2024-09-13T23:56:58.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.302+0000 7f9858681f40 1 -- 172.21.15.173:0/1317785148 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d20f116c0 con 0x560d20eff000 2024-09-13T23:56:58.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f9858681f40 1 Processor -- start 2024-09-13T23:56:58.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f9858681f40 1 -- start start 2024-09-13T23:56:58.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f9853e34700 1 -- 172.21.15.173:0/1317785148 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x560d20ff8b00 con 0x560d20eff000 2024-09-13T23:56:58.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f9858681f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff800 0x560d211e4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f9858681f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d20f8c000 con 0x560d20eff800 2024-09-13T23:56:58.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f9853e34700 1 --2- 172.21.15.173:0/1317785148 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560d21292000 0x560d211e5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f9853e34700 1 -- 172.21.15.173:0/1317785148 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x560d20f65180 con 0x560d20eff000 2024-09-13T23:56:58.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f985763b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff800 0x560d211e4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f985763b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff800 0x560d211e4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58146/0 (socket says 172.21.15.173:58146) 2024-09-13T23:56:58.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f985763b700 1 -- 172.21.15.173:0/1680011515 learned_addr learned my addr 172.21.15.173:0/1680011515 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f9856e3a700 1 --2- 172.21.15.173:0/1317785148 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560d21292000 0x560d211e5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f9856e3a700 1 --2- 172.21.15.173:0/1317785148 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560d21292000 0x560d211e5080 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x560d21d76fc0 tx=0x560d21256240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f985763b700 1 -- 172.21.15.173:0/1680011515 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d20f10000 con 0x560d20eff800 2024-09-13T23:56:58.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f985763b700 1 --2- 172.21.15.173:0/1680011515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff800 0x560d211e4b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x560d21d767b0 tx=0x560d21256d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ddc1bd0a3e0261 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f985162f700 1 -- 172.21.15.173:0/1680011515 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560d20fa38c0 con 0x560d20eff800 2024-09-13T23:56:58.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f985162f700 1 -- 172.21.15.173:0/1680011515 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560d212aa000 con 0x560d20eff800 2024-09-13T23:56:58.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f985162f700 1 -- 172.21.15.173:0/1680011515 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560d20fa34a0 con 0x560d20eff800 2024-09-13T23:56:58.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f9858681f40 1 -- 172.21.15.173:0/1680011515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff800 msgr2=0x560d211e4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f9858681f40 1 --2- 172.21.15.173:0/1680011515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff800 0x560d211e4b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x560d21d767b0 tx=0x560d21256d20 comp rx=0 tx=0).stop 2024-09-13T23:56:58.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f9858681f40 1 -- 172.21.15.173:0/1680011515 shutdown_connections 2024-09-13T23:56:58.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f9858681f40 1 --2- 172.21.15.173:0/1680011515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff800 0x560d211e4b00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f9858681f40 1 -- 172.21.15.173:0/1680011515 >> 172.21.15.173:0/1680011515 conn(0x560d20eff400 msgr2=0x560d20fff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f9858681f40 1 -- 172.21.15.173:0/1680011515 shutdown_connections 2024-09-13T23:56:58.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f9858681f40 1 -- 172.21.15.173:0/1680011515 wait complete. 2024-09-13T23:56:58.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f9858681f40 1 Processor -- start 2024-09-13T23:56:58.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f9858681f40 1 -- start start 2024-09-13T23:56:58.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f9858681f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff800 0x560d211e4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f9858681f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d20f24640 con 0x560d20eff800 2024-09-13T23:56:58.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.306+0000 7f985763b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff800 0x560d211e4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.310+0000 7f985763b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff800 0x560d211e4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58156/0 (socket says 172.21.15.173:58156) 2024-09-13T23:56:58.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.310+0000 7f985763b700 1 -- 172.21.15.173:0/1227781379 learned_addr learned my addr 172.21.15.173:0/1227781379 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.310+0000 7f985763b700 1 -- 172.21.15.173:0/1227781379 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d20f10ea0 con 0x560d20eff800 2024-09-13T23:56:58.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.310+0000 7f985763b700 1 --2- 172.21.15.173:0/1227781379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff800 0x560d211e4b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x560d21d763f0 tx=0x560d21003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.310+0000 7f984fe2c700 1 -- 172.21.15.173:0/1227781379 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560d20fa3b80 con 0x560d20eff800 2024-09-13T23:56:58.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.310+0000 7f984fe2c700 1 -- 172.21.15.173:0/1227781379 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560d212aa180 con 0x560d20eff800 2024-09-13T23:56:58.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.310+0000 7f984fe2c700 1 -- 172.21.15.173:0/1227781379 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560d20fa38c0 con 0x560d20eff800 2024-09-13T23:56:58.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.310+0000 7f9858681f40 1 -- 172.21.15.173:0/1227781379 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560d20f10820 con 0x560d20eff800 2024-09-13T23:56:58.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.310+0000 7f9858681f40 1 -- 172.21.15.173:0/1227781379 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d20f109c0 con 0x560d20eff800 2024-09-13T23:56:58.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.310+0000 7f984fe2c700 1 -- 172.21.15.173:0/1227781379 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x560d20ff9080 con 0x560d20eff800 2024-09-13T23:56:58.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.310+0000 7f9858681f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:56:58.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.310+0000 7f9858681f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:56:58.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.310+0000 7f984fe2c700 1 --2- 172.21.15.173:0/1227781379 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560d21292c00 0x560d211e5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.310+0000 7f984fe2c700 1 -- 172.21.15.173:0/1227781379 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x560d20f65340 con 0x560d20eff800 2024-09-13T23:56:58.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f9858681f40 1 Processor -- start 2024-09-13T23:56:58.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f9856639700 1 --2- 172.21.15.173:0/1227781379 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560d21292c00 0x560d211e5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f9858681f40 1 -- start start 2024-09-13T23:56:58.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f9858681f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d21293400 0x560d211e5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f9858681f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d20f248c0 con 0x560d21293400 2024-09-13T23:56:58.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f9856639700 1 --2- 172.21.15.173:0/1227781379 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560d21292c00 0x560d211e5600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x560d211df920 tx=0x560d21003800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f9856e3a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d21293400 0x560d211e5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f9856e3a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d21293400 0x560d211e5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58170/0 (socket says 172.21.15.173:58170) 2024-09-13T23:56:58.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f9856e3a700 1 -- 172.21.15.173:0/2379972695 learned_addr learned my addr 172.21.15.173:0/2379972695 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f9856e3a700 1 -- 172.21.15.173:0/2379972695 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d20f10b60 con 0x560d21293400 2024-09-13T23:56:58.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f9856e3a700 1 --2- 172.21.15.173:0/2379972695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d21293400 0x560d211e5b80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x560d21d76960 tx=0x560d21256c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d7a954e200dc62 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f983de08700 1 -- 172.21.15.173:0/2379972695 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560d20fa3600 con 0x560d21293400 2024-09-13T23:56:58.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f983de08700 1 -- 172.21.15.173:0/2379972695 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560d212aa600 con 0x560d21293400 2024-09-13T23:56:58.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f983de08700 1 -- 172.21.15.173:0/2379972695 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560d20fa3a20 con 0x560d21293400 2024-09-13T23:56:58.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f9858681f40 1 -- 172.21.15.173:0/2379972695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d21293400 msgr2=0x560d211e5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f9858681f40 1 --2- 172.21.15.173:0/2379972695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d21293400 0x560d211e5b80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x560d21d76960 tx=0x560d21256c00 comp rx=0 tx=0).stop 2024-09-13T23:56:58.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f9858681f40 1 -- 172.21.15.173:0/2379972695 shutdown_connections 2024-09-13T23:56:58.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f9858681f40 1 --2- 172.21.15.173:0/2379972695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d21293400 0x560d211e5b80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f9858681f40 1 -- 172.21.15.173:0/2379972695 >> 172.21.15.173:0/2379972695 conn(0x560d21293000 msgr2=0x560d21000000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f9858681f40 1 -- 172.21.15.173:0/2379972695 shutdown_connections 2024-09-13T23:56:58.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f9858681f40 1 -- 172.21.15.173:0/2379972695 wait complete. 2024-09-13T23:56:58.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f9858681f40 1 Processor -- start 2024-09-13T23:56:58.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f9858681f40 1 -- start start 2024-09-13T23:56:58.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f9858681f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d21293400 0x560d211e5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.314+0000 7f9858681f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d20f24f00 con 0x560d21293400 2024-09-13T23:56:58.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.318+0000 7f9856e3a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d21293400 0x560d211e5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.318+0000 7f9856e3a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d21293400 0x560d211e5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58180/0 (socket says 172.21.15.173:58180) 2024-09-13T23:56:58.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.318+0000 7f9856e3a700 1 -- 172.21.15.173:0/950008195 learned_addr learned my addr 172.21.15.173:0/950008195 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.318+0000 7f9856e3a700 1 -- 172.21.15.173:0/950008195 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d20f10d00 con 0x560d21293400 2024-09-13T23:56:58.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.318+0000 7f9856e3a700 1 --2- 172.21.15.173:0/950008195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d21293400 0x560d211e5b80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x560d21275530 tx=0x560d212561e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.318+0000 7f983c605700 1 -- 172.21.15.173:0/950008195 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560d20fa3600 con 0x560d21293400 2024-09-13T23:56:58.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.318+0000 7f983c605700 1 -- 172.21.15.173:0/950008195 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560d212aa300 con 0x560d21293400 2024-09-13T23:56:58.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.318+0000 7f983c605700 1 -- 172.21.15.173:0/950008195 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560d20fa3a20 con 0x560d21293400 2024-09-13T23:56:58.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.318+0000 7f9858681f40 1 -- 172.21.15.173:0/950008195 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560d20f10340 con 0x560d21293400 2024-09-13T23:56:58.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.318+0000 7f9858681f40 1 -- 172.21.15.173:0/950008195 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d21366000 con 0x560d21293400 2024-09-13T23:56:58.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.318+0000 7f983c605700 1 -- 172.21.15.173:0/950008195 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x560d20ff8dc0 con 0x560d21293400 2024-09-13T23:56:58.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.318+0000 7f983c605700 1 --2- 172.21.15.173:0/950008195 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560d2135fc00 0x560d211e6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.318+0000 7f983c605700 1 -- 172.21.15.173:0/950008195 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x560d20f65500 con 0x560d21293400 2024-09-13T23:56:58.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.318+0000 7f9856639700 1 --2- 172.21.15.173:0/950008195 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560d2135fc00 0x560d211e6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.318+0000 7f9856639700 1 --2- 172.21.15.173:0/950008195 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560d2135fc00 0x560d211e6c00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x560d21275440 tx=0x560d21003860 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.322+0000 7f983a601700 20 reqs_thread_entry: start 2024-09-13T23:56:58.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.322+0000 7f9858681f40 1 --2- 172.21.15.173:0/1317785148 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560d2135e800 0x560d211e6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.322+0000 7f9858681f40 1 -- 172.21.15.173:0/1317785148 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560d2135ec00 con 0x560d2135e800 2024-09-13T23:56:58.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.322+0000 7f985763b700 1 --2- 172.21.15.173:0/1317785148 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560d2135e800 0x560d211e6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.322+0000 7f985763b700 1 --2- 172.21.15.173:0/1317785148 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560d2135e800 0x560d211e6100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.322+0000 7f985763b700 1 -- 172.21.15.173:0/1317785148 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x560d213c8240 con 0x560d2135e800 2024-09-13T23:56:58.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.322+0000 7f9858681f40 1 --2- 172.21.15.173:0/1317785148 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560d2135f000 0x560d211e6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.322+0000 7f9858681f40 1 -- 172.21.15.173:0/1317785148 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:2 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560d2135f400 con 0x560d2135f000 2024-09-13T23:56:58.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.322+0000 7f9856e3a700 1 --2- 172.21.15.173:0/1317785148 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560d2135f000 0x560d211e6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.322+0000 7f9856e3a700 1 --2- 172.21.15.173:0/1317785148 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560d2135f000 0x560d211e6680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.322+0000 7f9856e3a700 1 -- 172.21.15.173:0/1317785148 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(2 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [call out=24b,read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+898 (crc 0 0 0) 0x560d213c8480 con 0x560d2135f000 2024-09-13T23:56:58.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.326+0000 7f9858681f40 1 -- 172.21.15.173:0/1317785148 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:3 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [stat,call version.inc in=38b,writefull 0~874 in=874b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560d2135f800 con 0x560d2135f000 2024-09-13T23:56:58.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.326+0000 7f9856e3a700 1 -- 172.21.15.173:0/1317785148 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(3 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [stat,call,writefull 0~874] v33'2 uv2 ondisk = 0) v8 ==== 274+0+0 (crc 0 0 0) 0x560d213c8480 con 0x560d2135f000 2024-09-13T23:56:58.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 -- 172.21.15.173:0/1227781379 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560d21292c00 msgr2=0x560d211e5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 --2- 172.21.15.173:0/1227781379 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560d21292c00 0x560d211e5600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x560d211df920 tx=0x560d21003800 comp rx=0 tx=0).stop 2024-09-13T23:56:58.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 -- 172.21.15.173:0/1227781379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff800 msgr2=0x560d211e4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 --2- 172.21.15.173:0/1227781379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff800 0x560d211e4b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x560d21d763f0 tx=0x560d21003f20 comp rx=0 tx=0).stop 2024-09-13T23:56:58.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 -- 172.21.15.173:0/1227781379 shutdown_connections 2024-09-13T23:56:58.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 --2- 172.21.15.173:0/1227781379 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560d21292c00 0x560d211e5600 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 --2- 172.21.15.173:0/1227781379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff800 0x560d211e4b00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 -- 172.21.15.173:0/1227781379 >> 172.21.15.173:0/1227781379 conn(0x560d20eff400 msgr2=0x560d20fff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 -- 172.21.15.173:0/1227781379 shutdown_connections 2024-09-13T23:56:58.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 -- 172.21.15.173:0/1227781379 wait complete. 2024-09-13T23:56:58.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 -- 172.21.15.173:0/950008195 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560d2135fc00 msgr2=0x560d211e6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 --2- 172.21.15.173:0/950008195 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560d2135fc00 0x560d211e6c00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x560d21275440 tx=0x560d21003860 comp rx=0 tx=0).stop 2024-09-13T23:56:58.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 -- 172.21.15.173:0/950008195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d21293400 msgr2=0x560d211e5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 --2- 172.21.15.173:0/950008195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d21293400 0x560d211e5b80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x560d21275530 tx=0x560d212561e0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 -- 172.21.15.173:0/950008195 shutdown_connections 2024-09-13T23:56:58.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 --2- 172.21.15.173:0/950008195 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560d2135fc00 0x560d211e6c00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 --2- 172.21.15.173:0/950008195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d21293400 0x560d211e5b80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 -- 172.21.15.173:0/950008195 >> 172.21.15.173:0/950008195 conn(0x560d21293000 msgr2=0x560d21000000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 -- 172.21.15.173:0/950008195 shutdown_connections 2024-09-13T23:56:58.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 -- 172.21.15.173:0/950008195 wait complete. 2024-09-13T23:56:58.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 -- 172.21.15.173:0/1317785148 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560d2135e800 msgr2=0x560d211e6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 --2- 172.21.15.173:0/1317785148 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560d2135e800 0x560d211e6100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 -- 172.21.15.173:0/1317785148 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560d2135f000 msgr2=0x560d211e6680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 --2- 172.21.15.173:0/1317785148 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560d2135f000 0x560d211e6680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 -- 172.21.15.173:0/1317785148 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560d21292000 msgr2=0x560d211e5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 --2- 172.21.15.173:0/1317785148 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560d21292000 0x560d211e5080 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x560d21d76fc0 tx=0x560d21256240 comp rx=0 tx=0).stop 2024-09-13T23:56:58.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 -- 172.21.15.173:0/1317785148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff000 msgr2=0x560d211e4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 --2- 172.21.15.173:0/1317785148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff000 0x560d211e4580 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x560d21d57aa0 tx=0x560d21003a40 comp rx=0 tx=0).stop 2024-09-13T23:56:58.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 -- 172.21.15.173:0/1317785148 shutdown_connections 2024-09-13T23:56:58.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 --2- 172.21.15.173:0/1317785148 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560d2135f000 0x560d211e6680 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 --2- 172.21.15.173:0/1317785148 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560d2135e800 0x560d211e6100 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 --2- 172.21.15.173:0/1317785148 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560d21292000 0x560d211e5080 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 --2- 172.21.15.173:0/1317785148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560d20eff000 0x560d211e4580 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 -- 172.21.15.173:0/1317785148 >> 172.21.15.173:0/1317785148 conn(0x560d20efec00 msgr2=0x560d20fff000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 -- 172.21.15.173:0/1317785148 shutdown_connections 2024-09-13T23:56:58.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.330+0000 7f9858681f40 1 -- 172.21.15.173:0/1317785148 wait complete. 2024-09-13T23:56:58.338 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:56:58.338 INFO:teuthology.orchestra.run.smithi173.stdout: "id": "d342d0db-d035-4a54-bae7-2e0f76db6818", 2024-09-13T23:56:58.339 INFO:teuthology.orchestra.run.smithi173.stdout: "name": "default", 2024-09-13T23:56:58.339 INFO:teuthology.orchestra.run.smithi173.stdout: "domain_root": "default.rgw.meta:root", 2024-09-13T23:56:58.339 INFO:teuthology.orchestra.run.smithi173.stdout: "control_pool": "default.rgw.control", 2024-09-13T23:56:58.339 INFO:teuthology.orchestra.run.smithi173.stdout: "gc_pool": "default.rgw.log:gc", 2024-09-13T23:56:58.339 INFO:teuthology.orchestra.run.smithi173.stdout: "lc_pool": "default.rgw.log:lc", 2024-09-13T23:56:58.339 INFO:teuthology.orchestra.run.smithi173.stdout: "log_pool": "default.rgw.log", 2024-09-13T23:56:58.339 INFO:teuthology.orchestra.run.smithi173.stdout: "intent_log_pool": "default.rgw.log:intent", 2024-09-13T23:56:58.339 INFO:teuthology.orchestra.run.smithi173.stdout: "usage_log_pool": "default.rgw.log:usage", 2024-09-13T23:56:58.339 INFO:teuthology.orchestra.run.smithi173.stdout: "roles_pool": "default.rgw.meta:roles", 2024-09-13T23:56:58.339 INFO:teuthology.orchestra.run.smithi173.stdout: "reshard_pool": "default.rgw.log:reshard", 2024-09-13T23:56:58.339 INFO:teuthology.orchestra.run.smithi173.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2024-09-13T23:56:58.339 INFO:teuthology.orchestra.run.smithi173.stdout: "user_email_pool": "default.rgw.meta:users.email", 2024-09-13T23:56:58.339 INFO:teuthology.orchestra.run.smithi173.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2024-09-13T23:56:58.339 INFO:teuthology.orchestra.run.smithi173.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2024-09-13T23:56:58.339 INFO:teuthology.orchestra.run.smithi173.stdout: "otp_pool": "default.rgw.otp", 2024-09-13T23:56:58.340 INFO:teuthology.orchestra.run.smithi173.stdout: "system_key": { 2024-09-13T23:56:58.340 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "", 2024-09-13T23:56:58.340 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "" 2024-09-13T23:56:58.340 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:56:58.340 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_pools": [ 2024-09-13T23:56:58.340 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:56:58.340 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "default-placement", 2024-09-13T23:56:58.340 INFO:teuthology.orchestra.run.smithi173.stdout: "val": { 2024-09-13T23:56:58.340 INFO:teuthology.orchestra.run.smithi173.stdout: "index_pool": "default.rgw.buckets.index", 2024-09-13T23:56:58.340 INFO:teuthology.orchestra.run.smithi173.stdout: "storage_classes": { 2024-09-13T23:56:58.340 INFO:teuthology.orchestra.run.smithi173.stdout: "STANDARD": { 2024-09-13T23:56:58.340 INFO:teuthology.orchestra.run.smithi173.stdout: "data_pool": "default.rgw.buckets.data" 2024-09-13T23:56:58.340 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:56:58.341 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:56:58.341 INFO:teuthology.orchestra.run.smithi173.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2024-09-13T23:56:58.341 INFO:teuthology.orchestra.run.smithi173.stdout: "index_type": 0, 2024-09-13T23:56:58.341 INFO:teuthology.orchestra.run.smithi173.stdout: "inline_data": true 2024-09-13T23:56:58.341 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:56:58.341 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:56:58.341 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:56:58.341 INFO:teuthology.orchestra.run.smithi173.stdout: "realm_id": "", 2024-09-13T23:56:58.341 INFO:teuthology.orchestra.run.smithi173.stdout: "notif_pool": "default.rgw.log:notif" 2024-09-13T23:56:58.341 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:56:58.342 DEBUG:tasks.util.rgw: json result: {'id': 'd342d0db-d035-4a54-bae7-2e0f76db6818', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-09-13T23:56:58.343 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-13T23:56:58.343 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-13T23:56:58.344 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-13T23:56:58.382 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:56:58.383 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:56:58.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.378+0000 7f3135635f40 1 Processor -- start 2024-09-13T23:56:58.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.378+0000 7f3135635f40 1 -- start start 2024-09-13T23:56:58.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.378+0000 7f3135635f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55a48ebbf000 0x55a48eea4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.378+0000 7f3135635f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a48ec83500 con 0x55a48ebbf400 2024-09-13T23:56:58.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.378+0000 7f3135635f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a48ec4ca00 con 0x55a48ebbf000 2024-09-13T23:56:58.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.378+0000 7f3133dee700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55a48ebbf000 0x55a48eea4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.378+0000 7f31335ed700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55a48ebbf400 0x55a48ecbe800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:57806/0 (socket says 172.21.15.173:57806) 2024-09-13T23:56:58.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.378+0000 7f31335ed700 1 -- 172.21.15.173:0/2424777184 learned_addr learned my addr 172.21.15.173:0/2424777184 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:56:58.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.378+0000 7f3133dee700 1 -- 172.21.15.173:0/2424777184 >> v1:172.21.15.87:6789/0 conn(0x55a48ebbf400 legacy=0x55a48ecbe800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.378+0000 7f3133dee700 1 -- 172.21.15.173:0/2424777184 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a48ebd1d40 con 0x55a48ebbf000 2024-09-13T23:56:58.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.382+0000 7f3133dee700 1 --2- 172.21.15.173:0/2424777184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbf000 0x55a48eea4580 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55a48ee9fa70 tx=0x55a48ecc3920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b226754cad26d18a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.382+0000 7f3132dec700 1 -- 172.21.15.173:0/2424777184 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a48ec634a0 con 0x55a48ebbf000 2024-09-13T23:56:58.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.382+0000 7f3132dec700 1 -- 172.21.15.173:0/2424777184 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a48ec83800 con 0x55a48ebbf000 2024-09-13T23:56:58.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.382+0000 7f3132dec700 1 -- 172.21.15.173:0/2424777184 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a48ec63600 con 0x55a48ebbf000 2024-09-13T23:56:58.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.382+0000 7f3135635f40 1 -- 172.21.15.173:0/2424777184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbf000 msgr2=0x55a48eea4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.382+0000 7f3135635f40 1 --2- 172.21.15.173:0/2424777184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbf000 0x55a48eea4580 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55a48ee9fa70 tx=0x55a48ecc3920 comp rx=0 tx=0).stop 2024-09-13T23:56:58.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.382+0000 7f3135635f40 1 -- 172.21.15.173:0/2424777184 shutdown_connections 2024-09-13T23:56:58.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.382+0000 7f3135635f40 1 --2- 172.21.15.173:0/2424777184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbf000 0x55a48eea4580 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.382+0000 7f3135635f40 1 -- 172.21.15.173:0/2424777184 >> 172.21.15.173:0/2424777184 conn(0x55a48ebbec00 msgr2=0x55a48ecbe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.382+0000 7f3135635f40 1 -- 172.21.15.173:0/2424777184 shutdown_connections 2024-09-13T23:56:58.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.382+0000 7f3135635f40 1 -- 172.21.15.173:0/2424777184 wait complete. 2024-09-13T23:56:58.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.382+0000 7f3135635f40 1 Processor -- start 2024-09-13T23:56:58.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.382+0000 7f3135635f40 1 -- start start 2024-09-13T23:56:58.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.382+0000 7f3135635f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbf400 0x55a48eea4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.382+0000 7f3135635f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a48ec4c500 con 0x55a48ebbf400 2024-09-13T23:56:58.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.382+0000 7f3133dee700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbf400 0x55a48eea4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.382+0000 7f3133dee700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbf400 0x55a48eea4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58200/0 (socket says 172.21.15.173:58200) 2024-09-13T23:56:58.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.382+0000 7f3133dee700 1 -- 172.21.15.173:0/1838835975 learned_addr learned my addr 172.21.15.173:0/1838835975 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.382+0000 7f3133dee700 1 -- 172.21.15.173:0/1838835975 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a48ebd1ba0 con 0x55a48ebbf400 2024-09-13T23:56:58.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.382+0000 7f3133dee700 1 --2- 172.21.15.173:0/1838835975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbf400 0x55a48eea4b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55a48fa23860 tx=0x55a48ecc3800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d727d42b96ba19 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.382+0000 7f31325eb700 1 -- 172.21.15.173:0/1838835975 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a48ec63760 con 0x55a48ebbf400 2024-09-13T23:56:58.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.382+0000 7f31325eb700 1 -- 172.21.15.173:0/1838835975 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a48ec83b00 con 0x55a48ebbf400 2024-09-13T23:56:58.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.382+0000 7f31325eb700 1 -- 172.21.15.173:0/1838835975 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a48ec634a0 con 0x55a48ebbf400 2024-09-13T23:56:58.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.386+0000 7f3135635f40 1 -- 172.21.15.173:0/1838835975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbf400 msgr2=0x55a48eea4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.386+0000 7f3135635f40 1 --2- 172.21.15.173:0/1838835975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbf400 0x55a48eea4b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55a48fa23860 tx=0x55a48ecc3800 comp rx=0 tx=0).stop 2024-09-13T23:56:58.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.386+0000 7f3135635f40 1 -- 172.21.15.173:0/1838835975 shutdown_connections 2024-09-13T23:56:58.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.386+0000 7f3135635f40 1 --2- 172.21.15.173:0/1838835975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbf400 0x55a48eea4b00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.386+0000 7f3135635f40 1 -- 172.21.15.173:0/1838835975 >> 172.21.15.173:0/1838835975 conn(0x55a48ebbec00 msgr2=0x55a48ecbf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.386+0000 7f3135635f40 1 -- 172.21.15.173:0/1838835975 shutdown_connections 2024-09-13T23:56:58.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.386+0000 7f3135635f40 1 -- 172.21.15.173:0/1838835975 wait complete. 2024-09-13T23:56:58.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.386+0000 7f3135635f40 1 Processor -- start 2024-09-13T23:56:58.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.386+0000 7f3135635f40 1 -- start start 2024-09-13T23:56:58.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.386+0000 7f3135635f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbf400 0x55a48eea4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.386+0000 7f3135635f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a48ec4c3c0 con 0x55a48ebbf400 2024-09-13T23:56:58.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.386+0000 7f3133dee700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbf400 0x55a48eea4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.386+0000 7f3133dee700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbf400 0x55a48eea4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58204/0 (socket says 172.21.15.173:58204) 2024-09-13T23:56:58.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.386+0000 7f3133dee700 1 -- 172.21.15.173:0/3860402176 learned_addr learned my addr 172.21.15.173:0/3860402176 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.386+0000 7f3133dee700 1 -- 172.21.15.173:0/3860402176 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a48ebd1a00 con 0x55a48ebbf400 2024-09-13T23:56:58.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.386+0000 7f3133dee700 1 --2- 172.21.15.173:0/3860402176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbf400 0x55a48eea4b00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55a48fa23f20 tx=0x55a48ecc3920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.386+0000 7f3130de8700 1 -- 172.21.15.173:0/3860402176 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a48ec63600 con 0x55a48ebbf400 2024-09-13T23:56:58.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.386+0000 7f3130de8700 1 -- 172.21.15.173:0/3860402176 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a48ec83c80 con 0x55a48ebbf400 2024-09-13T23:56:58.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.386+0000 7f3135635f40 1 -- 172.21.15.173:0/3860402176 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a48ebd1860 con 0x55a48ebbf400 2024-09-13T23:56:58.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.386+0000 7f3130de8700 1 -- 172.21.15.173:0/3860402176 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a48ec638c0 con 0x55a48ebbf400 2024-09-13T23:56:58.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.386+0000 7f3135635f40 1 -- 172.21.15.173:0/3860402176 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a48ebd16c0 con 0x55a48ebbf400 2024-09-13T23:56:58.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f3135635f40 1 Processor -- start 2024-09-13T23:56:58.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f3135635f40 1 -- start start 2024-09-13T23:56:58.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f3135635f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbfc00 0x55a48eea5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f3135635f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a48ec4c000 con 0x55a48ebbfc00 2024-09-13T23:56:58.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f3130de8700 1 -- 172.21.15.173:0/3860402176 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55a48ecb8b00 con 0x55a48ebbf400 2024-09-13T23:56:58.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f31345ef700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbfc00 0x55a48eea5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f31345ef700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbfc00 0x55a48eea5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58218/0 (socket says 172.21.15.173:58218) 2024-09-13T23:56:58.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f31345ef700 1 -- 172.21.15.173:0/3623296315 learned_addr learned my addr 172.21.15.173:0/3623296315 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f3130de8700 1 --2- 172.21.15.173:0/3860402176 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a48ef58000 0x55a48eea6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f3130de8700 1 -- 172.21.15.173:0/3860402176 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55a48ec25180 con 0x55a48ebbf400 2024-09-13T23:56:58.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f31345ef700 1 -- 172.21.15.173:0/3623296315 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a48ebd0000 con 0x55a48ebbfc00 2024-09-13T23:56:58.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f3133dee700 1 --2- 172.21.15.173:0/3860402176 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a48ef58000 0x55a48eea6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f31345ef700 1 --2- 172.21.15.173:0/3623296315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbfc00 0x55a48eea5080 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55a48ef4e060 tx=0x55a48ef18780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a674bd175a842594 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f312e5e3700 1 -- 172.21.15.173:0/3623296315 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a48ec63600 con 0x55a48ebbfc00 2024-09-13T23:56:58.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f312e5e3700 1 -- 172.21.15.173:0/3623296315 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a48ef5e000 con 0x55a48ebbfc00 2024-09-13T23:56:58.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f312e5e3700 1 -- 172.21.15.173:0/3623296315 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a48ec638c0 con 0x55a48ebbfc00 2024-09-13T23:56:58.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f3135635f40 1 -- 172.21.15.173:0/3623296315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbfc00 msgr2=0x55a48eea5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f3135635f40 1 --2- 172.21.15.173:0/3623296315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbfc00 0x55a48eea5080 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55a48ef4e060 tx=0x55a48ef18780 comp rx=0 tx=0).stop 2024-09-13T23:56:58.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f3133dee700 1 --2- 172.21.15.173:0/3860402176 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a48ef58000 0x55a48eea6100 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55a48fa32ff0 tx=0x55a48ef188a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f3135635f40 1 -- 172.21.15.173:0/3623296315 shutdown_connections 2024-09-13T23:56:58.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f3135635f40 1 --2- 172.21.15.173:0/3623296315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbfc00 0x55a48eea5080 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f3135635f40 1 -- 172.21.15.173:0/3623296315 >> 172.21.15.173:0/3623296315 conn(0x55a48ebbf800 msgr2=0x55a48ecbf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f3135635f40 1 -- 172.21.15.173:0/3623296315 shutdown_connections 2024-09-13T23:56:58.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f3135635f40 1 -- 172.21.15.173:0/3623296315 wait complete. 2024-09-13T23:56:58.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f3135635f40 1 Processor -- start 2024-09-13T23:56:58.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f3135635f40 1 -- start start 2024-09-13T23:56:58.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f3135635f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbfc00 0x55a48eea5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.390+0000 7f3135635f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a48ebe4640 con 0x55a48ebbfc00 2024-09-13T23:56:58.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.394+0000 7f31345ef700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbfc00 0x55a48eea5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.394+0000 7f31345ef700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbfc00 0x55a48eea5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58232/0 (socket says 172.21.15.173:58232) 2024-09-13T23:56:58.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.394+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 learned_addr learned my addr 172.21.15.173:0/2034952029 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.394+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a48ebd0ea0 con 0x55a48ebbfc00 2024-09-13T23:56:58.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.394+0000 7f31345ef700 1 --2- 172.21.15.173:0/2034952029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbfc00 0x55a48eea5080 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55a48fa32720 tx=0x55a48ef185a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.394+0000 7f312cde0700 1 -- 172.21.15.173:0/2034952029 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a48ec63760 con 0x55a48ebbfc00 2024-09-13T23:56:58.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.394+0000 7f312cde0700 1 -- 172.21.15.173:0/2034952029 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a48ef5e180 con 0x55a48ebbfc00 2024-09-13T23:56:58.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.394+0000 7f312cde0700 1 -- 172.21.15.173:0/2034952029 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a48ec63600 con 0x55a48ebbfc00 2024-09-13T23:56:58.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.394+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a48ebd0820 con 0x55a48ebbfc00 2024-09-13T23:56:58.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.394+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a48ebd09c0 con 0x55a48ebbfc00 2024-09-13T23:56:58.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.394+0000 7f3135635f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.394+0000 7f312cde0700 1 -- 172.21.15.173:0/2034952029 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55a48ecb8dc0 con 0x55a48ebbfc00 2024-09-13T23:56:58.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.394+0000 7f312cde0700 1 --2- 172.21.15.173:0/2034952029 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a48ef58c00 0x55a48eea6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.394+0000 7f312cde0700 1 -- 172.21.15.173:0/2034952029 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55a48ec25340 con 0x55a48ebbfc00 2024-09-13T23:56:58.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.398+0000 7f31335ed700 1 --2- 172.21.15.173:0/2034952029 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a48ef58c00 0x55a48eea6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.398+0000 7f3135635f40 1 --2- 172.21.15.173:0/2034952029 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a48ef59000 0x55a48eea5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.398+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59400 con 0x55a48ef59000 2024-09-13T23:56:58.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.398+0000 7f31345ef700 1 --2- 172.21.15.173:0/2034952029 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a48ef59000 0x55a48eea5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.398+0000 7f31335ed700 1 --2- 172.21.15.173:0/2034952029 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a48ef58c00 0x55a48eea6680 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55a48ef4fec0 tx=0x55a48ef19920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.398+0000 7f31345ef700 1 --2- 172.21.15.173:0/2034952029 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a48ef59000 0x55a48eea5600 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.398+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.398+0000 7f3135635f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.398+0000 7f3135635f40 20 realm 2024-09-13T23:56:58.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.398+0000 7f3135635f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.398+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59000 2024-09-13T23:56:58.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.398+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.398+0000 7f3135635f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.398+0000 7f3135635f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:56:58.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.398+0000 7f3135635f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.398+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59c00 con 0x55a48ef59000 2024-09-13T23:56:58.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.398+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.398+0000 7f3135635f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.398+0000 7f3135635f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.398+0000 7f3135635f40 1 --2- 172.21.15.173:0/2034952029 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a48ef59400 0x55a48eea5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.398+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59400 2024-09-13T23:56:58.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.398+0000 7f3133dee700 1 --2- 172.21.15.173:0/2034952029 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a48ef59400 0x55a48eea5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.398+0000 7f3133dee700 1 --2- 172.21.15.173:0/2034952029 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a48ef59400 0x55a48eea5b80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.402+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.402+0000 7f3135635f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:58.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.402+0000 7f3135635f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.402+0000 7f3135635f40 1 --2- 172.21.15.173:0/2034952029 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a48ef59c00 0x55a48eea6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.402+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f024000 con 0x55a48ef59c00 2024-09-13T23:56:58.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.402+0000 7f31335ed700 1 --2- 172.21.15.173:0/2034952029 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a48ef59c00 0x55a48eea6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.402+0000 7f31335ed700 1 --2- 172.21.15.173:0/2034952029 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a48ef59c00 0x55a48eea6c00 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.402+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.402+0000 7f3135635f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:56:58.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.402+0000 7f3135635f40 20 searching for the correct realm 2024-09-13T23:56:58.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.402+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f024400 con 0x55a48ef59c00 2024-09-13T23:56:58.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.402+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.402+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f024000 con 0x55a48ef59400 2024-09-13T23:56:58.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.402+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.402+0000 7f3133dee700 1 --2- 172.21.15.173:0/2034952029 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a48f024000 0x55a48eea4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.402+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48f024000 2024-09-13T23:56:58.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.402+0000 7f31345ef700 1 --2- 172.21.15.173:0/2034952029 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a48f024000 0x55a48eea4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.402+0000 7f31345ef700 1 --2- 172.21.15.173:0/2034952029 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a48f024000 0x55a48eea4580 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.406+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48f024000 2024-09-13T23:56:58.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.406+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59000 2024-09-13T23:56:58.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.406+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.406+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59000 2024-09-13T23:56:58.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.406+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.406+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59c00 2024-09-13T23:56:58.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.406+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.406+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59000 2024-09-13T23:56:58.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.406+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.406+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59400 2024-09-13T23:56:58.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.406+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.406+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59400 2024-09-13T23:56:58.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.406+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.406+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59000 2024-09-13T23:56:58.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.410+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.410+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48f024000 2024-09-13T23:56:58.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.410+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48f024000 2024-09-13T23:56:58.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.410+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59000 2024-09-13T23:56:58.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.410+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.410+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48f024000 2024-09-13T23:56:58.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.410+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48f024000 2024-09-13T23:56:58.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.410+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59400 2024-09-13T23:56:58.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.410+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.410+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59c00 2024-09-13T23:56:58.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.410+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.410+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59000 2024-09-13T23:56:58.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.414+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.414+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59400 2024-09-13T23:56:58.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.414+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.414+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59c00 2024-09-13T23:56:58.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.414+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.414+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59000 2024-09-13T23:56:58.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.414+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.414+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59000 2024-09-13T23:56:58.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.414+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.414+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59000 2024-09-13T23:56:58.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.414+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.414+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59c00 2024-09-13T23:56:58.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.414+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.414+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48f024000 2024-09-13T23:56:58.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.418+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48f024000 2024-09-13T23:56:58.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.418+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59000 2024-09-13T23:56:58.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.418+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.418+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48f024000 2024-09-13T23:56:58.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.418+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48f024000 2024-09-13T23:56:58.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.418+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59c00 2024-09-13T23:56:58.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.418+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.418+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48f024000 2024-09-13T23:56:58.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.418+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48f024000 2024-09-13T23:56:58.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.418+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59400 2024-09-13T23:56:58.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.418+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.418+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59400 2024-09-13T23:56:58.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.422+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.422+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59c00 2024-09-13T23:56:58.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.422+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.422+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59400 2024-09-13T23:56:58.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.422+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.422+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59400 2024-09-13T23:56:58.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.422+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.422+0000 7f3135635f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:56:58.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.422+0000 7f3135635f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:56:58.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.422+0000 7f3135635f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:56:58.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.422+0000 7f3135635f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:56:58.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.422+0000 7f3135635f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.422+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f024800 con 0x55a48ef59000 2024-09-13T23:56:58.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.422+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.422+0000 7f3135635f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.422+0000 7f3135635f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.422+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f024c00 con 0x55a48ef59400 2024-09-13T23:56:58.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.422+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f3135635f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:58.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f3135635f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f025000 con 0x55a48ef59000 2024-09-13T23:56:58.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f3135635f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:56:58.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f3135635f40 20 zone default found 2024-09-13T23:56:58.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f3135635f40 4 Realm: () 2024-09-13T23:56:58.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f3135635f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:56:58.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f3135635f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:56:58.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f3135635f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:56:58.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f3135635f40 20 zonegroup default 2024-09-13T23:56:58.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f3135635f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f025400 con 0x55a48f024000 2024-09-13T23:56:58.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48f024000 2024-09-13T23:56:58.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f3135635f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f3135635f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f025800 con 0x55a48ef59c00 2024-09-13T23:56:58.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f3135635f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f3135635f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f025c00 con 0x55a48ef59c00 2024-09-13T23:56:58.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f3135635f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f3135635f40 20 started sync module instance, tier type = 2024-09-13T23:56:58.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f3135635f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:56:58.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.426+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f026000 con 0x55a48ef59400 2024-09-13T23:56:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.430+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.430+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94165260679936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f026400 con 0x55a48ef59400 2024-09-13T23:56:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.430+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f026800 con 0x55a48ef59000 2024-09-13T23:56:58.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.434+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.434+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94165260681088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f026c00 con 0x55a48ef59000 2024-09-13T23:56:58.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.434+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f027000 con 0x55a48ef59400 2024-09-13T23:56:58.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.434+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94165260679936] v33'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.434+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94165260681088] v33'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.434+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.434+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94165260682240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f027400 con 0x55a48ef59400 2024-09-13T23:56:58.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.434+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f027800 con 0x55a48f024000 2024-09-13T23:56:58.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.438+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48f024000 2024-09-13T23:56:58.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.438+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94165260683392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f027c00 con 0x55a48f024000 2024-09-13T23:56:58.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.438+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f026800 con 0x55a48ef59400 2024-09-13T23:56:58.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.438+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94165260682240] v33'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.442+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94165260683392] v33'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48f024000 2024-09-13T23:56:58.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.442+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.442+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94165260684544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f026000 con 0x55a48ef59400 2024-09-13T23:56:58.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.442+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f026400 con 0x55a48ef59c00 2024-09-13T23:56:58.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.442+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.446+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94165260685696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f024800 con 0x55a48ef59c00 2024-09-13T23:56:58.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.446+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94165260684544] v33'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.446+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f025000 con 0x55a48ef59c00 2024-09-13T23:56:58.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.446+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v33'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.446+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94165260686848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f025400 con 0x55a48ef59c00 2024-09-13T23:56:58.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.446+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f024c00 con 0x55a48f024000 2024-09-13T23:56:58.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.446+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94165260685696] v33'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.450+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48f024000 2024-09-13T23:56:58.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.450+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94165260688000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48f024000 2024-09-13T23:56:58.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.450+0000 7f3135635f40 20 add_watcher() i=0 2024-09-13T23:56:58.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.450+0000 7f3135635f40 20 add_watcher() i=1 2024-09-13T23:56:58.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.450+0000 7f3135635f40 20 add_watcher() i=2 2024-09-13T23:56:58.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.450+0000 7f3135635f40 20 add_watcher() i=3 2024-09-13T23:56:58.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.450+0000 7f3135635f40 20 add_watcher() i=4 2024-09-13T23:56:58.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.450+0000 7f3135635f40 20 add_watcher() i=5 2024-09-13T23:56:58.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.450+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94165260686848] v33'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.450+0000 7f3135635f40 20 add_watcher() i=6 2024-09-13T23:56:58.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.450+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94165260688000] v33'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48f024000 2024-09-13T23:56:58.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.450+0000 7f3135635f40 20 add_watcher() i=7 2024-09-13T23:56:58.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.450+0000 7f3135635f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:56:58.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.450+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f026c00 con 0x55a48ef59000 2024-09-13T23:56:58.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.450+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.450+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94165262319616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f027800 con 0x55a48ef59000 2024-09-13T23:56:58.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.454+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94165262319616] v33'46 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.454+0000 7f311adbc700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:58.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.454+0000 7f3135635f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:56:58.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.454+0000 7f3135635f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:56:58.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.454+0000 7f3135635f40 1 Processor -- start 2024-09-13T23:56:58.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.454+0000 7f3135635f40 1 -- start start 2024-09-13T23:56:58.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.454+0000 7f3135635f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48f026400 0x55a48eea7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.454+0000 7f3135635f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a48ebe4780 con 0x55a48f026400 2024-09-13T23:56:58.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.454+0000 7f31335ed700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48f026400 0x55a48eea7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.454+0000 7f31335ed700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48f026400 0x55a48eea7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58238/0 (socket says 172.21.15.173:58238) 2024-09-13T23:56:58.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.454+0000 7f31335ed700 1 -- 172.21.15.173:0/3797559144 learned_addr learned my addr 172.21.15.173:0/3797559144 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.454+0000 7f31335ed700 1 -- 172.21.15.173:0/3797559144 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a48ebd0b60 con 0x55a48f026400 2024-09-13T23:56:58.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.458+0000 7f31335ed700 1 --2- 172.21.15.173:0/3797559144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48f026400 0x55a48eea7180 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55a48f036090 tx=0x55a48ef198c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6608fd2b982821fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.458+0000 7f311a5bb700 1 -- 172.21.15.173:0/3797559144 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a48f03e000 con 0x55a48f026400 2024-09-13T23:56:58.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.458+0000 7f311a5bb700 1 -- 172.21.15.173:0/3797559144 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a48ef5e600 con 0x55a48f026400 2024-09-13T23:56:58.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.458+0000 7f311a5bb700 1 -- 172.21.15.173:0/3797559144 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a48f03e160 con 0x55a48f026400 2024-09-13T23:56:58.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.458+0000 7f3135635f40 1 -- 172.21.15.173:0/3797559144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48f026400 msgr2=0x55a48eea7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.458+0000 7f3135635f40 1 --2- 172.21.15.173:0/3797559144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48f026400 0x55a48eea7180 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55a48f036090 tx=0x55a48ef198c0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.458+0000 7f3135635f40 1 -- 172.21.15.173:0/3797559144 shutdown_connections 2024-09-13T23:56:58.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.458+0000 7f3135635f40 1 --2- 172.21.15.173:0/3797559144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48f026400 0x55a48eea7180 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.458+0000 7f3135635f40 1 -- 172.21.15.173:0/3797559144 >> 172.21.15.173:0/3797559144 conn(0x55a48f027c00 msgr2=0x55a48ecc0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.458+0000 7f3135635f40 1 -- 172.21.15.173:0/3797559144 shutdown_connections 2024-09-13T23:56:58.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.458+0000 7f3135635f40 1 -- 172.21.15.173:0/3797559144 wait complete. 2024-09-13T23:56:58.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.458+0000 7f3135635f40 1 Processor -- start 2024-09-13T23:56:58.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.458+0000 7f3135635f40 1 -- start start 2024-09-13T23:56:58.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.458+0000 7f3135635f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48f026400 0x55a48eea7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.458+0000 7f3135635f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a48ec4c000 con 0x55a48f026400 2024-09-13T23:56:58.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.458+0000 7f31335ed700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48f026400 0x55a48eea7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.458+0000 7f31335ed700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48f026400 0x55a48eea7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58246/0 (socket says 172.21.15.173:58246) 2024-09-13T23:56:58.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.458+0000 7f31335ed700 1 -- 172.21.15.173:0/574617945 learned_addr learned my addr 172.21.15.173:0/574617945 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.462+0000 7f31335ed700 1 -- 172.21.15.173:0/574617945 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a48ebd0d00 con 0x55a48f026400 2024-09-13T23:56:58.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.462+0000 7f31335ed700 1 --2- 172.21.15.173:0/574617945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48f026400 0x55a48eea7180 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55a48f0362a0 tx=0x55a48ef19a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.462+0000 7f3118db8700 1 -- 172.21.15.173:0/574617945 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a48f03e2c0 con 0x55a48f026400 2024-09-13T23:56:58.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.462+0000 7f3118db8700 1 -- 172.21.15.173:0/574617945 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a48ef5e300 con 0x55a48f026400 2024-09-13T23:56:58.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.462+0000 7f3135635f40 1 -- 172.21.15.173:0/574617945 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a48ebd0340 con 0x55a48f026400 2024-09-13T23:56:58.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.462+0000 7f3118db8700 1 -- 172.21.15.173:0/574617945 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a48f03e000 con 0x55a48f026400 2024-09-13T23:56:58.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.462+0000 7f3135635f40 1 -- 172.21.15.173:0/574617945 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a48ebd0b60 con 0x55a48f026400 2024-09-13T23:56:58.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.462+0000 7f3118db8700 1 -- 172.21.15.173:0/574617945 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55a48ecb9b80 con 0x55a48f026400 2024-09-13T23:56:58.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.462+0000 7f3118db8700 1 --2- 172.21.15.173:0/574617945 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a48f0b8000 0x55a48f0be000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.462+0000 7f3118db8700 1 -- 172.21.15.173:0/574617945 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55a48ec25500 con 0x55a48f026400 2024-09-13T23:56:58.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.462+0000 7f3135635f40 5 note: GC not initialized 2024-09-13T23:56:58.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.462+0000 7f31345ef700 1 --2- 172.21.15.173:0/574617945 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a48f0b8000 0x55a48f0be000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.462+0000 7f31345ef700 1 --2- 172.21.15.173:0/574617945 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a48f0b8000 0x55a48f0be000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55a48fa33260 tx=0x55a48f084660 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.466+0000 7f31165b3700 20 reqs_thread_entry: start 2024-09-13T23:56:58.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.466+0000 7f3135635f40 20 init_complete bucket index max shards: 11 2024-09-13T23:56:58.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.466+0000 7f3135635f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:56:58.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.466+0000 7f31145af700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:28 2024 2024-09-13T23:56:58.470 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:56:58.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.466+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f025800 con 0x55a48ef59400 2024-09-13T23:56:58.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.466+0000 7f3113d8d700 20 reqs_thread_entry: start 2024-09-13T23:56:58.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.466+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.466+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f025c00 con 0x55a48ef59400 2024-09-13T23:56:58.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.466+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.466+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59400 2024-09-13T23:56:58.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.466+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.466+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f0b8400 con 0x55a48ef59c00 2024-09-13T23:56:58.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.470+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.470+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f0b8800 con 0x55a48ef59400 2024-09-13T23:56:58.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.470+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.470+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f0b8c00 con 0x55a48ef59c00 2024-09-13T23:56:58.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.470+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.470+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f0b9000 con 0x55a48ef59000 2024-09-13T23:56:58.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.470+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.470+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f0b9400 con 0x55a48ef59000 2024-09-13T23:56:58.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.470+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.470+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f0b9800 con 0x55a48ef59c00 2024-09-13T23:56:58.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.470+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.470+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f0b9c00 con 0x55a48ef59c00 2024-09-13T23:56:58.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.470+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.470+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f025800 con 0x55a48ef59c00 2024-09-13T23:56:58.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.474+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.474+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f027000 con 0x55a48ef59000 2024-09-13T23:56:58.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.474+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.474+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f027400 con 0x55a48f024000 2024-09-13T23:56:58.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.474+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48f024000 2024-09-13T23:56:58.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.474+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f026800 con 0x55a48ef59c00 2024-09-13T23:56:58.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.474+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.474+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f026000 con 0x55a48f024000 2024-09-13T23:56:58.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.474+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48f024000 2024-09-13T23:56:58.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.474+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f0b9000 con 0x55a48ef59000 2024-09-13T23:56:58.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.474+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.474+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f0b9400 con 0x55a48ef59c00 2024-09-13T23:56:58.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.474+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.474+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f0b8400 con 0x55a48ef59000 2024-09-13T23:56:58.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.474+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 24 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.474+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f0b8c00 con 0x55a48ef59400 2024-09-13T23:56:58.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.478+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.478+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f0b9800 con 0x55a48ef59400 2024-09-13T23:56:58.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.478+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.478+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f024800 con 0x55a48ef59c00 2024-09-13T23:56:58.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.478+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.478+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f025000 con 0x55a48ef59400 2024-09-13T23:56:58.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.478+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.478+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f026c00 con 0x55a48ef59c00 2024-09-13T23:56:58.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.478+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.478+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f027800 con 0x55a48ef59000 2024-09-13T23:56:58.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.478+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 25 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.478+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f027000 con 0x55a48ef59400 2024-09-13T23:56:58.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.482+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.482+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f027400 con 0x55a48ef59400 2024-09-13T23:56:58.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.482+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.482+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f025800 con 0x55a48ef59400 2024-09-13T23:56:58.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.482+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 27 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.482+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f024800 con 0x55a48ef59000 2024-09-13T23:56:58.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.482+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 26 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.482+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f025c00 con 0x55a48ef59c00 2024-09-13T23:56:58.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.482+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.482+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f025000 con 0x55a48ef59c00 2024-09-13T23:56:58.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.482+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.482+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f0b9c00 con 0x55a48ef59400 2024-09-13T23:56:58.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.486+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 28 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.486+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f0b9400 con 0x55a48ef59000 2024-09-13T23:56:58.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.486+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 27 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.486+0000 7f311adbc700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:58.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.486+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94165262319616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f0b8800 con 0x55a48ef59000 2024-09-13T23:56:58.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.490+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 28 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94165262319616] v33'47 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.490+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94165260679936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f0b8c00 con 0x55a48ef59400 2024-09-13T23:56:58.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.494+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 29 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94165260679936] v33'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.494+0000 7f3135635f40 20 remove_watcher() i=0 2024-09-13T23:56:58.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.494+0000 7f3135635f40 2 removed watcher, disabling cache 2024-09-13T23:56:58.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.494+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94165260681088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f0b9800 con 0x55a48ef59000 2024-09-13T23:56:58.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.494+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.1 v2:172.21.15.173:6808/3256211813 29 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94165260681088] v33'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48ef59000 2024-09-13T23:56:58.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.494+0000 7f3135635f40 20 remove_watcher() i=1 2024-09-13T23:56:58.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.494+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94165260682240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48ef59800 con 0x55a48ef59400 2024-09-13T23:56:58.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.498+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 30 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94165260682240] v33'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.498+0000 7f3135635f40 20 remove_watcher() i=2 2024-09-13T23:56:58.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.498+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94165260683392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f026800 con 0x55a48f024000 2024-09-13T23:56:58.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.502+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94165260683392] v33'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48f024000 2024-09-13T23:56:58.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.502+0000 7f3135635f40 20 remove_watcher() i=3 2024-09-13T23:56:58.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.502+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94165260684544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f026c00 con 0x55a48ef59400 2024-09-13T23:56:58.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.502+0000 7f3133dee700 1 -- 172.21.15.173:0/2034952029 <== osd.0 v2:172.21.15.87:6800/3507919120 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94165260684544] v33'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5200 con 0x55a48ef59400 2024-09-13T23:56:58.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.502+0000 7f3135635f40 20 remove_watcher() i=4 2024-09-13T23:56:58.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.502+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94165260685696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f0b9c00 con 0x55a48ef59c00 2024-09-13T23:56:58.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.506+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94165260685696] v33'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.506+0000 7f3135635f40 20 remove_watcher() i=5 2024-09-13T23:56:58.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.506+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94165260686848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f0b8c00 con 0x55a48ef59c00 2024-09-13T23:56:58.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.510+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 <== osd.3 v2:172.21.15.173:6800/4020038786 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94165260686848] v33'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc5440 con 0x55a48ef59c00 2024-09-13T23:56:58.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.510+0000 7f3135635f40 20 remove_watcher() i=6 2024-09-13T23:56:58.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.510+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94165260688000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a48f0b9000 con 0x55a48f024000 2024-09-13T23:56:58.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.510+0000 7f31345ef700 1 -- 172.21.15.173:0/2034952029 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94165260688000] v33'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a48efc4b40 con 0x55a48f024000 2024-09-13T23:56:58.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.510+0000 7f3135635f40 20 remove_watcher() i=7 2024-09-13T23:56:58.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.510+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a48ef59400 msgr2=0x55a48eea5b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.510+0000 7f3135635f40 1 --2- 172.21.15.173:0/2034952029 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a48ef59400 0x55a48eea5b80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.510+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a48ef59000 msgr2=0x55a48eea5600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.510+0000 7f3135635f40 1 --2- 172.21.15.173:0/2034952029 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a48ef59000 0x55a48eea5600 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.510+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a48f024000 msgr2=0x55a48eea4580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.510+0000 7f3135635f40 1 --2- 172.21.15.173:0/2034952029 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a48f024000 0x55a48eea4580 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.510+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a48ef59c00 msgr2=0x55a48eea6c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.510+0000 7f3135635f40 1 --2- 172.21.15.173:0/2034952029 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a48ef59c00 0x55a48eea6c00 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a48ef58c00 msgr2=0x55a48eea6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 --2- 172.21.15.173:0/2034952029 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a48ef58c00 0x55a48eea6680 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55a48ef4fec0 tx=0x55a48ef19920 comp rx=0 tx=0).stop 2024-09-13T23:56:58.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbfc00 msgr2=0x55a48eea5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 --2- 172.21.15.173:0/2034952029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbfc00 0x55a48eea5080 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55a48fa32720 tx=0x55a48ef185a0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f31335ed700 1 -- 172.21.15.173:0/2034952029 reap_dead start 2024-09-13T23:56:58.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 shutdown_connections 2024-09-13T23:56:58.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 --2- 172.21.15.173:0/2034952029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbfc00 0x55a48eea5080 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 >> 172.21.15.173:0/2034952029 conn(0x55a48ebbf800 msgr2=0x55a48ecbf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 shutdown_connections 2024-09-13T23:56:58.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 -- 172.21.15.173:0/2034952029 wait complete. 2024-09-13T23:56:58.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 -- 172.21.15.173:0/574617945 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a48f0b8000 msgr2=0x55a48f0be000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 --2- 172.21.15.173:0/574617945 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a48f0b8000 0x55a48f0be000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55a48fa33260 tx=0x55a48f084660 comp rx=0 tx=0).stop 2024-09-13T23:56:58.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 -- 172.21.15.173:0/574617945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48f026400 msgr2=0x55a48eea7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 --2- 172.21.15.173:0/574617945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48f026400 0x55a48eea7180 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55a48f0362a0 tx=0x55a48ef19a40 comp rx=0 tx=0).stop 2024-09-13T23:56:58.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 -- 172.21.15.173:0/574617945 shutdown_connections 2024-09-13T23:56:58.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 --2- 172.21.15.173:0/574617945 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a48f0b8000 0x55a48f0be000 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 --2- 172.21.15.173:0/574617945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48f026400 0x55a48eea7180 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 -- 172.21.15.173:0/574617945 >> 172.21.15.173:0/574617945 conn(0x55a48f027c00 msgr2=0x55a48ecc0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 -- 172.21.15.173:0/574617945 shutdown_connections 2024-09-13T23:56:58.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 -- 172.21.15.173:0/574617945 wait complete. 2024-09-13T23:56:58.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 -- 172.21.15.173:0/3860402176 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a48ef58000 msgr2=0x55a48eea6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 --2- 172.21.15.173:0/3860402176 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a48ef58000 0x55a48eea6100 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55a48fa32ff0 tx=0x55a48ef188a0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 -- 172.21.15.173:0/3860402176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbf400 msgr2=0x55a48eea4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 --2- 172.21.15.173:0/3860402176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbf400 0x55a48eea4b00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55a48fa23f20 tx=0x55a48ecc3920 comp rx=0 tx=0).stop 2024-09-13T23:56:58.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 -- 172.21.15.173:0/3860402176 shutdown_connections 2024-09-13T23:56:58.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 --2- 172.21.15.173:0/3860402176 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a48ef58000 0x55a48eea6100 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 --2- 172.21.15.173:0/3860402176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a48ebbf400 0x55a48eea4b00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 -- 172.21.15.173:0/3860402176 >> 172.21.15.173:0/3860402176 conn(0x55a48ebbec00 msgr2=0x55a48ecbf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 -- 172.21.15.173:0/3860402176 shutdown_connections 2024-09-13T23:56:58.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.514+0000 7f3135635f40 1 -- 172.21.15.173:0/3860402176 wait complete. 2024-09-13T23:56:58.522 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:56:58.522 INFO:teuthology.orchestra.run.smithi173.stdout: "entries": [], 2024-09-13T23:56:58.522 INFO:teuthology.orchestra.run.smithi173.stdout: "summary": [] 2024-09-13T23:56:58.523 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:56:58.524 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-13T23:56:58.524 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:56:58.524 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:56:58.524 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:56:58.611 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:56:58.612 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:56:58.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.606+0000 7f12852e4f40 1 Processor -- start 2024-09-13T23:56:58.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.606+0000 7f12852e4f40 1 -- start start 2024-09-13T23:56:58.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.606+0000 7f12852e4f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x561431795400 0x561431a7a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.606+0000 7f12852e4f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561431859500 con 0x561431795000 2024-09-13T23:56:58.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.606+0000 7f12852e4f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x561431822a00 con 0x561431795400 2024-09-13T23:56:58.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.606+0000 7f128329c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x561431795400 0x561431a7a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.606+0000 7f1283a9d700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x561431795000 0x561431894800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:57812/0 (socket says 172.21.15.173:57812) 2024-09-13T23:56:58.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.606+0000 7f128329c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x561431795400 0x561431a7a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58262/0 (socket says 172.21.15.173:58262) 2024-09-13T23:56:58.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.606+0000 7f1283a9d700 1 -- 172.21.15.173:0/4051420591 learned_addr learned my addr 172.21.15.173:0/4051420591 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:56:58.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.610+0000 7f128329c700 1 -- 172.21.15.173:0/4051420591 >> v1:172.21.15.87:6789/0 conn(0x561431795000 legacy=0x561431894800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.610+0000 7f128329c700 1 -- 172.21.15.173:0/4051420591 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614317a7d40 con 0x561431795400 2024-09-13T23:56:58.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.610+0000 7f128329c700 1 --2- 172.21.15.173:0/4051420591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795400 0x561431a7a580 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x561431a75920 tx=0x561431899920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ccce81b2e02903d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.610+0000 7f1282a9b700 1 -- 172.21.15.173:0/4051420591 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5614318394a0 con 0x561431795400 2024-09-13T23:56:58.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.610+0000 7f1282a9b700 1 -- 172.21.15.173:0/4051420591 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561431859800 con 0x561431795400 2024-09-13T23:56:58.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.610+0000 7f1282a9b700 1 -- 172.21.15.173:0/4051420591 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561431839600 con 0x561431795400 2024-09-13T23:56:58.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.610+0000 7f12852e4f40 1 -- 172.21.15.173:0/4051420591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795400 msgr2=0x561431a7a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.610+0000 7f12852e4f40 1 --2- 172.21.15.173:0/4051420591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795400 0x561431a7a580 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x561431a75920 tx=0x561431899920 comp rx=0 tx=0).stop 2024-09-13T23:56:58.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.610+0000 7f12852e4f40 1 -- 172.21.15.173:0/4051420591 shutdown_connections 2024-09-13T23:56:58.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.610+0000 7f12852e4f40 1 --2- 172.21.15.173:0/4051420591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795400 0x561431a7a580 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.610+0000 7f12852e4f40 1 -- 172.21.15.173:0/4051420591 >> 172.21.15.173:0/4051420591 conn(0x561431794c00 msgr2=0x561431894000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.610+0000 7f12852e4f40 1 -- 172.21.15.173:0/4051420591 shutdown_connections 2024-09-13T23:56:58.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.610+0000 7f12852e4f40 1 -- 172.21.15.173:0/4051420591 wait complete. 2024-09-13T23:56:58.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.610+0000 7f12852e4f40 1 Processor -- start 2024-09-13T23:56:58.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.610+0000 7f12852e4f40 1 -- start start 2024-09-13T23:56:58.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.610+0000 7f12852e4f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795000 0x561431a7a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.610+0000 7f12852e4f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x561431822500 con 0x561431795000 2024-09-13T23:56:58.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.610+0000 7f1283a9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795000 0x561431a7a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.610+0000 7f1283a9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795000 0x561431a7a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58270/0 (socket says 172.21.15.173:58270) 2024-09-13T23:56:58.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.610+0000 7f1283a9d700 1 -- 172.21.15.173:0/1451843051 learned_addr learned my addr 172.21.15.173:0/1451843051 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.614+0000 7f1283a9d700 1 -- 172.21.15.173:0/1451843051 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614317a7ba0 con 0x561431795000 2024-09-13T23:56:58.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.614+0000 7f1283a9d700 1 --2- 172.21.15.173:0/1451843051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795000 0x561431a7a580 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x5614318f1e00 tx=0x561431899b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99c341df5d62c6f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.614+0000 7f128229a700 1 -- 172.21.15.173:0/1451843051 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5614318394a0 con 0x561431795000 2024-09-13T23:56:58.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.614+0000 7f128229a700 1 -- 172.21.15.173:0/1451843051 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561431859b00 con 0x561431795000 2024-09-13T23:56:58.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.614+0000 7f128229a700 1 -- 172.21.15.173:0/1451843051 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561431839600 con 0x561431795000 2024-09-13T23:56:58.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.614+0000 7f12852e4f40 1 -- 172.21.15.173:0/1451843051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795000 msgr2=0x561431a7a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.614+0000 7f12852e4f40 1 --2- 172.21.15.173:0/1451843051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795000 0x561431a7a580 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x5614318f1e00 tx=0x561431899b60 comp rx=0 tx=0).stop 2024-09-13T23:56:58.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.614+0000 7f12852e4f40 1 -- 172.21.15.173:0/1451843051 shutdown_connections 2024-09-13T23:56:58.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.614+0000 7f12852e4f40 1 --2- 172.21.15.173:0/1451843051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795000 0x561431a7a580 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.614+0000 7f12852e4f40 1 -- 172.21.15.173:0/1451843051 >> 172.21.15.173:0/1451843051 conn(0x561431794c00 msgr2=0x561431895000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.614+0000 7f12852e4f40 1 -- 172.21.15.173:0/1451843051 shutdown_connections 2024-09-13T23:56:58.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.614+0000 7f12852e4f40 1 -- 172.21.15.173:0/1451843051 wait complete. 2024-09-13T23:56:58.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.614+0000 7f12852e4f40 1 Processor -- start 2024-09-13T23:56:58.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.614+0000 7f12852e4f40 1 -- start start 2024-09-13T23:56:58.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.614+0000 7f12852e4f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795400 0x561431a7ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.614+0000 7f12852e4f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614318223c0 con 0x561431795400 2024-09-13T23:56:58.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.614+0000 7f1283a9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795400 0x561431a7ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.614+0000 7f1283a9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795400 0x561431a7ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58278/0 (socket says 172.21.15.173:58278) 2024-09-13T23:56:58.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.614+0000 7f1283a9d700 1 -- 172.21.15.173:0/3852248790 learned_addr learned my addr 172.21.15.173:0/3852248790 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.614+0000 7f1283a9d700 1 -- 172.21.15.173:0/3852248790 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614317a7a00 con 0x561431795400 2024-09-13T23:56:58.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.618+0000 7f1283a9d700 1 --2- 172.21.15.173:0/3852248790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795400 0x561431a7ab00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x5614318f1e90 tx=0x561431899a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.618+0000 7f1280a97700 1 -- 172.21.15.173:0/3852248790 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5614318398c0 con 0x561431795400 2024-09-13T23:56:58.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.618+0000 7f1280a97700 1 -- 172.21.15.173:0/3852248790 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561431859c80 con 0x561431795400 2024-09-13T23:56:58.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.618+0000 7f12852e4f40 1 -- 172.21.15.173:0/3852248790 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5614317a7860 con 0x561431795400 2024-09-13T23:56:58.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.618+0000 7f1280a97700 1 -- 172.21.15.173:0/3852248790 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5614318394a0 con 0x561431795400 2024-09-13T23:56:58.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.618+0000 7f12852e4f40 1 -- 172.21.15.173:0/3852248790 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5614317a76c0 con 0x561431795400 2024-09-13T23:56:58.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.618+0000 7f12852e4f40 1 Processor -- start 2024-09-13T23:56:58.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.618+0000 7f12852e4f40 1 -- start start 2024-09-13T23:56:58.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.618+0000 7f12852e4f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795c00 0x561431a7b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.618+0000 7f12852e4f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x561431822000 con 0x561431795c00 2024-09-13T23:56:58.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.618+0000 7f1280a97700 1 -- 172.21.15.173:0/3852248790 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x56143188eb00 con 0x561431795400 2024-09-13T23:56:58.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.618+0000 7f128429e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795c00 0x561431a7b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.618+0000 7f128429e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795c00 0x561431a7b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58292/0 (socket says 172.21.15.173:58292) 2024-09-13T23:56:58.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.618+0000 7f128429e700 1 -- 172.21.15.173:0/3885435865 learned_addr learned my addr 172.21.15.173:0/3885435865 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.618+0000 7f1280a97700 1 --2- 172.21.15.173:0/3852248790 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561431b42000 0x561431a7c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.618+0000 7f1280a97700 1 -- 172.21.15.173:0/3852248790 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5614317fb180 con 0x561431795400 2024-09-13T23:56:58.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.618+0000 7f128429e700 1 -- 172.21.15.173:0/3885435865 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614317a6000 con 0x561431795c00 2024-09-13T23:56:58.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.618+0000 7f1283a9d700 1 --2- 172.21.15.173:0/3852248790 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561431b42000 0x561431a7c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.618+0000 7f128429e700 1 --2- 172.21.15.173:0/3885435865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795c00 0x561431a7b080 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x561431b1c2a0 tx=0x561431899f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24469a659d6b3a59 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.618+0000 7f127e292700 1 -- 172.21.15.173:0/3885435865 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5614318398c0 con 0x561431795c00 2024-09-13T23:56:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.622+0000 7f127e292700 1 -- 172.21.15.173:0/3885435865 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561431b3e000 con 0x561431795c00 2024-09-13T23:56:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.622+0000 7f127e292700 1 -- 172.21.15.173:0/3885435865 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5614318394a0 con 0x561431795c00 2024-09-13T23:56:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.622+0000 7f12852e4f40 1 -- 172.21.15.173:0/3885435865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795c00 msgr2=0x561431a7b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.622+0000 7f12852e4f40 1 --2- 172.21.15.173:0/3885435865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795c00 0x561431a7b080 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x561431b1c2a0 tx=0x561431899f20 comp rx=0 tx=0).stop 2024-09-13T23:56:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.622+0000 7f1283a9d700 1 --2- 172.21.15.173:0/3852248790 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561431b42000 0x561431a7c100 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x561431ac5500 tx=0x561431afc240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.622+0000 7f12852e4f40 1 -- 172.21.15.173:0/3885435865 shutdown_connections 2024-09-13T23:56:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.622+0000 7f12852e4f40 1 --2- 172.21.15.173:0/3885435865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795c00 0x561431a7b080 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.622+0000 7f12852e4f40 1 -- 172.21.15.173:0/3885435865 >> 172.21.15.173:0/3885435865 conn(0x561431795800 msgr2=0x561431895800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.622+0000 7f12852e4f40 1 -- 172.21.15.173:0/3885435865 shutdown_connections 2024-09-13T23:56:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.622+0000 7f12852e4f40 1 -- 172.21.15.173:0/3885435865 wait complete. 2024-09-13T23:56:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.622+0000 7f12852e4f40 1 Processor -- start 2024-09-13T23:56:58.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.622+0000 7f12852e4f40 1 -- start start 2024-09-13T23:56:58.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.622+0000 7f12852e4f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795c00 0x561431a7b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.622+0000 7f12852e4f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614317ba640 con 0x561431795c00 2024-09-13T23:56:58.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.622+0000 7f128429e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795c00 0x561431a7b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.622+0000 7f128429e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795c00 0x561431a7b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58294/0 (socket says 172.21.15.173:58294) 2024-09-13T23:56:58.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.622+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 learned_addr learned my addr 172.21.15.173:0/2807583184 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.622+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614317a6ea0 con 0x561431795c00 2024-09-13T23:56:58.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.622+0000 7f128429e700 1 --2- 172.21.15.173:0/2807583184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795c00 0x561431a7b080 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x5614318f1f50 tx=0x561431afc900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.622+0000 7f127ca8f700 1 -- 172.21.15.173:0/2807583184 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561431839b80 con 0x561431795c00 2024-09-13T23:56:58.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.622+0000 7f127ca8f700 1 -- 172.21.15.173:0/2807583184 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561431b3e180 con 0x561431795c00 2024-09-13T23:56:58.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.622+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5614317a6820 con 0x561431795c00 2024-09-13T23:56:58.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.622+0000 7f127ca8f700 1 -- 172.21.15.173:0/2807583184 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5614318398c0 con 0x561431795c00 2024-09-13T23:56:58.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.622+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5614317a69c0 con 0x561431795c00 2024-09-13T23:56:58.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.626+0000 7f127ca8f700 1 -- 172.21.15.173:0/2807583184 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x56143188edc0 con 0x561431795c00 2024-09-13T23:56:58.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.626+0000 7f12852e4f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.626+0000 7f127ca8f700 1 --2- 172.21.15.173:0/2807583184 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561431b42c00 0x561431a7c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.626+0000 7f127ca8f700 1 -- 172.21.15.173:0/2807583184 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5614317fb340 con 0x561431795c00 2024-09-13T23:56:58.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.626+0000 7f128329c700 1 --2- 172.21.15.173:0/2807583184 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561431b42c00 0x561431a7c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.626+0000 7f12852e4f40 1 --2- 172.21.15.173:0/2807583184 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x561431b43000 0x561431a7b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.626+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43400 con 0x561431b43000 2024-09-13T23:56:58.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.626+0000 7f128429e700 1 --2- 172.21.15.173:0/2807583184 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x561431b43000 0x561431a7b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.626+0000 7f128329c700 1 --2- 172.21.15.173:0/2807583184 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561431b42c00 0x561431a7c680 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x561431a75920 tx=0x561431899800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.626+0000 7f128429e700 1 --2- 172.21.15.173:0/2807583184 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x561431b43000 0x561431a7b600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.626+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561431be6b40 con 0x561431b43000 2024-09-13T23:56:58.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.626+0000 7f12852e4f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.626+0000 7f12852e4f40 20 realm 2024-09-13T23:56:58.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.626+0000 7f12852e4f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.626+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43000 2024-09-13T23:56:58.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.626+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561431be6b40 con 0x561431b43000 2024-09-13T23:56:58.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.626+0000 7f12852e4f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.626+0000 7f12852e4f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:56:58.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.626+0000 7f12852e4f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.626+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43c00 con 0x561431b43000 2024-09-13T23:56:58.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.630+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561431be6b40 con 0x561431b43000 2024-09-13T23:56:58.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.630+0000 7f12852e4f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.630+0000 7f12852e4f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.630+0000 7f12852e4f40 1 --2- 172.21.15.173:0/2807583184 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x561431b43400 0x561431a7bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.630+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43400 2024-09-13T23:56:58.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.630+0000 7f1283a9d700 1 --2- 172.21.15.173:0/2807583184 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x561431b43400 0x561431a7bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.630+0000 7f1283a9d700 1 --2- 172.21.15.173:0/2807583184 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x561431b43400 0x561431a7bb80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.630+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x561431be7200 con 0x561431b43400 2024-09-13T23:56:58.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.630+0000 7f12852e4f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:58.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.630+0000 7f12852e4f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.630+0000 7f12852e4f40 1 --2- 172.21.15.173:0/2807583184 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x561431b43c00 0x561431a7cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.630+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431bf4000 con 0x561431b43c00 2024-09-13T23:56:58.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.630+0000 7f128329c700 1 --2- 172.21.15.173:0/2807583184 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x561431b43c00 0x561431a7cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.630+0000 7f128329c700 1 --2- 172.21.15.173:0/2807583184 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x561431b43c00 0x561431a7cc00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.630+0000 7f128329c700 1 -- 172.21.15.173:0/2807583184 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x561431be7440 con 0x561431b43c00 2024-09-13T23:56:58.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.630+0000 7f12852e4f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:56:58.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.630+0000 7f12852e4f40 20 searching for the correct realm 2024-09-13T23:56:58.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.630+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431bf4400 con 0x561431b43c00 2024-09-13T23:56:58.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.634+0000 7f128329c700 1 -- 172.21.15.173:0/2807583184 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x561431be7440 con 0x561431b43c00 2024-09-13T23:56:58.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.634+0000 7f128329c700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431bf4000 con 0x561431b43400 2024-09-13T23:56:58.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.634+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be7200 con 0x561431b43400 2024-09-13T23:56:58.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.634+0000 7f1283a9d700 1 --2- 172.21.15.173:0/2807583184 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x561431bf4000 0x561431a7a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.634+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431bf4000 2024-09-13T23:56:58.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.634+0000 7f128429e700 1 --2- 172.21.15.173:0/2807583184 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x561431bf4000 0x561431a7a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.634+0000 7f128429e700 1 --2- 172.21.15.173:0/2807583184 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x561431bf4000 0x561431a7a580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.634+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be6b40 con 0x561431bf4000 2024-09-13T23:56:58.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.634+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43000 2024-09-13T23:56:58.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.634+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x561431be6b40 con 0x561431b43000 2024-09-13T23:56:58.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.634+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43000 2024-09-13T23:56:58.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.634+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be6b40 con 0x561431b43000 2024-09-13T23:56:58.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.634+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43c00 2024-09-13T23:56:58.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.638+0000 7f128329c700 1 -- 172.21.15.173:0/2807583184 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be7440 con 0x561431b43c00 2024-09-13T23:56:58.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.638+0000 7f128329c700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43000 2024-09-13T23:56:58.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.638+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be6b40 con 0x561431b43000 2024-09-13T23:56:58.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.638+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43400 2024-09-13T23:56:58.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.638+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be7200 con 0x561431b43400 2024-09-13T23:56:58.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.638+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43400 2024-09-13T23:56:58.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.638+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be7200 con 0x561431b43400 2024-09-13T23:56:58.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.638+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43000 2024-09-13T23:56:58.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.638+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be6b40 con 0x561431b43000 2024-09-13T23:56:58.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.638+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431bf4000 2024-09-13T23:56:58.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.638+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be6b40 con 0x561431bf4000 2024-09-13T23:56:58.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.638+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43000 2024-09-13T23:56:58.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.638+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be6b40 con 0x561431b43000 2024-09-13T23:56:58.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.638+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431bf4000 2024-09-13T23:56:58.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.642+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be6b40 con 0x561431bf4000 2024-09-13T23:56:58.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.642+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43400 2024-09-13T23:56:58.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.642+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be7200 con 0x561431b43400 2024-09-13T23:56:58.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.642+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43c00 2024-09-13T23:56:58.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.642+0000 7f128329c700 1 -- 172.21.15.173:0/2807583184 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be7440 con 0x561431b43c00 2024-09-13T23:56:58.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.642+0000 7f128329c700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43000 2024-09-13T23:56:58.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.642+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be6b40 con 0x561431b43000 2024-09-13T23:56:58.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.642+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43400 2024-09-13T23:56:58.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.642+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be7200 con 0x561431b43400 2024-09-13T23:56:58.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.642+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43c00 2024-09-13T23:56:58.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.642+0000 7f128329c700 1 -- 172.21.15.173:0/2807583184 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be7440 con 0x561431b43c00 2024-09-13T23:56:58.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.642+0000 7f128329c700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43000 2024-09-13T23:56:58.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.646+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be6b40 con 0x561431b43000 2024-09-13T23:56:58.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.646+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43000 2024-09-13T23:56:58.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.646+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be6b40 con 0x561431b43000 2024-09-13T23:56:58.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.646+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43000 2024-09-13T23:56:58.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.646+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be6b40 con 0x561431b43000 2024-09-13T23:56:58.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.646+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43c00 2024-09-13T23:56:58.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.646+0000 7f128329c700 1 -- 172.21.15.173:0/2807583184 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be7440 con 0x561431b43c00 2024-09-13T23:56:58.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.646+0000 7f128329c700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431bf4000 2024-09-13T23:56:58.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.646+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be6b40 con 0x561431bf4000 2024-09-13T23:56:58.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.646+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43000 2024-09-13T23:56:58.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.646+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be6b40 con 0x561431b43000 2024-09-13T23:56:58.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.646+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431bf4000 2024-09-13T23:56:58.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.646+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be6b40 con 0x561431bf4000 2024-09-13T23:56:58.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.646+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43c00 2024-09-13T23:56:58.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.646+0000 7f128329c700 1 -- 172.21.15.173:0/2807583184 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be7440 con 0x561431b43c00 2024-09-13T23:56:58.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.646+0000 7f128329c700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431bf4000 2024-09-13T23:56:58.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.650+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be6b40 con 0x561431bf4000 2024-09-13T23:56:58.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.650+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43400 2024-09-13T23:56:58.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.650+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be7200 con 0x561431b43400 2024-09-13T23:56:58.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.650+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43400 2024-09-13T23:56:58.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.650+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be7200 con 0x561431b43400 2024-09-13T23:56:58.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.650+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43c00 2024-09-13T23:56:58.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.650+0000 7f128329c700 1 -- 172.21.15.173:0/2807583184 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be7440 con 0x561431b43c00 2024-09-13T23:56:58.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.650+0000 7f128329c700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43400 2024-09-13T23:56:58.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.650+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x561431be7200 con 0x561431b43400 2024-09-13T23:56:58.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.650+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43400 2024-09-13T23:56:58.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.650+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561431be7200 con 0x561431b43400 2024-09-13T23:56:58.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.650+0000 7f12852e4f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:56:58.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.650+0000 7f12852e4f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:56:58.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.650+0000 7f12852e4f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:56:58.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.650+0000 7f12852e4f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:56:58.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.650+0000 7f12852e4f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.650+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431bf4800 con 0x561431b43000 2024-09-13T23:56:58.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561431be6b40 con 0x561431b43000 2024-09-13T23:56:58.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f12852e4f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f12852e4f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431bf4c00 con 0x561431b43400 2024-09-13T23:56:58.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x561431be7200 con 0x561431b43400 2024-09-13T23:56:58.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f12852e4f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:58.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f12852e4f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431bf5000 con 0x561431b43000 2024-09-13T23:56:58.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x561431be6b40 con 0x561431b43000 2024-09-13T23:56:58.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f12852e4f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:56:58.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f12852e4f40 20 zone default found 2024-09-13T23:56:58.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f12852e4f40 4 Realm: () 2024-09-13T23:56:58.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f12852e4f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:56:58.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f12852e4f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:56:58.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f12852e4f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:56:58.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f12852e4f40 20 zonegroup default 2024-09-13T23:56:58.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f12852e4f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431bf5400 con 0x561431bf4000 2024-09-13T23:56:58.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x561431be6b40 con 0x561431bf4000 2024-09-13T23:56:58.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f12852e4f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f12852e4f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431bf5800 con 0x561431b43c00 2024-09-13T23:56:58.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f128329c700 1 -- 172.21.15.173:0/2807583184 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x561431be7440 con 0x561431b43c00 2024-09-13T23:56:58.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f12852e4f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f12852e4f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431bf5c00 con 0x561431b43c00 2024-09-13T23:56:58.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f128329c700 1 -- 172.21.15.173:0/2807583184 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x561431be7440 con 0x561431b43c00 2024-09-13T23:56:58.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.654+0000 7f12852e4f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.658+0000 7f12852e4f40 20 started sync module instance, tier type = 2024-09-13T23:56:58.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.658+0000 7f12852e4f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:56:58.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.658+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431ada000 con 0x561431b43400 2024-09-13T23:56:58.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.658+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561431be7200 con 0x561431b43400 2024-09-13T23:56:58.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.658+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94644732369664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431ada400 con 0x561431b43400 2024-09-13T23:56:58.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.658+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431ada800 con 0x561431b43000 2024-09-13T23:56:58.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.662+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561431be6b40 con 0x561431b43000 2024-09-13T23:56:58.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.662+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94644732369664] v33'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561431be7200 con 0x561431b43400 2024-09-13T23:56:58.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.662+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94644732370816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431adac00 con 0x561431b43000 2024-09-13T23:56:58.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.662+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431adb000 con 0x561431b43400 2024-09-13T23:56:58.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.666+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94644732370816] v33'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561431be6b40 con 0x561431b43000 2024-09-13T23:56:58.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.666+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561431be7200 con 0x561431b43400 2024-09-13T23:56:58.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.666+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94644732371968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431adb400 con 0x561431b43400 2024-09-13T23:56:58.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.666+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431adb800 con 0x561431bf4000 2024-09-13T23:56:58.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.666+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94644732371968] v33'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561431be7200 con 0x561431b43400 2024-09-13T23:56:58.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.666+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561431be6b40 con 0x561431bf4000 2024-09-13T23:56:58.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.666+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94644732373120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431adbc00 con 0x561431bf4000 2024-09-13T23:56:58.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.666+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431ada800 con 0x561431b43400 2024-09-13T23:56:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.670+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94644732373120] v33'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561431be6b40 con 0x561431bf4000 2024-09-13T23:56:58.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.670+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561431be7200 con 0x561431b43400 2024-09-13T23:56:58.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.670+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94644732374272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431ada000 con 0x561431b43400 2024-09-13T23:56:58.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.670+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431ada400 con 0x561431b43c00 2024-09-13T23:56:58.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.674+0000 7f128329c700 1 -- 172.21.15.173:0/2807583184 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561431be7440 con 0x561431b43c00 2024-09-13T23:56:58.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.674+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94644732375424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431bf4800 con 0x561431b43c00 2024-09-13T23:56:58.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.674+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431bf5000 con 0x561431b43c00 2024-09-13T23:56:58.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.674+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94644732374272] v33'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561431be7200 con 0x561431b43400 2024-09-13T23:56:58.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.674+0000 7f128329c700 1 -- 172.21.15.173:0/2807583184 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94644732375424] v33'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561431be7440 con 0x561431b43c00 2024-09-13T23:56:58.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.674+0000 7f128329c700 1 -- 172.21.15.173:0/2807583184 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561431be7440 con 0x561431b43c00 2024-09-13T23:56:58.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.678+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94644732376576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431bf5400 con 0x561431b43c00 2024-09-13T23:56:58.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.678+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431bf4c00 con 0x561431bf4000 2024-09-13T23:56:58.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.678+0000 7f128329c700 1 -- 172.21.15.173:0/2807583184 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94644732376576] v33'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561431be7440 con 0x561431b43c00 2024-09-13T23:56:58.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.682+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561431be6b40 con 0x561431bf4000 2024-09-13T23:56:58.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.682+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94644732377728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431bf4000 2024-09-13T23:56:58.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.682+0000 7f12852e4f40 20 add_watcher() i=0 2024-09-13T23:56:58.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.682+0000 7f12852e4f40 20 add_watcher() i=1 2024-09-13T23:56:58.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.682+0000 7f12852e4f40 20 add_watcher() i=2 2024-09-13T23:56:58.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.682+0000 7f12852e4f40 20 add_watcher() i=3 2024-09-13T23:56:58.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.682+0000 7f12852e4f40 20 add_watcher() i=4 2024-09-13T23:56:58.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.682+0000 7f12852e4f40 20 add_watcher() i=5 2024-09-13T23:56:58.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.682+0000 7f12852e4f40 20 add_watcher() i=6 2024-09-13T23:56:58.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.686+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94644732377728] v33'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561431be6b40 con 0x561431bf4000 2024-09-13T23:56:58.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.686+0000 7f12852e4f40 20 add_watcher() i=7 2024-09-13T23:56:58.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.686+0000 7f12852e4f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:56:58.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.686+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431adac00 con 0x561431b43000 2024-09-13T23:56:58.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.686+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x561431be6b40 con 0x561431b43000 2024-09-13T23:56:58.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.686+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94644734025728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431adb800 con 0x561431b43000 2024-09-13T23:56:58.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.686+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94644734025728] v33'48 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x561431be6b40 con 0x561431b43000 2024-09-13T23:56:58.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.686+0000 7f126aa6b700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:58.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.690+0000 7f12852e4f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:56:58.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.690+0000 7f12852e4f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:56:58.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.690+0000 7f12852e4f40 1 Processor -- start 2024-09-13T23:56:58.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.690+0000 7f12852e4f40 1 -- start start 2024-09-13T23:56:58.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.690+0000 7f12852e4f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431ada400 0x561431a7d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.690+0000 7f12852e4f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614317ba780 con 0x561431ada400 2024-09-13T23:56:58.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.690+0000 7f128329c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431ada400 0x561431a7d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.690+0000 7f128329c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431ada400 0x561431a7d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58300/0 (socket says 172.21.15.173:58300) 2024-09-13T23:56:58.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.690+0000 7f128329c700 1 -- 172.21.15.173:0/528264026 learned_addr learned my addr 172.21.15.173:0/528264026 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.690+0000 7f128329c700 1 -- 172.21.15.173:0/528264026 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614317a6b60 con 0x561431ada400 2024-09-13T23:56:58.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.690+0000 7f128329c700 1 --2- 172.21.15.173:0/528264026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431ada400 0x561431a7d180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x561431c0e0f0 tx=0x561431899980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d65b04e889f8f2f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.690+0000 7f126a26a700 1 -- 172.21.15.173:0/528264026 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561431839760 con 0x561431ada400 2024-09-13T23:56:58.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.690+0000 7f126a26a700 1 -- 172.21.15.173:0/528264026 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561431b3e600 con 0x561431ada400 2024-09-13T23:56:58.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.690+0000 7f126a26a700 1 -- 172.21.15.173:0/528264026 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561431c10000 con 0x561431ada400 2024-09-13T23:56:58.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.690+0000 7f12852e4f40 1 -- 172.21.15.173:0/528264026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431ada400 msgr2=0x561431a7d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.690+0000 7f12852e4f40 1 --2- 172.21.15.173:0/528264026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431ada400 0x561431a7d180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x561431c0e0f0 tx=0x561431899980 comp rx=0 tx=0).stop 2024-09-13T23:56:58.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.690+0000 7f12852e4f40 1 -- 172.21.15.173:0/528264026 shutdown_connections 2024-09-13T23:56:58.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.690+0000 7f12852e4f40 1 --2- 172.21.15.173:0/528264026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431ada400 0x561431a7d180 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.690+0000 7f12852e4f40 1 -- 172.21.15.173:0/528264026 >> 172.21.15.173:0/528264026 conn(0x561431adbc00 msgr2=0x561431896000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.690+0000 7f12852e4f40 1 -- 172.21.15.173:0/528264026 shutdown_connections 2024-09-13T23:56:58.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.694+0000 7f12852e4f40 1 -- 172.21.15.173:0/528264026 wait complete. 2024-09-13T23:56:58.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.694+0000 7f12852e4f40 1 Processor -- start 2024-09-13T23:56:58.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.694+0000 7f12852e4f40 1 -- start start 2024-09-13T23:56:58.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.694+0000 7f12852e4f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431ada400 0x561431a7d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.694+0000 7f12852e4f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x561431822000 con 0x561431ada400 2024-09-13T23:56:58.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.694+0000 7f128329c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431ada400 0x561431a7d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.694+0000 7f128329c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431ada400 0x561431a7d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58310/0 (socket says 172.21.15.173:58310) 2024-09-13T23:56:58.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.694+0000 7f128329c700 1 -- 172.21.15.173:0/29468180 learned_addr learned my addr 172.21.15.173:0/29468180 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.694+0000 7f128329c700 1 -- 172.21.15.173:0/29468180 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614317a6d00 con 0x561431ada400 2024-09-13T23:56:58.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.694+0000 7f128329c700 1 --2- 172.21.15.173:0/29468180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431ada400 0x561431a7d180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x561431c0e390 tx=0x561431afdc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.694+0000 7f1268a67700 1 -- 172.21.15.173:0/29468180 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561431c10160 con 0x561431ada400 2024-09-13T23:56:58.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.694+0000 7f1268a67700 1 -- 172.21.15.173:0/29468180 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561431b3e300 con 0x561431ada400 2024-09-13T23:56:58.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.694+0000 7f12852e4f40 1 -- 172.21.15.173:0/29468180 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5614317a6340 con 0x561431ada400 2024-09-13T23:56:58.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.694+0000 7f1268a67700 1 -- 172.21.15.173:0/29468180 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561431c102c0 con 0x561431ada400 2024-09-13T23:56:58.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.694+0000 7f12852e4f40 1 -- 172.21.15.173:0/29468180 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5614317a7d40 con 0x561431ada400 2024-09-13T23:56:58.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.698+0000 7f1268a67700 1 -- 172.21.15.173:0/29468180 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x56143188fb80 con 0x561431ada400 2024-09-13T23:56:58.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.698+0000 7f1268a67700 1 --2- 172.21.15.173:0/29468180 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561431c8c000 0x561431c92000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.698+0000 7f1268a67700 1 -- 172.21.15.173:0/29468180 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5614317fb500 con 0x561431ada400 2024-09-13T23:56:58.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.698+0000 7f12852e4f40 5 note: GC not initialized 2024-09-13T23:56:58.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.698+0000 7f128429e700 1 --2- 172.21.15.173:0/29468180 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561431c8c000 0x561431c92000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.698+0000 7f128429e700 1 --2- 172.21.15.173:0/29468180 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561431c8c000 0x561431c92000 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x561431b95710 tx=0x561431c58ae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.698+0000 7f1266262700 20 reqs_thread_entry: start 2024-09-13T23:56:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.698+0000 7f12852e4f40 20 init_complete bucket index max shards: 11 2024-09-13T23:56:58.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.698+0000 7f12852e4f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:56:58.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.698+0000 7f126425e700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:29 2024 2024-09-13T23:56:58.705 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:56:58.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.698+0000 7f1263a3c700 20 reqs_thread_entry: start 2024-09-13T23:56:58.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.698+0000 7f12852e4f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.698+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431bf5800 con 0x561431b43000 2024-09-13T23:56:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.702+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x561431be6b40 con 0x561431b43000 2024-09-13T23:56:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.702+0000 7f12852e4f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:could not fetch user info: no user info saved 2024-09-13T23:56:58.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.702+0000 7f126aa6b700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:58.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.702+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94644734025728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431bf5c00 con 0x561431b43000 2024-09-13T23:56:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.706+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94644734025728] v33'49 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x561431be6b40 con 0x561431b43000 2024-09-13T23:56:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.706+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94644732369664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431b43800 con 0x561431b43400 2024-09-13T23:56:58.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.706+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94644732369664] v33'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561431be7200 con 0x561431b43400 2024-09-13T23:56:58.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.706+0000 7f12852e4f40 20 remove_watcher() i=0 2024-09-13T23:56:58.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.706+0000 7f12852e4f40 2 removed watcher, disabling cache 2024-09-13T23:56:58.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.706+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94644732370816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431c8c400 con 0x561431b43000 2024-09-13T23:56:58.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.710+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94644732370816] v33'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561431be6b40 con 0x561431b43000 2024-09-13T23:56:58.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.710+0000 7f12852e4f40 20 remove_watcher() i=1 2024-09-13T23:56:58.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.710+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94644732371968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431c8c800 con 0x561431b43400 2024-09-13T23:56:58.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.714+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94644732371968] v33'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561431be7200 con 0x561431b43400 2024-09-13T23:56:58.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.714+0000 7f12852e4f40 20 remove_watcher() i=2 2024-09-13T23:56:58.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.714+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94644732373120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431c8cc00 con 0x561431bf4000 2024-09-13T23:56:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.714+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94644732373120] v33'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561431be6b40 con 0x561431bf4000 2024-09-13T23:56:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.714+0000 7f12852e4f40 20 remove_watcher() i=3 2024-09-13T23:56:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.714+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94644732374272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431c8d000 con 0x561431b43400 2024-09-13T23:56:58.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.718+0000 7f1283a9d700 1 -- 172.21.15.173:0/2807583184 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94644732374272] v33'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561431be7200 con 0x561431b43400 2024-09-13T23:56:58.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.718+0000 7f12852e4f40 20 remove_watcher() i=4 2024-09-13T23:56:58.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.718+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94644732375424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431c8d400 con 0x561431b43c00 2024-09-13T23:56:58.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.722+0000 7f128329c700 1 -- 172.21.15.173:0/2807583184 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94644732375424] v33'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561431be7440 con 0x561431b43c00 2024-09-13T23:56:58.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.722+0000 7f12852e4f40 20 remove_watcher() i=5 2024-09-13T23:56:58.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.722+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94644732376576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431c8d800 con 0x561431b43c00 2024-09-13T23:56:58.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.722+0000 7f128329c700 1 -- 172.21.15.173:0/2807583184 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94644732376576] v33'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561431be7440 con 0x561431b43c00 2024-09-13T23:56:58.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.722+0000 7f12852e4f40 20 remove_watcher() i=6 2024-09-13T23:56:58.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.722+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94644732377728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561431c8dc00 con 0x561431bf4000 2024-09-13T23:56:58.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f128429e700 1 -- 172.21.15.173:0/2807583184 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94644732377728] v33'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561431be6b40 con 0x561431bf4000 2024-09-13T23:56:58.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 20 remove_watcher() i=7 2024-09-13T23:56:58.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x561431b43400 msgr2=0x561431a7bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 --2- 172.21.15.173:0/2807583184 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x561431b43400 0x561431a7bb80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x561431b43000 msgr2=0x561431a7b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 --2- 172.21.15.173:0/2807583184 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x561431b43000 0x561431a7b600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x561431bf4000 msgr2=0x561431a7a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 --2- 172.21.15.173:0/2807583184 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x561431bf4000 0x561431a7a580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x561431b43c00 msgr2=0x561431a7cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 --2- 172.21.15.173:0/2807583184 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x561431b43c00 0x561431a7cc00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561431b42c00 msgr2=0x561431a7c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 --2- 172.21.15.173:0/2807583184 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561431b42c00 0x561431a7c680 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x561431a75920 tx=0x561431899800 comp rx=0 tx=0).stop 2024-09-13T23:56:58.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795c00 msgr2=0x561431a7b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 --2- 172.21.15.173:0/2807583184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795c00 0x561431a7b080 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x5614318f1f50 tx=0x561431afc900 comp rx=0 tx=0).stop 2024-09-13T23:56:58.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f128329c700 1 -- 172.21.15.173:0/2807583184 reap_dead start 2024-09-13T23:56:58.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 shutdown_connections 2024-09-13T23:56:58.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 --2- 172.21.15.173:0/2807583184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795c00 0x561431a7b080 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 >> 172.21.15.173:0/2807583184 conn(0x561431795800 msgr2=0x561431895800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 shutdown_connections 2024-09-13T23:56:58.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 -- 172.21.15.173:0/2807583184 wait complete. 2024-09-13T23:56:58.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 -- 172.21.15.173:0/29468180 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561431c8c000 msgr2=0x561431c92000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 --2- 172.21.15.173:0/29468180 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561431c8c000 0x561431c92000 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x561431b95710 tx=0x561431c58ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 -- 172.21.15.173:0/29468180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431ada400 msgr2=0x561431a7d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 --2- 172.21.15.173:0/29468180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431ada400 0x561431a7d180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x561431c0e390 tx=0x561431afdc20 comp rx=0 tx=0).stop 2024-09-13T23:56:58.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 -- 172.21.15.173:0/29468180 shutdown_connections 2024-09-13T23:56:58.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 --2- 172.21.15.173:0/29468180 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561431c8c000 0x561431c92000 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 --2- 172.21.15.173:0/29468180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431ada400 0x561431a7d180 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.726+0000 7f12852e4f40 1 -- 172.21.15.173:0/29468180 >> 172.21.15.173:0/29468180 conn(0x561431adbc00 msgr2=0x561431896000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.730+0000 7f12852e4f40 1 -- 172.21.15.173:0/29468180 shutdown_connections 2024-09-13T23:56:58.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.730+0000 7f12852e4f40 1 -- 172.21.15.173:0/29468180 wait complete. 2024-09-13T23:56:58.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.730+0000 7f12852e4f40 1 -- 172.21.15.173:0/3852248790 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561431b42000 msgr2=0x561431a7c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.730+0000 7f12852e4f40 1 --2- 172.21.15.173:0/3852248790 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561431b42000 0x561431a7c100 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x561431ac5500 tx=0x561431afc240 comp rx=0 tx=0).stop 2024-09-13T23:56:58.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.730+0000 7f12852e4f40 1 -- 172.21.15.173:0/3852248790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795400 msgr2=0x561431a7ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.730+0000 7f12852e4f40 1 --2- 172.21.15.173:0/3852248790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795400 0x561431a7ab00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x5614318f1e90 tx=0x561431899a40 comp rx=0 tx=0).stop 2024-09-13T23:56:58.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.730+0000 7f12852e4f40 1 -- 172.21.15.173:0/3852248790 shutdown_connections 2024-09-13T23:56:58.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.730+0000 7f12852e4f40 1 --2- 172.21.15.173:0/3852248790 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561431b42000 0x561431a7c100 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.730+0000 7f12852e4f40 1 --2- 172.21.15.173:0/3852248790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561431795400 0x561431a7ab00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.730+0000 7f12852e4f40 1 -- 172.21.15.173:0/3852248790 >> 172.21.15.173:0/3852248790 conn(0x561431794c00 msgr2=0x561431895000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.730+0000 7f12852e4f40 1 -- 172.21.15.173:0/3852248790 shutdown_connections 2024-09-13T23:56:58.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.730+0000 7f12852e4f40 1 -- 172.21.15.173:0/3852248790 wait complete. 2024-09-13T23:56:58.738 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-13T23:56:58.739 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-13T23:56:58.739 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-13T23:56:58.739 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-13T23:56:58.791 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:56:58.791 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:56:58.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.786+0000 7f2cbc48df40 1 Processor -- start 2024-09-13T23:56:58.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.786+0000 7f2cbc48df40 1 -- start start 2024-09-13T23:56:58.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.786+0000 7f2cbc48df40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x564f4c8a5400 0x564f4cb8a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.786+0000 7f2cbc48df40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564f4c969500 con 0x564f4c8a5000 2024-09-13T23:56:58.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.786+0000 7f2cbc48df40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x564f4c932a00 con 0x564f4c8a5400 2024-09-13T23:56:58.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.786+0000 7f2cba445700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x564f4c8a5400 0x564f4cb8a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.786+0000 7f2cbac46700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x564f4c8a5000 0x564f4c9a4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:57822/0 (socket says 172.21.15.173:57822) 2024-09-13T23:56:58.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.786+0000 7f2cbac46700 1 -- 172.21.15.173:0/1428732577 learned_addr learned my addr 172.21.15.173:0/1428732577 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:56:58.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.786+0000 7f2cba445700 1 -- 172.21.15.173:0/1428732577 >> v1:172.21.15.87:6789/0 conn(0x564f4c8a5000 legacy=0x564f4c9a4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.786+0000 7f2cba445700 1 -- 172.21.15.173:0/1428732577 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f4c8b7d40 con 0x564f4c8a5400 2024-09-13T23:56:58.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.790+0000 7f2cba445700 1 --2- 172.21.15.173:0/1428732577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5400 0x564f4cb8a580 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x564f4cb85920 tx=0x564f4c9a9920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92162b0f9273c25f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.790+0000 7f2cb9c44700 1 -- 172.21.15.173:0/1428732577 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564f4c9494a0 con 0x564f4c8a5400 2024-09-13T23:56:58.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.790+0000 7f2cb9c44700 1 -- 172.21.15.173:0/1428732577 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564f4c969800 con 0x564f4c8a5400 2024-09-13T23:56:58.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.790+0000 7f2cb9c44700 1 -- 172.21.15.173:0/1428732577 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564f4c949600 con 0x564f4c8a5400 2024-09-13T23:56:58.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.790+0000 7f2cbc48df40 1 -- 172.21.15.173:0/1428732577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5400 msgr2=0x564f4cb8a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.790+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/1428732577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5400 0x564f4cb8a580 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x564f4cb85920 tx=0x564f4c9a9920 comp rx=0 tx=0).stop 2024-09-13T23:56:58.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.790+0000 7f2cbc48df40 1 -- 172.21.15.173:0/1428732577 shutdown_connections 2024-09-13T23:56:58.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.790+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/1428732577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5400 0x564f4cb8a580 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.790+0000 7f2cbc48df40 1 -- 172.21.15.173:0/1428732577 >> 172.21.15.173:0/1428732577 conn(0x564f4c8a4c00 msgr2=0x564f4c9a4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.790+0000 7f2cbc48df40 1 -- 172.21.15.173:0/1428732577 shutdown_connections 2024-09-13T23:56:58.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.790+0000 7f2cbc48df40 1 -- 172.21.15.173:0/1428732577 wait complete. 2024-09-13T23:56:58.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.790+0000 7f2cbc48df40 1 Processor -- start 2024-09-13T23:56:58.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.790+0000 7f2cbc48df40 1 -- start start 2024-09-13T23:56:58.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.790+0000 7f2cbc48df40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5000 0x564f4cb8a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.790+0000 7f2cbc48df40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f4c932500 con 0x564f4c8a5000 2024-09-13T23:56:58.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.790+0000 7f2cbac46700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5000 0x564f4cb8a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.790+0000 7f2cbac46700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5000 0x564f4cb8a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58338/0 (socket says 172.21.15.173:58338) 2024-09-13T23:56:58.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.790+0000 7f2cbac46700 1 -- 172.21.15.173:0/3115478301 learned_addr learned my addr 172.21.15.173:0/3115478301 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.790+0000 7f2cbac46700 1 -- 172.21.15.173:0/3115478301 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f4c8b7ba0 con 0x564f4c8a5000 2024-09-13T23:56:58.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.790+0000 7f2cbac46700 1 --2- 172.21.15.173:0/3115478301 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5000 0x564f4cb8a580 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x564f4ca01e90 tx=0x564f4c9a9b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f092b7a09e85d87 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.794+0000 7f2cb9443700 1 -- 172.21.15.173:0/3115478301 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564f4c9494a0 con 0x564f4c8a5000 2024-09-13T23:56:58.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.794+0000 7f2cb9443700 1 -- 172.21.15.173:0/3115478301 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564f4c969b00 con 0x564f4c8a5000 2024-09-13T23:56:58.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.794+0000 7f2cb9443700 1 -- 172.21.15.173:0/3115478301 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564f4c949600 con 0x564f4c8a5000 2024-09-13T23:56:58.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.794+0000 7f2cbc48df40 1 -- 172.21.15.173:0/3115478301 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5000 msgr2=0x564f4cb8a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.794+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/3115478301 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5000 0x564f4cb8a580 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x564f4ca01e90 tx=0x564f4c9a9b60 comp rx=0 tx=0).stop 2024-09-13T23:56:58.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.794+0000 7f2cbc48df40 1 -- 172.21.15.173:0/3115478301 shutdown_connections 2024-09-13T23:56:58.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.794+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/3115478301 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5000 0x564f4cb8a580 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.794+0000 7f2cbc48df40 1 -- 172.21.15.173:0/3115478301 >> 172.21.15.173:0/3115478301 conn(0x564f4c8a4c00 msgr2=0x564f4c9a5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.794+0000 7f2cbc48df40 1 -- 172.21.15.173:0/3115478301 shutdown_connections 2024-09-13T23:56:58.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.794+0000 7f2cbc48df40 1 -- 172.21.15.173:0/3115478301 wait complete. 2024-09-13T23:56:58.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.794+0000 7f2cbc48df40 1 Processor -- start 2024-09-13T23:56:58.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.794+0000 7f2cbc48df40 1 -- start start 2024-09-13T23:56:58.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.794+0000 7f2cbc48df40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5000 0x564f4cb8a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.794+0000 7f2cbc48df40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f4c9323c0 con 0x564f4c8a5000 2024-09-13T23:56:58.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.794+0000 7f2cbac46700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5000 0x564f4cb8a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.794+0000 7f2cbac46700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5000 0x564f4cb8a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58346/0 (socket says 172.21.15.173:58346) 2024-09-13T23:56:58.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.794+0000 7f2cbac46700 1 -- 172.21.15.173:0/2854122937 learned_addr learned my addr 172.21.15.173:0/2854122937 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.794+0000 7f2cbac46700 1 -- 172.21.15.173:0/2854122937 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f4c8b7a00 con 0x564f4c8a5000 2024-09-13T23:56:58.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.794+0000 7f2cbac46700 1 --2- 172.21.15.173:0/2854122937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5000 0x564f4cb8a580 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x564f4cbbc0c0 tx=0x564f4c9a9a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.794+0000 7f2cb7c40700 1 -- 172.21.15.173:0/2854122937 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564f4c9498c0 con 0x564f4c8a5000 2024-09-13T23:56:58.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.794+0000 7f2cb7c40700 1 -- 172.21.15.173:0/2854122937 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564f4c969c80 con 0x564f4c8a5000 2024-09-13T23:56:58.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.794+0000 7f2cbc48df40 1 -- 172.21.15.173:0/2854122937 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564f4c8b7860 con 0x564f4c8a5000 2024-09-13T23:56:58.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.794+0000 7f2cb7c40700 1 -- 172.21.15.173:0/2854122937 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564f4c9494a0 con 0x564f4c8a5000 2024-09-13T23:56:58.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.794+0000 7f2cbc48df40 1 -- 172.21.15.173:0/2854122937 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f4c8b76c0 con 0x564f4c8a5000 2024-09-13T23:56:58.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cbc48df40 1 Processor -- start 2024-09-13T23:56:58.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cbc48df40 1 -- start start 2024-09-13T23:56:58.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cbc48df40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5800 0x564f4cb8ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cbc48df40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f4c8ca640 con 0x564f4c8a5800 2024-09-13T23:56:58.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cb7c40700 1 -- 172.21.15.173:0/2854122937 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x564f4c99eb00 con 0x564f4c8a5000 2024-09-13T23:56:58.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cbb447700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5800 0x564f4cb8ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cbb447700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5800 0x564f4cb8ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58348/0 (socket says 172.21.15.173:58348) 2024-09-13T23:56:58.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cbb447700 1 -- 172.21.15.173:0/2805546447 learned_addr learned my addr 172.21.15.173:0/2805546447 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cb7c40700 1 --2- 172.21.15.173:0/2854122937 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564f4cc54000 0x564f4cb8b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cb7c40700 1 -- 172.21.15.173:0/2854122937 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x564f4c90b180 con 0x564f4c8a5000 2024-09-13T23:56:58.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cbac46700 1 --2- 172.21.15.173:0/2854122937 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564f4cc54000 0x564f4cb8b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cbb447700 1 -- 172.21.15.173:0/2805546447 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f4c8b6000 con 0x564f4c8a5800 2024-09-13T23:56:58.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cbb447700 1 --2- 172.21.15.173:0/2805546447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5800 0x564f4cb8ab00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x564f4cc30720 tx=0x564f4cc12a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12acebcde2a6e85b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cb543b700 1 -- 172.21.15.173:0/2805546447 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564f4c9498c0 con 0x564f4c8a5800 2024-09-13T23:56:58.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cb543b700 1 -- 172.21.15.173:0/2805546447 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564f4cc5a000 con 0x564f4c8a5800 2024-09-13T23:56:58.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cb543b700 1 -- 172.21.15.173:0/2805546447 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564f4c9494a0 con 0x564f4c8a5800 2024-09-13T23:56:58.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cbc48df40 1 -- 172.21.15.173:0/2805546447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5800 msgr2=0x564f4cb8ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/2805546447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5800 0x564f4cb8ab00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x564f4cc30720 tx=0x564f4cc12a20 comp rx=0 tx=0).stop 2024-09-13T23:56:58.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cbac46700 1 --2- 172.21.15.173:0/2854122937 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564f4cc54000 0x564f4cb8b080 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x564f4cbbd620 tx=0x564f4cc12240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cbc48df40 1 -- 172.21.15.173:0/2805546447 shutdown_connections 2024-09-13T23:56:58.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/2805546447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5800 0x564f4cb8ab00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cbc48df40 1 -- 172.21.15.173:0/2805546447 >> 172.21.15.173:0/2805546447 conn(0x564f4c8a5400 msgr2=0x564f4c9a5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cbc48df40 1 -- 172.21.15.173:0/2805546447 shutdown_connections 2024-09-13T23:56:58.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cbc48df40 1 -- 172.21.15.173:0/2805546447 wait complete. 2024-09-13T23:56:58.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cbc48df40 1 Processor -- start 2024-09-13T23:56:58.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.798+0000 7f2cbc48df40 1 -- start start 2024-09-13T23:56:58.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.802+0000 7f2cbc48df40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5800 0x564f4cb8ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.802+0000 7f2cbc48df40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f4c8ca8c0 con 0x564f4c8a5800 2024-09-13T23:56:58.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.802+0000 7f2cbb447700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5800 0x564f4cb8ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.802+0000 7f2cbb447700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5800 0x564f4cb8ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58350/0 (socket says 172.21.15.173:58350) 2024-09-13T23:56:58.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.802+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 learned_addr learned my addr 172.21.15.173:0/993238018 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.802+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f4c8b6ea0 con 0x564f4c8a5800 2024-09-13T23:56:58.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.802+0000 7f2cbb447700 1 --2- 172.21.15.173:0/993238018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5800 0x564f4cb8ab00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x564f4cbbc750 tx=0x564f4cc12840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.802+0000 7f2cb3c38700 1 -- 172.21.15.173:0/993238018 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564f4c949b80 con 0x564f4c8a5800 2024-09-13T23:56:58.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.802+0000 7f2cb3c38700 1 -- 172.21.15.173:0/993238018 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564f4cc5a180 con 0x564f4c8a5800 2024-09-13T23:56:58.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.802+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564f4c8b6820 con 0x564f4c8a5800 2024-09-13T23:56:58.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.802+0000 7f2cb3c38700 1 -- 172.21.15.173:0/993238018 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564f4c9498c0 con 0x564f4c8a5800 2024-09-13T23:56:58.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.802+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f4c8b69c0 con 0x564f4c8a5800 2024-09-13T23:56:58.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.802+0000 7f2cbc48df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.802+0000 7f2cb3c38700 1 -- 172.21.15.173:0/993238018 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x564f4c99f080 con 0x564f4c8a5800 2024-09-13T23:56:58.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.806+0000 7f2cb3c38700 1 --2- 172.21.15.173:0/993238018 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564f4cc54c00 0x564f4cb8b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.806+0000 7f2cb3c38700 1 -- 172.21.15.173:0/993238018 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x564f4c90b340 con 0x564f4c8a5800 2024-09-13T23:56:58.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.806+0000 7f2cba445700 1 --2- 172.21.15.173:0/993238018 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564f4cc54c00 0x564f4cb8b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.806+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/993238018 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564f4cc55000 0x564f4cb8bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.806+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55400 con 0x564f4cc55000 2024-09-13T23:56:58.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.806+0000 7f2cbb447700 1 --2- 172.21.15.173:0/993238018 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564f4cc55000 0x564f4cb8bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.806+0000 7f2cba445700 1 --2- 172.21.15.173:0/993238018 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564f4cc54c00 0x564f4cb8b600 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x564f4cb85920 tx=0x564f4c9a9800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.806+0000 7f2cbb447700 1 --2- 172.21.15.173:0/993238018 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564f4cc55000 0x564f4cb8bb80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.806+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.806+0000 7f2cbc48df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.806+0000 7f2cbc48df40 20 realm 2024-09-13T23:56:58.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.806+0000 7f2cbc48df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.806+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55000 2024-09-13T23:56:58.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.806+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.806+0000 7f2cbc48df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.806+0000 7f2cbc48df40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:56:58.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.806+0000 7f2cbc48df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.806+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55c00 con 0x564f4cc55000 2024-09-13T23:56:58.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.806+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.806+0000 7f2cbc48df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.806+0000 7f2cbc48df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.806+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/993238018 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564f4cc55400 0x564f4cb8c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.806+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55400 2024-09-13T23:56:58.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.806+0000 7f2cbac46700 1 --2- 172.21.15.173:0/993238018 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564f4cc55400 0x564f4cb8c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.810+0000 7f2cbac46700 1 --2- 172.21.15.173:0/993238018 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564f4cc55400 0x564f4cb8c100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.810+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x564f4ccc5200 con 0x564f4cc55400 2024-09-13T23:56:58.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.810+0000 7f2cbc48df40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:58.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.810+0000 7f2cbc48df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.810+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/993238018 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564f4cc55c00 0x564f4cb8c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.810+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cd0a000 con 0x564f4cc55c00 2024-09-13T23:56:58.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.810+0000 7f2cba445700 1 --2- 172.21.15.173:0/993238018 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564f4cc55c00 0x564f4cb8c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.810+0000 7f2cba445700 1 --2- 172.21.15.173:0/993238018 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564f4cc55c00 0x564f4cb8c680 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.810+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x564f4ccc5440 con 0x564f4cc55c00 2024-09-13T23:56:58.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.810+0000 7f2cbc48df40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:56:58.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.810+0000 7f2cbc48df40 20 searching for the correct realm 2024-09-13T23:56:58.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.810+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cd0a400 con 0x564f4cc55c00 2024-09-13T23:56:58.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.810+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x564f4ccc5440 con 0x564f4cc55c00 2024-09-13T23:56:58.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.810+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cd0a000 con 0x564f4cc55400 2024-09-13T23:56:58.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.810+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc5200 con 0x564f4cc55400 2024-09-13T23:56:58.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.810+0000 7f2cbac46700 1 --2- 172.21.15.173:0/993238018 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564f4cd0a000 0x564f4cb8cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.810+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cd0a000 2024-09-13T23:56:58.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.810+0000 7f2cbb447700 1 --2- 172.21.15.173:0/993238018 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564f4cd0a000 0x564f4cb8cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.814+0000 7f2cbb447700 1 --2- 172.21.15.173:0/993238018 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564f4cd0a000 0x564f4cb8cc00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.814+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cd0a000 2024-09-13T23:56:58.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.814+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55000 2024-09-13T23:56:58.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.814+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.814+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55000 2024-09-13T23:56:58.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.814+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.814+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55c00 2024-09-13T23:56:58.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.814+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc5440 con 0x564f4cc55c00 2024-09-13T23:56:58.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.814+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55000 2024-09-13T23:56:58.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.814+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.814+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55400 2024-09-13T23:56:58.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.814+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc5200 con 0x564f4cc55400 2024-09-13T23:56:58.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.814+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55400 2024-09-13T23:56:58.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.818+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc5200 con 0x564f4cc55400 2024-09-13T23:56:58.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.818+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55000 2024-09-13T23:56:58.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.818+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.818+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cd0a000 2024-09-13T23:56:58.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.818+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cd0a000 2024-09-13T23:56:58.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.818+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55000 2024-09-13T23:56:58.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.818+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.818+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cd0a000 2024-09-13T23:56:58.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.818+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cd0a000 2024-09-13T23:56:58.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.818+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55400 2024-09-13T23:56:58.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.818+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc5200 con 0x564f4cc55400 2024-09-13T23:56:58.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.818+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55c00 2024-09-13T23:56:58.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.818+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc5440 con 0x564f4cc55c00 2024-09-13T23:56:58.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.818+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55000 2024-09-13T23:56:58.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.822+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.822+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55400 2024-09-13T23:56:58.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.822+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc5200 con 0x564f4cc55400 2024-09-13T23:56:58.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.822+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55c00 2024-09-13T23:56:58.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.822+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc5440 con 0x564f4cc55c00 2024-09-13T23:56:58.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.822+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55000 2024-09-13T23:56:58.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.822+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.822+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55000 2024-09-13T23:56:58.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.822+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.822+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55000 2024-09-13T23:56:58.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.822+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.822+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55c00 2024-09-13T23:56:58.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.822+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc5440 con 0x564f4cc55c00 2024-09-13T23:56:58.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.822+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cd0a000 2024-09-13T23:56:58.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.826+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cd0a000 2024-09-13T23:56:58.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.826+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55000 2024-09-13T23:56:58.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.826+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.826+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cd0a000 2024-09-13T23:56:58.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.826+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cd0a000 2024-09-13T23:56:58.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.826+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55c00 2024-09-13T23:56:58.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.826+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc5440 con 0x564f4cc55c00 2024-09-13T23:56:58.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.826+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cd0a000 2024-09-13T23:56:58.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.826+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cd0a000 2024-09-13T23:56:58.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.826+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55400 2024-09-13T23:56:58.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.826+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc5200 con 0x564f4cc55400 2024-09-13T23:56:58.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.826+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55400 2024-09-13T23:56:58.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.830+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc5200 con 0x564f4cc55400 2024-09-13T23:56:58.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.830+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55c00 2024-09-13T23:56:58.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.830+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc5440 con 0x564f4cc55c00 2024-09-13T23:56:58.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.830+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55400 2024-09-13T23:56:58.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.830+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x564f4ccc5200 con 0x564f4cc55400 2024-09-13T23:56:58.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.830+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cc55400 2024-09-13T23:56:58.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.830+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564f4ccc5200 con 0x564f4cc55400 2024-09-13T23:56:58.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.830+0000 7f2cbc48df40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:56:58.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.830+0000 7f2cbc48df40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:56:58.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.830+0000 7f2cbc48df40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:56:58.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.830+0000 7f2cbc48df40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:56:58.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.830+0000 7f2cbc48df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.830+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cd0a800 con 0x564f4cc55000 2024-09-13T23:56:58.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.830+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.830+0000 7f2cbc48df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.830+0000 7f2cbc48df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.830+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cd0ac00 con 0x564f4cc55400 2024-09-13T23:56:58.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.830+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x564f4ccc5200 con 0x564f4cc55400 2024-09-13T23:56:58.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.830+0000 7f2cbc48df40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:58.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.830+0000 7f2cbc48df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.830+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cd0b000 con 0x564f4cc55000 2024-09-13T23:56:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.834+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.834+0000 7f2cbc48df40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:56:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.834+0000 7f2cbc48df40 20 zone default found 2024-09-13T23:56:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.834+0000 7f2cbc48df40 4 Realm: () 2024-09-13T23:56:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.834+0000 7f2cbc48df40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:56:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.834+0000 7f2cbc48df40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:56:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.834+0000 7f2cbc48df40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:56:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.834+0000 7f2cbc48df40 20 zonegroup default 2024-09-13T23:56:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.834+0000 7f2cbc48df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.834+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cd0b400 con 0x564f4cd0a000 2024-09-13T23:56:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.834+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cd0a000 2024-09-13T23:56:58.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.834+0000 7f2cbc48df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.834+0000 7f2cbc48df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.834+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cd0b800 con 0x564f4cc55c00 2024-09-13T23:56:58.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.834+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x564f4ccc5440 con 0x564f4cc55c00 2024-09-13T23:56:58.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.834+0000 7f2cbc48df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.834+0000 7f2cbc48df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.834+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cd0bc00 con 0x564f4cc55c00 2024-09-13T23:56:58.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.834+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x564f4ccc5440 con 0x564f4cc55c00 2024-09-13T23:56:58.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.834+0000 7f2cbc48df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.834+0000 7f2cbc48df40 20 started sync module instance, tier type = 2024-09-13T23:56:58.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.834+0000 7f2cbc48df40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:56:58.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.834+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cbf4000 con 0x564f4cc55400 2024-09-13T23:56:58.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.838+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc5200 con 0x564f4cc55400 2024-09-13T23:56:58.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.838+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94898589539072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cbf4400 con 0x564f4cc55400 2024-09-13T23:56:58.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.838+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cbf4800 con 0x564f4cc55000 2024-09-13T23:56:58.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.842+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.842+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94898589540224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cbf4c00 con 0x564f4cc55000 2024-09-13T23:56:58.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.842+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cbf5000 con 0x564f4cc55400 2024-09-13T23:56:58.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.842+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94898589539072] v33'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc5200 con 0x564f4cc55400 2024-09-13T23:56:58.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.842+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94898589540224] v33'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.842+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc5200 con 0x564f4cc55400 2024-09-13T23:56:58.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.842+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94898589541376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cbf5400 con 0x564f4cc55400 2024-09-13T23:56:58.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.842+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cbf5800 con 0x564f4cd0a000 2024-09-13T23:56:58.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.846+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cd0a000 2024-09-13T23:56:58.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.846+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94898589542528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cbf5c00 con 0x564f4cd0a000 2024-09-13T23:56:58.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.846+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cbf4800 con 0x564f4cc55400 2024-09-13T23:56:58.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.850+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94898589541376] v33'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc5200 con 0x564f4cc55400 2024-09-13T23:56:58.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.850+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94898589542528] v33'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cd0a000 2024-09-13T23:56:58.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.850+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc5200 con 0x564f4cc55400 2024-09-13T23:56:58.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.850+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94898589543680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cbf4000 con 0x564f4cc55400 2024-09-13T23:56:58.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.850+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cd0a800 con 0x564f4cc55c00 2024-09-13T23:56:58.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.854+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc5440 con 0x564f4cc55c00 2024-09-13T23:56:58.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.854+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94898589544832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cd0b000 con 0x564f4cc55c00 2024-09-13T23:56:58.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.854+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cd0b400 con 0x564f4cc55c00 2024-09-13T23:56:58.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.854+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94898589543680] v33'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc5200 con 0x564f4cc55400 2024-09-13T23:56:58.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.854+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94898589544832] v33'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc5440 con 0x564f4cc55c00 2024-09-13T23:56:58.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.858+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc5440 con 0x564f4cc55c00 2024-09-13T23:56:58.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.858+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94898589545984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cd0ac00 con 0x564f4cc55c00 2024-09-13T23:56:58.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.858+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cc55800 con 0x564f4cd0a000 2024-09-13T23:56:58.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.862+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94898589545984] v33'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc5440 con 0x564f4cc55c00 2024-09-13T23:56:58.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.862+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cd0a000 2024-09-13T23:56:58.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.862+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94898589547136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cbf4400 con 0x564f4cd0a000 2024-09-13T23:56:58.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.862+0000 7f2cbc48df40 20 add_watcher() i=0 2024-09-13T23:56:58.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.862+0000 7f2cbc48df40 20 add_watcher() i=1 2024-09-13T23:56:58.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.862+0000 7f2cbc48df40 20 add_watcher() i=2 2024-09-13T23:56:58.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.862+0000 7f2cbc48df40 20 add_watcher() i=3 2024-09-13T23:56:58.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.862+0000 7f2cbc48df40 20 add_watcher() i=4 2024-09-13T23:56:58.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.862+0000 7f2cbc48df40 20 add_watcher() i=5 2024-09-13T23:56:58.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.862+0000 7f2cbc48df40 20 add_watcher() i=6 2024-09-13T23:56:58.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.862+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94898589547136] v33'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cd0a000 2024-09-13T23:56:58.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.862+0000 7f2cbc48df40 20 add_watcher() i=7 2024-09-13T23:56:58.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.862+0000 7f2cbc48df40 2 all 8 watchers are set, enabling cache 2024-09-13T23:56:58.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.862+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cbf5000 con 0x564f4cc55000 2024-09-13T23:56:58.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.866+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.866+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94898591227904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cbf5400 con 0x564f4cc55000 2024-09-13T23:56:58.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.866+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94898591227904] v33'50 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.866+0000 7f2ca1c14700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:58.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.866+0000 7f2cbc48df40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:56:58.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.866+0000 7f2cbc48df40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:56:58.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.870+0000 7f2cbc48df40 1 Processor -- start 2024-09-13T23:56:58.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.870+0000 7f2cbc48df40 1 -- start start 2024-09-13T23:56:58.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.870+0000 7f2cbc48df40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4cd0a400 0x564f4cb8d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.870+0000 7f2cbc48df40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f4c9323c0 con 0x564f4cd0a400 2024-09-13T23:56:58.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.870+0000 7f2cba445700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4cd0a400 0x564f4cb8d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.870+0000 7f2cba445700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4cd0a400 0x564f4cb8d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58362/0 (socket says 172.21.15.173:58362) 2024-09-13T23:56:58.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.870+0000 7f2cba445700 1 -- 172.21.15.173:0/109936114 learned_addr learned my addr 172.21.15.173:0/109936114 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.870+0000 7f2cba445700 1 -- 172.21.15.173:0/109936114 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f4c8b6b60 con 0x564f4cd0a400 2024-09-13T23:56:58.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.870+0000 7f2cba445700 1 --2- 172.21.15.173:0/109936114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4cd0a400 0x564f4cb8d180 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x564f4ccbdef0 tx=0x564f4c9a9980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86e80fadbf483ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.870+0000 7f2ca1413700 1 -- 172.21.15.173:0/109936114 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564f4c949760 con 0x564f4cd0a400 2024-09-13T23:56:58.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.870+0000 7f2ca1413700 1 -- 172.21.15.173:0/109936114 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564f4cc5a600 con 0x564f4cd0a400 2024-09-13T23:56:58.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.870+0000 7f2ca1413700 1 -- 172.21.15.173:0/109936114 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564f4cd30000 con 0x564f4cd0a400 2024-09-13T23:56:58.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.870+0000 7f2cbc48df40 1 -- 172.21.15.173:0/109936114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4cd0a400 msgr2=0x564f4cb8d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.870+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/109936114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4cd0a400 0x564f4cb8d180 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x564f4ccbdef0 tx=0x564f4c9a9980 comp rx=0 tx=0).stop 2024-09-13T23:56:58.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.870+0000 7f2cbc48df40 1 -- 172.21.15.173:0/109936114 shutdown_connections 2024-09-13T23:56:58.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.870+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/109936114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4cd0a400 0x564f4cb8d180 secure :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0x564f4ccbdef0 tx=0x564f4c9a9980 comp rx=0 tx=0).stop 2024-09-13T23:56:58.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.870+0000 7f2cbc48df40 1 -- 172.21.15.173:0/109936114 >> 172.21.15.173:0/109936114 conn(0x564f4cbf4800 msgr2=0x564f4c9a6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.870+0000 7f2cbc48df40 1 -- 172.21.15.173:0/109936114 shutdown_connections 2024-09-13T23:56:58.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.870+0000 7f2cbc48df40 1 -- 172.21.15.173:0/109936114 wait complete. 2024-09-13T23:56:58.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.870+0000 7f2cbc48df40 1 Processor -- start 2024-09-13T23:56:58.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.874+0000 7f2cbc48df40 1 -- start start 2024-09-13T23:56:58.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.874+0000 7f2cbc48df40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4cd0b800 0x564f4cb8d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.874+0000 7f2cbc48df40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f4c932500 con 0x564f4cd0b800 2024-09-13T23:56:58.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.874+0000 7f2cba445700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4cd0b800 0x564f4cb8d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.874+0000 7f2cba445700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4cd0b800 0x564f4cb8d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58370/0 (socket says 172.21.15.173:58370) 2024-09-13T23:56:58.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.874+0000 7f2cba445700 1 -- 172.21.15.173:0/132743047 learned_addr learned my addr 172.21.15.173:0/132743047 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.874+0000 7f2cba445700 1 -- 172.21.15.173:0/132743047 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f4c8b6d00 con 0x564f4cd0b800 2024-09-13T23:56:58.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.874+0000 7f2cba445700 1 --2- 172.21.15.173:0/132743047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4cd0b800 0x564f4cb8d700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x564f4cd2e0c0 tx=0x564f4cc13c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.874+0000 7f2c9fc10700 1 -- 172.21.15.173:0/132743047 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564f4cd30160 con 0x564f4cd0b800 2024-09-13T23:56:58.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.874+0000 7f2c9fc10700 1 -- 172.21.15.173:0/132743047 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564f4cc5a300 con 0x564f4cd0b800 2024-09-13T23:56:58.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.874+0000 7f2cbc48df40 1 -- 172.21.15.173:0/132743047 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564f4c8b6340 con 0x564f4cd0b800 2024-09-13T23:56:58.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.874+0000 7f2c9fc10700 1 -- 172.21.15.173:0/132743047 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564f4cd302c0 con 0x564f4cd0b800 2024-09-13T23:56:58.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.874+0000 7f2cbc48df40 1 -- 172.21.15.173:0/132743047 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f4c8b7d40 con 0x564f4cd0b800 2024-09-13T23:56:58.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.874+0000 7f2c9fc10700 1 -- 172.21.15.173:0/132743047 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x564f4c99fb80 con 0x564f4cd0b800 2024-09-13T23:56:58.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.878+0000 7f2c9fc10700 1 --2- 172.21.15.173:0/132743047 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564f4cc55800 0x564f4cdaa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.878+0000 7f2c9fc10700 1 -- 172.21.15.173:0/132743047 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x564f4c90b500 con 0x564f4cd0b800 2024-09-13T23:56:58.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.878+0000 7f2cbc48df40 5 note: GC not initialized 2024-09-13T23:56:58.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.878+0000 7f2cbb447700 1 --2- 172.21.15.173:0/132743047 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564f4cc55800 0x564f4cdaa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.878+0000 7f2cbb447700 1 --2- 172.21.15.173:0/132743047 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564f4cc55800 0x564f4cdaa000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x564f4ccbd440 tx=0x564f4cd72ae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.878+0000 7f2c9d40b700 20 reqs_thread_entry: start 2024-09-13T23:56:58.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.878+0000 7f2cbc48df40 20 init_complete bucket index max shards: 11 2024-09-13T23:56:58.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.878+0000 7f2cbc48df40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:56:58.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.878+0000 7f2c9b407700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:29 2024 2024-09-13T23:56:58.885 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:56:58.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.878+0000 7f2c9abe5700 20 reqs_thread_entry: start 2024-09-13T23:56:58.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.878+0000 7f2cbc48df40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:56:58.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.878+0000 7f2cbc48df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.878+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cbf4c00 con 0x564f4cc55000 2024-09-13T23:56:58.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.882+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.882+0000 7f2cbc48df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.882+0000 7f2cbc48df40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-13T23:56:58.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.882+0000 7f2cbc48df40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:56:58.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.882+0000 7f2cbc48df40 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-13T23:56:58.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.882+0000 7f2cbc48df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.882+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cbf5800 con 0x564f4cc55000 2024-09-13T23:56:58.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.882+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 197+0+0 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.882+0000 7f2cbc48df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.882+0000 7f2cbc48df40 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-13T23:56:58.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.882+0000 7f2cbc48df40 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T23:56:58.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.882+0000 7f2cbc48df40 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-13T23:56:58.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.882+0000 7f2cbc48df40 20 rados->read ofs=0 len=0 2024-09-13T23:56:58.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.882+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cbf5c00 con 0x564f4cc55000 2024-09-13T23:56:58.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.882+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.882+0000 7f2cbc48df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:58.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.882+0000 7f2cbc48df40 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-13T23:56:58.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.882+0000 7f2cbc48df40 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-13T23:56:58.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.882+0000 7f2cbc48df40 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-13T23:56:58.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.882+0000 7f2cbc48df40 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-13T23:56:58.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.882+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cbf4400 con 0x564f4cc55000 2024-09-13T23:56:58.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.886+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~357] v33'1 uv1 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.886+0000 7f2cbc48df40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:56:58.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.886+0000 7f2cbc48df40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:56:58.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.886+0000 7f2cbc48df40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:56:58.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.886+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94898591230208 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cbf5000 con 0x564f4cc55400 2024-09-13T23:56:58.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.886+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== watch-notify(notify (1) cookie 94898589543680 notify 141733920768 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x564f4cc10820 con 0x564f4cc55400 2024-09-13T23:56:58.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.886+0000 7f2cb543b700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920768 cookie 94898589543680 notifier 4304 bl.length()=533 2024-09-13T23:56:58.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.886+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(66 notify.4 [notify cookie 94898591230208 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x564f4ccc5200 con 0x564f4cc55400 2024-09-13T23:56:58.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.886+0000 7f2cb543b700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:56:58.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.886+0000 7f2cb543b700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:56:58.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.886+0000 7f2cb543b700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4ce1c000 con 0x564f4cc55400 2024-09-13T23:56:58.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.886+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc5200 con 0x564f4cc55400 2024-09-13T23:56:58.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.886+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== watch-notify(notify_complete (2) cookie 94898591230208 notify 141733920768 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x564f4cc109c0 con 0x564f4cc55400 2024-09-13T23:56:58.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.886+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cbf5400 con 0x564f4cc55000 2024-09-13T23:56:58.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.890+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 24 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) v8 ==== 239+0+0 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.890+0000 7f2cbc48df40 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-13T23:56:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.890+0000 7f2cbc48df40 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T23:56:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.890+0000 7f2cbc48df40 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-13T23:56:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.890+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94898591230208 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cbf4c00 con 0x564f4cd0a000 2024-09-13T23:56:58.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.890+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== watch-notify(notify (1) cookie 94898589542528 notify 141733920768 ret 0) v3 ==== 211+0+0 (crc 0 0 0) 0x564f4ccb6820 con 0x564f4cd0a000 2024-09-13T23:56:58.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.890+0000 7f2cb543b700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920768 cookie 94898589542528 notifier 4304 bl.length()=169 2024-09-13T23:56:58.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.890+0000 7f2cb543b700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-13T23:56:58.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.890+0000 7f2cb543b700 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T23:56:58.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.890+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(69 notify.3 [notify cookie 94898591230208 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cd0a000 2024-09-13T23:56:58.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.890+0000 7f2cb543b700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4ce1c400 con 0x564f4cd0a000 2024-09-13T23:56:58.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.890+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== watch-notify(notify_complete (2) cookie 94898591230208 notify 141733920768 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x564f4ccb69c0 con 0x564f4cd0a000 2024-09-13T23:56:58.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.890+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cd0a000 2024-09-13T23:56:58.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.890+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cbf5800 con 0x564f4cc55000 2024-09-13T23:56:58.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.894+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 25 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.894+0000 7f2cbc48df40 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-13T23:56:58.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.894+0000 7f2cbc48df40 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-13T23:56:58.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.894+0000 7f2cbc48df40 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-13T23:56:58.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.894+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94898591230208 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cbf5c00 con 0x564f4cd0a000 2024-09-13T23:56:58.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.894+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== watch-notify(notify (1) cookie 94898589542528 notify 141733920769 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x564f4ccb69c0 con 0x564f4cd0a000 2024-09-13T23:56:58.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.894+0000 7f2cb543b700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920769 cookie 94898589542528 notifier 4304 bl.length()=177 2024-09-13T23:56:58.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.894+0000 7f2cb543b700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-13T23:56:58.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.894+0000 7f2cb543b700 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-13T23:56:58.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.894+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(72 notify.3 [notify cookie 94898591230208 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cd0a000 2024-09-13T23:56:58.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.894+0000 7f2cb543b700 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4ce1c800 con 0x564f4cd0a000 2024-09-13T23:56:58.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.894+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.2 v2:172.21.15.173:6809/889985573 18 ==== watch-notify(notify_complete (2) cookie 94898591230208 notify 141733920769 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x564f4ccb6b60 con 0x564f4cd0a000 2024-09-13T23:56:58.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.894+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.2 v2:172.21.15.173:6809/889985573 19 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cd0a000 2024-09-13T23:56:58.901 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:56:58.901 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "foo", 2024-09-13T23:56:58.901 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Foo", 2024-09-13T23:56:58.901 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "foo@foo.com", 2024-09-13T23:56:58.901 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:56:58.902 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:56:58.902 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [], 2024-09-13T23:56:58.902 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:56:58.902 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:56:58.902 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:56:58.902 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-09-13T23:56:58.902 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-09-13T23:56:58.902 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:56:58.902 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:56:58.902 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [], 2024-09-13T23:56:58.902 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:56:58.902 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:56:58.902 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:56:58.902 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:56:58.903 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:56:58.903 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:56:58.903 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:56:58.903 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:56:58.903 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:56:58.903 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:56:58.903 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:56:58.903 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:56:58.903 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:56:58.903 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:56:58.903 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:56:58.903 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:56:58.903 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:56:58.903 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:56:58.903 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:56:58.904 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:56:58.904 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:56:58.904 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:56:58.904 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:56:58.904 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:56:58.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.898+0000 7f2ca1c14700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:58.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.898+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94898591227904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4ce1d400 con 0x564f4cc55000 2024-09-13T23:56:58.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.898+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 26 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94898591227904] v33'51 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.898+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94898589539072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4ce1d800 con 0x564f4cc55400 2024-09-13T23:56:58.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.902+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94898589539072] v33'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc5200 con 0x564f4cc55400 2024-09-13T23:56:58.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.902+0000 7f2cbc48df40 20 remove_watcher() i=0 2024-09-13T23:56:58.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.902+0000 7f2cbc48df40 2 removed watcher, disabling cache 2024-09-13T23:56:58.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.902+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94898589540224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4ce1dc00 con 0x564f4cc55000 2024-09-13T23:56:58.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.906+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.1 v2:172.21.15.173:6808/3256211813 27 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94898589540224] v33'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cc55000 2024-09-13T23:56:58.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.906+0000 7f2cbc48df40 20 remove_watcher() i=1 2024-09-13T23:56:58.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.906+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94898589541376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4cbf4400 con 0x564f4cc55400 2024-09-13T23:56:58.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.906+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94898589541376] v33'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc5200 con 0x564f4cc55400 2024-09-13T23:56:58.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.906+0000 7f2cbc48df40 20 remove_watcher() i=2 2024-09-13T23:56:58.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.906+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94898589542528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4ce1c000 con 0x564f4cd0a000 2024-09-13T23:56:58.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.910+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.2 v2:172.21.15.173:6809/889985573 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94898589542528] v33'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cd0a000 2024-09-13T23:56:58.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.910+0000 7f2cbc48df40 20 remove_watcher() i=3 2024-09-13T23:56:58.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.910+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94898589543680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4ce1d800 con 0x564f4cc55400 2024-09-13T23:56:58.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.914+0000 7f2cbac46700 1 -- 172.21.15.173:0/993238018 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94898589543680] v33'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc5200 con 0x564f4cc55400 2024-09-13T23:56:58.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.914+0000 7f2cbc48df40 20 remove_watcher() i=4 2024-09-13T23:56:58.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.914+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94898589544832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4ce1c400 con 0x564f4cc55c00 2024-09-13T23:56:58.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.914+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94898589544832] v33'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc5440 con 0x564f4cc55c00 2024-09-13T23:56:58.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.914+0000 7f2cbc48df40 20 remove_watcher() i=5 2024-09-13T23:56:58.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.914+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94898589545984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4ce1c800 con 0x564f4cc55c00 2024-09-13T23:56:58.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.918+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94898589545984] v33'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc5440 con 0x564f4cc55c00 2024-09-13T23:56:58.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.918+0000 7f2cbc48df40 20 remove_watcher() i=6 2024-09-13T23:56:58.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.918+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94898589547136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564f4ce1d400 con 0x564f4cd0a000 2024-09-13T23:56:58.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.918+0000 7f2cbb447700 1 -- 172.21.15.173:0/993238018 <== osd.2 v2:172.21.15.173:6809/889985573 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94898589547136] v33'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564f4ccc4b40 con 0x564f4cd0a000 2024-09-13T23:56:58.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.918+0000 7f2cbc48df40 20 remove_watcher() i=7 2024-09-13T23:56:58.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.918+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564f4cc55400 msgr2=0x564f4cb8c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.918+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/993238018 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564f4cc55400 0x564f4cb8c100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.918+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564f4cc55000 msgr2=0x564f4cb8bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.918+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/993238018 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564f4cc55000 0x564f4cb8bb80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.918+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564f4cd0a000 msgr2=0x564f4cb8cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.918+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/993238018 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564f4cd0a000 0x564f4cb8cc00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.918+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564f4cc55c00 msgr2=0x564f4cb8c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.918+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/993238018 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564f4cc55c00 0x564f4cb8c680 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564f4cc54c00 msgr2=0x564f4cb8b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/993238018 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564f4cc54c00 0x564f4cb8b600 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x564f4cb85920 tx=0x564f4c9a9800 comp rx=0 tx=0).stop 2024-09-13T23:56:58.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5800 msgr2=0x564f4cb8ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/993238018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5800 0x564f4cb8ab00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x564f4cbbc750 tx=0x564f4cc12840 comp rx=0 tx=0).stop 2024-09-13T23:56:58.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 reap_dead start 2024-09-13T23:56:58.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cba445700 1 -- 172.21.15.173:0/993238018 reap_dead start 2024-09-13T23:56:58.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 shutdown_connections 2024-09-13T23:56:58.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 >> 172.21.15.173:0/993238018 conn(0x564f4c8a5400 msgr2=0x564f4c9a5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 shutdown_connections 2024-09-13T23:56:58.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 -- 172.21.15.173:0/993238018 wait complete. 2024-09-13T23:56:58.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 -- 172.21.15.173:0/132743047 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564f4cc55800 msgr2=0x564f4cdaa000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/132743047 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564f4cc55800 0x564f4cdaa000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x564f4ccbd440 tx=0x564f4cd72ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 -- 172.21.15.173:0/132743047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4cd0b800 msgr2=0x564f4cb8d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/132743047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4cd0b800 0x564f4cb8d700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x564f4cd2e0c0 tx=0x564f4cc13c20 comp rx=0 tx=0).stop 2024-09-13T23:56:58.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 -- 172.21.15.173:0/132743047 shutdown_connections 2024-09-13T23:56:58.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/132743047 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564f4cc55800 0x564f4cdaa000 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/132743047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4cd0b800 0x564f4cb8d700 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 -- 172.21.15.173:0/132743047 >> 172.21.15.173:0/132743047 conn(0x564f4cbf4800 msgr2=0x564f4c9a6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 -- 172.21.15.173:0/132743047 shutdown_connections 2024-09-13T23:56:58.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 -- 172.21.15.173:0/132743047 wait complete. 2024-09-13T23:56:58.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 -- 172.21.15.173:0/2854122937 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564f4cc54000 msgr2=0x564f4cb8b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/2854122937 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564f4cc54000 0x564f4cb8b080 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x564f4cbbd620 tx=0x564f4cc12240 comp rx=0 tx=0).stop 2024-09-13T23:56:58.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 -- 172.21.15.173:0/2854122937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5000 msgr2=0x564f4cb8a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/2854122937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5000 0x564f4cb8a580 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x564f4cbbc0c0 tx=0x564f4c9a9a40 comp rx=0 tx=0).stop 2024-09-13T23:56:58.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 -- 172.21.15.173:0/2854122937 shutdown_connections 2024-09-13T23:56:58.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/2854122937 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564f4cc54000 0x564f4cb8b080 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 --2- 172.21.15.173:0/2854122937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564f4c8a5000 0x564f4cb8a580 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 -- 172.21.15.173:0/2854122937 >> 172.21.15.173:0/2854122937 conn(0x564f4c8a4c00 msgr2=0x564f4c9a5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 -- 172.21.15.173:0/2854122937 shutdown_connections 2024-09-13T23:56:58.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.922+0000 7f2cbc48df40 1 -- 172.21.15.173:0/2854122937 wait complete. 2024-09-13T23:56:58.933 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:56:58.933 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-13T23:56:58.934 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-13T23:56:58.934 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-13T23:56:58.975 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:56:58.976 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:56:58.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.970+0000 7f8406052f40 1 Processor -- start 2024-09-13T23:56:58.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.970+0000 7f8406052f40 1 -- start start 2024-09-13T23:56:58.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.970+0000 7f8406052f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55ce9e1a7400 0x55ce9e48c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.970+0000 7f8406052f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ce9e26b500 con 0x55ce9e1a7000 2024-09-13T23:56:58.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.970+0000 7f8406052f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ce9e234a00 con 0x55ce9e1a7400 2024-09-13T23:56:58.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.970+0000 7f840400a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55ce9e1a7400 0x55ce9e48c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.970+0000 7f840480b700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55ce9e1a7000 0x55ce9e2a6800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:57832/0 (socket says 172.21.15.173:57832) 2024-09-13T23:56:58.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.970+0000 7f840480b700 1 -- 172.21.15.173:0/1550561893 learned_addr learned my addr 172.21.15.173:0/1550561893 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:56:58.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.974+0000 7f840400a700 1 -- 172.21.15.173:0/1550561893 >> v1:172.21.15.87:6789/0 conn(0x55ce9e1a7000 legacy=0x55ce9e2a6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.974+0000 7f8403809700 1 -- 172.21.15.173:0/1550561893 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178779257 0 0) 0x55ce9e302000 con 0x55ce9e1a7000 2024-09-13T23:56:58.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.974+0000 7f840400a700 1 -- 172.21.15.173:0/1550561893 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce9e1b9d40 con 0x55ce9e1a7400 2024-09-13T23:56:58.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.974+0000 7f840400a700 1 --2- 172.21.15.173:0/1550561893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7400 0x55ce9e48c580 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55ce9e487920 tx=0x55ce9e2ab920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6b0354c3a6e92e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.974+0000 7f8403809700 1 -- 172.21.15.173:0/1550561893 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ce9e24b4a0 con 0x55ce9e1a7400 2024-09-13T23:56:58.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.974+0000 7f8403809700 1 -- 172.21.15.173:0/1550561893 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ce9e26b800 con 0x55ce9e1a7400 2024-09-13T23:56:58.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.974+0000 7f8403809700 1 -- 172.21.15.173:0/1550561893 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ce9e24b600 con 0x55ce9e1a7400 2024-09-13T23:56:58.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.974+0000 7f8406052f40 1 -- 172.21.15.173:0/1550561893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7400 msgr2=0x55ce9e48c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.974+0000 7f8406052f40 1 --2- 172.21.15.173:0/1550561893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7400 0x55ce9e48c580 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55ce9e487920 tx=0x55ce9e2ab920 comp rx=0 tx=0).stop 2024-09-13T23:56:58.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.974+0000 7f8406052f40 1 -- 172.21.15.173:0/1550561893 shutdown_connections 2024-09-13T23:56:58.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.974+0000 7f8406052f40 1 --2- 172.21.15.173:0/1550561893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7400 0x55ce9e48c580 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.974+0000 7f8406052f40 1 -- 172.21.15.173:0/1550561893 >> 172.21.15.173:0/1550561893 conn(0x55ce9e1a6c00 msgr2=0x55ce9e2a6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.974+0000 7f8406052f40 1 -- 172.21.15.173:0/1550561893 shutdown_connections 2024-09-13T23:56:58.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.974+0000 7f8406052f40 1 -- 172.21.15.173:0/1550561893 wait complete. 2024-09-13T23:56:58.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.978+0000 7f8406052f40 1 Processor -- start 2024-09-13T23:56:58.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.978+0000 7f8406052f40 1 -- start start 2024-09-13T23:56:58.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.978+0000 7f8406052f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7000 0x55ce9e48c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.978+0000 7f8406052f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce9e234500 con 0x55ce9e1a7000 2024-09-13T23:56:58.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.978+0000 7f840480b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7000 0x55ce9e48c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.978+0000 7f840480b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7000 0x55ce9e48c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58382/0 (socket says 172.21.15.173:58382) 2024-09-13T23:56:58.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.978+0000 7f840480b700 1 -- 172.21.15.173:0/4238252484 learned_addr learned my addr 172.21.15.173:0/4238252484 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.978+0000 7f840480b700 1 -- 172.21.15.173:0/4238252484 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce9e1b9ba0 con 0x55ce9e1a7000 2024-09-13T23:56:58.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.978+0000 7f840480b700 1 --2- 172.21.15.173:0/4238252484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7000 0x55ce9e48c580 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55ce9ef71d70 tx=0x55ce9e2abb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51f0a929d65c301 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.982+0000 7f8403008700 1 -- 172.21.15.173:0/4238252484 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ce9e24b4a0 con 0x55ce9e1a7000 2024-09-13T23:56:58.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.982+0000 7f8403008700 1 -- 172.21.15.173:0/4238252484 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ce9e26bb00 con 0x55ce9e1a7000 2024-09-13T23:56:58.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.982+0000 7f8403008700 1 -- 172.21.15.173:0/4238252484 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ce9e24b600 con 0x55ce9e1a7000 2024-09-13T23:56:58.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.982+0000 7f8406052f40 1 -- 172.21.15.173:0/4238252484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7000 msgr2=0x55ce9e48c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.982+0000 7f8406052f40 1 --2- 172.21.15.173:0/4238252484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7000 0x55ce9e48c580 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55ce9ef71d70 tx=0x55ce9e2abb60 comp rx=0 tx=0).stop 2024-09-13T23:56:58.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.982+0000 7f8406052f40 1 -- 172.21.15.173:0/4238252484 shutdown_connections 2024-09-13T23:56:58.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.982+0000 7f8406052f40 1 --2- 172.21.15.173:0/4238252484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7000 0x55ce9e48c580 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.982+0000 7f8406052f40 1 -- 172.21.15.173:0/4238252484 >> 172.21.15.173:0/4238252484 conn(0x55ce9e1a6c00 msgr2=0x55ce9e2a7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.982+0000 7f8406052f40 1 -- 172.21.15.173:0/4238252484 shutdown_connections 2024-09-13T23:56:58.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.982+0000 7f8406052f40 1 -- 172.21.15.173:0/4238252484 wait complete. 2024-09-13T23:56:58.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.982+0000 7f8406052f40 1 Processor -- start 2024-09-13T23:56:58.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.986+0000 7f8406052f40 1 -- start start 2024-09-13T23:56:58.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.986+0000 7f8406052f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7000 0x55ce9e48c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.986+0000 7f8406052f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce9e2343c0 con 0x55ce9e1a7000 2024-09-13T23:56:58.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.986+0000 7f840480b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7000 0x55ce9e48c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.986+0000 7f840480b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7000 0x55ce9e48c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58394/0 (socket says 172.21.15.173:58394) 2024-09-13T23:56:58.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.986+0000 7f840480b700 1 -- 172.21.15.173:0/1064087426 learned_addr learned my addr 172.21.15.173:0/1064087426 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.986+0000 7f840480b700 1 -- 172.21.15.173:0/1064087426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce9e1b9a00 con 0x55ce9e1a7000 2024-09-13T23:56:58.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.986+0000 7f840480b700 1 --2- 172.21.15.173:0/1064087426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7000 0x55ce9e48c580 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x55ce9ef71e00 tx=0x55ce9e2aba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.986+0000 7f8401805700 1 -- 172.21.15.173:0/1064087426 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ce9e24b8c0 con 0x55ce9e1a7000 2024-09-13T23:56:58.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.986+0000 7f8401805700 1 -- 172.21.15.173:0/1064087426 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ce9e26bc80 con 0x55ce9e1a7000 2024-09-13T23:56:58.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.986+0000 7f8401805700 1 -- 172.21.15.173:0/1064087426 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ce9e24b4a0 con 0x55ce9e1a7000 2024-09-13T23:56:58.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.986+0000 7f8406052f40 1 -- 172.21.15.173:0/1064087426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ce9e1b9860 con 0x55ce9e1a7000 2024-09-13T23:56:58.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.986+0000 7f8406052f40 1 -- 172.21.15.173:0/1064087426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce9e1b96c0 con 0x55ce9e1a7000 2024-09-13T23:56:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.986+0000 7f8406052f40 1 Processor -- start 2024-09-13T23:56:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.986+0000 7f8406052f40 1 -- start start 2024-09-13T23:56:58.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.986+0000 7f8406052f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7800 0x55ce9e48cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.986+0000 7f8406052f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce9e1cc640 con 0x55ce9e1a7800 2024-09-13T23:56:58.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.990+0000 7f8401805700 1 -- 172.21.15.173:0/1064087426 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55ce9e2a0b00 con 0x55ce9e1a7000 2024-09-13T23:56:58.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.990+0000 7f840500c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7800 0x55ce9e48cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.990+0000 7f840500c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7800 0x55ce9e48cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58406/0 (socket says 172.21.15.173:58406) 2024-09-13T23:56:58.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.990+0000 7f840500c700 1 -- 172.21.15.173:0/213884250 learned_addr learned my addr 172.21.15.173:0/213884250 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:58.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.990+0000 7f8401805700 1 --2- 172.21.15.173:0/1064087426 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ce9e54a000 0x55ce9e48d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.990+0000 7f8401805700 1 -- 172.21.15.173:0/1064087426 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55ce9e20d180 con 0x55ce9e1a7000 2024-09-13T23:56:58.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.990+0000 7f840480b700 1 --2- 172.21.15.173:0/1064087426 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ce9e54a000 0x55ce9e48d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:58.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.990+0000 7f840500c700 1 -- 172.21.15.173:0/213884250 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce9e1b8000 con 0x55ce9e1a7800 2024-09-13T23:56:58.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.990+0000 7f840500c700 1 --2- 172.21.15.173:0/213884250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7800 0x55ce9e48cb00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55ce9e5282a0 tx=0x55ce9e50aa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f143f96486484e2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.990+0000 7f83ff000700 1 -- 172.21.15.173:0/213884250 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ce9e24b8c0 con 0x55ce9e1a7800 2024-09-13T23:56:58.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.990+0000 7f840480b700 1 --2- 172.21.15.173:0/1064087426 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ce9e54a000 0x55ce9e48d080 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55ce9e4dd500 tx=0x55ce9e50a240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:58.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.990+0000 7f83ff000700 1 -- 172.21.15.173:0/213884250 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ce9e552000 con 0x55ce9e1a7800 2024-09-13T23:56:58.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.990+0000 7f83ff000700 1 -- 172.21.15.173:0/213884250 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ce9e24b4a0 con 0x55ce9e1a7800 2024-09-13T23:56:58.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.990+0000 7f8406052f40 1 -- 172.21.15.173:0/213884250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7800 msgr2=0x55ce9e48cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.990+0000 7f8406052f40 1 --2- 172.21.15.173:0/213884250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7800 0x55ce9e48cb00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55ce9e5282a0 tx=0x55ce9e50aa20 comp rx=0 tx=0).stop 2024-09-13T23:56:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.990+0000 7f8406052f40 1 -- 172.21.15.173:0/213884250 shutdown_connections 2024-09-13T23:56:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.990+0000 7f8406052f40 1 --2- 172.21.15.173:0/213884250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7800 0x55ce9e48cb00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.990+0000 7f8406052f40 1 -- 172.21.15.173:0/213884250 >> 172.21.15.173:0/213884250 conn(0x55ce9e1a7400 msgr2=0x55ce9e2a7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.990+0000 7f8406052f40 1 -- 172.21.15.173:0/213884250 shutdown_connections 2024-09-13T23:56:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.990+0000 7f8406052f40 1 -- 172.21.15.173:0/213884250 wait complete. 2024-09-13T23:56:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.990+0000 7f8406052f40 1 Processor -- start 2024-09-13T23:56:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.990+0000 7f8406052f40 1 -- start start 2024-09-13T23:56:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.994+0000 7f8406052f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7800 0x55ce9e48cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.994+0000 7f8406052f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce9e1cc8c0 con 0x55ce9e1a7800 2024-09-13T23:56:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.994+0000 7f840500c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7800 0x55ce9e48cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.994+0000 7f840500c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7800 0x55ce9e48cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58418/0 (socket says 172.21.15.173:58418) 2024-09-13T23:56:59.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.994+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 learned_addr learned my addr 172.21.15.173:0/2839047455 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.994+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce9e1b8ea0 con 0x55ce9e1a7800 2024-09-13T23:56:59.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.994+0000 7f840500c700 1 --2- 172.21.15.173:0/2839047455 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7800 0x55ce9e48cb00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55ce9e4dc4b0 tx=0x55ce9e50a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.994+0000 7f83fd7fd700 1 -- 172.21.15.173:0/2839047455 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ce9e24bb80 con 0x55ce9e1a7800 2024-09-13T23:56:59.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.994+0000 7f83fd7fd700 1 -- 172.21.15.173:0/2839047455 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ce9e552180 con 0x55ce9e1a7800 2024-09-13T23:56:59.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.994+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ce9e1b8820 con 0x55ce9e1a7800 2024-09-13T23:56:59.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.994+0000 7f83fd7fd700 1 -- 172.21.15.173:0/2839047455 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ce9e24b8c0 con 0x55ce9e1a7800 2024-09-13T23:56:59.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.994+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce9e1b89c0 con 0x55ce9e1a7800 2024-09-13T23:56:59.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.994+0000 7f8406052f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.994+0000 7f83fd7fd700 1 -- 172.21.15.173:0/2839047455 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55ce9e2a0dc0 con 0x55ce9e1a7800 2024-09-13T23:56:59.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f83fd7fd700 1 --2- 172.21.15.173:0/2839047455 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ce9e54ac00 0x55ce9e48d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f83fd7fd700 1 -- 172.21.15.173:0/2839047455 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55ce9e20d340 con 0x55ce9e1a7800 2024-09-13T23:56:59.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f840400a700 1 --2- 172.21.15.173:0/2839047455 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ce9e54ac00 0x55ce9e48d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f8406052f40 1 --2- 172.21.15.173:0/2839047455 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55ce9e54b000 0x55ce9e48db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b400 con 0x55ce9e54b000 2024-09-13T23:56:59.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f840500c700 1 --2- 172.21.15.173:0/2839047455 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55ce9e54b000 0x55ce9e48db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f840400a700 1 --2- 172.21.15.173:0/2839047455 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ce9e54ac00 0x55ce9e48d600 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55ce9e487920 tx=0x55ce9e2ab800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f840500c700 1 --2- 172.21.15.173:0/2839047455 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55ce9e54b000 0x55ce9e48db80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e54b000 2024-09-13T23:56:59.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f8406052f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f8406052f40 20 realm 2024-09-13T23:56:59.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f8406052f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54b000 2024-09-13T23:56:59.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e54b000 2024-09-13T23:56:59.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f8406052f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f8406052f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:56:59.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f8406052f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54bc00 con 0x55ce9e54b000 2024-09-13T23:56:59.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e54b000 2024-09-13T23:56:59.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f8406052f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f8406052f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f8406052f40 1 --2- 172.21.15.173:0/2839047455 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55ce9e54b400 0x55ce9e48e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54b400 2024-09-13T23:56:59.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f840480b700 1 --2- 172.21.15.173:0/2839047455 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55ce9e54b400 0x55ce9e48e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:58.998+0000 7f840480b700 1 --2- 172.21.15.173:0/2839047455 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55ce9e54b400 0x55ce9e48e100 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.002+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55ce9e5f7200 con 0x55ce9e54b400 2024-09-13T23:56:59.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.002+0000 7f8406052f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:59.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.002+0000 7f8406052f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.002+0000 7f8406052f40 1 --2- 172.21.15.173:0/2839047455 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55ce9e54bc00 0x55ce9e48e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.002+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e604000 con 0x55ce9e54bc00 2024-09-13T23:56:59.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.002+0000 7f840400a700 1 --2- 172.21.15.173:0/2839047455 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55ce9e54bc00 0x55ce9e48e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.002+0000 7f840400a700 1 --2- 172.21.15.173:0/2839047455 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55ce9e54bc00 0x55ce9e48e680 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.002+0000 7f840400a700 1 -- 172.21.15.173:0/2839047455 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55ce9e5f7440 con 0x55ce9e54bc00 2024-09-13T23:56:59.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.002+0000 7f8406052f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:56:59.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.002+0000 7f8406052f40 20 searching for the correct realm 2024-09-13T23:56:59.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.002+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e604400 con 0x55ce9e54bc00 2024-09-13T23:56:59.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.002+0000 7f840400a700 1 -- 172.21.15.173:0/2839047455 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55ce9e5f7440 con 0x55ce9e54bc00 2024-09-13T23:56:59.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.002+0000 7f840400a700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e604000 con 0x55ce9e54b400 2024-09-13T23:56:59.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.002+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f7200 con 0x55ce9e54b400 2024-09-13T23:56:59.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.002+0000 7f840480b700 1 --2- 172.21.15.173:0/2839047455 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55ce9e604000 0x55ce9e48ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.002+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e604000 2024-09-13T23:56:59.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.002+0000 7f840500c700 1 --2- 172.21.15.173:0/2839047455 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55ce9e604000 0x55ce9e48ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.006+0000 7f840500c700 1 --2- 172.21.15.173:0/2839047455 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55ce9e604000 0x55ce9e48ec00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.006+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e604000 2024-09-13T23:56:59.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.006+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54b000 2024-09-13T23:56:59.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.006+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e54b000 2024-09-13T23:56:59.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.006+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54b000 2024-09-13T23:56:59.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.006+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e54b000 2024-09-13T23:56:59.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.006+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54bc00 2024-09-13T23:56:59.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.006+0000 7f840400a700 1 -- 172.21.15.173:0/2839047455 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f7440 con 0x55ce9e54bc00 2024-09-13T23:56:59.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.006+0000 7f840400a700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54b000 2024-09-13T23:56:59.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.006+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e54b000 2024-09-13T23:56:59.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.006+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54b400 2024-09-13T23:56:59.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.006+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f7200 con 0x55ce9e54b400 2024-09-13T23:56:59.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.006+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54b400 2024-09-13T23:56:59.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.010+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f7200 con 0x55ce9e54b400 2024-09-13T23:56:59.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.010+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54b000 2024-09-13T23:56:59.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.010+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e54b000 2024-09-13T23:56:59.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.010+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e604000 2024-09-13T23:56:59.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.010+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e604000 2024-09-13T23:56:59.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.010+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54b000 2024-09-13T23:56:59.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.010+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e54b000 2024-09-13T23:56:59.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.010+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e604000 2024-09-13T23:56:59.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.010+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e604000 2024-09-13T23:56:59.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.010+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54b400 2024-09-13T23:56:59.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.010+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f7200 con 0x55ce9e54b400 2024-09-13T23:56:59.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.010+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54bc00 2024-09-13T23:56:59.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.010+0000 7f840400a700 1 -- 172.21.15.173:0/2839047455 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f7440 con 0x55ce9e54bc00 2024-09-13T23:56:59.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.010+0000 7f840400a700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54b000 2024-09-13T23:56:59.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.010+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e54b000 2024-09-13T23:56:59.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.010+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54b400 2024-09-13T23:56:59.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.014+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f7200 con 0x55ce9e54b400 2024-09-13T23:56:59.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.014+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54bc00 2024-09-13T23:56:59.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.014+0000 7f840400a700 1 -- 172.21.15.173:0/2839047455 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f7440 con 0x55ce9e54bc00 2024-09-13T23:56:59.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.014+0000 7f840400a700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54b000 2024-09-13T23:56:59.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.014+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e54b000 2024-09-13T23:56:59.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.014+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54b000 2024-09-13T23:56:59.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.014+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e54b000 2024-09-13T23:56:59.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.014+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54b000 2024-09-13T23:56:59.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.014+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e54b000 2024-09-13T23:56:59.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.014+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54bc00 2024-09-13T23:56:59.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.014+0000 7f840400a700 1 -- 172.21.15.173:0/2839047455 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f7440 con 0x55ce9e54bc00 2024-09-13T23:56:59.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.014+0000 7f840400a700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e604000 2024-09-13T23:56:59.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.014+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e604000 2024-09-13T23:56:59.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.014+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54b000 2024-09-13T23:56:59.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.018+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e54b000 2024-09-13T23:56:59.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.018+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e604000 2024-09-13T23:56:59.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.018+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e604000 2024-09-13T23:56:59.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.018+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54bc00 2024-09-13T23:56:59.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.018+0000 7f840400a700 1 -- 172.21.15.173:0/2839047455 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f7440 con 0x55ce9e54bc00 2024-09-13T23:56:59.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.018+0000 7f840400a700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e604000 2024-09-13T23:56:59.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.018+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e604000 2024-09-13T23:56:59.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.018+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54b400 2024-09-13T23:56:59.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.018+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f7200 con 0x55ce9e54b400 2024-09-13T23:56:59.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.018+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54b400 2024-09-13T23:56:59.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.018+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f7200 con 0x55ce9e54b400 2024-09-13T23:56:59.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.018+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54bc00 2024-09-13T23:56:59.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f840400a700 1 -- 172.21.15.173:0/2839047455 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f7440 con 0x55ce9e54bc00 2024-09-13T23:56:59.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f840400a700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54b400 2024-09-13T23:56:59.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55ce9e5f7200 con 0x55ce9e54b400 2024-09-13T23:56:59.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e54b400 2024-09-13T23:56:59.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ce9e5f7200 con 0x55ce9e54b400 2024-09-13T23:56:59.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f8406052f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:56:59.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f8406052f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:56:59.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f8406052f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:56:59.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f8406052f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:56:59.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f8406052f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e604800 con 0x55ce9e54b000 2024-09-13T23:56:59.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e54b000 2024-09-13T23:56:59.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f8406052f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f8406052f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e604c00 con 0x55ce9e54b400 2024-09-13T23:56:59.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55ce9e5f7200 con 0x55ce9e54b400 2024-09-13T23:56:59.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f8406052f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:59.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f8406052f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e605000 con 0x55ce9e54b000 2024-09-13T23:56:59.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e54b000 2024-09-13T23:56:59.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f8406052f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:56:59.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f8406052f40 20 zone default found 2024-09-13T23:56:59.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f8406052f40 4 Realm: () 2024-09-13T23:56:59.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f8406052f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:56:59.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f8406052f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:56:59.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f8406052f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:56:59.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f8406052f40 20 zonegroup default 2024-09-13T23:56:59.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f8406052f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.022+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e605400 con 0x55ce9e604000 2024-09-13T23:56:59.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.026+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e604000 2024-09-13T23:56:59.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.026+0000 7f8406052f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.026+0000 7f8406052f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.026+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e605800 con 0x55ce9e54bc00 2024-09-13T23:56:59.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.026+0000 7f840400a700 1 -- 172.21.15.173:0/2839047455 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55ce9e5f7440 con 0x55ce9e54bc00 2024-09-13T23:56:59.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.026+0000 7f8406052f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.026+0000 7f8406052f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.026+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e605c00 con 0x55ce9e54bc00 2024-09-13T23:56:59.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.026+0000 7f840400a700 1 -- 172.21.15.173:0/2839047455 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55ce9e5f7440 con 0x55ce9e54bc00 2024-09-13T23:56:59.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.026+0000 7f8406052f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.026+0000 7f8406052f40 20 started sync module instance, tier type = 2024-09-13T23:56:59.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.026+0000 7f8406052f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:56:59.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.026+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e60e000 con 0x55ce9e54b400 2024-09-13T23:56:59.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.030+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ce9e5f7200 con 0x55ce9e54b400 2024-09-13T23:56:59.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.030+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94345907157760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e60e400 con 0x55ce9e54b400 2024-09-13T23:56:59.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.030+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e60e800 con 0x55ce9e54b000 2024-09-13T23:56:59.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.030+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e54b000 2024-09-13T23:56:59.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.030+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94345907158912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e60ec00 con 0x55ce9e54b000 2024-09-13T23:56:59.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.030+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e60f000 con 0x55ce9e54b400 2024-09-13T23:56:59.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.030+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94345907157760] v33'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ce9e5f7200 con 0x55ce9e54b400 2024-09-13T23:56:59.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.034+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94345907158912] v33'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e54b000 2024-09-13T23:56:59.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.034+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ce9e5f7200 con 0x55ce9e54b400 2024-09-13T23:56:59.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.034+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94345907160064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e60f400 con 0x55ce9e54b400 2024-09-13T23:56:59.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.034+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e60f800 con 0x55ce9e604000 2024-09-13T23:56:59.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.038+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e604000 2024-09-13T23:56:59.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.038+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94345907161216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e60fc00 con 0x55ce9e604000 2024-09-13T23:56:59.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.038+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e60e800 con 0x55ce9e54b400 2024-09-13T23:56:59.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.038+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94345907160064] v33'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ce9e5f7200 con 0x55ce9e54b400 2024-09-13T23:56:59.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.038+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94345907161216] v33'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e604000 2024-09-13T23:56:59.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.038+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ce9e5f7200 con 0x55ce9e54b400 2024-09-13T23:56:59.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.038+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94345907162368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e60e000 con 0x55ce9e54b400 2024-09-13T23:56:59.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.038+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e604800 con 0x55ce9e54bc00 2024-09-13T23:56:59.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.042+0000 7f840400a700 1 -- 172.21.15.173:0/2839047455 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ce9e5f7440 con 0x55ce9e54bc00 2024-09-13T23:56:59.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.042+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94345907163520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e605000 con 0x55ce9e54bc00 2024-09-13T23:56:59.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.042+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e605400 con 0x55ce9e54bc00 2024-09-13T23:56:59.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.042+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94345907162368] v33'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ce9e5f7200 con 0x55ce9e54b400 2024-09-13T23:56:59.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.046+0000 7f840400a700 1 -- 172.21.15.173:0/2839047455 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v33'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ce9e5f7440 con 0x55ce9e54bc00 2024-09-13T23:56:59.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.046+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94345907164672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e604c00 con 0x55ce9e54bc00 2024-09-13T23:56:59.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.046+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e54b800 con 0x55ce9e604000 2024-09-13T23:56:59.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.046+0000 7f840400a700 1 -- 172.21.15.173:0/2839047455 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94345907163520] v33'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ce9e5f7440 con 0x55ce9e54bc00 2024-09-13T23:56:59.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.050+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e604000 2024-09-13T23:56:59.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.050+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94345907165824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e60e400 con 0x55ce9e604000 2024-09-13T23:56:59.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.050+0000 7f8406052f40 20 add_watcher() i=0 2024-09-13T23:56:59.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.050+0000 7f840400a700 1 -- 172.21.15.173:0/2839047455 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94345907164672] v33'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ce9e5f7440 con 0x55ce9e54bc00 2024-09-13T23:56:59.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.050+0000 7f8406052f40 20 add_watcher() i=1 2024-09-13T23:56:59.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.050+0000 7f8406052f40 20 add_watcher() i=2 2024-09-13T23:56:59.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.050+0000 7f8406052f40 20 add_watcher() i=3 2024-09-13T23:56:59.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.050+0000 7f8406052f40 20 add_watcher() i=4 2024-09-13T23:56:59.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.050+0000 7f8406052f40 20 add_watcher() i=5 2024-09-13T23:56:59.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.050+0000 7f8406052f40 20 add_watcher() i=6 2024-09-13T23:56:59.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.054+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94345907165824] v33'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e604000 2024-09-13T23:56:59.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.054+0000 7f8406052f40 20 add_watcher() i=7 2024-09-13T23:56:59.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.054+0000 7f8406052f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:56:59.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.054+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e60f000 con 0x55ce9e54b000 2024-09-13T23:56:59.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.054+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e54b000 2024-09-13T23:56:59.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.054+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94345908797440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e60f400 con 0x55ce9e54b000 2024-09-13T23:56:59.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.054+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94345908797440] v33'52 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e54b000 2024-09-13T23:56:59.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.054+0000 7f83eb7d9700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:59.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.054+0000 7f8406052f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:56:59.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.054+0000 7f8406052f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:56:59.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.058+0000 7f8406052f40 1 Processor -- start 2024-09-13T23:56:59.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.058+0000 7f8406052f40 1 -- start start 2024-09-13T23:56:59.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.058+0000 7f8406052f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e604400 0x55ce9e48f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.058+0000 7f8406052f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce9e2343c0 con 0x55ce9e604400 2024-09-13T23:56:59.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.058+0000 7f840400a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e604400 0x55ce9e48f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.058+0000 7f840400a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e604400 0x55ce9e48f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58422/0 (socket says 172.21.15.173:58422) 2024-09-13T23:56:59.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.058+0000 7f840400a700 1 -- 172.21.15.173:0/4165780725 learned_addr learned my addr 172.21.15.173:0/4165780725 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.058+0000 7f840400a700 1 -- 172.21.15.173:0/4165780725 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce9e1b8b60 con 0x55ce9e604400 2024-09-13T23:56:59.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.058+0000 7f840400a700 1 --2- 172.21.15.173:0/4165780725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e604400 0x55ce9e48f180 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55ce9e61c0c0 tx=0x55ce9e2ab980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9feb4aa0a136651f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.058+0000 7f83eafd8700 1 -- 172.21.15.173:0/4165780725 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ce9e24b760 con 0x55ce9e604400 2024-09-13T23:56:59.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.058+0000 7f83eafd8700 1 -- 172.21.15.173:0/4165780725 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ce9e552600 con 0x55ce9e604400 2024-09-13T23:56:59.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.058+0000 7f83eafd8700 1 -- 172.21.15.173:0/4165780725 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ce9e626000 con 0x55ce9e604400 2024-09-13T23:56:59.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.058+0000 7f8406052f40 1 -- 172.21.15.173:0/4165780725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e604400 msgr2=0x55ce9e48f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.058+0000 7f8406052f40 1 --2- 172.21.15.173:0/4165780725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e604400 0x55ce9e48f180 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55ce9e61c0c0 tx=0x55ce9e2ab980 comp rx=0 tx=0).stop 2024-09-13T23:56:59.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.058+0000 7f8406052f40 1 -- 172.21.15.173:0/4165780725 shutdown_connections 2024-09-13T23:56:59.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.058+0000 7f8406052f40 1 --2- 172.21.15.173:0/4165780725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e604400 0x55ce9e48f180 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.058+0000 7f8406052f40 1 -- 172.21.15.173:0/4165780725 >> 172.21.15.173:0/4165780725 conn(0x55ce9e60e800 msgr2=0x55ce9e2a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.058+0000 7f8406052f40 1 -- 172.21.15.173:0/4165780725 shutdown_connections 2024-09-13T23:56:59.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.058+0000 7f8406052f40 1 -- 172.21.15.173:0/4165780725 wait complete. 2024-09-13T23:56:59.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.062+0000 7f8406052f40 1 Processor -- start 2024-09-13T23:56:59.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.062+0000 7f8406052f40 1 -- start start 2024-09-13T23:56:59.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.062+0000 7f8406052f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e604400 0x55ce9e48f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.062+0000 7f8406052f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce9e234500 con 0x55ce9e604400 2024-09-13T23:56:59.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.062+0000 7f840400a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e604400 0x55ce9e48f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.062+0000 7f840400a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e604400 0x55ce9e48f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58434/0 (socket says 172.21.15.173:58434) 2024-09-13T23:56:59.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.062+0000 7f840400a700 1 -- 172.21.15.173:0/1756209889 learned_addr learned my addr 172.21.15.173:0/1756209889 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.062+0000 7f840400a700 1 -- 172.21.15.173:0/1756209889 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce9e1b8d00 con 0x55ce9e604400 2024-09-13T23:56:59.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.062+0000 7f840400a700 1 --2- 172.21.15.173:0/1756209889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e604400 0x55ce9e48f180 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55ce9e61c2d0 tx=0x55ce9e50bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.062+0000 7f83e97d5700 1 -- 172.21.15.173:0/1756209889 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ce9e626160 con 0x55ce9e604400 2024-09-13T23:56:59.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.062+0000 7f83e97d5700 1 -- 172.21.15.173:0/1756209889 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ce9e552300 con 0x55ce9e604400 2024-09-13T23:56:59.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.062+0000 7f83e97d5700 1 -- 172.21.15.173:0/1756209889 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ce9e6262c0 con 0x55ce9e604400 2024-09-13T23:56:59.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.062+0000 7f8406052f40 1 -- 172.21.15.173:0/1756209889 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ce9e1b8340 con 0x55ce9e604400 2024-09-13T23:56:59.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.062+0000 7f8406052f40 1 -- 172.21.15.173:0/1756209889 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce9e1b9d40 con 0x55ce9e604400 2024-09-13T23:56:59.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.066+0000 7f83e97d5700 1 -- 172.21.15.173:0/1756209889 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55ce9e2a1b80 con 0x55ce9e604400 2024-09-13T23:56:59.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.066+0000 7f83e97d5700 1 --2- 172.21.15.173:0/1756209889 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ce9e54b800 0x55ce9e6a0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.066+0000 7f83e97d5700 1 -- 172.21.15.173:0/1756209889 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55ce9e20d500 con 0x55ce9e604400 2024-09-13T23:56:59.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.066+0000 7f8406052f40 5 note: GC not initialized 2024-09-13T23:56:59.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.066+0000 7f840500c700 1 --2- 172.21.15.173:0/1756209889 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ce9e54b800 0x55ce9e6a0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.066+0000 7f840500c700 1 --2- 172.21.15.173:0/1756209889 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ce9e54b800 0x55ce9e6a0000 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55ce9e5a77d0 tx=0x55ce9e664ae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.066+0000 7f83e6fd0700 20 reqs_thread_entry: start 2024-09-13T23:56:59.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.066+0000 7f8406052f40 20 init_complete bucket index max shards: 11 2024-09-13T23:56:59.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.066+0000 7f8406052f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:56:59.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.066+0000 7f83e4fcc700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:29 2024 2024-09-13T23:56:59.073 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:56:59.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.066+0000 7f83e47aa700 20 reqs_thread_entry: start 2024-09-13T23:56:59.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.066+0000 7f8406052f40 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:56:59.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.066+0000 7f8406052f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.066+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e604800 con 0x55ce9e604000 2024-09-13T23:56:59.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.070+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e604000 2024-09-13T23:56:59.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.070+0000 7f8406052f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.070+0000 7f8406052f40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T23:56:59.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.070+0000 7f8406052f40 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:56:59.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.070+0000 7f8406052f40 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-13T23:56:59.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.070+0000 7f8406052f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.070+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e60ec00 con 0x55ce9e54b000 2024-09-13T23:56:59.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.070+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) v8 ==== 197+0+23 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e54b000 2024-09-13T23:56:59.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.070+0000 7f8406052f40 20 rados_obj.operate() r=0 bl.length=7 2024-09-13T23:56:59.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.070+0000 7f8406052f40 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-13T23:56:59.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.070+0000 7f8406052f40 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T23:56:59.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.070+0000 7f8406052f40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:56:59.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.070+0000 7f8406052f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.070+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e60f800 con 0x55ce9e54b000 2024-09-13T23:56:59.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.070+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(64 foo [call out=48b,read 0~357 out=357b] v0'0 uv1 ondisk = 0) v8 ==== 189+0+405 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e54b000 2024-09-13T23:56:59.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.070+0000 7f8406052f40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:56:59.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.070+0000 7f8406052f40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x11 2024-09-13T23:56:59.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.070+0000 7f8406052f40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:56:59.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.070+0000 7f8406052f40 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-13T23:56:59.078 INFO:teuthology.orchestra.run.smithi173.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-13T23:56:59.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.070+0000 7f83eb7d9700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:59.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.070+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94345908797440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e60fc00 con 0x55ce9e54b000 2024-09-13T23:56:59.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.074+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94345908797440] v33'53 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e54b000 2024-09-13T23:56:59.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.074+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94345907157760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e60e400 con 0x55ce9e54b400 2024-09-13T23:56:59.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.078+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94345907157760] v33'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ce9e5f7200 con 0x55ce9e54b400 2024-09-13T23:56:59.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.078+0000 7f8406052f40 20 remove_watcher() i=0 2024-09-13T23:56:59.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.078+0000 7f8406052f40 2 removed watcher, disabling cache 2024-09-13T23:56:59.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.078+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94345907158912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e60f000 con 0x55ce9e54b000 2024-09-13T23:56:59.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.078+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94345907158912] v33'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e54b000 2024-09-13T23:56:59.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.078+0000 7f8406052f40 20 remove_watcher() i=1 2024-09-13T23:56:59.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.078+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94345907160064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e60f400 con 0x55ce9e54b400 2024-09-13T23:56:59.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.082+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94345907160064] v33'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ce9e5f7200 con 0x55ce9e54b400 2024-09-13T23:56:59.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.082+0000 7f8406052f40 20 remove_watcher() i=2 2024-09-13T23:56:59.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.082+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94345907161216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e60ec00 con 0x55ce9e604000 2024-09-13T23:56:59.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.086+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94345907161216] v33'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e604000 2024-09-13T23:56:59.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.086+0000 7f8406052f40 20 remove_watcher() i=3 2024-09-13T23:56:59.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.086+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94345907162368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e60f800 con 0x55ce9e54b400 2024-09-13T23:56:59.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.086+0000 7f840480b700 1 -- 172.21.15.173:0/2839047455 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94345907162368] v33'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ce9e5f7200 con 0x55ce9e54b400 2024-09-13T23:56:59.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.086+0000 7f8406052f40 20 remove_watcher() i=4 2024-09-13T23:56:59.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.086+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94345907163520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e60fc00 con 0x55ce9e54bc00 2024-09-13T23:56:59.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.090+0000 7f840400a700 1 -- 172.21.15.173:0/2839047455 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94345907163520] v33'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ce9e5f7440 con 0x55ce9e54bc00 2024-09-13T23:56:59.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.090+0000 7f8406052f40 20 remove_watcher() i=5 2024-09-13T23:56:59.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.090+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94345907164672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e604800 con 0x55ce9e54bc00 2024-09-13T23:56:59.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.094+0000 7f840400a700 1 -- 172.21.15.173:0/2839047455 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94345907164672] v33'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ce9e5f7440 con 0x55ce9e54bc00 2024-09-13T23:56:59.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.094+0000 7f8406052f40 20 remove_watcher() i=6 2024-09-13T23:56:59.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.094+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94345907165824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ce9e56e000 con 0x55ce9e604000 2024-09-13T23:56:59.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.094+0000 7f840500c700 1 -- 172.21.15.173:0/2839047455 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94345907165824] v33'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ce9e5f6b40 con 0x55ce9e604000 2024-09-13T23:56:59.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.094+0000 7f8406052f40 20 remove_watcher() i=7 2024-09-13T23:56:59.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.094+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55ce9e54b400 msgr2=0x55ce9e48e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.094+0000 7f8406052f40 1 --2- 172.21.15.173:0/2839047455 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55ce9e54b400 0x55ce9e48e100 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.094+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55ce9e54b000 msgr2=0x55ce9e48db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.094+0000 7f8406052f40 1 --2- 172.21.15.173:0/2839047455 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55ce9e54b000 0x55ce9e48db80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.094+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55ce9e604000 msgr2=0x55ce9e48ec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.094+0000 7f8406052f40 1 --2- 172.21.15.173:0/2839047455 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55ce9e604000 0x55ce9e48ec00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.094+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55ce9e54bc00 msgr2=0x55ce9e48e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.094+0000 7f8406052f40 1 --2- 172.21.15.173:0/2839047455 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55ce9e54bc00 0x55ce9e48e680 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ce9e54ac00 msgr2=0x55ce9e48d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 --2- 172.21.15.173:0/2839047455 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ce9e54ac00 0x55ce9e48d600 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55ce9e487920 tx=0x55ce9e2ab800 comp rx=0 tx=0).stop 2024-09-13T23:56:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7800 msgr2=0x55ce9e48cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f840400a700 1 -- 172.21.15.173:0/2839047455 reap_dead start 2024-09-13T23:56:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 --2- 172.21.15.173:0/2839047455 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7800 0x55ce9e48cb00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55ce9e4dc4b0 tx=0x55ce9e50a840 comp rx=0 tx=0).stop 2024-09-13T23:56:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 shutdown_connections 2024-09-13T23:56:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 --2- 172.21.15.173:0/2839047455 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7800 0x55ce9e48cb00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 >> 172.21.15.173:0/2839047455 conn(0x55ce9e1a7400 msgr2=0x55ce9e2a7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 shutdown_connections 2024-09-13T23:56:59.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 -- 172.21.15.173:0/2839047455 wait complete. 2024-09-13T23:56:59.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 -- 172.21.15.173:0/1756209889 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ce9e54b800 msgr2=0x55ce9e6a0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 --2- 172.21.15.173:0/1756209889 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ce9e54b800 0x55ce9e6a0000 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55ce9e5a77d0 tx=0x55ce9e664ae0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 -- 172.21.15.173:0/1756209889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e604400 msgr2=0x55ce9e48f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 --2- 172.21.15.173:0/1756209889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e604400 0x55ce9e48f180 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55ce9e61c2d0 tx=0x55ce9e50bc20 comp rx=0 tx=0).stop 2024-09-13T23:56:59.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 -- 172.21.15.173:0/1756209889 shutdown_connections 2024-09-13T23:56:59.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 --2- 172.21.15.173:0/1756209889 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ce9e54b800 0x55ce9e6a0000 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 --2- 172.21.15.173:0/1756209889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e604400 0x55ce9e48f180 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 -- 172.21.15.173:0/1756209889 >> 172.21.15.173:0/1756209889 conn(0x55ce9e60e800 msgr2=0x55ce9e2a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 -- 172.21.15.173:0/1756209889 shutdown_connections 2024-09-13T23:56:59.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 -- 172.21.15.173:0/1756209889 wait complete. 2024-09-13T23:56:59.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 -- 172.21.15.173:0/1064087426 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ce9e54a000 msgr2=0x55ce9e48d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 --2- 172.21.15.173:0/1064087426 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ce9e54a000 0x55ce9e48d080 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55ce9e4dd500 tx=0x55ce9e50a240 comp rx=0 tx=0).stop 2024-09-13T23:56:59.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 -- 172.21.15.173:0/1064087426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7000 msgr2=0x55ce9e48c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 --2- 172.21.15.173:0/1064087426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7000 0x55ce9e48c580 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x55ce9ef71e00 tx=0x55ce9e2aba40 comp rx=0 tx=0).stop 2024-09-13T23:56:59.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 -- 172.21.15.173:0/1064087426 shutdown_connections 2024-09-13T23:56:59.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 --2- 172.21.15.173:0/1064087426 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ce9e54a000 0x55ce9e48d080 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 --2- 172.21.15.173:0/1064087426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ce9e1a7000 0x55ce9e48c580 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 -- 172.21.15.173:0/1064087426 >> 172.21.15.173:0/1064087426 conn(0x55ce9e1a6c00 msgr2=0x55ce9e2a7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 -- 172.21.15.173:0/1064087426 shutdown_connections 2024-09-13T23:56:59.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.098+0000 7f8406052f40 1 -- 172.21.15.173:0/1064087426 wait complete. 2024-09-13T23:56:59.108 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-13T23:56:59.108 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:56:59.109 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:56:59.109 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:56:59.147 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:56:59.148 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:56:59.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.142+0000 7f70135e2f40 1 Processor -- start 2024-09-13T23:56:59.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.142+0000 7f70135e2f40 1 -- start start 2024-09-13T23:56:59.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.142+0000 7f70135e2f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55a09a8dd400 0x55a09abc2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.142+0000 7f70135e2f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a09a9a1500 con 0x55a09a8dd000 2024-09-13T23:56:59.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.142+0000 7f70135e2f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a09a96aa00 con 0x55a09a8dd400 2024-09-13T23:56:59.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.142+0000 7f701159a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55a09a8dd400 0x55a09abc2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.142+0000 7f7011d9b700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55a09a8dd000 0x55a09a9dc800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:57844/0 (socket says 172.21.15.173:57844) 2024-09-13T23:56:59.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.142+0000 7f7011d9b700 1 -- 172.21.15.173:0/3896415393 learned_addr learned my addr 172.21.15.173:0/3896415393 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:56:59.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.146+0000 7f701159a700 1 -- 172.21.15.173:0/3896415393 >> v1:172.21.15.87:6789/0 conn(0x55a09a8dd000 legacy=0x55a09a9dc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.146+0000 7f701159a700 1 -- 172.21.15.173:0/3896415393 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a09a8efd40 con 0x55a09a8dd400 2024-09-13T23:56:59.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.146+0000 7f701159a700 1 --2- 172.21.15.173:0/3896415393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd400 0x55a09abc2580 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55a09abbd920 tx=0x55a09a9e1920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbdd93b050a36420 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.146+0000 7f7010d99700 1 -- 172.21.15.173:0/3896415393 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a09a9814a0 con 0x55a09a8dd400 2024-09-13T23:56:59.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.146+0000 7f7010d99700 1 -- 172.21.15.173:0/3896415393 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a09a9a1800 con 0x55a09a8dd400 2024-09-13T23:56:59.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.146+0000 7f7010d99700 1 -- 172.21.15.173:0/3896415393 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a09a981600 con 0x55a09a8dd400 2024-09-13T23:56:59.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.146+0000 7f70135e2f40 1 -- 172.21.15.173:0/3896415393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd400 msgr2=0x55a09abc2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.146+0000 7f70135e2f40 1 --2- 172.21.15.173:0/3896415393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd400 0x55a09abc2580 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55a09abbd920 tx=0x55a09a9e1920 comp rx=0 tx=0).stop 2024-09-13T23:56:59.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.146+0000 7f70135e2f40 1 -- 172.21.15.173:0/3896415393 shutdown_connections 2024-09-13T23:56:59.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.146+0000 7f70135e2f40 1 --2- 172.21.15.173:0/3896415393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd400 0x55a09abc2580 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.146+0000 7f70135e2f40 1 -- 172.21.15.173:0/3896415393 >> 172.21.15.173:0/3896415393 conn(0x55a09a8dcc00 msgr2=0x55a09a9dc000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.146+0000 7f70135e2f40 1 -- 172.21.15.173:0/3896415393 shutdown_connections 2024-09-13T23:56:59.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.146+0000 7f70135e2f40 1 -- 172.21.15.173:0/3896415393 wait complete. 2024-09-13T23:56:59.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.146+0000 7f70135e2f40 1 Processor -- start 2024-09-13T23:56:59.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.146+0000 7f70135e2f40 1 -- start start 2024-09-13T23:56:59.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.146+0000 7f70135e2f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd000 0x55a09abc2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.146+0000 7f70135e2f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09a96a500 con 0x55a09a8dd000 2024-09-13T23:56:59.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.146+0000 7f7011d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd000 0x55a09abc2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.146+0000 7f7011d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd000 0x55a09abc2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58452/0 (socket says 172.21.15.173:58452) 2024-09-13T23:56:59.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.146+0000 7f7011d9b700 1 -- 172.21.15.173:0/2885717359 learned_addr learned my addr 172.21.15.173:0/2885717359 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.150+0000 7f7011d9b700 1 -- 172.21.15.173:0/2885717359 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a09a8efba0 con 0x55a09a8dd000 2024-09-13T23:56:59.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.150+0000 7f7011d9b700 1 --2- 172.21.15.173:0/2885717359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd000 0x55a09abc2580 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55a09aa39e90 tx=0x55a09a9e1b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bdf8fe5b5430b33 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.150+0000 7f7010598700 1 -- 172.21.15.173:0/2885717359 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a09a9814a0 con 0x55a09a8dd000 2024-09-13T23:56:59.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.150+0000 7f7010598700 1 -- 172.21.15.173:0/2885717359 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a09a9a1b00 con 0x55a09a8dd000 2024-09-13T23:56:59.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.150+0000 7f7010598700 1 -- 172.21.15.173:0/2885717359 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a09a981600 con 0x55a09a8dd000 2024-09-13T23:56:59.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.150+0000 7f70135e2f40 1 -- 172.21.15.173:0/2885717359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd000 msgr2=0x55a09abc2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.150+0000 7f70135e2f40 1 --2- 172.21.15.173:0/2885717359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd000 0x55a09abc2580 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55a09aa39e90 tx=0x55a09a9e1b60 comp rx=0 tx=0).stop 2024-09-13T23:56:59.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.150+0000 7f70135e2f40 1 -- 172.21.15.173:0/2885717359 shutdown_connections 2024-09-13T23:56:59.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.150+0000 7f70135e2f40 1 --2- 172.21.15.173:0/2885717359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd000 0x55a09abc2580 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.150+0000 7f70135e2f40 1 -- 172.21.15.173:0/2885717359 >> 172.21.15.173:0/2885717359 conn(0x55a09a8dcc00 msgr2=0x55a09a9dd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.150+0000 7f70135e2f40 1 -- 172.21.15.173:0/2885717359 shutdown_connections 2024-09-13T23:56:59.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.150+0000 7f70135e2f40 1 -- 172.21.15.173:0/2885717359 wait complete. 2024-09-13T23:56:59.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.150+0000 7f70135e2f40 1 Processor -- start 2024-09-13T23:56:59.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.150+0000 7f70135e2f40 1 -- start start 2024-09-13T23:56:59.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.150+0000 7f70135e2f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd000 0x55a09abc2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.150+0000 7f70135e2f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09a96a3c0 con 0x55a09a8dd000 2024-09-13T23:56:59.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.154+0000 7f7011d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd000 0x55a09abc2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.154+0000 7f7011d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd000 0x55a09abc2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58460/0 (socket says 172.21.15.173:58460) 2024-09-13T23:56:59.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.154+0000 7f7011d9b700 1 -- 172.21.15.173:0/1168616370 learned_addr learned my addr 172.21.15.173:0/1168616370 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.154+0000 7f7011d9b700 1 -- 172.21.15.173:0/1168616370 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a09a8efa00 con 0x55a09a8dd000 2024-09-13T23:56:59.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.154+0000 7f7011d9b700 1 --2- 172.21.15.173:0/1168616370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd000 0x55a09abc2580 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55a09aa39fb0 tx=0x55a09a9e1a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.154+0000 7f700ed95700 1 -- 172.21.15.173:0/1168616370 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a09a9818c0 con 0x55a09a8dd000 2024-09-13T23:56:59.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.154+0000 7f700ed95700 1 -- 172.21.15.173:0/1168616370 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a09a9a1c80 con 0x55a09a8dd000 2024-09-13T23:56:59.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.154+0000 7f70135e2f40 1 -- 172.21.15.173:0/1168616370 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a09a8ef860 con 0x55a09a8dd000 2024-09-13T23:56:59.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.154+0000 7f700ed95700 1 -- 172.21.15.173:0/1168616370 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a09a9814a0 con 0x55a09a8dd000 2024-09-13T23:56:59.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.154+0000 7f70135e2f40 1 -- 172.21.15.173:0/1168616370 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a09a8ef6c0 con 0x55a09a8dd000 2024-09-13T23:56:59.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.154+0000 7f700ed95700 1 -- 172.21.15.173:0/1168616370 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55a09a9d6b00 con 0x55a09a8dd000 2024-09-13T23:56:59.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.154+0000 7f70135e2f40 1 Processor -- start 2024-09-13T23:56:59.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.154+0000 7f70135e2f40 1 -- start start 2024-09-13T23:56:59.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.154+0000 7f700ed95700 1 --2- 172.21.15.173:0/1168616370 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a09ac74000 0x55a09abc3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.154+0000 7f700ed95700 1 -- 172.21.15.173:0/1168616370 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55a09a943180 con 0x55a09a8dd000 2024-09-13T23:56:59.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.154+0000 7f70135e2f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd800 0x55a09abc2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.154+0000 7f701259c700 1 --2- 172.21.15.173:0/1168616370 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a09ac74000 0x55a09abc3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.154+0000 7f70135e2f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09a96a000 con 0x55a09a8dd800 2024-09-13T23:56:59.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.158+0000 7f7011d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd800 0x55a09abc2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.158+0000 7f7011d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd800 0x55a09abc2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58464/0 (socket says 172.21.15.173:58464) 2024-09-13T23:56:59.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.158+0000 7f7011d9b700 1 -- 172.21.15.173:0/2668480867 learned_addr learned my addr 172.21.15.173:0/2668480867 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.158+0000 7f701259c700 1 --2- 172.21.15.173:0/1168616370 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a09ac74000 0x55a09abc3080 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55a09b754900 tx=0x55a09ac36a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.158+0000 7f7011d9b700 1 -- 172.21.15.173:0/2668480867 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a09a8ee000 con 0x55a09a8dd800 2024-09-13T23:56:59.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.158+0000 7f7011d9b700 1 --2- 172.21.15.173:0/2668480867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd800 0x55a09abc2b00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55a09b754360 tx=0x55a09ac36240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35fec00a77e99d38 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.158+0000 7f700c590700 1 -- 172.21.15.173:0/2668480867 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a09a981600 con 0x55a09a8dd800 2024-09-13T23:56:59.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.158+0000 7f700c590700 1 -- 172.21.15.173:0/2668480867 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a09a9a1c80 con 0x55a09a8dd800 2024-09-13T23:56:59.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.158+0000 7f700c590700 1 -- 172.21.15.173:0/2668480867 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a09a981a20 con 0x55a09a8dd800 2024-09-13T23:56:59.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.158+0000 7f70135e2f40 1 -- 172.21.15.173:0/2668480867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd800 msgr2=0x55a09abc2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.158+0000 7f70135e2f40 1 --2- 172.21.15.173:0/2668480867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd800 0x55a09abc2b00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55a09b754360 tx=0x55a09ac36240 comp rx=0 tx=0).stop 2024-09-13T23:56:59.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.158+0000 7f70135e2f40 1 -- 172.21.15.173:0/2668480867 shutdown_connections 2024-09-13T23:56:59.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.158+0000 7f70135e2f40 1 --2- 172.21.15.173:0/2668480867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd800 0x55a09abc2b00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.158+0000 7f70135e2f40 1 -- 172.21.15.173:0/2668480867 >> 172.21.15.173:0/2668480867 conn(0x55a09a8dd400 msgr2=0x55a09a9dd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.158+0000 7f70135e2f40 1 -- 172.21.15.173:0/2668480867 shutdown_connections 2024-09-13T23:56:59.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.158+0000 7f70135e2f40 1 -- 172.21.15.173:0/2668480867 wait complete. 2024-09-13T23:56:59.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.158+0000 7f70135e2f40 1 Processor -- start 2024-09-13T23:56:59.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.158+0000 7f70135e2f40 1 -- start start 2024-09-13T23:56:59.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.158+0000 7f70135e2f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd800 0x55a09abc2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.158+0000 7f70135e2f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09a902640 con 0x55a09a8dd800 2024-09-13T23:56:59.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.162+0000 7f7011d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd800 0x55a09abc2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.162+0000 7f7011d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd800 0x55a09abc2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58470/0 (socket says 172.21.15.173:58470) 2024-09-13T23:56:59.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.162+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 learned_addr learned my addr 172.21.15.173:0/410451685 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.162+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a09a8eeea0 con 0x55a09a8dd800 2024-09-13T23:56:59.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.162+0000 7f7011d9b700 1 --2- 172.21.15.173:0/410451685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd800 0x55a09abc2b00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55a09b7546c0 tx=0x55a09ac36c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.162+0000 7f700ad8d700 1 -- 172.21.15.173:0/410451685 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a09a981600 con 0x55a09a8dd800 2024-09-13T23:56:59.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.162+0000 7f700ad8d700 1 -- 172.21.15.173:0/410451685 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a09ac96000 con 0x55a09a8dd800 2024-09-13T23:56:59.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.162+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a09a8ee820 con 0x55a09a8dd800 2024-09-13T23:56:59.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.162+0000 7f700ad8d700 1 -- 172.21.15.173:0/410451685 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a09a981a20 con 0x55a09a8dd800 2024-09-13T23:56:59.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.162+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a09a8ee9c0 con 0x55a09a8dd800 2024-09-13T23:56:59.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.162+0000 7f700ad8d700 1 -- 172.21.15.173:0/410451685 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55a09a9d6dc0 con 0x55a09a8dd800 2024-09-13T23:56:59.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.162+0000 7f70135e2f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.162+0000 7f700ad8d700 1 --2- 172.21.15.173:0/410451685 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a09ac75000 0x55a09abc3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.162+0000 7f700ad8d700 1 -- 172.21.15.173:0/410451685 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55a09a943340 con 0x55a09a8dd800 2024-09-13T23:56:59.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.162+0000 7f701159a700 1 --2- 172.21.15.173:0/410451685 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a09ac75000 0x55a09abc3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.162+0000 7f70135e2f40 1 --2- 172.21.15.173:0/410451685 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a09ac75400 0x55a09abc3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.162+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ac75800 con 0x55a09ac75400 2024-09-13T23:56:59.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.166+0000 7f701259c700 1 --2- 172.21.15.173:0/410451685 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a09ac75400 0x55a09abc3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.166+0000 7f701159a700 1 --2- 172.21.15.173:0/410451685 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a09ac75000 0x55a09abc3600 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55a09abbd920 tx=0x55a09a9e1800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.166+0000 7f701259c700 1 --2- 172.21.15.173:0/410451685 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a09ac75400 0x55a09abc3b80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.166+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ac75400 2024-09-13T23:56:59.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.166+0000 7f70135e2f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.166+0000 7f70135e2f40 20 realm 2024-09-13T23:56:59.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.166+0000 7f70135e2f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.166+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ac75c00 con 0x55a09ac75400 2024-09-13T23:56:59.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.166+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ac75400 2024-09-13T23:56:59.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.166+0000 7f70135e2f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.166+0000 7f70135e2f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:56:59.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.166+0000 7f70135e2f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.166+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ac75800 con 0x55a09ac75400 2024-09-13T23:56:59.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.166+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ac75400 2024-09-13T23:56:59.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.166+0000 7f70135e2f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.166+0000 7f70135e2f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.166+0000 7f70135e2f40 1 --2- 172.21.15.173:0/410451685 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a09ac75c00 0x55a09abc4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.166+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ac75c00 2024-09-13T23:56:59.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.166+0000 7f7011d9b700 1 --2- 172.21.15.173:0/410451685 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a09ac75c00 0x55a09abc4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.166+0000 7f7011d9b700 1 --2- 172.21.15.173:0/410451685 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a09ac75c00 0x55a09abc4100 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.170+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55a09ad03200 con 0x55a09ac75c00 2024-09-13T23:56:59.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.170+0000 7f70135e2f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:59.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.170+0000 7f70135e2f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.170+0000 7f70135e2f40 1 --2- 172.21.15.173:0/410451685 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a09ad10400 0x55a09abc4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.170+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10800 con 0x55a09ad10400 2024-09-13T23:56:59.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.170+0000 7f701159a700 1 --2- 172.21.15.173:0/410451685 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a09ad10400 0x55a09abc4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.170+0000 7f701159a700 1 --2- 172.21.15.173:0/410451685 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a09ad10400 0x55a09abc4680 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.170+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55a09ad03440 con 0x55a09ad10400 2024-09-13T23:56:59.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.170+0000 7f70135e2f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:56:59.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.170+0000 7f70135e2f40 20 searching for the correct realm 2024-09-13T23:56:59.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.170+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10c00 con 0x55a09ad10400 2024-09-13T23:56:59.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.170+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55a09ad03440 con 0x55a09ad10400 2024-09-13T23:56:59.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.170+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10800 con 0x55a09ac75c00 2024-09-13T23:56:59.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.170+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad03200 con 0x55a09ac75c00 2024-09-13T23:56:59.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.170+0000 7f7011d9b700 1 --2- 172.21.15.173:0/410451685 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a09ad10800 0x55a09abc4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.170+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ad10800 2024-09-13T23:56:59.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.170+0000 7f701259c700 1 --2- 172.21.15.173:0/410451685 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a09ad10800 0x55a09abc4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.174+0000 7f701259c700 1 --2- 172.21.15.173:0/410451685 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a09ad10800 0x55a09abc4c00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.174+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ad10800 2024-09-13T23:56:59.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.174+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ac75400 2024-09-13T23:56:59.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.174+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ac75400 2024-09-13T23:56:59.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.174+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ac75400 2024-09-13T23:56:59.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.174+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ac75400 2024-09-13T23:56:59.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.174+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ad10400 2024-09-13T23:56:59.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.174+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad03440 con 0x55a09ad10400 2024-09-13T23:56:59.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.174+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ac75400 2024-09-13T23:56:59.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.174+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ac75400 2024-09-13T23:56:59.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.174+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ac75c00 2024-09-13T23:56:59.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.178+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad03200 con 0x55a09ac75c00 2024-09-13T23:56:59.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.178+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ac75c00 2024-09-13T23:56:59.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.178+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad03200 con 0x55a09ac75c00 2024-09-13T23:56:59.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.178+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ac75400 2024-09-13T23:56:59.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.178+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ac75400 2024-09-13T23:56:59.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.178+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ad10800 2024-09-13T23:56:59.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.178+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ad10800 2024-09-13T23:56:59.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.178+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ac75400 2024-09-13T23:56:59.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.178+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ac75400 2024-09-13T23:56:59.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.178+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ad10800 2024-09-13T23:56:59.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.178+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ad10800 2024-09-13T23:56:59.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.178+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ac75c00 2024-09-13T23:56:59.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.178+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad03200 con 0x55a09ac75c00 2024-09-13T23:56:59.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.178+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ad10400 2024-09-13T23:56:59.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.182+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad03440 con 0x55a09ad10400 2024-09-13T23:56:59.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.182+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ac75400 2024-09-13T23:56:59.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.182+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ac75400 2024-09-13T23:56:59.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.182+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ac75c00 2024-09-13T23:56:59.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.182+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad03200 con 0x55a09ac75c00 2024-09-13T23:56:59.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.182+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ad10400 2024-09-13T23:56:59.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.182+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad03440 con 0x55a09ad10400 2024-09-13T23:56:59.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.182+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ac75400 2024-09-13T23:56:59.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.182+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ac75400 2024-09-13T23:56:59.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.182+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ac75400 2024-09-13T23:56:59.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.182+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ac75400 2024-09-13T23:56:59.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.182+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ac75400 2024-09-13T23:56:59.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.182+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ac75400 2024-09-13T23:56:59.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.182+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ad10400 2024-09-13T23:56:59.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.186+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad03440 con 0x55a09ad10400 2024-09-13T23:56:59.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.186+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ad10800 2024-09-13T23:56:59.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.186+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ad10800 2024-09-13T23:56:59.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.186+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ac75400 2024-09-13T23:56:59.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.186+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ac75400 2024-09-13T23:56:59.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.186+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ad10800 2024-09-13T23:56:59.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.186+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ad10800 2024-09-13T23:56:59.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.186+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ad10400 2024-09-13T23:56:59.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.186+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad03440 con 0x55a09ad10400 2024-09-13T23:56:59.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.186+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ad10800 2024-09-13T23:56:59.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.186+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ad10800 2024-09-13T23:56:59.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.186+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ac75c00 2024-09-13T23:56:59.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.190+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad03200 con 0x55a09ac75c00 2024-09-13T23:56:59.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.190+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ac75c00 2024-09-13T23:56:59.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.190+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad03200 con 0x55a09ac75c00 2024-09-13T23:56:59.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.190+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ad10400 2024-09-13T23:56:59.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.190+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad03440 con 0x55a09ad10400 2024-09-13T23:56:59.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.190+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ac75c00 2024-09-13T23:56:59.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.190+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55a09ad03200 con 0x55a09ac75c00 2024-09-13T23:56:59.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.190+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ac75c00 2024-09-13T23:56:59.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.190+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a09ad03200 con 0x55a09ac75c00 2024-09-13T23:56:59.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.190+0000 7f70135e2f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:56:59.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.190+0000 7f70135e2f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:56:59.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.190+0000 7f70135e2f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:56:59.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.190+0000 7f70135e2f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:56:59.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.190+0000 7f70135e2f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.190+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad11000 con 0x55a09ac75400 2024-09-13T23:56:59.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ac75400 2024-09-13T23:56:59.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad11400 con 0x55a09ac75c00 2024-09-13T23:56:59.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55a09ad03200 con 0x55a09ac75c00 2024-09-13T23:56:59.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:59.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad11800 con 0x55a09ac75400 2024-09-13T23:56:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ac75400 2024-09-13T23:56:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:56:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 20 zone default found 2024-09-13T23:56:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 4 Realm: () 2024-09-13T23:56:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:56:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:56:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:56:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 20 zonegroup default 2024-09-13T23:56:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad11c00 con 0x55a09ad10800 2024-09-13T23:56:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ad10800 2024-09-13T23:56:59.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad11000 con 0x55a09ad10400 2024-09-13T23:56:59.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55a09ad03440 con 0x55a09ad10400 2024-09-13T23:56:59.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad11800 con 0x55a09ad10400 2024-09-13T23:56:59.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55a09ad03440 con 0x55a09ad10400 2024-09-13T23:56:59.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 20 started sync module instance, tier type = 2024-09-13T23:56:59.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:56:59.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.194+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ac75800 con 0x55a09ac75c00 2024-09-13T23:56:59.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.198+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a09ad03200 con 0x55a09ac75c00 2024-09-13T23:56:59.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.198+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94148279114496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ac74800 con 0x55a09ac75c00 2024-09-13T23:56:59.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.198+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ac75800 con 0x55a09ac75400 2024-09-13T23:56:59.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.202+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ac75400 2024-09-13T23:56:59.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.202+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94148279115648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10000 con 0x55a09ac75400 2024-09-13T23:56:59.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.202+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad11400 con 0x55a09ac75c00 2024-09-13T23:56:59.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.202+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94148279114496] v33'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a09ad03200 con 0x55a09ac75c00 2024-09-13T23:56:59.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.206+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94148279115648] v33'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ac75400 2024-09-13T23:56:59.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.206+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a09ad03200 con 0x55a09ac75c00 2024-09-13T23:56:59.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.206+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94148279116800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad18000 con 0x55a09ac75c00 2024-09-13T23:56:59.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.206+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad18400 con 0x55a09ad10800 2024-09-13T23:56:59.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.206+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94148279116800] v33'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a09ad03200 con 0x55a09ac75c00 2024-09-13T23:56:59.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.206+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ad10800 2024-09-13T23:56:59.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.206+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94148279117952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad18800 con 0x55a09ad10800 2024-09-13T23:56:59.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.206+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad18c00 con 0x55a09ac75c00 2024-09-13T23:56:59.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.210+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94148279117952] v33'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ad10800 2024-09-13T23:56:59.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.210+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a09ad03200 con 0x55a09ac75c00 2024-09-13T23:56:59.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.210+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94148279119104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad19000 con 0x55a09ac75c00 2024-09-13T23:56:59.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.210+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad19400 con 0x55a09ad10400 2024-09-13T23:56:59.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.214+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a09ad03440 con 0x55a09ad10400 2024-09-13T23:56:59.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.214+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94148279119104] v33'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a09ad03200 con 0x55a09ac75c00 2024-09-13T23:56:59.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.214+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94148279120256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad19800 con 0x55a09ad10400 2024-09-13T23:56:59.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.214+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad19c00 con 0x55a09ad10400 2024-09-13T23:56:59.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.214+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94148279120256] v33'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a09ad03440 con 0x55a09ad10400 2024-09-13T23:56:59.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.218+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a09ad03440 con 0x55a09ad10400 2024-09-13T23:56:59.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.218+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94148279121408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad19400 con 0x55a09ad10400 2024-09-13T23:56:59.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.218+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad18000 con 0x55a09ad10800 2024-09-13T23:56:59.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.222+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ad10800 2024-09-13T23:56:59.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.222+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94148279122560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad18c00 con 0x55a09ad10800 2024-09-13T23:56:59.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.222+0000 7f70135e2f40 20 add_watcher() i=0 2024-09-13T23:56:59.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.222+0000 7f70135e2f40 20 add_watcher() i=1 2024-09-13T23:56:59.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.222+0000 7f70135e2f40 20 add_watcher() i=2 2024-09-13T23:56:59.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.222+0000 7f70135e2f40 20 add_watcher() i=3 2024-09-13T23:56:59.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.222+0000 7f70135e2f40 20 add_watcher() i=4 2024-09-13T23:56:59.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.222+0000 7f70135e2f40 20 add_watcher() i=5 2024-09-13T23:56:59.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.226+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94148279121408] v33'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a09ad03440 con 0x55a09ad10400 2024-09-13T23:56:59.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.226+0000 7f70135e2f40 20 add_watcher() i=6 2024-09-13T23:56:59.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.226+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94148279122560] v33'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ad10800 2024-09-13T23:56:59.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.226+0000 7f70135e2f40 20 add_watcher() i=7 2024-09-13T23:56:59.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.226+0000 7f70135e2f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:56:59.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.226+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad10c00 con 0x55a09ac75400 2024-09-13T23:56:59.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.226+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ac75400 2024-09-13T23:56:59.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.226+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94148280590336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad11000 con 0x55a09ac75400 2024-09-13T23:56:59.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.230+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94148280590336] v33'54 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ac75400 2024-09-13T23:56:59.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.230+0000 7f6ff8d69700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:59.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.230+0000 7f70135e2f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:56:59.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.230+0000 7f70135e2f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:56:59.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.230+0000 7f70135e2f40 1 Processor -- start 2024-09-13T23:56:59.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.230+0000 7f70135e2f40 1 -- start start 2024-09-13T23:56:59.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.230+0000 7f70135e2f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09ad11400 0x55a09abc5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.230+0000 7f70135e2f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09a902780 con 0x55a09ad11400 2024-09-13T23:56:59.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.230+0000 7f701159a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09ad11400 0x55a09abc5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.230+0000 7f701159a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09ad11400 0x55a09abc5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58486/0 (socket says 172.21.15.173:58486) 2024-09-13T23:56:59.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.230+0000 7f701159a700 1 -- 172.21.15.173:0/1861975921 learned_addr learned my addr 172.21.15.173:0/1861975921 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.230+0000 7f701159a700 1 -- 172.21.15.173:0/1861975921 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a09a8eeb60 con 0x55a09ad11400 2024-09-13T23:56:59.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.230+0000 7f701159a700 1 --2- 172.21.15.173:0/1861975921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09ad11400 0x55a09abc5180 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55a09acaff20 tx=0x55a09a9e1980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c857ef68eab6b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.230+0000 7f6ff8568700 1 -- 172.21.15.173:0/1861975921 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a09a981760 con 0x55a09ad11400 2024-09-13T23:56:59.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.230+0000 7f6ff8568700 1 -- 172.21.15.173:0/1861975921 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a09ac96900 con 0x55a09ad11400 2024-09-13T23:56:59.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.230+0000 7f6ff8568700 1 -- 172.21.15.173:0/1861975921 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a09ad20160 con 0x55a09ad11400 2024-09-13T23:56:59.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.234+0000 7f70135e2f40 1 -- 172.21.15.173:0/1861975921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09ad11400 msgr2=0x55a09abc5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.234+0000 7f70135e2f40 1 --2- 172.21.15.173:0/1861975921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09ad11400 0x55a09abc5180 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55a09acaff20 tx=0x55a09a9e1980 comp rx=0 tx=0).stop 2024-09-13T23:56:59.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.234+0000 7f70135e2f40 1 -- 172.21.15.173:0/1861975921 shutdown_connections 2024-09-13T23:56:59.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.234+0000 7f70135e2f40 1 --2- 172.21.15.173:0/1861975921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09ad11400 0x55a09abc5180 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.234+0000 7f70135e2f40 1 -- 172.21.15.173:0/1861975921 >> 172.21.15.173:0/1861975921 conn(0x55a09ad11800 msgr2=0x55a09a9de000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.234+0000 7f70135e2f40 1 -- 172.21.15.173:0/1861975921 shutdown_connections 2024-09-13T23:56:59.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.234+0000 7f70135e2f40 1 -- 172.21.15.173:0/1861975921 wait complete. 2024-09-13T23:56:59.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.234+0000 7f70135e2f40 1 Processor -- start 2024-09-13T23:56:59.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.234+0000 7f70135e2f40 1 -- start start 2024-09-13T23:56:59.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.234+0000 7f70135e2f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09ad11400 0x55a09abc5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.234+0000 7f70135e2f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09a96a000 con 0x55a09ad11400 2024-09-13T23:56:59.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.234+0000 7f701159a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09ad11400 0x55a09abc5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.234+0000 7f701159a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09ad11400 0x55a09abc5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58496/0 (socket says 172.21.15.173:58496) 2024-09-13T23:56:59.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.234+0000 7f701159a700 1 -- 172.21.15.173:0/2422628326 learned_addr learned my addr 172.21.15.173:0/2422628326 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.234+0000 7f701159a700 1 -- 172.21.15.173:0/2422628326 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a09a8eed00 con 0x55a09ad11400 2024-09-13T23:56:59.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.234+0000 7f701159a700 1 --2- 172.21.15.173:0/2422628326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09ad11400 0x55a09abc5180 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55a09ad2a1e0 tx=0x55a09ac37c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.234+0000 7f6ff6d65700 1 -- 172.21.15.173:0/2422628326 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a09ad202c0 con 0x55a09ad11400 2024-09-13T23:56:59.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.234+0000 7f6ff6d65700 1 -- 172.21.15.173:0/2422628326 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a09ac96600 con 0x55a09ad11400 2024-09-13T23:56:59.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.238+0000 7f6ff6d65700 1 -- 172.21.15.173:0/2422628326 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a09ad20420 con 0x55a09ad11400 2024-09-13T23:56:59.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.238+0000 7f70135e2f40 1 -- 172.21.15.173:0/2422628326 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a09a8ee340 con 0x55a09ad11400 2024-09-13T23:56:59.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.238+0000 7f70135e2f40 1 -- 172.21.15.173:0/2422628326 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a09a8efd40 con 0x55a09ad11400 2024-09-13T23:56:59.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.238+0000 7f6ff6d65700 1 -- 172.21.15.173:0/2422628326 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55a09a9d7b80 con 0x55a09ad11400 2024-09-13T23:56:59.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.238+0000 7f6ff6d65700 1 --2- 172.21.15.173:0/2422628326 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a09ad10c00 0x55a09adb2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.238+0000 7f6ff6d65700 1 -- 172.21.15.173:0/2422628326 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55a09a9436c0 con 0x55a09ad11400 2024-09-13T23:56:59.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.238+0000 7f701259c700 1 --2- 172.21.15.173:0/2422628326 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a09ad10c00 0x55a09adb2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.238+0000 7f70135e2f40 5 note: GC not initialized 2024-09-13T23:56:59.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.238+0000 7f701259c700 1 --2- 172.21.15.173:0/2422628326 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a09ad10c00 0x55a09adb2000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55a09acaf6b0 tx=0x55a09ac369c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.242+0000 7f6ff4560700 20 reqs_thread_entry: start 2024-09-13T23:56:59.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.242+0000 7f70135e2f40 20 init_complete bucket index max shards: 11 2024-09-13T23:56:59.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.242+0000 7f70135e2f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:56:59.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.242+0000 7f6ff1d5b700 20 reqs_thread_entry: start 2024-09-13T23:56:59.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.242+0000 7f70135e2f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.242+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ac74800 con 0x55a09ac75400 2024-09-13T23:56:59.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.242+0000 7f6ff255c700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:29 2024 2024-09-13T23:56:59.247 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:56:59.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.242+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ac75400 2024-09-13T23:56:59.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.242+0000 7f70135e2f40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:56:59.248 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:56:59.248 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "foo", 2024-09-13T23:56:59.248 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Foo", 2024-09-13T23:56:59.248 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "foo@foo.com", 2024-09-13T23:56:59.248 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:56:59.248 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:56:59.248 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [], 2024-09-13T23:56:59.248 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:56:59.249 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:56:59.249 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:56:59.249 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-09-13T23:56:59.249 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-09-13T23:56:59.249 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:56:59.249 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:56:59.249 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [], 2024-09-13T23:56:59.249 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:56:59.249 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:56:59.249 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:56:59.249 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:56:59.249 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:56:59.249 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:56:59.249 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:56:59.250 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:56:59.250 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:56:59.250 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:56:59.250 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:56:59.250 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:56:59.250 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:56:59.250 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:56:59.250 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:56:59.250 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:56:59.250 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:56:59.250 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:56:59.250 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:56:59.250 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:56:59.251 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:56:59.251 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:56:59.251 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:56:59.251 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:56:59.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.242+0000 7f6ff8d69700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:59.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.242+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94148280590336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ac75800 con 0x55a09ac75400 2024-09-13T23:56:59.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.246+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94148280590336] v33'55 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ac75400 2024-09-13T23:56:59.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.246+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94148279114496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad18800 con 0x55a09ac75c00 2024-09-13T23:56:59.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.250+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94148279114496] v33'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a09ad03200 con 0x55a09ac75c00 2024-09-13T23:56:59.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.250+0000 7f70135e2f40 20 remove_watcher() i=0 2024-09-13T23:56:59.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.250+0000 7f70135e2f40 2 removed watcher, disabling cache 2024-09-13T23:56:59.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.250+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94148279115648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad18000 con 0x55a09ac75400 2024-09-13T23:56:59.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.250+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94148279115648] v33'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ac75400 2024-09-13T23:56:59.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.250+0000 7f70135e2f40 20 remove_watcher() i=1 2024-09-13T23:56:59.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.250+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94148279116800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad18c00 con 0x55a09ac75c00 2024-09-13T23:56:59.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.254+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94148279116800] v33'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a09ad03200 con 0x55a09ac75c00 2024-09-13T23:56:59.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.254+0000 7f70135e2f40 20 remove_watcher() i=2 2024-09-13T23:56:59.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.254+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94148279117952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad19000 con 0x55a09ad10800 2024-09-13T23:56:59.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.258+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94148279117952] v33'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ad10800 2024-09-13T23:56:59.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.258+0000 7f70135e2f40 20 remove_watcher() i=3 2024-09-13T23:56:59.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.258+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94148279119104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad18400 con 0x55a09ac75c00 2024-09-13T23:56:59.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.258+0000 7f7011d9b700 1 -- 172.21.15.173:0/410451685 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94148279119104] v33'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a09ad03200 con 0x55a09ac75c00 2024-09-13T23:56:59.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.258+0000 7f70135e2f40 20 remove_watcher() i=4 2024-09-13T23:56:59.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.258+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94148279120256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09ad11000 con 0x55a09ad10400 2024-09-13T23:56:59.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.262+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94148279120256] v33'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a09ad03440 con 0x55a09ad10400 2024-09-13T23:56:59.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.262+0000 7f70135e2f40 20 remove_watcher() i=5 2024-09-13T23:56:59.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.262+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94148279121408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09acf6000 con 0x55a09ad10400 2024-09-13T23:56:59.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.266+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94148279121408] v33'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a09ad03440 con 0x55a09ad10400 2024-09-13T23:56:59.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.266+0000 7f70135e2f40 20 remove_watcher() i=6 2024-09-13T23:56:59.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.266+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94148279122560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a09acf6400 con 0x55a09ad10800 2024-09-13T23:56:59.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.266+0000 7f701259c700 1 -- 172.21.15.173:0/410451685 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94148279122560] v33'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a09ad02b40 con 0x55a09ad10800 2024-09-13T23:56:59.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.266+0000 7f70135e2f40 20 remove_watcher() i=7 2024-09-13T23:56:59.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.266+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a09ac75c00 msgr2=0x55a09abc4100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.266+0000 7f70135e2f40 1 --2- 172.21.15.173:0/410451685 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a09ac75c00 0x55a09abc4100 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.266+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a09ac75400 msgr2=0x55a09abc3b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.266+0000 7f70135e2f40 1 --2- 172.21.15.173:0/410451685 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a09ac75400 0x55a09abc3b80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.266+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a09ad10800 msgr2=0x55a09abc4c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.266+0000 7f70135e2f40 1 --2- 172.21.15.173:0/410451685 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a09ad10800 0x55a09abc4c00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.266+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a09ad10400 msgr2=0x55a09abc4680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.266+0000 7f70135e2f40 1 --2- 172.21.15.173:0/410451685 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a09ad10400 0x55a09abc4680 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.266+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a09ac75000 msgr2=0x55a09abc3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.266+0000 7f70135e2f40 1 --2- 172.21.15.173:0/410451685 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a09ac75000 0x55a09abc3600 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55a09abbd920 tx=0x55a09a9e1800 comp rx=0 tx=0).stop 2024-09-13T23:56:59.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.266+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd800 msgr2=0x55a09abc2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.266+0000 7f70135e2f40 1 --2- 172.21.15.173:0/410451685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd800 0x55a09abc2b00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55a09b7546c0 tx=0x55a09ac36c00 comp rx=0 tx=0).stop 2024-09-13T23:56:59.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.266+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 reap_dead start 2024-09-13T23:56:59.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.266+0000 7f701159a700 1 -- 172.21.15.173:0/410451685 reap_dead start 2024-09-13T23:56:59.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.266+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 shutdown_connections 2024-09-13T23:56:59.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.266+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 >> 172.21.15.173:0/410451685 conn(0x55a09a8dd400 msgr2=0x55a09a9dd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.266+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 shutdown_connections 2024-09-13T23:56:59.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.270+0000 7f70135e2f40 1 -- 172.21.15.173:0/410451685 wait complete. 2024-09-13T23:56:59.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.270+0000 7f70135e2f40 1 -- 172.21.15.173:0/2422628326 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a09ad10c00 msgr2=0x55a09adb2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.270+0000 7f70135e2f40 1 --2- 172.21.15.173:0/2422628326 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a09ad10c00 0x55a09adb2000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55a09acaf6b0 tx=0x55a09ac369c0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.270+0000 7f70135e2f40 1 -- 172.21.15.173:0/2422628326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09ad11400 msgr2=0x55a09abc5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.270+0000 7f70135e2f40 1 --2- 172.21.15.173:0/2422628326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09ad11400 0x55a09abc5180 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55a09ad2a1e0 tx=0x55a09ac37c20 comp rx=0 tx=0).stop 2024-09-13T23:56:59.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.270+0000 7f70135e2f40 1 -- 172.21.15.173:0/2422628326 shutdown_connections 2024-09-13T23:56:59.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.270+0000 7f70135e2f40 1 --2- 172.21.15.173:0/2422628326 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a09ad10c00 0x55a09adb2000 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.270+0000 7f70135e2f40 1 --2- 172.21.15.173:0/2422628326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09ad11400 0x55a09abc5180 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.270+0000 7f70135e2f40 1 -- 172.21.15.173:0/2422628326 >> 172.21.15.173:0/2422628326 conn(0x55a09ad11800 msgr2=0x55a09a9de000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.270+0000 7f70135e2f40 1 -- 172.21.15.173:0/2422628326 shutdown_connections 2024-09-13T23:56:59.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.270+0000 7f70135e2f40 1 -- 172.21.15.173:0/2422628326 wait complete. 2024-09-13T23:56:59.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.270+0000 7f70135e2f40 1 -- 172.21.15.173:0/1168616370 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a09ac74000 msgr2=0x55a09abc3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.270+0000 7f70135e2f40 1 --2- 172.21.15.173:0/1168616370 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a09ac74000 0x55a09abc3080 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55a09b754900 tx=0x55a09ac36a20 comp rx=0 tx=0).stop 2024-09-13T23:56:59.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.270+0000 7f70135e2f40 1 -- 172.21.15.173:0/1168616370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd000 msgr2=0x55a09abc2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.270+0000 7f70135e2f40 1 --2- 172.21.15.173:0/1168616370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd000 0x55a09abc2580 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55a09aa39fb0 tx=0x55a09a9e1a40 comp rx=0 tx=0).stop 2024-09-13T23:56:59.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.270+0000 7f70135e2f40 1 -- 172.21.15.173:0/1168616370 shutdown_connections 2024-09-13T23:56:59.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.270+0000 7f70135e2f40 1 --2- 172.21.15.173:0/1168616370 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a09ac74000 0x55a09abc3080 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.270+0000 7f70135e2f40 1 --2- 172.21.15.173:0/1168616370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a09a8dd000 0x55a09abc2580 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.270+0000 7f70135e2f40 1 -- 172.21.15.173:0/1168616370 >> 172.21.15.173:0/1168616370 conn(0x55a09a8dcc00 msgr2=0x55a09a9dd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.270+0000 7f70135e2f40 1 -- 172.21.15.173:0/1168616370 shutdown_connections 2024-09-13T23:56:59.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.270+0000 7f70135e2f40 1 -- 172.21.15.173:0/1168616370 wait complete. 2024-09-13T23:56:59.280 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:56:59.280 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-13T23:56:59.280 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-13T23:56:59.280 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-13T23:56:59.363 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:56:59.363 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:56:59.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.358+0000 7fb47fceaf40 1 Processor -- start 2024-09-13T23:56:59.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.358+0000 7fb47fceaf40 1 -- start start 2024-09-13T23:56:59.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.358+0000 7fb47fceaf40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x56318acd9000 0x56318afbe580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.358+0000 7fb47fceaf40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56318ad9d500 con 0x56318acd9400 2024-09-13T23:56:59.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.358+0000 7fb47fceaf40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x56318ad66a00 con 0x56318acd9000 2024-09-13T23:56:59.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.358+0000 7fb47e4a3700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x56318acd9000 0x56318afbe580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.358+0000 7fb47dca2700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x56318acd9400 0x56318add8800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:57856/0 (socket says 172.21.15.173:57856) 2024-09-13T23:56:59.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.358+0000 7fb47dca2700 1 -- 172.21.15.173:0/835740366 learned_addr learned my addr 172.21.15.173:0/835740366 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:56:59.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.362+0000 7fb47e4a3700 1 -- 172.21.15.173:0/835740366 >> v1:172.21.15.87:6789/0 conn(0x56318acd9400 legacy=0x56318add8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.362+0000 7fb47e4a3700 1 -- 172.21.15.173:0/835740366 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56318acebd40 con 0x56318acd9000 2024-09-13T23:56:59.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.362+0000 7fb47e4a3700 1 --2- 172.21.15.173:0/835740366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9000 0x56318afbe580 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x56318afb9a70 tx=0x56318addd920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed19bda835818fe7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.362+0000 7fb47d4a1700 1 -- 172.21.15.173:0/835740366 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56318ad7d4a0 con 0x56318acd9000 2024-09-13T23:56:59.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.362+0000 7fb47d4a1700 1 -- 172.21.15.173:0/835740366 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56318ad9d800 con 0x56318acd9000 2024-09-13T23:56:59.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.362+0000 7fb47d4a1700 1 -- 172.21.15.173:0/835740366 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56318ad7d600 con 0x56318acd9000 2024-09-13T23:56:59.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.362+0000 7fb47fceaf40 1 -- 172.21.15.173:0/835740366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9000 msgr2=0x56318afbe580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.362+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/835740366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9000 0x56318afbe580 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x56318afb9a70 tx=0x56318addd920 comp rx=0 tx=0).stop 2024-09-13T23:56:59.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.362+0000 7fb47fceaf40 1 -- 172.21.15.173:0/835740366 shutdown_connections 2024-09-13T23:56:59.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.362+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/835740366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9000 0x56318afbe580 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.362+0000 7fb47fceaf40 1 -- 172.21.15.173:0/835740366 >> 172.21.15.173:0/835740366 conn(0x56318acd8c00 msgr2=0x56318add8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.362+0000 7fb47fceaf40 1 -- 172.21.15.173:0/835740366 shutdown_connections 2024-09-13T23:56:59.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.362+0000 7fb47fceaf40 1 -- 172.21.15.173:0/835740366 wait complete. 2024-09-13T23:56:59.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.362+0000 7fb47fceaf40 1 Processor -- start 2024-09-13T23:56:59.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.362+0000 7fb47fceaf40 1 -- start start 2024-09-13T23:56:59.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.362+0000 7fb47fceaf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9000 0x56318afbe580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.362+0000 7fb47fceaf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56318ad66500 con 0x56318acd9000 2024-09-13T23:56:59.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.362+0000 7fb47e4a3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9000 0x56318afbe580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.362+0000 7fb47e4a3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9000 0x56318afbe580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58516/0 (socket says 172.21.15.173:58516) 2024-09-13T23:56:59.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.362+0000 7fb47e4a3700 1 -- 172.21.15.173:0/1980239174 learned_addr learned my addr 172.21.15.173:0/1980239174 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.362+0000 7fb47e4a3700 1 -- 172.21.15.173:0/1980239174 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56318acebba0 con 0x56318acd9000 2024-09-13T23:56:59.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47e4a3700 1 --2- 172.21.15.173:0/1980239174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9000 0x56318afbe580 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x56318ae35d40 tx=0x56318addd800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79d427b2c7d85cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47cca0700 1 -- 172.21.15.173:0/1980239174 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56318ad7d760 con 0x56318acd9000 2024-09-13T23:56:59.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47cca0700 1 -- 172.21.15.173:0/1980239174 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56318ad9db00 con 0x56318acd9000 2024-09-13T23:56:59.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47cca0700 1 -- 172.21.15.173:0/1980239174 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56318ad7d4a0 con 0x56318acd9000 2024-09-13T23:56:59.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47fceaf40 1 -- 172.21.15.173:0/1980239174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9000 msgr2=0x56318afbe580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/1980239174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9000 0x56318afbe580 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x56318ae35d40 tx=0x56318addd800 comp rx=0 tx=0).stop 2024-09-13T23:56:59.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47fceaf40 1 -- 172.21.15.173:0/1980239174 shutdown_connections 2024-09-13T23:56:59.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/1980239174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9000 0x56318afbe580 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47fceaf40 1 -- 172.21.15.173:0/1980239174 >> 172.21.15.173:0/1980239174 conn(0x56318acd8c00 msgr2=0x56318add9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47fceaf40 1 -- 172.21.15.173:0/1980239174 shutdown_connections 2024-09-13T23:56:59.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47fceaf40 1 -- 172.21.15.173:0/1980239174 wait complete. 2024-09-13T23:56:59.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47fceaf40 1 Processor -- start 2024-09-13T23:56:59.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47fceaf40 1 -- start start 2024-09-13T23:56:59.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47fceaf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9000 0x56318afbe580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47fceaf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56318ad663c0 con 0x56318acd9000 2024-09-13T23:56:59.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47e4a3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9000 0x56318afbe580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47e4a3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9000 0x56318afbe580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58520/0 (socket says 172.21.15.173:58520) 2024-09-13T23:56:59.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47e4a3700 1 -- 172.21.15.173:0/3397932928 learned_addr learned my addr 172.21.15.173:0/3397932928 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47e4a3700 1 -- 172.21.15.173:0/3397932928 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56318aceba00 con 0x56318acd9000 2024-09-13T23:56:59.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47e4a3700 1 --2- 172.21.15.173:0/3397932928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9000 0x56318afbe580 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x56318ae356b0 tx=0x56318addd920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47b49d700 1 -- 172.21.15.173:0/3397932928 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56318ad7d600 con 0x56318acd9000 2024-09-13T23:56:59.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47b49d700 1 -- 172.21.15.173:0/3397932928 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56318ad9dc80 con 0x56318acd9000 2024-09-13T23:56:59.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47fceaf40 1 -- 172.21.15.173:0/3397932928 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56318aceb860 con 0x56318acd9000 2024-09-13T23:56:59.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47b49d700 1 -- 172.21.15.173:0/3397932928 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56318ad7d8c0 con 0x56318acd9000 2024-09-13T23:56:59.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.366+0000 7fb47fceaf40 1 -- 172.21.15.173:0/3397932928 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56318aceb6c0 con 0x56318acd9000 2024-09-13T23:56:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.370+0000 7fb47fceaf40 1 Processor -- start 2024-09-13T23:56:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.370+0000 7fb47fceaf40 1 -- start start 2024-09-13T23:56:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.370+0000 7fb47b49d700 1 -- 172.21.15.173:0/3397932928 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x56318add2b00 con 0x56318acd9000 2024-09-13T23:56:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.370+0000 7fb47fceaf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9800 0x56318afbeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.370+0000 7fb47fceaf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56318acfe640 con 0x56318acd9800 2024-09-13T23:56:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.370+0000 7fb47b49d700 1 --2- 172.21.15.173:0/3397932928 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56318b06e000 0x56318afbf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.370+0000 7fb47eca4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9800 0x56318afbeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.370+0000 7fb47b49d700 1 -- 172.21.15.173:0/3397932928 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x56318ad3f180 con 0x56318acd9000 2024-09-13T23:56:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.370+0000 7fb47eca4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9800 0x56318afbeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58536/0 (socket says 172.21.15.173:58536) 2024-09-13T23:56:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.370+0000 7fb47eca4700 1 -- 172.21.15.173:0/1795578415 learned_addr learned my addr 172.21.15.173:0/1795578415 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.370+0000 7fb47e4a3700 1 --2- 172.21.15.173:0/3397932928 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56318b06e000 0x56318afbf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.370+0000 7fb47eca4700 1 -- 172.21.15.173:0/1795578415 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56318acea000 con 0x56318acd9800 2024-09-13T23:56:59.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.370+0000 7fb47e4a3700 1 --2- 172.21.15.173:0/3397932928 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56318b06e000 0x56318afbf080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x56318affd4a0 tx=0x56318b0328a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.370+0000 7fb47eca4700 1 --2- 172.21.15.173:0/1795578415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9800 0x56318afbeb00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x56318ae35f80 tx=0x56318b032780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1911059ef5bca1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.370+0000 7fb478c98700 1 -- 172.21.15.173:0/1795578415 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56318ad7d600 con 0x56318acd9800 2024-09-13T23:56:59.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.370+0000 7fb478c98700 1 -- 172.21.15.173:0/1795578415 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56318b078000 con 0x56318acd9800 2024-09-13T23:56:59.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.370+0000 7fb478c98700 1 -- 172.21.15.173:0/1795578415 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56318ad7d8c0 con 0x56318acd9800 2024-09-13T23:56:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.374+0000 7fb47fceaf40 1 -- 172.21.15.173:0/1795578415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9800 msgr2=0x56318afbeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.374+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/1795578415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9800 0x56318afbeb00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x56318ae35f80 tx=0x56318b032780 comp rx=0 tx=0).stop 2024-09-13T23:56:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.374+0000 7fb47fceaf40 1 -- 172.21.15.173:0/1795578415 shutdown_connections 2024-09-13T23:56:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.374+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/1795578415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9800 0x56318afbeb00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.374+0000 7fb47fceaf40 1 -- 172.21.15.173:0/1795578415 >> 172.21.15.173:0/1795578415 conn(0x56318acd9400 msgr2=0x56318add9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.374+0000 7fb47fceaf40 1 -- 172.21.15.173:0/1795578415 shutdown_connections 2024-09-13T23:56:59.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.374+0000 7fb47fceaf40 1 -- 172.21.15.173:0/1795578415 wait complete. 2024-09-13T23:56:59.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.374+0000 7fb47fceaf40 1 Processor -- start 2024-09-13T23:56:59.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.374+0000 7fb47fceaf40 1 -- start start 2024-09-13T23:56:59.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.374+0000 7fb47fceaf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9800 0x56318afbeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.374+0000 7fb47fceaf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56318acfe8c0 con 0x56318acd9800 2024-09-13T23:56:59.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.374+0000 7fb47eca4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9800 0x56318afbeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.374+0000 7fb47eca4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9800 0x56318afbeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58546/0 (socket says 172.21.15.173:58546) 2024-09-13T23:56:59.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.374+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 learned_addr learned my addr 172.21.15.173:0/2655296670 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.374+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56318aceaea0 con 0x56318acd9800 2024-09-13T23:56:59.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.374+0000 7fb47eca4700 1 --2- 172.21.15.173:0/2655296670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9800 0x56318afbeb00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x56318ae35e90 tx=0x56318adddce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.374+0000 7fb477495700 1 -- 172.21.15.173:0/2655296670 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56318ad7d760 con 0x56318acd9800 2024-09-13T23:56:59.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.374+0000 7fb477495700 1 -- 172.21.15.173:0/2655296670 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56318b078180 con 0x56318acd9800 2024-09-13T23:56:59.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.374+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56318acea820 con 0x56318acd9800 2024-09-13T23:56:59.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.374+0000 7fb477495700 1 -- 172.21.15.173:0/2655296670 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56318ad7d600 con 0x56318acd9800 2024-09-13T23:56:59.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.374+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56318acea9c0 con 0x56318acd9800 2024-09-13T23:56:59.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.378+0000 7fb47fceaf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.378+0000 7fb477495700 1 -- 172.21.15.173:0/2655296670 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x56318add2dc0 con 0x56318acd9800 2024-09-13T23:56:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.378+0000 7fb477495700 1 --2- 172.21.15.173:0/2655296670 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56318b06ec00 0x56318afbf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.378+0000 7fb477495700 1 -- 172.21.15.173:0/2655296670 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x56318ad3f340 con 0x56318acd9800 2024-09-13T23:56:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.378+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/2655296670 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56318b06f000 0x56318afbfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.378+0000 7fb47dca2700 1 --2- 172.21.15.173:0/2655296670 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56318b06ec00 0x56318afbf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.378+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f400 con 0x56318b06f000 2024-09-13T23:56:59.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.378+0000 7fb47eca4700 1 --2- 172.21.15.173:0/2655296670 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56318b06f000 0x56318afbfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.378+0000 7fb47eca4700 1 --2- 172.21.15.173:0/2655296670 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56318b06f000 0x56318afbfb80 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.378+0000 7fb47dca2700 1 --2- 172.21.15.173:0/2655296670 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56318b06ec00 0x56318afbf600 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x56318b051470 tx=0x56318b033920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.378+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56318b124b40 con 0x56318b06f000 2024-09-13T23:56:59.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.378+0000 7fb47fceaf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.378+0000 7fb47fceaf40 20 realm 2024-09-13T23:56:59.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.378+0000 7fb47fceaf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.378+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06f000 2024-09-13T23:56:59.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.378+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56318b124b40 con 0x56318b06f000 2024-09-13T23:56:59.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.378+0000 7fb47fceaf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.378+0000 7fb47fceaf40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:56:59.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.378+0000 7fb47fceaf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.378+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06fc00 con 0x56318b06f000 2024-09-13T23:56:59.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.382+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56318b124b40 con 0x56318b06f000 2024-09-13T23:56:59.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.382+0000 7fb47fceaf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.382+0000 7fb47fceaf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.382+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/2655296670 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56318b06f400 0x56318afc0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.382+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06f400 2024-09-13T23:56:59.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.382+0000 7fb47e4a3700 1 --2- 172.21.15.173:0/2655296670 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56318b06f400 0x56318afc0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.382+0000 7fb47e4a3700 1 --2- 172.21.15.173:0/2655296670 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56318b06f400 0x56318afc0100 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.382+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x56318b125200 con 0x56318b06f400 2024-09-13T23:56:59.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.382+0000 7fb47fceaf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:59.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.382+0000 7fb47fceaf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.382+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/2655296670 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56318b06fc00 0x56318afc0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.382+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b138000 con 0x56318b06fc00 2024-09-13T23:56:59.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.382+0000 7fb47dca2700 1 --2- 172.21.15.173:0/2655296670 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56318b06fc00 0x56318afc0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.382+0000 7fb47dca2700 1 --2- 172.21.15.173:0/2655296670 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56318b06fc00 0x56318afc0680 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.382+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x56318b125440 con 0x56318b06fc00 2024-09-13T23:56:59.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.382+0000 7fb47fceaf40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:56:59.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.382+0000 7fb47fceaf40 20 searching for the correct realm 2024-09-13T23:56:59.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.382+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b138400 con 0x56318b06fc00 2024-09-13T23:56:59.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.386+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x56318b125440 con 0x56318b06fc00 2024-09-13T23:56:59.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.386+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b138000 con 0x56318b06f400 2024-09-13T23:56:59.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.386+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b125200 con 0x56318b06f400 2024-09-13T23:56:59.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.386+0000 7fb47e4a3700 1 --2- 172.21.15.173:0/2655296670 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56318b138000 0x56318afc0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.386+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b138000 2024-09-13T23:56:59.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.386+0000 7fb47eca4700 1 --2- 172.21.15.173:0/2655296670 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56318b138000 0x56318afc0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.386+0000 7fb47eca4700 1 --2- 172.21.15.173:0/2655296670 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56318b138000 0x56318afc0c00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.386+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b124b40 con 0x56318b138000 2024-09-13T23:56:59.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.386+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06f000 2024-09-13T23:56:59.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.386+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x56318b124b40 con 0x56318b06f000 2024-09-13T23:56:59.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.386+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06f000 2024-09-13T23:56:59.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.386+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b124b40 con 0x56318b06f000 2024-09-13T23:56:59.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.386+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06fc00 2024-09-13T23:56:59.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.386+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b125440 con 0x56318b06fc00 2024-09-13T23:56:59.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.386+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06f000 2024-09-13T23:56:59.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.390+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b124b40 con 0x56318b06f000 2024-09-13T23:56:59.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.390+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06f400 2024-09-13T23:56:59.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.390+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b125200 con 0x56318b06f400 2024-09-13T23:56:59.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.390+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06f400 2024-09-13T23:56:59.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.390+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b125200 con 0x56318b06f400 2024-09-13T23:56:59.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.390+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06f000 2024-09-13T23:56:59.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.390+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b124b40 con 0x56318b06f000 2024-09-13T23:56:59.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.390+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b138000 2024-09-13T23:56:59.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.390+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b124b40 con 0x56318b138000 2024-09-13T23:56:59.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.390+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06f000 2024-09-13T23:56:59.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.390+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b124b40 con 0x56318b06f000 2024-09-13T23:56:59.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.390+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b138000 2024-09-13T23:56:59.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.390+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b124b40 con 0x56318b138000 2024-09-13T23:56:59.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.390+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06f400 2024-09-13T23:56:59.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.394+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b125200 con 0x56318b06f400 2024-09-13T23:56:59.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.394+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06fc00 2024-09-13T23:56:59.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.394+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b125440 con 0x56318b06fc00 2024-09-13T23:56:59.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.394+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06f000 2024-09-13T23:56:59.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.394+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b124b40 con 0x56318b06f000 2024-09-13T23:56:59.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.394+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06f400 2024-09-13T23:56:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.394+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b125200 con 0x56318b06f400 2024-09-13T23:56:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.394+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06fc00 2024-09-13T23:56:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.394+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b125440 con 0x56318b06fc00 2024-09-13T23:56:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.394+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06f000 2024-09-13T23:56:59.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.394+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b124b40 con 0x56318b06f000 2024-09-13T23:56:59.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.394+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06f000 2024-09-13T23:56:59.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.394+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b124b40 con 0x56318b06f000 2024-09-13T23:56:59.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.394+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06f000 2024-09-13T23:56:59.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.394+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b124b40 con 0x56318b06f000 2024-09-13T23:56:59.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.394+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06fc00 2024-09-13T23:56:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.398+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b125440 con 0x56318b06fc00 2024-09-13T23:56:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.398+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b138000 2024-09-13T23:56:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.398+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b124b40 con 0x56318b138000 2024-09-13T23:56:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.398+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06f000 2024-09-13T23:56:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.398+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b124b40 con 0x56318b06f000 2024-09-13T23:56:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.398+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b138000 2024-09-13T23:56:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.398+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b124b40 con 0x56318b138000 2024-09-13T23:56:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.398+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06fc00 2024-09-13T23:56:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.398+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b125440 con 0x56318b06fc00 2024-09-13T23:56:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.398+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b138000 2024-09-13T23:56:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.398+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b124b40 con 0x56318b138000 2024-09-13T23:56:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.398+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06f400 2024-09-13T23:56:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.398+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b125200 con 0x56318b06f400 2024-09-13T23:56:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.398+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06f400 2024-09-13T23:56:59.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.402+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b125200 con 0x56318b06f400 2024-09-13T23:56:59.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.402+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06fc00 2024-09-13T23:56:59.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.402+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b125440 con 0x56318b06fc00 2024-09-13T23:56:59.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.402+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06f400 2024-09-13T23:56:59.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.402+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x56318b125200 con 0x56318b06f400 2024-09-13T23:56:59.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.402+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b06f400 2024-09-13T23:56:59.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.402+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56318b125200 con 0x56318b06f400 2024-09-13T23:56:59.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.402+0000 7fb47fceaf40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:56:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.402+0000 7fb47fceaf40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:56:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.402+0000 7fb47fceaf40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:56:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.402+0000 7fb47fceaf40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:56:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.402+0000 7fb47fceaf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.402+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b138800 con 0x56318b06f000 2024-09-13T23:56:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.402+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56318b124b40 con 0x56318b06f000 2024-09-13T23:56:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.402+0000 7fb47fceaf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.402+0000 7fb47fceaf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.402+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b138c00 con 0x56318b06f400 2024-09-13T23:56:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x56318b125200 con 0x56318b06f400 2024-09-13T23:56:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47fceaf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47fceaf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b139000 con 0x56318b06f000 2024-09-13T23:56:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x56318b124b40 con 0x56318b06f000 2024-09-13T23:56:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47fceaf40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:56:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47fceaf40 20 zone default found 2024-09-13T23:56:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47fceaf40 4 Realm: () 2024-09-13T23:56:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47fceaf40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:56:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47fceaf40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:56:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47fceaf40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:56:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47fceaf40 20 zonegroup default 2024-09-13T23:56:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47fceaf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b139400 con 0x56318b138000 2024-09-13T23:56:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x56318b124b40 con 0x56318b138000 2024-09-13T23:56:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47fceaf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47fceaf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b139800 con 0x56318b06fc00 2024-09-13T23:56:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x56318b125440 con 0x56318b06fc00 2024-09-13T23:56:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47fceaf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47fceaf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b139c00 con 0x56318b06fc00 2024-09-13T23:56:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x56318b125440 con 0x56318b06fc00 2024-09-13T23:56:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47fceaf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47fceaf40 20 started sync module instance, tier type = 2024-09-13T23:56:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47fceaf40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:56:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.406+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13e000 con 0x56318b06f400 2024-09-13T23:56:59.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.410+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b125200 con 0x56318b06f400 2024-09-13T23:56:59.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.410+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94770785114880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13e400 con 0x56318b06f400 2024-09-13T23:56:59.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.410+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13e800 con 0x56318b06f000 2024-09-13T23:56:59.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.414+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94770785114880] v33'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b125200 con 0x56318b06f400 2024-09-13T23:56:59.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.414+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b124b40 con 0x56318b06f000 2024-09-13T23:56:59.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.414+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94770785116032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13ec00 con 0x56318b06f000 2024-09-13T23:56:59.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.414+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13f000 con 0x56318b06f400 2024-09-13T23:56:59.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.418+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94770785116032] v33'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b124b40 con 0x56318b06f000 2024-09-13T23:56:59.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.418+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b125200 con 0x56318b06f400 2024-09-13T23:56:59.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.418+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94770785117184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13f400 con 0x56318b06f400 2024-09-13T23:56:59.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.418+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13f800 con 0x56318b138000 2024-09-13T23:56:59.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.418+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94770785117184] v33'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b125200 con 0x56318b06f400 2024-09-13T23:56:59.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.418+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b124b40 con 0x56318b138000 2024-09-13T23:56:59.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.418+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94770785118336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13fc00 con 0x56318b138000 2024-09-13T23:56:59.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.418+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13e800 con 0x56318b06f400 2024-09-13T23:56:59.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.422+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94770785118336] v33'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b124b40 con 0x56318b138000 2024-09-13T23:56:59.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.422+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b125200 con 0x56318b06f400 2024-09-13T23:56:59.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.422+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94770785119488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13e000 con 0x56318b06f400 2024-09-13T23:56:59.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.422+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b138800 con 0x56318b06fc00 2024-09-13T23:56:59.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.426+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b125440 con 0x56318b06fc00 2024-09-13T23:56:59.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.426+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94770785120640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b139000 con 0x56318b06fc00 2024-09-13T23:56:59.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.426+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b139400 con 0x56318b06fc00 2024-09-13T23:56:59.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.426+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94770785119488] v33'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b125200 con 0x56318b06f400 2024-09-13T23:56:59.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.426+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94770785120640] v33'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b125440 con 0x56318b06fc00 2024-09-13T23:56:59.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.426+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b125440 con 0x56318b06fc00 2024-09-13T23:56:59.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.426+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94770785121792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b138c00 con 0x56318b06fc00 2024-09-13T23:56:59.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.426+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b06f800 con 0x56318b138000 2024-09-13T23:56:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.430+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94770785121792] v33'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b125440 con 0x56318b06fc00 2024-09-13T23:56:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.430+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b124b40 con 0x56318b138000 2024-09-13T23:56:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.430+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94770785122944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13e400 con 0x56318b138000 2024-09-13T23:56:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.430+0000 7fb47fceaf40 20 add_watcher() i=0 2024-09-13T23:56:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.430+0000 7fb47fceaf40 20 add_watcher() i=1 2024-09-13T23:56:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.430+0000 7fb47fceaf40 20 add_watcher() i=2 2024-09-13T23:56:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.430+0000 7fb47fceaf40 20 add_watcher() i=3 2024-09-13T23:56:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.430+0000 7fb47fceaf40 20 add_watcher() i=4 2024-09-13T23:56:59.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.430+0000 7fb47fceaf40 20 add_watcher() i=5 2024-09-13T23:56:59.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.430+0000 7fb47fceaf40 20 add_watcher() i=6 2024-09-13T23:56:59.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.430+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94770785122944] v33'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b124b40 con 0x56318b138000 2024-09-13T23:56:59.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.430+0000 7fb47fceaf40 20 add_watcher() i=7 2024-09-13T23:56:59.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.430+0000 7fb47fceaf40 2 all 8 watchers are set, enabling cache 2024-09-13T23:56:59.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.430+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13f000 con 0x56318b06f000 2024-09-13T23:56:59.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.430+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x56318b124b40 con 0x56318b06f000 2024-09-13T23:56:59.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.430+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94770786746368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13f400 con 0x56318b06f000 2024-09-13T23:56:59.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.434+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94770786746368] v33'56 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x56318b124b40 con 0x56318b06f000 2024-09-13T23:56:59.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.434+0000 7fb465471700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:59.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.434+0000 7fb47fceaf40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:56:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.434+0000 7fb47fceaf40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:56:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.434+0000 7fb47fceaf40 1 Processor -- start 2024-09-13T23:56:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.434+0000 7fb47fceaf40 1 -- start start 2024-09-13T23:56:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.434+0000 7fb47fceaf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318b138400 0x56318afc1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.434+0000 7fb47fceaf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56318ad663c0 con 0x56318b138400 2024-09-13T23:56:59.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.434+0000 7fb47dca2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318b138400 0x56318afc1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.434+0000 7fb47dca2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318b138400 0x56318afc1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58558/0 (socket says 172.21.15.173:58558) 2024-09-13T23:56:59.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.434+0000 7fb47dca2700 1 -- 172.21.15.173:0/3322351073 learned_addr learned my addr 172.21.15.173:0/3322351073 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.434+0000 7fb47dca2700 1 -- 172.21.15.173:0/3322351073 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56318aceab60 con 0x56318b138400 2024-09-13T23:56:59.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.434+0000 7fb47dca2700 1 --2- 172.21.15.173:0/3322351073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318b138400 0x56318afc1180 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x56318b14c690 tx=0x56318b0338c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77fca3b776cffcdd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.434+0000 7fb464c70700 1 -- 172.21.15.173:0/3322351073 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56318b154000 con 0x56318b138400 2024-09-13T23:56:59.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.434+0000 7fb464c70700 1 -- 172.21.15.173:0/3322351073 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56318b078600 con 0x56318b138400 2024-09-13T23:56:59.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.434+0000 7fb464c70700 1 -- 172.21.15.173:0/3322351073 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56318b154160 con 0x56318b138400 2024-09-13T23:56:59.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.438+0000 7fb47fceaf40 1 -- 172.21.15.173:0/3322351073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318b138400 msgr2=0x56318afc1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.438+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/3322351073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318b138400 0x56318afc1180 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x56318b14c690 tx=0x56318b0338c0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.438+0000 7fb47fceaf40 1 -- 172.21.15.173:0/3322351073 shutdown_connections 2024-09-13T23:56:59.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.438+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/3322351073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318b138400 0x56318afc1180 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.438+0000 7fb47fceaf40 1 -- 172.21.15.173:0/3322351073 >> 172.21.15.173:0/3322351073 conn(0x56318b13e800 msgr2=0x56318adda000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.438+0000 7fb47fceaf40 1 -- 172.21.15.173:0/3322351073 shutdown_connections 2024-09-13T23:56:59.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.438+0000 7fb47fceaf40 1 -- 172.21.15.173:0/3322351073 wait complete. 2024-09-13T23:56:59.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.438+0000 7fb47fceaf40 1 Processor -- start 2024-09-13T23:56:59.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.438+0000 7fb47fceaf40 1 -- start start 2024-09-13T23:56:59.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.438+0000 7fb47fceaf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318b138400 0x56318afc1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.438+0000 7fb47fceaf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56318ad66500 con 0x56318b138400 2024-09-13T23:56:59.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.438+0000 7fb47dca2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318b138400 0x56318afc1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.438+0000 7fb47dca2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318b138400 0x56318afc1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58568/0 (socket says 172.21.15.173:58568) 2024-09-13T23:56:59.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.438+0000 7fb47dca2700 1 -- 172.21.15.173:0/4111006942 learned_addr learned my addr 172.21.15.173:0/4111006942 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.438+0000 7fb47dca2700 1 -- 172.21.15.173:0/4111006942 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56318acead00 con 0x56318b138400 2024-09-13T23:56:59.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.438+0000 7fb47dca2700 1 --2- 172.21.15.173:0/4111006942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318b138400 0x56318afc1180 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x56318b14c8d0 tx=0x56318b033a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.438+0000 7fb46346d700 1 -- 172.21.15.173:0/4111006942 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56318b1542c0 con 0x56318b138400 2024-09-13T23:56:59.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.438+0000 7fb46346d700 1 -- 172.21.15.173:0/4111006942 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56318b078300 con 0x56318b138400 2024-09-13T23:56:59.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.438+0000 7fb47fceaf40 1 -- 172.21.15.173:0/4111006942 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56318acea340 con 0x56318b138400 2024-09-13T23:56:59.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.438+0000 7fb46346d700 1 -- 172.21.15.173:0/4111006942 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56318b154000 con 0x56318b138400 2024-09-13T23:56:59.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.438+0000 7fb47fceaf40 1 -- 172.21.15.173:0/4111006942 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56318aceab60 con 0x56318b138400 2024-09-13T23:56:59.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.442+0000 7fb46346d700 1 -- 172.21.15.173:0/4111006942 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x56318add3b80 con 0x56318b138400 2024-09-13T23:56:59.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.442+0000 7fb46346d700 1 --2- 172.21.15.173:0/4111006942 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56318b06f800 0x56318b1d4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.442+0000 7fb46346d700 1 -- 172.21.15.173:0/4111006942 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x56318ad3f500 con 0x56318b138400 2024-09-13T23:56:59.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.442+0000 7fb47eca4700 1 --2- 172.21.15.173:0/4111006942 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56318b06f800 0x56318b1d4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.442+0000 7fb47fceaf40 5 note: GC not initialized 2024-09-13T23:56:59.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.442+0000 7fb47eca4700 1 --2- 172.21.15.173:0/4111006942 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56318b06f800 0x56318b1d4000 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x56318b0e1500 tx=0x56318b19e660 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.442+0000 7fb460c68700 20 reqs_thread_entry: start 2024-09-13T23:56:59.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.442+0000 7fb47fceaf40 20 init_complete bucket index max shards: 11 2024-09-13T23:56:59.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.442+0000 7fb47fceaf40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:56:59.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.442+0000 7fb45e463700 20 reqs_thread_entry: start 2024-09-13T23:56:59.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.442+0000 7fb47fceaf40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:56:59.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.442+0000 7fb47fceaf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.442+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b138800 con 0x56318b06f000 2024-09-13T23:56:59.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.442+0000 7fb45ec64700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:29 2024 2024-09-13T23:56:59.450 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:56:59.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.442+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x56318b124b40 con 0x56318b06f000 2024-09-13T23:56:59.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.446+0000 7fb47fceaf40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:56:59.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.446+0000 7fb47fceaf40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:56:59.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.446+0000 7fb47fceaf40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:56:59.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.446+0000 7fb47fceaf40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:56:59.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.446+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13ec00 con 0x56318b138000 2024-09-13T23:56:59.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.446+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x56318b124b40 con 0x56318b138000 2024-09-13T23:56:59.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.446+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13fc00 con 0x56318b06f000 2024-09-13T23:56:59.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.446+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~357] v33'2 uv2 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x56318b124b40 con 0x56318b06f000 2024-09-13T23:56:59.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.446+0000 7fb47fceaf40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:56:59.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.446+0000 7fb47fceaf40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:56:59.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.446+0000 7fb47fceaf40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:56:59.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.446+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94770786748672 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13e400 con 0x56318b06f400 2024-09-13T23:56:59.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.450+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== watch-notify(notify (1) cookie 94770785119488 notify 141733920769 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x56318b030680 con 0x56318b06f400 2024-09-13T23:56:59.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.450+0000 7fb478c98700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920769 cookie 94770785119488 notifier 4328 bl.length()=533 2024-09-13T23:56:59.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.450+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(65 notify.4 [notify cookie 94770786748672 out=8b] v0'0 uv33 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x56318b125200 con 0x56318b06f400 2024-09-13T23:56:59.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.450+0000 7fb478c98700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:56:59.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.450+0000 7fb478c98700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:56:59.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.450+0000 7fb478c98700 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13f000 con 0x56318b06f400 2024-09-13T23:56:59.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.450+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== watch-notify(notify_complete (2) cookie 94770786748672 notify 141733920769 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56318b030820 con 0x56318b06f400 2024-09-13T23:56:59.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.450+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b125200 con 0x56318b06f400 2024-09-13T23:56:59.455 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:56:59.455 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "foo", 2024-09-13T23:56:59.455 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Foo", 2024-09-13T23:56:59.455 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "foo@foo.com", 2024-09-13T23:56:59.455 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 1, 2024-09-13T23:56:59.455 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:56:59.455 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [], 2024-09-13T23:56:59.455 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:56:59.455 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:56:59.455 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:56:59.455 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-09-13T23:56:59.456 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-09-13T23:56:59.456 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:56:59.456 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:56:59.456 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [], 2024-09-13T23:56:59.456 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:56:59.456 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:56:59.456 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:56:59.456 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:56:59.456 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:56:59.456 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:56:59.456 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:56:59.456 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:56:59.456 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:56:59.456 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:56:59.457 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:56:59.457 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:56:59.457 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:56:59.457 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:56:59.457 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:56:59.457 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:56:59.457 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:56:59.457 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:56:59.457 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:56:59.457 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:56:59.457 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:56:59.457 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:56:59.457 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:56:59.457 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:56:59.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.450+0000 7fb465471700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:59.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.450+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94770786746368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13f400 con 0x56318b06f000 2024-09-13T23:56:59.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.454+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94770786746368] v33'57 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x56318b124b40 con 0x56318b06f000 2024-09-13T23:56:59.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.454+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94770785114880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13ec00 con 0x56318b06f400 2024-09-13T23:56:59.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.454+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94770785114880] v33'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b125200 con 0x56318b06f400 2024-09-13T23:56:59.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.458+0000 7fb47fceaf40 20 remove_watcher() i=0 2024-09-13T23:56:59.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.458+0000 7fb47fceaf40 2 removed watcher, disabling cache 2024-09-13T23:56:59.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.458+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94770785116032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13fc00 con 0x56318b06f000 2024-09-13T23:56:59.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.458+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94770785116032] v33'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b124b40 con 0x56318b06f000 2024-09-13T23:56:59.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.458+0000 7fb47fceaf40 20 remove_watcher() i=1 2024-09-13T23:56:59.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.458+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94770785117184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13f800 con 0x56318b06f400 2024-09-13T23:56:59.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.462+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94770785117184] v33'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b125200 con 0x56318b06f400 2024-09-13T23:56:59.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.462+0000 7fb47fceaf40 20 remove_watcher() i=2 2024-09-13T23:56:59.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.462+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94770785118336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13e000 con 0x56318b138000 2024-09-13T23:56:59.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.462+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94770785118336] v33'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b124b40 con 0x56318b138000 2024-09-13T23:56:59.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.462+0000 7fb47fceaf40 20 remove_watcher() i=3 2024-09-13T23:56:59.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.462+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94770785119488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13e400 con 0x56318b06f400 2024-09-13T23:56:59.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.466+0000 7fb47e4a3700 1 -- 172.21.15.173:0/2655296670 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94770785119488] v33'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b125200 con 0x56318b06f400 2024-09-13T23:56:59.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.466+0000 7fb47fceaf40 20 remove_watcher() i=4 2024-09-13T23:56:59.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.466+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94770785120640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13f000 con 0x56318b06fc00 2024-09-13T23:56:59.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.470+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94770785120640] v33'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b125440 con 0x56318b06fc00 2024-09-13T23:56:59.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.470+0000 7fb47fceaf40 20 remove_watcher() i=5 2024-09-13T23:56:59.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.470+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94770785121792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13ec00 con 0x56318b06fc00 2024-09-13T23:56:59.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.470+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94770785121792] v33'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b125440 con 0x56318b06fc00 2024-09-13T23:56:59.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.470+0000 7fb47fceaf40 20 remove_watcher() i=6 2024-09-13T23:56:59.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.470+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94770785122944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56318b13f800 con 0x56318b138000 2024-09-13T23:56:59.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.474+0000 7fb47eca4700 1 -- 172.21.15.173:0/2655296670 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94770785122944] v33'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56318b124b40 con 0x56318b138000 2024-09-13T23:56:59.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.474+0000 7fb47fceaf40 20 remove_watcher() i=7 2024-09-13T23:56:59.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.474+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56318b06f400 msgr2=0x56318afc0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.474+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/2655296670 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56318b06f400 0x56318afc0100 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.474+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56318b06f000 msgr2=0x56318afbfb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.474+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/2655296670 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56318b06f000 0x56318afbfb80 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.474+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56318b138000 msgr2=0x56318afc0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.474+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/2655296670 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56318b138000 0x56318afc0c00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.474+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56318b06fc00 msgr2=0x56318afc0680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.474+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/2655296670 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56318b06fc00 0x56318afc0680 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.474+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56318b06ec00 msgr2=0x56318afbf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.474+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/2655296670 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56318b06ec00 0x56318afbf600 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x56318b051470 tx=0x56318b033920 comp rx=0 tx=0).stop 2024-09-13T23:56:59.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.474+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9800 msgr2=0x56318afbeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.474+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/2655296670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9800 0x56318afbeb00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x56318ae35e90 tx=0x56318adddce0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.474+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 reap_dead start 2024-09-13T23:56:59.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.474+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 shutdown_connections 2024-09-13T23:56:59.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.474+0000 7fb47dca2700 1 -- 172.21.15.173:0/2655296670 reap_dead start 2024-09-13T23:56:59.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.474+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 >> 172.21.15.173:0/2655296670 conn(0x56318acd9400 msgr2=0x56318add9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.474+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 shutdown_connections 2024-09-13T23:56:59.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.474+0000 7fb47fceaf40 1 -- 172.21.15.173:0/2655296670 wait complete. 2024-09-13T23:56:59.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.478+0000 7fb47fceaf40 1 -- 172.21.15.173:0/4111006942 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56318b06f800 msgr2=0x56318b1d4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.478+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/4111006942 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56318b06f800 0x56318b1d4000 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x56318b0e1500 tx=0x56318b19e660 comp rx=0 tx=0).stop 2024-09-13T23:56:59.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.478+0000 7fb47fceaf40 1 -- 172.21.15.173:0/4111006942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318b138400 msgr2=0x56318afc1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.478+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/4111006942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318b138400 0x56318afc1180 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x56318b14c8d0 tx=0x56318b033a40 comp rx=0 tx=0).stop 2024-09-13T23:56:59.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.478+0000 7fb47fceaf40 1 -- 172.21.15.173:0/4111006942 shutdown_connections 2024-09-13T23:56:59.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.478+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/4111006942 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56318b06f800 0x56318b1d4000 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.478+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/4111006942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318b138400 0x56318afc1180 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.478+0000 7fb47fceaf40 1 -- 172.21.15.173:0/4111006942 >> 172.21.15.173:0/4111006942 conn(0x56318b13e800 msgr2=0x56318adda000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.478+0000 7fb47fceaf40 1 -- 172.21.15.173:0/4111006942 shutdown_connections 2024-09-13T23:56:59.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.478+0000 7fb47fceaf40 1 -- 172.21.15.173:0/4111006942 wait complete. 2024-09-13T23:56:59.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.478+0000 7fb47fceaf40 1 -- 172.21.15.173:0/3397932928 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56318b06e000 msgr2=0x56318afbf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.478+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/3397932928 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56318b06e000 0x56318afbf080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x56318affd4a0 tx=0x56318b0328a0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.478+0000 7fb47fceaf40 1 -- 172.21.15.173:0/3397932928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9000 msgr2=0x56318afbe580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.478+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/3397932928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9000 0x56318afbe580 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x56318ae356b0 tx=0x56318addd920 comp rx=0 tx=0).stop 2024-09-13T23:56:59.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.478+0000 7fb47fceaf40 1 -- 172.21.15.173:0/3397932928 shutdown_connections 2024-09-13T23:56:59.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.478+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/3397932928 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56318b06e000 0x56318afbf080 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.478+0000 7fb47fceaf40 1 --2- 172.21.15.173:0/3397932928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56318acd9000 0x56318afbe580 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.478+0000 7fb47fceaf40 1 -- 172.21.15.173:0/3397932928 >> 172.21.15.173:0/3397932928 conn(0x56318acd8c00 msgr2=0x56318add9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.478+0000 7fb47fceaf40 1 -- 172.21.15.173:0/3397932928 shutdown_connections 2024-09-13T23:56:59.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.478+0000 7fb47fceaf40 1 -- 172.21.15.173:0/3397932928 wait complete. 2024-09-13T23:56:59.488 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:56:59.488 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:56:59.488 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:56:59.489 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:56:59.530 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:56:59.530 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:56:59.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.526+0000 7f1e16214f40 1 Processor -- start 2024-09-13T23:56:59.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.526+0000 7f1e16214f40 1 -- start start 2024-09-13T23:56:59.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.526+0000 7f1e16214f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x56033ce8f400 0x56033d174580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.526+0000 7f1e16214f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56033cf53500 con 0x56033ce8f000 2024-09-13T23:56:59.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.526+0000 7f1e16214f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x56033cf1ca00 con 0x56033ce8f400 2024-09-13T23:56:59.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.526+0000 7f1e141cc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x56033ce8f400 0x56033d174580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.526+0000 7f1e149cd700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x56033ce8f000 0x56033cf8e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:57870/0 (socket says 172.21.15.173:57870) 2024-09-13T23:56:59.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.526+0000 7f1e149cd700 1 -- 172.21.15.173:0/3784355484 learned_addr learned my addr 172.21.15.173:0/3784355484 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:56:59.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.526+0000 7f1e141cc700 1 -- 172.21.15.173:0/3784355484 >> v1:172.21.15.87:6789/0 conn(0x56033ce8f000 legacy=0x56033cf8e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.526+0000 7f1e141cc700 1 -- 172.21.15.173:0/3784355484 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56033cea1d40 con 0x56033ce8f400 2024-09-13T23:56:59.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.526+0000 7f1e141cc700 1 --2- 172.21.15.173:0/3784355484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f400 0x56033d174580 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x56033d16f920 tx=0x56033cf93920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc7f91edc4c51e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.526+0000 7f1e139cb700 1 -- 172.21.15.173:0/3784355484 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56033cf334a0 con 0x56033ce8f400 2024-09-13T23:56:59.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.526+0000 7f1e139cb700 1 -- 172.21.15.173:0/3784355484 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56033cf53800 con 0x56033ce8f400 2024-09-13T23:56:59.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.526+0000 7f1e139cb700 1 -- 172.21.15.173:0/3784355484 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56033cf33600 con 0x56033ce8f400 2024-09-13T23:56:59.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.530+0000 7f1e16214f40 1 -- 172.21.15.173:0/3784355484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f400 msgr2=0x56033d174580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.530+0000 7f1e16214f40 1 --2- 172.21.15.173:0/3784355484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f400 0x56033d174580 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x56033d16f920 tx=0x56033cf93920 comp rx=0 tx=0).stop 2024-09-13T23:56:59.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.530+0000 7f1e16214f40 1 -- 172.21.15.173:0/3784355484 shutdown_connections 2024-09-13T23:56:59.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.530+0000 7f1e16214f40 1 --2- 172.21.15.173:0/3784355484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f400 0x56033d174580 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.530+0000 7f1e16214f40 1 -- 172.21.15.173:0/3784355484 >> 172.21.15.173:0/3784355484 conn(0x56033ce8ec00 msgr2=0x56033cf8e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.530+0000 7f1e16214f40 1 -- 172.21.15.173:0/3784355484 shutdown_connections 2024-09-13T23:56:59.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.530+0000 7f1e16214f40 1 -- 172.21.15.173:0/3784355484 wait complete. 2024-09-13T23:56:59.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.530+0000 7f1e16214f40 1 Processor -- start 2024-09-13T23:56:59.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.530+0000 7f1e16214f40 1 -- start start 2024-09-13T23:56:59.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.530+0000 7f1e16214f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f000 0x56033d174580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.530+0000 7f1e16214f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56033cf1c500 con 0x56033ce8f000 2024-09-13T23:56:59.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.530+0000 7f1e149cd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f000 0x56033d174580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.530+0000 7f1e149cd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f000 0x56033d174580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58576/0 (socket says 172.21.15.173:58576) 2024-09-13T23:56:59.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.530+0000 7f1e149cd700 1 -- 172.21.15.173:0/3219343547 learned_addr learned my addr 172.21.15.173:0/3219343547 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.530+0000 7f1e149cd700 1 -- 172.21.15.173:0/3219343547 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56033cea1ba0 con 0x56033ce8f000 2024-09-13T23:56:59.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.530+0000 7f1e149cd700 1 --2- 172.21.15.173:0/3219343547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f000 0x56033d174580 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x56033cfebe90 tx=0x56033cf93b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c058221a32f07f4d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.530+0000 7f1e131ca700 1 -- 172.21.15.173:0/3219343547 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56033cf334a0 con 0x56033ce8f000 2024-09-13T23:56:59.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.530+0000 7f1e131ca700 1 -- 172.21.15.173:0/3219343547 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56033cf53b00 con 0x56033ce8f000 2024-09-13T23:56:59.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.530+0000 7f1e131ca700 1 -- 172.21.15.173:0/3219343547 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56033cf33600 con 0x56033ce8f000 2024-09-13T23:56:59.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.530+0000 7f1e16214f40 1 -- 172.21.15.173:0/3219343547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f000 msgr2=0x56033d174580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.530+0000 7f1e16214f40 1 --2- 172.21.15.173:0/3219343547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f000 0x56033d174580 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x56033cfebe90 tx=0x56033cf93b60 comp rx=0 tx=0).stop 2024-09-13T23:56:59.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.534+0000 7f1e16214f40 1 -- 172.21.15.173:0/3219343547 shutdown_connections 2024-09-13T23:56:59.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.534+0000 7f1e16214f40 1 --2- 172.21.15.173:0/3219343547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f000 0x56033d174580 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.534+0000 7f1e16214f40 1 -- 172.21.15.173:0/3219343547 >> 172.21.15.173:0/3219343547 conn(0x56033ce8ec00 msgr2=0x56033cf8f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.534+0000 7f1e16214f40 1 -- 172.21.15.173:0/3219343547 shutdown_connections 2024-09-13T23:56:59.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.534+0000 7f1e16214f40 1 -- 172.21.15.173:0/3219343547 wait complete. 2024-09-13T23:56:59.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.534+0000 7f1e16214f40 1 Processor -- start 2024-09-13T23:56:59.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.534+0000 7f1e16214f40 1 -- start start 2024-09-13T23:56:59.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.534+0000 7f1e16214f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f000 0x56033d174580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.534+0000 7f1e16214f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56033cf1c3c0 con 0x56033ce8f000 2024-09-13T23:56:59.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.534+0000 7f1e149cd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f000 0x56033d174580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.534+0000 7f1e149cd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f000 0x56033d174580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58584/0 (socket says 172.21.15.173:58584) 2024-09-13T23:56:59.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.534+0000 7f1e149cd700 1 -- 172.21.15.173:0/2190803190 learned_addr learned my addr 172.21.15.173:0/2190803190 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.534+0000 7f1e149cd700 1 -- 172.21.15.173:0/2190803190 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56033cea1a00 con 0x56033ce8f000 2024-09-13T23:56:59.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.534+0000 7f1e149cd700 1 --2- 172.21.15.173:0/2190803190 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f000 0x56033d174580 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x56033cfebfb0 tx=0x56033cf93a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.534+0000 7f1e119c7700 1 -- 172.21.15.173:0/2190803190 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56033cf338c0 con 0x56033ce8f000 2024-09-13T23:56:59.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.534+0000 7f1e119c7700 1 -- 172.21.15.173:0/2190803190 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56033cf53c80 con 0x56033ce8f000 2024-09-13T23:56:59.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.534+0000 7f1e119c7700 1 -- 172.21.15.173:0/2190803190 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56033cf334a0 con 0x56033ce8f000 2024-09-13T23:56:59.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.534+0000 7f1e16214f40 1 -- 172.21.15.173:0/2190803190 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56033cea1860 con 0x56033ce8f000 2024-09-13T23:56:59.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.534+0000 7f1e16214f40 1 -- 172.21.15.173:0/2190803190 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56033cea16c0 con 0x56033ce8f000 2024-09-13T23:56:59.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e16214f40 1 Processor -- start 2024-09-13T23:56:59.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e16214f40 1 -- start start 2024-09-13T23:56:59.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e16214f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f800 0x56033d174b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e16214f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56033cf1c000 con 0x56033ce8f800 2024-09-13T23:56:59.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e119c7700 1 -- 172.21.15.173:0/2190803190 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x56033cf88b00 con 0x56033ce8f000 2024-09-13T23:56:59.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e151ce700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f800 0x56033d174b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e151ce700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f800 0x56033d174b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58594/0 (socket says 172.21.15.173:58594) 2024-09-13T23:56:59.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e151ce700 1 -- 172.21.15.173:0/4153658703 learned_addr learned my addr 172.21.15.173:0/4153658703 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e119c7700 1 --2- 172.21.15.173:0/2190803190 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56033d230000 0x56033d175080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e119c7700 1 -- 172.21.15.173:0/2190803190 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x56033cef5180 con 0x56033ce8f000 2024-09-13T23:56:59.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e149cd700 1 --2- 172.21.15.173:0/2190803190 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56033d230000 0x56033d175080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e151ce700 1 -- 172.21.15.173:0/4153658703 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56033cea0000 con 0x56033ce8f800 2024-09-13T23:56:59.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e149cd700 1 --2- 172.21.15.173:0/2190803190 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56033d230000 0x56033d175080 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x56033dd07620 tx=0x56033d1f0240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e151ce700 1 --2- 172.21.15.173:0/4153658703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f800 0x56033d174b00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x56033d20a4b0 tx=0x56033d1f0a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554ec652f8432b18 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e0f1c2700 1 -- 172.21.15.173:0/4153658703 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56033cf338c0 con 0x56033ce8f800 2024-09-13T23:56:59.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e0f1c2700 1 -- 172.21.15.173:0/4153658703 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56033d236000 con 0x56033ce8f800 2024-09-13T23:56:59.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e0f1c2700 1 -- 172.21.15.173:0/4153658703 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56033cf334a0 con 0x56033ce8f800 2024-09-13T23:56:59.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e16214f40 1 -- 172.21.15.173:0/4153658703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f800 msgr2=0x56033d174b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e16214f40 1 --2- 172.21.15.173:0/4153658703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f800 0x56033d174b00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x56033d20a4b0 tx=0x56033d1f0a20 comp rx=0 tx=0).stop 2024-09-13T23:56:59.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e16214f40 1 -- 172.21.15.173:0/4153658703 shutdown_connections 2024-09-13T23:56:59.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e16214f40 1 --2- 172.21.15.173:0/4153658703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f800 0x56033d174b00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e16214f40 1 -- 172.21.15.173:0/4153658703 >> 172.21.15.173:0/4153658703 conn(0x56033ce8f400 msgr2=0x56033cf8f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e16214f40 1 -- 172.21.15.173:0/4153658703 shutdown_connections 2024-09-13T23:56:59.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e16214f40 1 -- 172.21.15.173:0/4153658703 wait complete. 2024-09-13T23:56:59.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e16214f40 1 Processor -- start 2024-09-13T23:56:59.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.538+0000 7f1e16214f40 1 -- start start 2024-09-13T23:56:59.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.542+0000 7f1e16214f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f800 0x56033d174b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.542+0000 7f1e16214f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56033ceb4640 con 0x56033ce8f800 2024-09-13T23:56:59.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.542+0000 7f1e151ce700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f800 0x56033d174b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.542+0000 7f1e151ce700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f800 0x56033d174b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58598/0 (socket says 172.21.15.173:58598) 2024-09-13T23:56:59.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.542+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 learned_addr learned my addr 172.21.15.173:0/3921408400 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.542+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56033cea0ea0 con 0x56033ce8f800 2024-09-13T23:56:59.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.542+0000 7f1e151ce700 1 --2- 172.21.15.173:0/3921408400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f800 0x56033d174b00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x56033dd06150 tx=0x56033d1f0840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.542+0000 7f1e0d9bf700 1 -- 172.21.15.173:0/3921408400 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56033cf33b80 con 0x56033ce8f800 2024-09-13T23:56:59.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.542+0000 7f1e0d9bf700 1 -- 172.21.15.173:0/3921408400 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56033d236180 con 0x56033ce8f800 2024-09-13T23:56:59.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.542+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56033cea0820 con 0x56033ce8f800 2024-09-13T23:56:59.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.542+0000 7f1e0d9bf700 1 -- 172.21.15.173:0/3921408400 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56033cf338c0 con 0x56033ce8f800 2024-09-13T23:56:59.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.542+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56033cea09c0 con 0x56033ce8f800 2024-09-13T23:56:59.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.542+0000 7f1e16214f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.542+0000 7f1e0d9bf700 1 -- 172.21.15.173:0/3921408400 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x56033cf89080 con 0x56033ce8f800 2024-09-13T23:56:59.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.546+0000 7f1e0d9bf700 1 --2- 172.21.15.173:0/3921408400 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56033d230c00 0x56033d175600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.546+0000 7f1e0d9bf700 1 -- 172.21.15.173:0/3921408400 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x56033cef5340 con 0x56033ce8f800 2024-09-13T23:56:59.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.546+0000 7f1e141cc700 1 --2- 172.21.15.173:0/3921408400 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56033d230c00 0x56033d175600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.546+0000 7f1e16214f40 1 --2- 172.21.15.173:0/3921408400 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56033d231000 0x56033d175b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.546+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231400 con 0x56033d231000 2024-09-13T23:56:59.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.546+0000 7f1e151ce700 1 --2- 172.21.15.173:0/3921408400 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56033d231000 0x56033d175b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.546+0000 7f1e141cc700 1 --2- 172.21.15.173:0/3921408400 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56033d230c00 0x56033d175600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x56033d16f920 tx=0x56033cf93800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.546+0000 7f1e151ce700 1 --2- 172.21.15.173:0/3921408400 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56033d231000 0x56033d175b80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.546+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56033d29cb40 con 0x56033d231000 2024-09-13T23:56:59.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.546+0000 7f1e16214f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.546+0000 7f1e16214f40 20 realm 2024-09-13T23:56:59.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.546+0000 7f1e16214f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.546+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231000 2024-09-13T23:56:59.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.546+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56033d29cb40 con 0x56033d231000 2024-09-13T23:56:59.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.546+0000 7f1e16214f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.546+0000 7f1e16214f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:56:59.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.546+0000 7f1e16214f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.546+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231c00 con 0x56033d231000 2024-09-13T23:56:59.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.546+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56033d29cb40 con 0x56033d231000 2024-09-13T23:56:59.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.546+0000 7f1e16214f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.546+0000 7f1e16214f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.546+0000 7f1e16214f40 1 --2- 172.21.15.173:0/3921408400 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56033d231400 0x56033d176100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.546+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231400 2024-09-13T23:56:59.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.546+0000 7f1e149cd700 1 --2- 172.21.15.173:0/3921408400 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56033d231400 0x56033d176100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.550+0000 7f1e149cd700 1 --2- 172.21.15.173:0/3921408400 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56033d231400 0x56033d176100 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.550+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x56033d29d200 con 0x56033d231400 2024-09-13T23:56:59.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.550+0000 7f1e16214f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:59.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.550+0000 7f1e16214f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.550+0000 7f1e16214f40 1 --2- 172.21.15.173:0/3921408400 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56033d231c00 0x56033d176680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.550+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d2ea000 con 0x56033d231c00 2024-09-13T23:56:59.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.550+0000 7f1e141cc700 1 --2- 172.21.15.173:0/3921408400 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56033d231c00 0x56033d176680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.550+0000 7f1e141cc700 1 --2- 172.21.15.173:0/3921408400 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56033d231c00 0x56033d176680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.550+0000 7f1e141cc700 1 -- 172.21.15.173:0/3921408400 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x56033d29d440 con 0x56033d231c00 2024-09-13T23:56:59.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.550+0000 7f1e16214f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:56:59.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.550+0000 7f1e16214f40 20 searching for the correct realm 2024-09-13T23:56:59.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.550+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d2ea400 con 0x56033d231c00 2024-09-13T23:56:59.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.550+0000 7f1e141cc700 1 -- 172.21.15.173:0/3921408400 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x56033d29d440 con 0x56033d231c00 2024-09-13T23:56:59.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.550+0000 7f1e141cc700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d2ea000 con 0x56033d231400 2024-09-13T23:56:59.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.550+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29d200 con 0x56033d231400 2024-09-13T23:56:59.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.550+0000 7f1e149cd700 1 --2- 172.21.15.173:0/3921408400 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56033d2ea000 0x56033d176c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.550+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d2ea000 2024-09-13T23:56:59.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.550+0000 7f1e151ce700 1 --2- 172.21.15.173:0/3921408400 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56033d2ea000 0x56033d176c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.554+0000 7f1e151ce700 1 --2- 172.21.15.173:0/3921408400 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56033d2ea000 0x56033d176c00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.554+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29cb40 con 0x56033d2ea000 2024-09-13T23:56:59.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.554+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231000 2024-09-13T23:56:59.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.554+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x56033d29cb40 con 0x56033d231000 2024-09-13T23:56:59.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.554+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231000 2024-09-13T23:56:59.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.554+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29cb40 con 0x56033d231000 2024-09-13T23:56:59.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.554+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231c00 2024-09-13T23:56:59.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.554+0000 7f1e141cc700 1 -- 172.21.15.173:0/3921408400 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29d440 con 0x56033d231c00 2024-09-13T23:56:59.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.554+0000 7f1e141cc700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231000 2024-09-13T23:56:59.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.554+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29cb40 con 0x56033d231000 2024-09-13T23:56:59.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.554+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231400 2024-09-13T23:56:59.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.554+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29d200 con 0x56033d231400 2024-09-13T23:56:59.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.554+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231400 2024-09-13T23:56:59.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.558+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29d200 con 0x56033d231400 2024-09-13T23:56:59.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.558+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231000 2024-09-13T23:56:59.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.558+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29cb40 con 0x56033d231000 2024-09-13T23:56:59.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.558+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d2ea000 2024-09-13T23:56:59.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.558+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29cb40 con 0x56033d2ea000 2024-09-13T23:56:59.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.558+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231000 2024-09-13T23:56:59.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.558+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29cb40 con 0x56033d231000 2024-09-13T23:56:59.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.558+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d2ea000 2024-09-13T23:56:59.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.558+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29cb40 con 0x56033d2ea000 2024-09-13T23:56:59.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.558+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231400 2024-09-13T23:56:59.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.558+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29d200 con 0x56033d231400 2024-09-13T23:56:59.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.558+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231c00 2024-09-13T23:56:59.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.558+0000 7f1e141cc700 1 -- 172.21.15.173:0/3921408400 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29d440 con 0x56033d231c00 2024-09-13T23:56:59.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.558+0000 7f1e141cc700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231000 2024-09-13T23:56:59.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.562+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29cb40 con 0x56033d231000 2024-09-13T23:56:59.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.562+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231400 2024-09-13T23:56:59.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.562+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29d200 con 0x56033d231400 2024-09-13T23:56:59.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.562+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231c00 2024-09-13T23:56:59.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.562+0000 7f1e141cc700 1 -- 172.21.15.173:0/3921408400 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29d440 con 0x56033d231c00 2024-09-13T23:56:59.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.562+0000 7f1e141cc700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231000 2024-09-13T23:56:59.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.562+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29cb40 con 0x56033d231000 2024-09-13T23:56:59.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.562+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231000 2024-09-13T23:56:59.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.562+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29cb40 con 0x56033d231000 2024-09-13T23:56:59.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.562+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231000 2024-09-13T23:56:59.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.562+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29cb40 con 0x56033d231000 2024-09-13T23:56:59.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.562+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231c00 2024-09-13T23:56:59.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.562+0000 7f1e141cc700 1 -- 172.21.15.173:0/3921408400 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29d440 con 0x56033d231c00 2024-09-13T23:56:59.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.562+0000 7f1e141cc700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d2ea000 2024-09-13T23:56:59.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.566+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29cb40 con 0x56033d2ea000 2024-09-13T23:56:59.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.566+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231000 2024-09-13T23:56:59.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.566+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29cb40 con 0x56033d231000 2024-09-13T23:56:59.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.566+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d2ea000 2024-09-13T23:56:59.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.566+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29cb40 con 0x56033d2ea000 2024-09-13T23:56:59.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.566+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231c00 2024-09-13T23:56:59.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.566+0000 7f1e141cc700 1 -- 172.21.15.173:0/3921408400 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29d440 con 0x56033d231c00 2024-09-13T23:56:59.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.566+0000 7f1e141cc700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d2ea000 2024-09-13T23:56:59.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.566+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29cb40 con 0x56033d2ea000 2024-09-13T23:56:59.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.566+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231400 2024-09-13T23:56:59.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.566+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29d200 con 0x56033d231400 2024-09-13T23:56:59.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.566+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231400 2024-09-13T23:56:59.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.570+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29d200 con 0x56033d231400 2024-09-13T23:56:59.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.570+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231c00 2024-09-13T23:56:59.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.570+0000 7f1e141cc700 1 -- 172.21.15.173:0/3921408400 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29d440 con 0x56033d231c00 2024-09-13T23:56:59.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.570+0000 7f1e141cc700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231400 2024-09-13T23:56:59.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.570+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x56033d29d200 con 0x56033d231400 2024-09-13T23:56:59.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.570+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d231400 2024-09-13T23:56:59.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.570+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56033d29d200 con 0x56033d231400 2024-09-13T23:56:59.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.570+0000 7f1e16214f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:56:59.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.570+0000 7f1e16214f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:56:59.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.570+0000 7f1e16214f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:56:59.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.570+0000 7f1e16214f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:56:59.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.570+0000 7f1e16214f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.570+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d2ea800 con 0x56033d231000 2024-09-13T23:56:59.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.570+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56033d29cb40 con 0x56033d231000 2024-09-13T23:56:59.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.570+0000 7f1e16214f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.570+0000 7f1e16214f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.570+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d2eac00 con 0x56033d231400 2024-09-13T23:56:59.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.570+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x56033d29d200 con 0x56033d231400 2024-09-13T23:56:59.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.570+0000 7f1e16214f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:59.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.570+0000 7f1e16214f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.570+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d2eb000 con 0x56033d231000 2024-09-13T23:56:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.574+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x56033d29cb40 con 0x56033d231000 2024-09-13T23:56:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.574+0000 7f1e16214f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:56:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.574+0000 7f1e16214f40 20 zone default found 2024-09-13T23:56:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.574+0000 7f1e16214f40 4 Realm: () 2024-09-13T23:56:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.574+0000 7f1e16214f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:56:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.574+0000 7f1e16214f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:56:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.574+0000 7f1e16214f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:56:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.574+0000 7f1e16214f40 20 zonegroup default 2024-09-13T23:56:59.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.574+0000 7f1e16214f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.574+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d2eb400 con 0x56033d2ea000 2024-09-13T23:56:59.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.574+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x56033d29cb40 con 0x56033d2ea000 2024-09-13T23:56:59.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.574+0000 7f1e16214f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.574+0000 7f1e16214f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.574+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d2eb800 con 0x56033d231c00 2024-09-13T23:56:59.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.574+0000 7f1e141cc700 1 -- 172.21.15.173:0/3921408400 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x56033d29d440 con 0x56033d231c00 2024-09-13T23:56:59.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.574+0000 7f1e16214f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.574+0000 7f1e16214f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.574+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d2ebc00 con 0x56033d231c00 2024-09-13T23:56:59.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.574+0000 7f1e141cc700 1 -- 172.21.15.173:0/3921408400 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x56033d29d440 con 0x56033d231c00 2024-09-13T23:56:59.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.574+0000 7f1e16214f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.574+0000 7f1e16214f40 20 started sync module instance, tier type = 2024-09-13T23:56:59.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.574+0000 7f1e16214f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:56:59.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.574+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d1c2000 con 0x56033d231400 2024-09-13T23:56:59.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.578+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56033d29d200 con 0x56033d231400 2024-09-13T23:56:59.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.578+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94571909790464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d1c2400 con 0x56033d231400 2024-09-13T23:56:59.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.578+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d1c2800 con 0x56033d231000 2024-09-13T23:56:59.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.582+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94571909790464] v33'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56033d29d200 con 0x56033d231400 2024-09-13T23:56:59.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.582+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56033d29cb40 con 0x56033d231000 2024-09-13T23:56:59.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.582+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94571909791616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d1c2c00 con 0x56033d231000 2024-09-13T23:56:59.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.582+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d1c3000 con 0x56033d231400 2024-09-13T23:56:59.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.586+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94571909791616] v33'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56033d29cb40 con 0x56033d231000 2024-09-13T23:56:59.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.586+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56033d29d200 con 0x56033d231400 2024-09-13T23:56:59.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.586+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94571909792768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d1c3400 con 0x56033d231400 2024-09-13T23:56:59.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.586+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d1c3800 con 0x56033d2ea000 2024-09-13T23:56:59.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.586+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94571909792768] v33'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56033d29d200 con 0x56033d231400 2024-09-13T23:56:59.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.586+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56033d29cb40 con 0x56033d2ea000 2024-09-13T23:56:59.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.586+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94571909793920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d1c3c00 con 0x56033d2ea000 2024-09-13T23:56:59.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.586+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d1c2800 con 0x56033d231400 2024-09-13T23:56:59.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.590+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94571909793920] v33'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56033d29cb40 con 0x56033d2ea000 2024-09-13T23:56:59.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.590+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56033d29d200 con 0x56033d231400 2024-09-13T23:56:59.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.590+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94571909795072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d1c2000 con 0x56033d231400 2024-09-13T23:56:59.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.590+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d2ea800 con 0x56033d231c00 2024-09-13T23:56:59.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.590+0000 7f1e141cc700 1 -- 172.21.15.173:0/3921408400 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56033d29d440 con 0x56033d231c00 2024-09-13T23:56:59.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.590+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94571909796224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d2eb000 con 0x56033d231c00 2024-09-13T23:56:59.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.590+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d2eb400 con 0x56033d231c00 2024-09-13T23:56:59.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.590+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94571909795072] v33'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56033d29d200 con 0x56033d231400 2024-09-13T23:56:59.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.598+0000 7f1e141cc700 1 -- 172.21.15.173:0/3921408400 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v33'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56033d29d440 con 0x56033d231c00 2024-09-13T23:56:59.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.598+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94571909797376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d2eac00 con 0x56033d231c00 2024-09-13T23:56:59.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.598+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d231800 con 0x56033d2ea000 2024-09-13T23:56:59.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.598+0000 7f1e141cc700 1 -- 172.21.15.173:0/3921408400 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94571909796224] v33'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56033d29d440 con 0x56033d231c00 2024-09-13T23:56:59.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.598+0000 7f1e141cc700 1 -- 172.21.15.173:0/3921408400 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94571909797376] v33'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56033d29d440 con 0x56033d231c00 2024-09-13T23:56:59.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.598+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56033d29cb40 con 0x56033d2ea000 2024-09-13T23:56:59.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.598+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94571909798528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d1c2400 con 0x56033d2ea000 2024-09-13T23:56:59.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.598+0000 7f1e16214f40 20 add_watcher() i=0 2024-09-13T23:56:59.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.598+0000 7f1e16214f40 20 add_watcher() i=1 2024-09-13T23:56:59.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.598+0000 7f1e16214f40 20 add_watcher() i=2 2024-09-13T23:56:59.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.598+0000 7f1e16214f40 20 add_watcher() i=3 2024-09-13T23:56:59.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.598+0000 7f1e16214f40 20 add_watcher() i=4 2024-09-13T23:56:59.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.598+0000 7f1e16214f40 20 add_watcher() i=5 2024-09-13T23:56:59.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.598+0000 7f1e16214f40 20 add_watcher() i=6 2024-09-13T23:56:59.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.602+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94571909798528] v33'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56033d29cb40 con 0x56033d2ea000 2024-09-13T23:56:59.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.602+0000 7f1e16214f40 20 add_watcher() i=7 2024-09-13T23:56:59.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.602+0000 7f1e16214f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:56:59.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.602+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d1c3000 con 0x56033d231000 2024-09-13T23:56:59.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.602+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x56033d29cb40 con 0x56033d231000 2024-09-13T23:56:59.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.602+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94571911430144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d1c3400 con 0x56033d231000 2024-09-13T23:56:59.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.606+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94571911430144] v33'58 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x56033d29cb40 con 0x56033d231000 2024-09-13T23:56:59.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.606+0000 7f1dfb99b700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:59.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.606+0000 7f1e16214f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:56:59.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.606+0000 7f1e16214f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:56:59.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.606+0000 7f1e16214f40 1 Processor -- start 2024-09-13T23:56:59.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.606+0000 7f1e16214f40 1 -- start start 2024-09-13T23:56:59.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.606+0000 7f1e16214f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033d2ea400 0x56033d177180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.606+0000 7f1e16214f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56033ceb4780 con 0x56033d2ea400 2024-09-13T23:56:59.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.606+0000 7f1e141cc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033d2ea400 0x56033d177180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.606+0000 7f1e141cc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033d2ea400 0x56033d177180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58604/0 (socket says 172.21.15.173:58604) 2024-09-13T23:56:59.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.606+0000 7f1e141cc700 1 -- 172.21.15.173:0/1112156971 learned_addr learned my addr 172.21.15.173:0/1112156971 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.606+0000 7f1e141cc700 1 -- 172.21.15.173:0/1112156971 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56033cea0b60 con 0x56033d2ea400 2024-09-13T23:56:59.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.606+0000 7f1e141cc700 1 --2- 172.21.15.173:0/1112156971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033d2ea400 0x56033d177180 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x56033d3060f0 tx=0x56033cf93980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355acfa66482f3a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.606+0000 7f1dfb19a700 1 -- 172.21.15.173:0/1112156971 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56033cf33760 con 0x56033d2ea400 2024-09-13T23:56:59.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.606+0000 7f1dfb19a700 1 -- 172.21.15.173:0/1112156971 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56033d236600 con 0x56033d2ea400 2024-09-13T23:56:59.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.606+0000 7f1dfb19a700 1 -- 172.21.15.173:0/1112156971 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56033d30e000 con 0x56033d2ea400 2024-09-13T23:56:59.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.610+0000 7f1e16214f40 1 -- 172.21.15.173:0/1112156971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033d2ea400 msgr2=0x56033d177180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.610+0000 7f1e16214f40 1 --2- 172.21.15.173:0/1112156971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033d2ea400 0x56033d177180 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x56033d3060f0 tx=0x56033cf93980 comp rx=0 tx=0).stop 2024-09-13T23:56:59.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.610+0000 7f1e16214f40 1 -- 172.21.15.173:0/1112156971 shutdown_connections 2024-09-13T23:56:59.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.610+0000 7f1e16214f40 1 --2- 172.21.15.173:0/1112156971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033d2ea400 0x56033d177180 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.610+0000 7f1e16214f40 1 -- 172.21.15.173:0/1112156971 >> 172.21.15.173:0/1112156971 conn(0x56033d1c2800 msgr2=0x56033cf90000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.610+0000 7f1e16214f40 1 -- 172.21.15.173:0/1112156971 shutdown_connections 2024-09-13T23:56:59.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.610+0000 7f1e16214f40 1 -- 172.21.15.173:0/1112156971 wait complete. 2024-09-13T23:56:59.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.610+0000 7f1e16214f40 1 Processor -- start 2024-09-13T23:56:59.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.610+0000 7f1e16214f40 1 -- start start 2024-09-13T23:56:59.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.610+0000 7f1e16214f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033d2ea400 0x56033d177180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.610+0000 7f1e16214f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56033cf1c000 con 0x56033d2ea400 2024-09-13T23:56:59.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.610+0000 7f1e141cc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033d2ea400 0x56033d177180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.610+0000 7f1e141cc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033d2ea400 0x56033d177180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58618/0 (socket says 172.21.15.173:58618) 2024-09-13T23:56:59.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.610+0000 7f1e141cc700 1 -- 172.21.15.173:0/3168802742 learned_addr learned my addr 172.21.15.173:0/3168802742 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.610+0000 7f1e141cc700 1 -- 172.21.15.173:0/3168802742 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56033cea0d00 con 0x56033d2ea400 2024-09-13T23:56:59.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.610+0000 7f1e141cc700 1 --2- 172.21.15.173:0/3168802742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033d2ea400 0x56033d177180 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x56033d306390 tx=0x56033d1f1c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.610+0000 7f1df9997700 1 -- 172.21.15.173:0/3168802742 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56033d30e160 con 0x56033d2ea400 2024-09-13T23:56:59.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.610+0000 7f1df9997700 1 -- 172.21.15.173:0/3168802742 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56033d236300 con 0x56033d2ea400 2024-09-13T23:56:59.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.610+0000 7f1e16214f40 1 -- 172.21.15.173:0/3168802742 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56033cea0340 con 0x56033d2ea400 2024-09-13T23:56:59.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.610+0000 7f1df9997700 1 -- 172.21.15.173:0/3168802742 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56033d30e2c0 con 0x56033d2ea400 2024-09-13T23:56:59.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.610+0000 7f1e16214f40 1 -- 172.21.15.173:0/3168802742 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56033cea1d40 con 0x56033d2ea400 2024-09-13T23:56:59.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.614+0000 7f1df9997700 1 -- 172.21.15.173:0/3168802742 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x56033cf89b80 con 0x56033d2ea400 2024-09-13T23:56:59.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.614+0000 7f1df9997700 1 --2- 172.21.15.173:0/3168802742 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56033d231800 0x56033d386000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.614+0000 7f1df9997700 1 -- 172.21.15.173:0/3168802742 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x56033cef5500 con 0x56033d2ea400 2024-09-13T23:56:59.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.614+0000 7f1e16214f40 5 note: GC not initialized 2024-09-13T23:56:59.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.614+0000 7f1e151ce700 1 --2- 172.21.15.173:0/3168802742 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56033d231800 0x56033d386000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.614+0000 7f1e151ce700 1 --2- 172.21.15.173:0/3168802742 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56033d231800 0x56033d386000 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x56033d29b7d0 tx=0x56033d34cae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.614+0000 7f1df7192700 20 reqs_thread_entry: start 2024-09-13T23:56:59.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.614+0000 7f1e16214f40 20 init_complete bucket index max shards: 11 2024-09-13T23:56:59.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.614+0000 7f1e16214f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:56:59.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.614+0000 7f1df518e700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:29 2024 2024-09-13T23:56:59.626 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:56:59.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.618+0000 7f1df496c700 20 reqs_thread_entry: start 2024-09-13T23:56:59.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.618+0000 7f1e16214f40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.618+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d2ea800 con 0x56033d231000 2024-09-13T23:56:59.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.618+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x56033d29cb40 con 0x56033d231000 2024-09-13T23:56:59.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.618+0000 7f1e16214f40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:56:59.628 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:56:59.628 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "foo", 2024-09-13T23:56:59.628 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Foo", 2024-09-13T23:56:59.628 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "foo@foo.com", 2024-09-13T23:56:59.628 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 1, 2024-09-13T23:56:59.628 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:56:59.628 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [], 2024-09-13T23:56:59.629 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:56:59.629 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:56:59.629 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:56:59.629 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-09-13T23:56:59.629 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-09-13T23:56:59.629 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:56:59.630 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:56:59.630 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [], 2024-09-13T23:56:59.630 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:56:59.630 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:56:59.630 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:56:59.630 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:56:59.630 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:56:59.631 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:56:59.631 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:56:59.631 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:56:59.631 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:56:59.631 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:56:59.631 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:56:59.631 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:56:59.632 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:56:59.632 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:56:59.632 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:56:59.632 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:56:59.632 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:56:59.632 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:56:59.632 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:56:59.633 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:56:59.633 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:56:59.633 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:56:59.633 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:56:59.633 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:56:59.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.618+0000 7f1dfb99b700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:59.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.618+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94571911430144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d1c2c00 con 0x56033d231000 2024-09-13T23:56:59.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.622+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94571911430144] v33'59 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x56033d29cb40 con 0x56033d231000 2024-09-13T23:56:59.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.622+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94571909790464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d1c3800 con 0x56033d231400 2024-09-13T23:56:59.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.626+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94571909790464] v33'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56033d29d200 con 0x56033d231400 2024-09-13T23:56:59.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.626+0000 7f1e16214f40 20 remove_watcher() i=0 2024-09-13T23:56:59.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.626+0000 7f1e16214f40 2 removed watcher, disabling cache 2024-09-13T23:56:59.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.626+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94571909791616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d1c3c00 con 0x56033d231000 2024-09-13T23:56:59.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.626+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94571909791616] v33'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56033d29cb40 con 0x56033d231000 2024-09-13T23:56:59.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.626+0000 7f1e16214f40 20 remove_watcher() i=1 2024-09-13T23:56:59.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.626+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94571909792768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d1c2400 con 0x56033d231400 2024-09-13T23:56:59.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.630+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94571909792768] v33'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56033d29d200 con 0x56033d231400 2024-09-13T23:56:59.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.630+0000 7f1e16214f40 20 remove_watcher() i=2 2024-09-13T23:56:59.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.630+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94571909793920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d256000 con 0x56033d2ea000 2024-09-13T23:56:59.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.630+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94571909793920] v33'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56033d29cb40 con 0x56033d2ea000 2024-09-13T23:56:59.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.630+0000 7f1e16214f40 20 remove_watcher() i=3 2024-09-13T23:56:59.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.630+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94571909795072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d256400 con 0x56033d231400 2024-09-13T23:56:59.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.634+0000 7f1e149cd700 1 -- 172.21.15.173:0/3921408400 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94571909795072] v33'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56033d29d200 con 0x56033d231400 2024-09-13T23:56:59.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.634+0000 7f1e16214f40 20 remove_watcher() i=4 2024-09-13T23:56:59.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.634+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94571909796224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d256800 con 0x56033d231c00 2024-09-13T23:56:59.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.638+0000 7f1e141cc700 1 -- 172.21.15.173:0/3921408400 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94571909796224] v33'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56033d29d440 con 0x56033d231c00 2024-09-13T23:56:59.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.638+0000 7f1e16214f40 20 remove_watcher() i=5 2024-09-13T23:56:59.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.638+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94571909797376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d256c00 con 0x56033d231c00 2024-09-13T23:56:59.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.638+0000 7f1e141cc700 1 -- 172.21.15.173:0/3921408400 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94571909797376] v33'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56033d29d440 con 0x56033d231c00 2024-09-13T23:56:59.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.638+0000 7f1e16214f40 20 remove_watcher() i=6 2024-09-13T23:56:59.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.638+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94571909798528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56033d257000 con 0x56033d2ea000 2024-09-13T23:56:59.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e151ce700 1 -- 172.21.15.173:0/3921408400 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94571909798528] v33'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56033d29cb40 con 0x56033d2ea000 2024-09-13T23:56:59.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 20 remove_watcher() i=7 2024-09-13T23:56:59.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56033d231400 msgr2=0x56033d176100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 --2- 172.21.15.173:0/3921408400 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56033d231400 0x56033d176100 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56033d231000 msgr2=0x56033d175b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 --2- 172.21.15.173:0/3921408400 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56033d231000 0x56033d175b80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56033d2ea000 msgr2=0x56033d176c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 --2- 172.21.15.173:0/3921408400 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56033d2ea000 0x56033d176c00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56033d231c00 msgr2=0x56033d176680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 --2- 172.21.15.173:0/3921408400 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56033d231c00 0x56033d176680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56033d230c00 msgr2=0x56033d175600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 --2- 172.21.15.173:0/3921408400 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56033d230c00 0x56033d175600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x56033d16f920 tx=0x56033cf93800 comp rx=0 tx=0).stop 2024-09-13T23:56:59.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f800 msgr2=0x56033d174b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e141cc700 1 -- 172.21.15.173:0/3921408400 reap_dead start 2024-09-13T23:56:59.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 --2- 172.21.15.173:0/3921408400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f800 0x56033d174b00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x56033dd06150 tx=0x56033d1f0840 comp rx=0 tx=0).stop 2024-09-13T23:56:59.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 shutdown_connections 2024-09-13T23:56:59.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 --2- 172.21.15.173:0/3921408400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f800 0x56033d174b00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 >> 172.21.15.173:0/3921408400 conn(0x56033ce8f400 msgr2=0x56033cf8f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 shutdown_connections 2024-09-13T23:56:59.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 -- 172.21.15.173:0/3921408400 wait complete. 2024-09-13T23:56:59.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 -- 172.21.15.173:0/3168802742 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56033d231800 msgr2=0x56033d386000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 --2- 172.21.15.173:0/3168802742 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56033d231800 0x56033d386000 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x56033d29b7d0 tx=0x56033d34cae0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 -- 172.21.15.173:0/3168802742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033d2ea400 msgr2=0x56033d177180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 --2- 172.21.15.173:0/3168802742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033d2ea400 0x56033d177180 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x56033d306390 tx=0x56033d1f1c20 comp rx=0 tx=0).stop 2024-09-13T23:56:59.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 -- 172.21.15.173:0/3168802742 shutdown_connections 2024-09-13T23:56:59.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 --2- 172.21.15.173:0/3168802742 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56033d231800 0x56033d386000 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 --2- 172.21.15.173:0/3168802742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033d2ea400 0x56033d177180 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 -- 172.21.15.173:0/3168802742 >> 172.21.15.173:0/3168802742 conn(0x56033d1c2800 msgr2=0x56033cf90000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 -- 172.21.15.173:0/3168802742 shutdown_connections 2024-09-13T23:56:59.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 -- 172.21.15.173:0/3168802742 wait complete. 2024-09-13T23:56:59.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 -- 172.21.15.173:0/2190803190 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56033d230000 msgr2=0x56033d175080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 --2- 172.21.15.173:0/2190803190 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56033d230000 0x56033d175080 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x56033dd07620 tx=0x56033d1f0240 comp rx=0 tx=0).stop 2024-09-13T23:56:59.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 -- 172.21.15.173:0/2190803190 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f000 msgr2=0x56033d174580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 --2- 172.21.15.173:0/2190803190 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f000 0x56033d174580 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x56033cfebfb0 tx=0x56033cf93a40 comp rx=0 tx=0).stop 2024-09-13T23:56:59.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 -- 172.21.15.173:0/2190803190 shutdown_connections 2024-09-13T23:56:59.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 --2- 172.21.15.173:0/2190803190 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56033d230000 0x56033d175080 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 --2- 172.21.15.173:0/2190803190 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56033ce8f000 0x56033d174580 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 -- 172.21.15.173:0/2190803190 >> 172.21.15.173:0/2190803190 conn(0x56033ce8ec00 msgr2=0x56033cf8f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 -- 172.21.15.173:0/2190803190 shutdown_connections 2024-09-13T23:56:59.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.642+0000 7f1e16214f40 1 -- 172.21.15.173:0/2190803190 wait complete. 2024-09-13T23:56:59.653 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:56:59.653 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-13T23:56:59.653 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-13T23:56:59.654 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-13T23:56:59.692 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:56:59.692 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:56:59.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.686+0000 7f384e1ebf40 1 Processor -- start 2024-09-13T23:56:59.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.686+0000 7f384e1ebf40 1 -- start start 2024-09-13T23:56:59.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.686+0000 7f384e1ebf40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55da80ae5000 0x55da80dca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.686+0000 7f384e1ebf40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55da80ba9500 con 0x55da80ae5400 2024-09-13T23:56:59.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.686+0000 7f384e1ebf40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55da80b72a00 con 0x55da80ae5000 2024-09-13T23:56:59.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.686+0000 7f384c9a4700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55da80ae5000 0x55da80dca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.686+0000 7f384c1a3700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55da80ae5400 0x55da80be4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:57880/0 (socket says 172.21.15.173:57880) 2024-09-13T23:56:59.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.690+0000 7f384c1a3700 1 -- 172.21.15.173:0/2341409656 learned_addr learned my addr 172.21.15.173:0/2341409656 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:56:59.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.690+0000 7f384c9a4700 1 -- 172.21.15.173:0/2341409656 >> v1:172.21.15.87:6789/0 conn(0x55da80ae5400 legacy=0x55da80be4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.690+0000 7f384b9a2700 1 -- 172.21.15.173:0/2341409656 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006666798 0 0) 0x55da80c40000 con 0x55da80ae5400 2024-09-13T23:56:59.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.690+0000 7f384c9a4700 1 -- 172.21.15.173:0/2341409656 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da80af7d40 con 0x55da80ae5000 2024-09-13T23:56:59.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.690+0000 7f384c9a4700 1 --2- 172.21.15.173:0/2341409656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5000 0x55da80dca580 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55da80dc5a70 tx=0x55da80be9920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb9a86d0cdabbfa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.690+0000 7f384b9a2700 1 -- 172.21.15.173:0/2341409656 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55da80b894a0 con 0x55da80ae5000 2024-09-13T23:56:59.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.690+0000 7f384b9a2700 1 -- 172.21.15.173:0/2341409656 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55da80ba9800 con 0x55da80ae5000 2024-09-13T23:56:59.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.690+0000 7f384b9a2700 1 -- 172.21.15.173:0/2341409656 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55da80b89600 con 0x55da80ae5000 2024-09-13T23:56:59.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.690+0000 7f384e1ebf40 1 -- 172.21.15.173:0/2341409656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5000 msgr2=0x55da80dca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.690+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/2341409656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5000 0x55da80dca580 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55da80dc5a70 tx=0x55da80be9920 comp rx=0 tx=0).stop 2024-09-13T23:56:59.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.690+0000 7f384e1ebf40 1 -- 172.21.15.173:0/2341409656 shutdown_connections 2024-09-13T23:56:59.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.690+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/2341409656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5000 0x55da80dca580 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.690+0000 7f384e1ebf40 1 -- 172.21.15.173:0/2341409656 >> 172.21.15.173:0/2341409656 conn(0x55da80ae4c00 msgr2=0x55da80be4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.690+0000 7f384e1ebf40 1 -- 172.21.15.173:0/2341409656 shutdown_connections 2024-09-13T23:56:59.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.690+0000 7f384e1ebf40 1 -- 172.21.15.173:0/2341409656 wait complete. 2024-09-13T23:56:59.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.690+0000 7f384e1ebf40 1 Processor -- start 2024-09-13T23:56:59.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.690+0000 7f384e1ebf40 1 -- start start 2024-09-13T23:56:59.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.690+0000 7f384e1ebf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5000 0x55da80dca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.690+0000 7f384e1ebf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da80b72500 con 0x55da80ae5000 2024-09-13T23:56:59.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.690+0000 7f384c9a4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5000 0x55da80dca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.690+0000 7f384c9a4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5000 0x55da80dca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58640/0 (socket says 172.21.15.173:58640) 2024-09-13T23:56:59.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.690+0000 7f384c9a4700 1 -- 172.21.15.173:0/4249462080 learned_addr learned my addr 172.21.15.173:0/4249462080 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384c9a4700 1 -- 172.21.15.173:0/4249462080 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da80af7ba0 con 0x55da80ae5000 2024-09-13T23:56:59.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384c9a4700 1 --2- 172.21.15.173:0/4249462080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5000 0x55da80dca580 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x55da818afe00 tx=0x55da80be9800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3daa475c75bdb8ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384b1a1700 1 -- 172.21.15.173:0/4249462080 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55da80b89760 con 0x55da80ae5000 2024-09-13T23:56:59.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384b1a1700 1 -- 172.21.15.173:0/4249462080 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55da80ba9b00 con 0x55da80ae5000 2024-09-13T23:56:59.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384b1a1700 1 -- 172.21.15.173:0/4249462080 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55da80b894a0 con 0x55da80ae5000 2024-09-13T23:56:59.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384e1ebf40 1 -- 172.21.15.173:0/4249462080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5000 msgr2=0x55da80dca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/4249462080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5000 0x55da80dca580 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x55da818afe00 tx=0x55da80be9800 comp rx=0 tx=0).stop 2024-09-13T23:56:59.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384e1ebf40 1 -- 172.21.15.173:0/4249462080 shutdown_connections 2024-09-13T23:56:59.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/4249462080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5000 0x55da80dca580 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384e1ebf40 1 -- 172.21.15.173:0/4249462080 >> 172.21.15.173:0/4249462080 conn(0x55da80ae4c00 msgr2=0x55da80be5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384e1ebf40 1 -- 172.21.15.173:0/4249462080 shutdown_connections 2024-09-13T23:56:59.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384e1ebf40 1 -- 172.21.15.173:0/4249462080 wait complete. 2024-09-13T23:56:59.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384e1ebf40 1 Processor -- start 2024-09-13T23:56:59.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384e1ebf40 1 -- start start 2024-09-13T23:56:59.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384e1ebf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5000 0x55da80dca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384e1ebf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da80b723c0 con 0x55da80ae5000 2024-09-13T23:56:59.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384c9a4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5000 0x55da80dca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384c9a4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5000 0x55da80dca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58654/0 (socket says 172.21.15.173:58654) 2024-09-13T23:56:59.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384c9a4700 1 -- 172.21.15.173:0/257697549 learned_addr learned my addr 172.21.15.173:0/257697549 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384c9a4700 1 -- 172.21.15.173:0/257697549 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da80af7a00 con 0x55da80ae5000 2024-09-13T23:56:59.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384c9a4700 1 --2- 172.21.15.173:0/257697549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5000 0x55da80dca580 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55da818afef0 tx=0x55da80be9920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384999e700 1 -- 172.21.15.173:0/257697549 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55da80b89600 con 0x55da80ae5000 2024-09-13T23:56:59.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384e1ebf40 1 -- 172.21.15.173:0/257697549 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55da80af7860 con 0x55da80ae5000 2024-09-13T23:56:59.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384999e700 1 -- 172.21.15.173:0/257697549 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55da80ba9c80 con 0x55da80ae5000 2024-09-13T23:56:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.694+0000 7f384999e700 1 -- 172.21.15.173:0/257697549 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55da80b898c0 con 0x55da80ae5000 2024-09-13T23:56:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.698+0000 7f384e1ebf40 1 -- 172.21.15.173:0/257697549 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55da80af76c0 con 0x55da80ae5000 2024-09-13T23:56:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.698+0000 7f384e1ebf40 1 Processor -- start 2024-09-13T23:56:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.698+0000 7f384e1ebf40 1 -- start start 2024-09-13T23:56:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.698+0000 7f384e1ebf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5800 0x55da80dcab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.698+0000 7f384e1ebf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da80b0a640 con 0x55da80ae5800 2024-09-13T23:56:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.698+0000 7f384999e700 1 -- 172.21.15.173:0/257697549 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55da80bdeb00 con 0x55da80ae5000 2024-09-13T23:56:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.698+0000 7f384d1a5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5800 0x55da80dcab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.698+0000 7f384d1a5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5800 0x55da80dcab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58668/0 (socket says 172.21.15.173:58668) 2024-09-13T23:56:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.698+0000 7f384999e700 1 --2- 172.21.15.173:0/257697549 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55da80e7e000 0x55da80dcb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.698+0000 7f384d1a5700 1 -- 172.21.15.173:0/2583600289 learned_addr learned my addr 172.21.15.173:0/2583600289 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.698+0000 7f384999e700 1 -- 172.21.15.173:0/257697549 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55da80b4b180 con 0x55da80ae5000 2024-09-13T23:56:59.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.698+0000 7f384c9a4700 1 --2- 172.21.15.173:0/257697549 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55da80e7e000 0x55da80dcb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.698+0000 7f384d1a5700 1 -- 172.21.15.173:0/2583600289 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da80af6000 con 0x55da80ae5800 2024-09-13T23:56:59.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.698+0000 7f384d1a5700 1 --2- 172.21.15.173:0/2583600289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5800 0x55da80dcab00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55da80e60510 tx=0x55da80e40780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20036fc3032fbb81 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.698+0000 7f3847199700 1 -- 172.21.15.173:0/2583600289 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55da80b89600 con 0x55da80ae5800 2024-09-13T23:56:59.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.698+0000 7f3847199700 1 -- 172.21.15.173:0/2583600289 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55da80e82000 con 0x55da80ae5800 2024-09-13T23:56:59.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.698+0000 7f3847199700 1 -- 172.21.15.173:0/2583600289 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55da80b898c0 con 0x55da80ae5800 2024-09-13T23:56:59.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.698+0000 7f384c9a4700 1 --2- 172.21.15.173:0/257697549 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55da80e7e000 0x55da80dcb080 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55da81959560 tx=0x55da80e408a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.702+0000 7f384e1ebf40 1 -- 172.21.15.173:0/2583600289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5800 msgr2=0x55da80dcab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.702+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/2583600289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5800 0x55da80dcab00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55da80e60510 tx=0x55da80e40780 comp rx=0 tx=0).stop 2024-09-13T23:56:59.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.702+0000 7f384e1ebf40 1 -- 172.21.15.173:0/2583600289 shutdown_connections 2024-09-13T23:56:59.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.702+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/2583600289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5800 0x55da80dcab00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.702+0000 7f384e1ebf40 1 -- 172.21.15.173:0/2583600289 >> 172.21.15.173:0/2583600289 conn(0x55da80ae5400 msgr2=0x55da80be5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.702+0000 7f384e1ebf40 1 -- 172.21.15.173:0/2583600289 shutdown_connections 2024-09-13T23:56:59.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.702+0000 7f384e1ebf40 1 -- 172.21.15.173:0/2583600289 wait complete. 2024-09-13T23:56:59.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.702+0000 7f384e1ebf40 1 Processor -- start 2024-09-13T23:56:59.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.702+0000 7f384e1ebf40 1 -- start start 2024-09-13T23:56:59.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.702+0000 7f384e1ebf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5800 0x55da80dcab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.702+0000 7f384e1ebf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da80b0a8c0 con 0x55da80ae5800 2024-09-13T23:56:59.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.702+0000 7f384d1a5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5800 0x55da80dcab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.702+0000 7f384d1a5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5800 0x55da80dcab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58684/0 (socket says 172.21.15.173:58684) 2024-09-13T23:56:59.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.702+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 learned_addr learned my addr 172.21.15.173:0/1035683126 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.702+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da80af6ea0 con 0x55da80ae5800 2024-09-13T23:56:59.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.702+0000 7f384d1a5700 1 --2- 172.21.15.173:0/1035683126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5800 0x55da80dcab00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55da819584b0 tx=0x55da80e405a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.702+0000 7f3845996700 1 -- 172.21.15.173:0/1035683126 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55da80b89760 con 0x55da80ae5800 2024-09-13T23:56:59.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.702+0000 7f3845996700 1 -- 172.21.15.173:0/1035683126 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55da80e82180 con 0x55da80ae5800 2024-09-13T23:56:59.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.702+0000 7f3845996700 1 -- 172.21.15.173:0/1035683126 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55da80b89600 con 0x55da80ae5800 2024-09-13T23:56:59.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.702+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55da80af6820 con 0x55da80ae5800 2024-09-13T23:56:59.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.702+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55da80af69c0 con 0x55da80ae5800 2024-09-13T23:56:59.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.706+0000 7f3845996700 1 -- 172.21.15.173:0/1035683126 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55da80bdf080 con 0x55da80ae5800 2024-09-13T23:56:59.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.706+0000 7f3845996700 1 --2- 172.21.15.173:0/1035683126 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55da80e7ec00 0x55da80dcb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.706+0000 7f3845996700 1 -- 172.21.15.173:0/1035683126 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55da80b4b340 con 0x55da80ae5800 2024-09-13T23:56:59.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.706+0000 7f384c1a3700 1 --2- 172.21.15.173:0/1035683126 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55da80e7ec00 0x55da80dcb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.706+0000 7f384e1ebf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.706+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/1035683126 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55da80e7f000 0x55da80dcbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.706+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f400 con 0x55da80e7f000 2024-09-13T23:56:59.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.706+0000 7f384d1a5700 1 --2- 172.21.15.173:0/1035683126 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55da80e7f000 0x55da80dcbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.706+0000 7f384c1a3700 1 --2- 172.21.15.173:0/1035683126 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55da80e7ec00 0x55da80dcb600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55da818ae030 tx=0x55da80e41920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.706+0000 7f384d1a5700 1 --2- 172.21.15.173:0/1035683126 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55da80e7f000 0x55da80dcbb80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.706+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55da80f34b40 con 0x55da80e7f000 2024-09-13T23:56:59.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.706+0000 7f384e1ebf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.706+0000 7f384e1ebf40 20 realm 2024-09-13T23:56:59.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.706+0000 7f384e1ebf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.706+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7f000 2024-09-13T23:56:59.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.706+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55da80f34b40 con 0x55da80e7f000 2024-09-13T23:56:59.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.706+0000 7f384e1ebf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.706+0000 7f384e1ebf40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:56:59.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.706+0000 7f384e1ebf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.706+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7fc00 con 0x55da80e7f000 2024-09-13T23:56:59.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.710+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55da80f34b40 con 0x55da80e7f000 2024-09-13T23:56:59.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.710+0000 7f384e1ebf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.710+0000 7f384e1ebf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.710+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/1035683126 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55da80e7f400 0x55da80dcc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.710+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7f400 2024-09-13T23:56:59.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.710+0000 7f384c9a4700 1 --2- 172.21.15.173:0/1035683126 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55da80e7f400 0x55da80dcc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.710+0000 7f384c9a4700 1 --2- 172.21.15.173:0/1035683126 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55da80e7f400 0x55da80dcc100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.710+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55da80f35200 con 0x55da80e7f400 2024-09-13T23:56:59.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.710+0000 7f384e1ebf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:59.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.710+0000 7f384e1ebf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.710+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/1035683126 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55da80e7fc00 0x55da80dcc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.710+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f44000 con 0x55da80e7fc00 2024-09-13T23:56:59.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.710+0000 7f384c1a3700 1 --2- 172.21.15.173:0/1035683126 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55da80e7fc00 0x55da80dcc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.710+0000 7f384c1a3700 1 --2- 172.21.15.173:0/1035683126 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55da80e7fc00 0x55da80dcc680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.710+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55da80f35440 con 0x55da80e7fc00 2024-09-13T23:56:59.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.710+0000 7f384e1ebf40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:56:59.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.710+0000 7f384e1ebf40 20 searching for the correct realm 2024-09-13T23:56:59.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.710+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f44400 con 0x55da80e7fc00 2024-09-13T23:56:59.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.714+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55da80f35440 con 0x55da80e7fc00 2024-09-13T23:56:59.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.714+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f44000 con 0x55da80e7f400 2024-09-13T23:56:59.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.714+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f35200 con 0x55da80e7f400 2024-09-13T23:56:59.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.714+0000 7f384c9a4700 1 --2- 172.21.15.173:0/1035683126 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55da80f44000 0x55da80dccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.714+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80f44000 2024-09-13T23:56:59.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.714+0000 7f384d1a5700 1 --2- 172.21.15.173:0/1035683126 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55da80f44000 0x55da80dccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.714+0000 7f384d1a5700 1 --2- 172.21.15.173:0/1035683126 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55da80f44000 0x55da80dccc00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.714+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f34b40 con 0x55da80f44000 2024-09-13T23:56:59.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.714+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7f000 2024-09-13T23:56:59.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.714+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55da80f34b40 con 0x55da80e7f000 2024-09-13T23:56:59.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.714+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7f000 2024-09-13T23:56:59.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.714+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f34b40 con 0x55da80e7f000 2024-09-13T23:56:59.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.714+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7fc00 2024-09-13T23:56:59.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.714+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f35440 con 0x55da80e7fc00 2024-09-13T23:56:59.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.714+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7f000 2024-09-13T23:56:59.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.718+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f34b40 con 0x55da80e7f000 2024-09-13T23:56:59.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.718+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7f400 2024-09-13T23:56:59.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.718+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f35200 con 0x55da80e7f400 2024-09-13T23:56:59.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.718+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7f400 2024-09-13T23:56:59.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.718+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f35200 con 0x55da80e7f400 2024-09-13T23:56:59.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.718+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7f000 2024-09-13T23:56:59.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.718+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f34b40 con 0x55da80e7f000 2024-09-13T23:56:59.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.718+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80f44000 2024-09-13T23:56:59.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.718+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f34b40 con 0x55da80f44000 2024-09-13T23:56:59.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.718+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7f000 2024-09-13T23:56:59.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.718+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f34b40 con 0x55da80e7f000 2024-09-13T23:56:59.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.718+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80f44000 2024-09-13T23:56:59.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.718+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f34b40 con 0x55da80f44000 2024-09-13T23:56:59.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.718+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7f400 2024-09-13T23:56:59.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.722+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f35200 con 0x55da80e7f400 2024-09-13T23:56:59.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.722+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7fc00 2024-09-13T23:56:59.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.722+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f35440 con 0x55da80e7fc00 2024-09-13T23:56:59.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.722+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7f000 2024-09-13T23:56:59.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.722+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f34b40 con 0x55da80e7f000 2024-09-13T23:56:59.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.722+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7f400 2024-09-13T23:56:59.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.722+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f35200 con 0x55da80e7f400 2024-09-13T23:56:59.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.722+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7fc00 2024-09-13T23:56:59.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.722+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f35440 con 0x55da80e7fc00 2024-09-13T23:56:59.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.722+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7f000 2024-09-13T23:56:59.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.722+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f34b40 con 0x55da80e7f000 2024-09-13T23:56:59.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.722+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7f000 2024-09-13T23:56:59.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.722+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f34b40 con 0x55da80e7f000 2024-09-13T23:56:59.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.722+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7f000 2024-09-13T23:56:59.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.726+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f34b40 con 0x55da80e7f000 2024-09-13T23:56:59.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.726+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7fc00 2024-09-13T23:56:59.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.726+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f35440 con 0x55da80e7fc00 2024-09-13T23:56:59.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.726+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80f44000 2024-09-13T23:56:59.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.726+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f34b40 con 0x55da80f44000 2024-09-13T23:56:59.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.726+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7f000 2024-09-13T23:56:59.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.726+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f34b40 con 0x55da80e7f000 2024-09-13T23:56:59.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.726+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80f44000 2024-09-13T23:56:59.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.726+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f34b40 con 0x55da80f44000 2024-09-13T23:56:59.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.726+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7fc00 2024-09-13T23:56:59.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.726+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f35440 con 0x55da80e7fc00 2024-09-13T23:56:59.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.726+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80f44000 2024-09-13T23:56:59.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.726+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f34b40 con 0x55da80f44000 2024-09-13T23:56:59.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.726+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7f400 2024-09-13T23:56:59.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.730+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f35200 con 0x55da80e7f400 2024-09-13T23:56:59.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.730+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7f400 2024-09-13T23:56:59.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.730+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f35200 con 0x55da80e7f400 2024-09-13T23:56:59.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.730+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7fc00 2024-09-13T23:56:59.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.730+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f35440 con 0x55da80e7fc00 2024-09-13T23:56:59.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.730+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7f400 2024-09-13T23:56:59.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.730+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55da80f35200 con 0x55da80e7f400 2024-09-13T23:56:59.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.730+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80e7f400 2024-09-13T23:56:59.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.730+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55da80f35200 con 0x55da80e7f400 2024-09-13T23:56:59.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.730+0000 7f384e1ebf40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:56:59.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.730+0000 7f384e1ebf40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:56:59.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.730+0000 7f384e1ebf40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:56:59.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.730+0000 7f384e1ebf40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:56:59.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.730+0000 7f384e1ebf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.730+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f44800 con 0x55da80e7f000 2024-09-13T23:56:59.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55da80f34b40 con 0x55da80e7f000 2024-09-13T23:56:59.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384e1ebf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384e1ebf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f44c00 con 0x55da80e7f400 2024-09-13T23:56:59.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55da80f35200 con 0x55da80e7f400 2024-09-13T23:56:59.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384e1ebf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:59.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384e1ebf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f45000 con 0x55da80e7f000 2024-09-13T23:56:59.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55da80f34b40 con 0x55da80e7f000 2024-09-13T23:56:59.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384e1ebf40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:56:59.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384e1ebf40 20 zone default found 2024-09-13T23:56:59.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384e1ebf40 4 Realm: () 2024-09-13T23:56:59.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384e1ebf40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:56:59.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384e1ebf40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:56:59.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384e1ebf40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:56:59.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384e1ebf40 20 zonegroup default 2024-09-13T23:56:59.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384e1ebf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f45400 con 0x55da80f44000 2024-09-13T23:56:59.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55da80f34b40 con 0x55da80f44000 2024-09-13T23:56:59.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384e1ebf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384e1ebf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f45800 con 0x55da80e7fc00 2024-09-13T23:56:59.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55da80f35440 con 0x55da80e7fc00 2024-09-13T23:56:59.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384e1ebf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384e1ebf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.734+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f45c00 con 0x55da80e7fc00 2024-09-13T23:56:59.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.738+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55da80f35440 con 0x55da80e7fc00 2024-09-13T23:56:59.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.738+0000 7f384e1ebf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.738+0000 7f384e1ebf40 20 started sync module instance, tier type = 2024-09-13T23:56:59.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.738+0000 7f384e1ebf40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:56:59.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.738+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f46000 con 0x55da80e7f400 2024-09-13T23:56:59.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.738+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f35200 con 0x55da80e7f400 2024-09-13T23:56:59.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.738+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94396953139968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f46400 con 0x55da80e7f400 2024-09-13T23:56:59.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.738+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f46800 con 0x55da80e7f000 2024-09-13T23:56:59.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.742+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94396953139968] v33'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f35200 con 0x55da80e7f400 2024-09-13T23:56:59.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.742+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f34b40 con 0x55da80e7f000 2024-09-13T23:56:59.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.742+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94396953141120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f46c00 con 0x55da80e7f000 2024-09-13T23:56:59.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.742+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f47000 con 0x55da80e7f400 2024-09-13T23:56:59.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.746+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94396953141120] v33'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f34b40 con 0x55da80e7f000 2024-09-13T23:56:59.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.746+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f35200 con 0x55da80e7f400 2024-09-13T23:56:59.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.746+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94396953142272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f47400 con 0x55da80e7f400 2024-09-13T23:56:59.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.746+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f47800 con 0x55da80f44000 2024-09-13T23:56:59.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.746+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f34b40 con 0x55da80f44000 2024-09-13T23:56:59.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.750+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94396953143424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f47c00 con 0x55da80f44000 2024-09-13T23:56:59.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.750+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f46800 con 0x55da80e7f400 2024-09-13T23:56:59.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.750+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94396953142272] v33'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f35200 con 0x55da80e7f400 2024-09-13T23:56:59.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.750+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94396953143424] v33'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f34b40 con 0x55da80f44000 2024-09-13T23:56:59.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.750+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f35200 con 0x55da80e7f400 2024-09-13T23:56:59.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.750+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94396953144576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f46000 con 0x55da80e7f400 2024-09-13T23:56:59.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.750+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f44800 con 0x55da80e7fc00 2024-09-13T23:56:59.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.754+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94396953144576] v33'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f35200 con 0x55da80e7f400 2024-09-13T23:56:59.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.754+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f35440 con 0x55da80e7fc00 2024-09-13T23:56:59.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.754+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94396953145728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f45000 con 0x55da80e7fc00 2024-09-13T23:56:59.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.754+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f45400 con 0x55da80e7fc00 2024-09-13T23:56:59.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.754+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94396953145728] v33'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f35440 con 0x55da80e7fc00 2024-09-13T23:56:59.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.754+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f35440 con 0x55da80e7fc00 2024-09-13T23:56:59.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.754+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94396953146880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f44c00 con 0x55da80e7fc00 2024-09-13T23:56:59.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.754+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80e7f800 con 0x55da80f44000 2024-09-13T23:56:59.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.758+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f34b40 con 0x55da80f44000 2024-09-13T23:56:59.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.758+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94396953148032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f46400 con 0x55da80f44000 2024-09-13T23:56:59.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.758+0000 7f384e1ebf40 20 add_watcher() i=0 2024-09-13T23:56:59.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.758+0000 7f384e1ebf40 20 add_watcher() i=1 2024-09-13T23:56:59.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.758+0000 7f384e1ebf40 20 add_watcher() i=2 2024-09-13T23:56:59.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.758+0000 7f384e1ebf40 20 add_watcher() i=3 2024-09-13T23:56:59.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.758+0000 7f384e1ebf40 20 add_watcher() i=4 2024-09-13T23:56:59.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.758+0000 7f384e1ebf40 20 add_watcher() i=5 2024-09-13T23:56:59.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.758+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94396953146880] v33'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f35440 con 0x55da80e7fc00 2024-09-13T23:56:59.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.758+0000 7f384e1ebf40 20 add_watcher() i=6 2024-09-13T23:56:59.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.758+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94396953148032] v33'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f34b40 con 0x55da80f44000 2024-09-13T23:56:59.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.758+0000 7f384e1ebf40 20 add_watcher() i=7 2024-09-13T23:56:59.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.758+0000 7f384e1ebf40 2 all 8 watchers are set, enabling cache 2024-09-13T23:56:59.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.758+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f47000 con 0x55da80e7f000 2024-09-13T23:56:59.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.758+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55da80f34b40 con 0x55da80e7f000 2024-09-13T23:56:59.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.758+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94396954755072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f47400 con 0x55da80e7f000 2024-09-13T23:56:59.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.762+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94396954755072] v33'60 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55da80f34b40 con 0x55da80e7f000 2024-09-13T23:56:59.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.762+0000 7f3833972700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:59.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.762+0000 7f384e1ebf40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:56:59.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.762+0000 7f384e1ebf40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:56:59.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.762+0000 7f384e1ebf40 1 Processor -- start 2024-09-13T23:56:59.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.762+0000 7f384e1ebf40 1 -- start start 2024-09-13T23:56:59.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.762+0000 7f384e1ebf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80f44400 0x55da80dcd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.762+0000 7f384e1ebf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da80b723c0 con 0x55da80f44400 2024-09-13T23:56:59.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.762+0000 7f384c1a3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80f44400 0x55da80dcd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.762+0000 7f384c1a3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80f44400 0x55da80dcd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58690/0 (socket says 172.21.15.173:58690) 2024-09-13T23:56:59.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.762+0000 7f384c1a3700 1 -- 172.21.15.173:0/450076894 learned_addr learned my addr 172.21.15.173:0/450076894 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.766+0000 7f384c1a3700 1 -- 172.21.15.173:0/450076894 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da80af6b60 con 0x55da80f44400 2024-09-13T23:56:59.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.766+0000 7f384c1a3700 1 --2- 172.21.15.173:0/450076894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80f44400 0x55da80dcd180 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55da80f540c0 tx=0x55da80e418c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4927b9e87c0328 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.766+0000 7f3833171700 1 -- 172.21.15.173:0/450076894 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55da80f5c000 con 0x55da80f44400 2024-09-13T23:56:59.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.766+0000 7f3833171700 1 -- 172.21.15.173:0/450076894 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55da80e82600 con 0x55da80f44400 2024-09-13T23:56:59.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.766+0000 7f3833171700 1 -- 172.21.15.173:0/450076894 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55da80f5c160 con 0x55da80f44400 2024-09-13T23:56:59.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.766+0000 7f384e1ebf40 1 -- 172.21.15.173:0/450076894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80f44400 msgr2=0x55da80dcd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.766+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/450076894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80f44400 0x55da80dcd180 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55da80f540c0 tx=0x55da80e418c0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.766+0000 7f384e1ebf40 1 -- 172.21.15.173:0/450076894 shutdown_connections 2024-09-13T23:56:59.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.766+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/450076894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80f44400 0x55da80dcd180 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.766+0000 7f384e1ebf40 1 -- 172.21.15.173:0/450076894 >> 172.21.15.173:0/450076894 conn(0x55da80f46800 msgr2=0x55da80be6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.766+0000 7f384e1ebf40 1 -- 172.21.15.173:0/450076894 shutdown_connections 2024-09-13T23:56:59.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.766+0000 7f384e1ebf40 1 -- 172.21.15.173:0/450076894 wait complete. 2024-09-13T23:56:59.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.766+0000 7f384e1ebf40 1 Processor -- start 2024-09-13T23:56:59.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.766+0000 7f384e1ebf40 1 -- start start 2024-09-13T23:56:59.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.766+0000 7f384e1ebf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80f44400 0x55da80dcd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.766+0000 7f384e1ebf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da80b72500 con 0x55da80f44400 2024-09-13T23:56:59.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.766+0000 7f384c1a3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80f44400 0x55da80dcd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.766+0000 7f384c1a3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80f44400 0x55da80dcd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58706/0 (socket says 172.21.15.173:58706) 2024-09-13T23:56:59.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.766+0000 7f384c1a3700 1 -- 172.21.15.173:0/1509599236 learned_addr learned my addr 172.21.15.173:0/1509599236 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.766+0000 7f384c1a3700 1 -- 172.21.15.173:0/1509599236 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da80af6d00 con 0x55da80f44400 2024-09-13T23:56:59.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.770+0000 7f384c1a3700 1 --2- 172.21.15.173:0/1509599236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80f44400 0x55da80dcd180 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55da80f542d0 tx=0x55da80e41a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.770+0000 7f383196e700 1 -- 172.21.15.173:0/1509599236 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55da80f5c2c0 con 0x55da80f44400 2024-09-13T23:56:59.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.770+0000 7f383196e700 1 -- 172.21.15.173:0/1509599236 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55da80e82300 con 0x55da80f44400 2024-09-13T23:56:59.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.770+0000 7f383196e700 1 -- 172.21.15.173:0/1509599236 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55da80f5c000 con 0x55da80f44400 2024-09-13T23:56:59.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.770+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1509599236 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55da80af6340 con 0x55da80f44400 2024-09-13T23:56:59.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.770+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1509599236 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55da80af6b60 con 0x55da80f44400 2024-09-13T23:56:59.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.770+0000 7f383196e700 1 -- 172.21.15.173:0/1509599236 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55da80bdfb80 con 0x55da80f44400 2024-09-13T23:56:59.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.770+0000 7f383196e700 1 --2- 172.21.15.173:0/1509599236 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55da80e7f800 0x55da80fe0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.770+0000 7f383196e700 1 -- 172.21.15.173:0/1509599236 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55da80b4b500 con 0x55da80f44400 2024-09-13T23:56:59.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.770+0000 7f384e1ebf40 5 note: GC not initialized 2024-09-13T23:56:59.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.770+0000 7f384d1a5700 1 --2- 172.21.15.173:0/1509599236 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55da80e7f800 0x55da80fe0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.770+0000 7f384d1a5700 1 --2- 172.21.15.173:0/1509599236 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55da80e7f800 0x55da80fe0000 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55da80edd740 tx=0x55da80fa6660 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.774+0000 7f382f169700 20 reqs_thread_entry: start 2024-09-13T23:56:59.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.774+0000 7f384e1ebf40 20 init_complete bucket index max shards: 11 2024-09-13T23:56:59.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.774+0000 7f384e1ebf40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:56:59.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.774+0000 7f382d165700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:30 2024 2024-09-13T23:56:59.778 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:56:59.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.774+0000 7f384e1ebf40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:56:59.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.774+0000 7f384e1ebf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.774+0000 7f382c943700 20 reqs_thread_entry: start 2024-09-13T23:56:59.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.774+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f44800 con 0x55da80e7f000 2024-09-13T23:56:59.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.774+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55da80f34b40 con 0x55da80e7f000 2024-09-13T23:56:59.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.774+0000 7f384e1ebf40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:56:59.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.774+0000 7f384e1ebf40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:56:59.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.774+0000 7f384e1ebf40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:56:59.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.774+0000 7f384e1ebf40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:56:59.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.774+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f46c00 con 0x55da80f44000 2024-09-13T23:56:59.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.774+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x55da80f34b40 con 0x55da80f44000 2024-09-13T23:56:59.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.774+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f47c00 con 0x55da80e7f000 2024-09-13T23:56:59.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.778+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~357] v33'3 uv3 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x55da80f34b40 con 0x55da80e7f000 2024-09-13T23:56:59.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.778+0000 7f384e1ebf40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:56:59.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.778+0000 7f384e1ebf40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:56:59.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.778+0000 7f384e1ebf40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:56:59.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.778+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94396954757376 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f46400 con 0x55da80e7f400 2024-09-13T23:56:59.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.778+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== watch-notify(notify (1) cookie 94396953144576 notify 141733920770 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x55da80e3e680 con 0x55da80e7f400 2024-09-13T23:56:59.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.778+0000 7f3846998700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920770 cookie 94396953144576 notifier 4344 bl.length()=533 2024-09-13T23:56:59.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.778+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(65 notify.4 [notify cookie 94396954757376 out=8b] v0'0 uv39 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55da80f35200 con 0x55da80e7f400 2024-09-13T23:56:59.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.778+0000 7f3846998700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:56:59.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.778+0000 7f3846998700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:56:59.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.778+0000 7f3846998700 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f47000 con 0x55da80e7f400 2024-09-13T23:56:59.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.778+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f35200 con 0x55da80e7f400 2024-09-13T23:56:59.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.778+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== watch-notify(notify_complete (2) cookie 94396954757376 notify 141733920770 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55da80e3e820 con 0x55da80e7f400 2024-09-13T23:56:59.785 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:56:59.785 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "foo", 2024-09-13T23:56:59.785 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Foo", 2024-09-13T23:56:59.786 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "foo@foo.com", 2024-09-13T23:56:59.786 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:56:59.786 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:56:59.786 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [], 2024-09-13T23:56:59.786 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:56:59.786 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:56:59.786 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:56:59.786 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-09-13T23:56:59.786 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-09-13T23:56:59.786 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:56:59.786 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:56:59.786 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [], 2024-09-13T23:56:59.786 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:56:59.786 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:56:59.786 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:56:59.787 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:56:59.787 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:56:59.787 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:56:59.787 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:56:59.787 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:56:59.787 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:56:59.787 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:56:59.787 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:56:59.787 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:56:59.787 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:56:59.787 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:56:59.787 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:56:59.787 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:56:59.787 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:56:59.788 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:56:59.788 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:56:59.788 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:56:59.788 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:56:59.788 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:56:59.788 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:56:59.788 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:56:59.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.782+0000 7f3833972700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:59.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.782+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94396954755072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f47400 con 0x55da80e7f000 2024-09-13T23:56:59.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.782+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94396954755072] v33'61 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55da80f34b40 con 0x55da80e7f000 2024-09-13T23:56:59.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.782+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94396953139968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f46c00 con 0x55da80e7f400 2024-09-13T23:56:59.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.786+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94396953139968] v33'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f35200 con 0x55da80e7f400 2024-09-13T23:56:59.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.786+0000 7f384e1ebf40 20 remove_watcher() i=0 2024-09-13T23:56:59.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.786+0000 7f384e1ebf40 2 removed watcher, disabling cache 2024-09-13T23:56:59.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.786+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94396953141120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f47c00 con 0x55da80e7f000 2024-09-13T23:56:59.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.790+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94396953141120] v33'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f34b40 con 0x55da80e7f000 2024-09-13T23:56:59.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.790+0000 7f384e1ebf40 20 remove_watcher() i=1 2024-09-13T23:56:59.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.790+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94396953142272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f47800 con 0x55da80e7f400 2024-09-13T23:56:59.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.790+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94396953142272] v33'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f35200 con 0x55da80e7f400 2024-09-13T23:56:59.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.790+0000 7f384e1ebf40 20 remove_watcher() i=2 2024-09-13T23:56:59.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.790+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94396953143424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f46000 con 0x55da80f44000 2024-09-13T23:56:59.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.794+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94396953143424] v33'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f34b40 con 0x55da80f44000 2024-09-13T23:56:59.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.794+0000 7f384e1ebf40 20 remove_watcher() i=3 2024-09-13T23:56:59.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.794+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94396953144576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f46400 con 0x55da80e7f400 2024-09-13T23:56:59.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.794+0000 7f384c9a4700 1 -- 172.21.15.173:0/1035683126 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94396953144576] v33'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f35200 con 0x55da80e7f400 2024-09-13T23:56:59.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.794+0000 7f384e1ebf40 20 remove_watcher() i=4 2024-09-13T23:56:59.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.794+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94396953145728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f47000 con 0x55da80e7fc00 2024-09-13T23:56:59.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.798+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94396953145728] v33'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f35440 con 0x55da80e7fc00 2024-09-13T23:56:59.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.798+0000 7f384e1ebf40 20 remove_watcher() i=5 2024-09-13T23:56:59.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.798+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94396953146880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f46c00 con 0x55da80e7fc00 2024-09-13T23:56:59.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.802+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94396953146880] v33'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f35440 con 0x55da80e7fc00 2024-09-13T23:56:59.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.802+0000 7f384e1ebf40 20 remove_watcher() i=6 2024-09-13T23:56:59.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.802+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94396953148032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55da80f47800 con 0x55da80f44000 2024-09-13T23:56:59.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384d1a5700 1 -- 172.21.15.173:0/1035683126 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94396953148032] v33'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55da80f34b40 con 0x55da80f44000 2024-09-13T23:56:59.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 20 remove_watcher() i=7 2024-09-13T23:56:59.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55da80e7f400 msgr2=0x55da80dcc100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/1035683126 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55da80e7f400 0x55da80dcc100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55da80e7f000 msgr2=0x55da80dcbb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/1035683126 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55da80e7f000 0x55da80dcbb80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55da80f44000 msgr2=0x55da80dccc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/1035683126 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55da80f44000 0x55da80dccc00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55da80e7fc00 msgr2=0x55da80dcc680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/1035683126 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55da80e7fc00 0x55da80dcc680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55da80e7ec00 msgr2=0x55da80dcb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/1035683126 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55da80e7ec00 0x55da80dcb600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55da818ae030 tx=0x55da80e41920 comp rx=0 tx=0).stop 2024-09-13T23:56:59.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5800 msgr2=0x55da80dcab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/1035683126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5800 0x55da80dcab00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55da819584b0 tx=0x55da80e405a0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 reap_dead start 2024-09-13T23:56:59.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384c1a3700 1 -- 172.21.15.173:0/1035683126 reap_dead start 2024-09-13T23:56:59.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 shutdown_connections 2024-09-13T23:56:59.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 >> 172.21.15.173:0/1035683126 conn(0x55da80ae5400 msgr2=0x55da80be5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 shutdown_connections 2024-09-13T23:56:59.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1035683126 wait complete. 2024-09-13T23:56:59.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1509599236 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55da80e7f800 msgr2=0x55da80fe0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/1509599236 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55da80e7f800 0x55da80fe0000 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55da80edd740 tx=0x55da80fa6660 comp rx=0 tx=0).stop 2024-09-13T23:56:59.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1509599236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80f44400 msgr2=0x55da80dcd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/1509599236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80f44400 0x55da80dcd180 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55da80f542d0 tx=0x55da80e41a40 comp rx=0 tx=0).stop 2024-09-13T23:56:59.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1509599236 shutdown_connections 2024-09-13T23:56:59.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/1509599236 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55da80e7f800 0x55da80fe0000 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/1509599236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80f44400 0x55da80dcd180 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1509599236 >> 172.21.15.173:0/1509599236 conn(0x55da80f46800 msgr2=0x55da80be6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1509599236 shutdown_connections 2024-09-13T23:56:59.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 -- 172.21.15.173:0/1509599236 wait complete. 2024-09-13T23:56:59.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 -- 172.21.15.173:0/257697549 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55da80e7e000 msgr2=0x55da80dcb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/257697549 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55da80e7e000 0x55da80dcb080 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55da81959560 tx=0x55da80e408a0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 -- 172.21.15.173:0/257697549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5000 msgr2=0x55da80dca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/257697549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5000 0x55da80dca580 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55da818afef0 tx=0x55da80be9920 comp rx=0 tx=0).stop 2024-09-13T23:56:59.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 -- 172.21.15.173:0/257697549 shutdown_connections 2024-09-13T23:56:59.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/257697549 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55da80e7e000 0x55da80dcb080 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.806+0000 7f384e1ebf40 1 --2- 172.21.15.173:0/257697549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55da80ae5000 0x55da80dca580 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.810+0000 7f384e1ebf40 1 -- 172.21.15.173:0/257697549 >> 172.21.15.173:0/257697549 conn(0x55da80ae4c00 msgr2=0x55da80be5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.810+0000 7f384e1ebf40 1 -- 172.21.15.173:0/257697549 shutdown_connections 2024-09-13T23:56:59.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.810+0000 7f384e1ebf40 1 -- 172.21.15.173:0/257697549 wait complete. 2024-09-13T23:56:59.819 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:56:59.819 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:56:59.819 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:56:59.819 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:56:59.904 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:56:59.904 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:56:59.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.898+0000 7f2b5db4cf40 1 Processor -- start 2024-09-13T23:56:59.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.898+0000 7f2b5db4cf40 1 -- start start 2024-09-13T23:56:59.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5db4cf40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x5559c053d400 0x5559c0822580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5db4cf40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5559c0601500 con 0x5559c053d000 2024-09-13T23:56:59.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5db4cf40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x5559c05caa00 con 0x5559c053d400 2024-09-13T23:56:59.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5bb04700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x5559c053d400 0x5559c0822580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5c305700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x5559c053d000 0x5559c063c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:57894/0 (socket says 172.21.15.173:57894) 2024-09-13T23:56:59.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5c305700 1 -- 172.21.15.173:0/2229803796 learned_addr learned my addr 172.21.15.173:0/2229803796 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:56:59.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5b303700 1 -- 172.21.15.173:0/2229803796 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1605610459 0 0) 0x5559c0698000 con 0x5559c053d000 2024-09-13T23:56:59.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5b303700 1 -- 172.21.15.173:0/2229803796 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x5559c0601680 con 0x5559c053d000 2024-09-13T23:56:59.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5bb04700 1 -- 172.21.15.173:0/2229803796 >> v1:172.21.15.87:6789/0 conn(0x5559c053d000 legacy=0x5559c063c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5bb04700 1 -- 172.21.15.173:0/2229803796 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559c054fd40 con 0x5559c053d400 2024-09-13T23:56:59.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5bb04700 1 --2- 172.21.15.173:0/2229803796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d400 0x5559c0822580 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x5559c081d920 tx=0x5559c0641980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9be2dad625f0d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5b303700 1 -- 172.21.15.173:0/2229803796 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559c05e14a0 con 0x5559c053d400 2024-09-13T23:56:59.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5b303700 1 -- 172.21.15.173:0/2229803796 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5559c0601680 con 0x5559c053d400 2024-09-13T23:56:59.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5b303700 1 -- 172.21.15.173:0/2229803796 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559c05e1600 con 0x5559c053d400 2024-09-13T23:56:59.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/2229803796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d400 msgr2=0x5559c0822580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/2229803796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d400 0x5559c0822580 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x5559c081d920 tx=0x5559c0641980 comp rx=0 tx=0).stop 2024-09-13T23:56:59.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/2229803796 shutdown_connections 2024-09-13T23:56:59.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/2229803796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d400 0x5559c0822580 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/2229803796 >> 172.21.15.173:0/2229803796 conn(0x5559c053cc00 msgr2=0x5559c063c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/2229803796 shutdown_connections 2024-09-13T23:56:59.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/2229803796 wait complete. 2024-09-13T23:56:59.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5db4cf40 1 Processor -- start 2024-09-13T23:56:59.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5db4cf40 1 -- start start 2024-09-13T23:56:59.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5db4cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d000 0x5559c0822580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.902+0000 7f2b5db4cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c05ca500 con 0x5559c053d000 2024-09-13T23:56:59.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.906+0000 7f2b5c305700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d000 0x5559c0822580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.906+0000 7f2b5c305700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d000 0x5559c0822580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58716/0 (socket says 172.21.15.173:58716) 2024-09-13T23:56:59.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.906+0000 7f2b5c305700 1 -- 172.21.15.173:0/851755587 learned_addr learned my addr 172.21.15.173:0/851755587 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.906+0000 7f2b5c305700 1 -- 172.21.15.173:0/851755587 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559c054fba0 con 0x5559c053d000 2024-09-13T23:56:59.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.906+0000 7f2b5c305700 1 --2- 172.21.15.173:0/851755587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d000 0x5559c0822580 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x5559c1307d70 tx=0x5559c0641b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea281467320a5d18 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.906+0000 7f2b5ab02700 1 -- 172.21.15.173:0/851755587 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559c05e14a0 con 0x5559c053d000 2024-09-13T23:56:59.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.906+0000 7f2b5ab02700 1 -- 172.21.15.173:0/851755587 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5559c0601b00 con 0x5559c053d000 2024-09-13T23:56:59.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.906+0000 7f2b5ab02700 1 -- 172.21.15.173:0/851755587 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559c05e1600 con 0x5559c053d000 2024-09-13T23:56:59.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.906+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/851755587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d000 msgr2=0x5559c0822580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.906+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/851755587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d000 0x5559c0822580 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x5559c1307d70 tx=0x5559c0641b60 comp rx=0 tx=0).stop 2024-09-13T23:56:59.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.906+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/851755587 shutdown_connections 2024-09-13T23:56:59.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.906+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/851755587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d000 0x5559c0822580 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.906+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/851755587 >> 172.21.15.173:0/851755587 conn(0x5559c053cc00 msgr2=0x5559c063d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.906+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/851755587 shutdown_connections 2024-09-13T23:56:59.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.906+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/851755587 wait complete. 2024-09-13T23:56:59.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.906+0000 7f2b5db4cf40 1 Processor -- start 2024-09-13T23:56:59.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.906+0000 7f2b5db4cf40 1 -- start start 2024-09-13T23:56:59.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.906+0000 7f2b5db4cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d000 0x5559c0822580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.906+0000 7f2b5db4cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c05ca3c0 con 0x5559c053d000 2024-09-13T23:56:59.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.906+0000 7f2b5c305700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d000 0x5559c0822580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.906+0000 7f2b5c305700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d000 0x5559c0822580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58726/0 (socket says 172.21.15.173:58726) 2024-09-13T23:56:59.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.906+0000 7f2b5c305700 1 -- 172.21.15.173:0/3081415948 learned_addr learned my addr 172.21.15.173:0/3081415948 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.910+0000 7f2b5c305700 1 -- 172.21.15.173:0/3081415948 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559c054fa00 con 0x5559c053d000 2024-09-13T23:56:59.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.910+0000 7f2b5c305700 1 --2- 172.21.15.173:0/3081415948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d000 0x5559c0822580 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5559c1307e00 tx=0x5559c0641920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.910+0000 7f2b592ff700 1 -- 172.21.15.173:0/3081415948 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559c05e18c0 con 0x5559c053d000 2024-09-13T23:56:59.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.910+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3081415948 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5559c054f860 con 0x5559c053d000 2024-09-13T23:56:59.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.910+0000 7f2b592ff700 1 -- 172.21.15.173:0/3081415948 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5559c0601c80 con 0x5559c053d000 2024-09-13T23:56:59.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.910+0000 7f2b592ff700 1 -- 172.21.15.173:0/3081415948 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559c05e14a0 con 0x5559c053d000 2024-09-13T23:56:59.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.910+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3081415948 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5559c054f6c0 con 0x5559c053d000 2024-09-13T23:56:59.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.910+0000 7f2b5db4cf40 1 Processor -- start 2024-09-13T23:56:59.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.910+0000 7f2b5db4cf40 1 -- start start 2024-09-13T23:56:59.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.910+0000 7f2b5db4cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d800 0x5559c0822b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.910+0000 7f2b5db4cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c05ca000 con 0x5559c053d800 2024-09-13T23:56:59.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.910+0000 7f2b5cb06700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d800 0x5559c0822b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.910+0000 7f2b5cb06700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d800 0x5559c0822b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58732/0 (socket says 172.21.15.173:58732) 2024-09-13T23:56:59.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.910+0000 7f2b592ff700 1 -- 172.21.15.173:0/3081415948 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x5559c0636b00 con 0x5559c053d000 2024-09-13T23:56:59.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.910+0000 7f2b5cb06700 1 -- 172.21.15.173:0/1871261250 learned_addr learned my addr 172.21.15.173:0/1871261250 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.910+0000 7f2b5cb06700 1 -- 172.21.15.173:0/1871261250 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559c054e000 con 0x5559c053d800 2024-09-13T23:56:59.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.910+0000 7f2b592ff700 1 --2- 172.21.15.173:0/3081415948 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559c08e2000 0x5559c0823080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.910+0000 7f2b592ff700 1 -- 172.21.15.173:0/3081415948 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5559c05a3180 con 0x5559c053d000 2024-09-13T23:56:59.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.910+0000 7f2b5c305700 1 --2- 172.21.15.173:0/3081415948 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559c08e2000 0x5559c0823080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.910+0000 7f2b5cb06700 1 --2- 172.21.15.173:0/1871261250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d800 0x5559c0822b00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x5559c0865620 tx=0x5559c089e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6560f6cd6c543023 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.914+0000 7f2b56afa700 1 -- 172.21.15.173:0/1871261250 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559c05e18c0 con 0x5559c053d800 2024-09-13T23:56:59.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.914+0000 7f2b56afa700 1 -- 172.21.15.173:0/1871261250 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5559c088e000 con 0x5559c053d800 2024-09-13T23:56:59.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.914+0000 7f2b56afa700 1 -- 172.21.15.173:0/1871261250 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559c05e14a0 con 0x5559c053d800 2024-09-13T23:56:59.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.914+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/1871261250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d800 msgr2=0x5559c0822b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.914+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/1871261250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d800 0x5559c0822b00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x5559c0865620 tx=0x5559c089e6c0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.914+0000 7f2b5c305700 1 --2- 172.21.15.173:0/3081415948 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559c08e2000 0x5559c0823080 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x5559c0865560 tx=0x5559c089c240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.914+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/1871261250 shutdown_connections 2024-09-13T23:56:59.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.914+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/1871261250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d800 0x5559c0822b00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.914+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/1871261250 >> 172.21.15.173:0/1871261250 conn(0x5559c053d400 msgr2=0x5559c063d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.914+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/1871261250 shutdown_connections 2024-09-13T23:56:59.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.914+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/1871261250 wait complete. 2024-09-13T23:56:59.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.914+0000 7f2b5db4cf40 1 Processor -- start 2024-09-13T23:56:59.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.914+0000 7f2b5db4cf40 1 -- start start 2024-09-13T23:56:59.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.914+0000 7f2b5db4cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d800 0x5559c0822b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.914+0000 7f2b5db4cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c0562640 con 0x5559c053d800 2024-09-13T23:56:59.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.914+0000 7f2b5cb06700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d800 0x5559c0822b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.914+0000 7f2b5cb06700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d800 0x5559c0822b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58740/0 (socket says 172.21.15.173:58740) 2024-09-13T23:56:59.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.914+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 learned_addr learned my addr 172.21.15.173:0/3066807163 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.914+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559c054eea0 con 0x5559c053d800 2024-09-13T23:56:59.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.914+0000 7f2b5cb06700 1 --2- 172.21.15.173:0/3066807163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d800 0x5559c0822b00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x5559c0864150 tx=0x5559c0641b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.914+0000 7f2b552f7700 1 -- 172.21.15.173:0/3066807163 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559c05e1b80 con 0x5559c053d800 2024-09-13T23:56:59.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.914+0000 7f2b552f7700 1 -- 172.21.15.173:0/3066807163 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5559c088e180 con 0x5559c053d800 2024-09-13T23:56:59.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.914+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5559c054e820 con 0x5559c053d800 2024-09-13T23:56:59.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.914+0000 7f2b552f7700 1 -- 172.21.15.173:0/3066807163 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559c05e18c0 con 0x5559c053d800 2024-09-13T23:56:59.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.918+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5559c054e9c0 con 0x5559c053d800 2024-09-13T23:56:59.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.918+0000 7f2b552f7700 1 -- 172.21.15.173:0/3066807163 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x5559c0637080 con 0x5559c053d800 2024-09-13T23:56:59.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.918+0000 7f2b552f7700 1 --2- 172.21.15.173:0/3066807163 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559c08e2c00 0x5559c0823600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.918+0000 7f2b552f7700 1 -- 172.21.15.173:0/3066807163 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5559c05a3340 con 0x5559c053d800 2024-09-13T23:56:59.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.918+0000 7f2b5db4cf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.918+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/3066807163 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5559c08e3000 0x5559c0823b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.918+0000 7f2b5bb04700 1 --2- 172.21.15.173:0/3066807163 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559c08e2c00 0x5559c0823600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.918+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3400 con 0x5559c08e3000 2024-09-13T23:56:59.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.918+0000 7f2b5cb06700 1 --2- 172.21.15.173:0/3066807163 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5559c08e3000 0x5559c0823b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.918+0000 7f2b5cb06700 1 --2- 172.21.15.173:0/3066807163 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5559c08e3000 0x5559c0823b80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.918+0000 7f2b5bb04700 1 --2- 172.21.15.173:0/3066807163 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559c08e2c00 0x5559c0823600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x5559c081d920 tx=0x5559c0641800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.918+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5559c0992b40 con 0x5559c08e3000 2024-09-13T23:56:59.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.918+0000 7f2b5db4cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.918+0000 7f2b5db4cf40 20 realm 2024-09-13T23:56:59.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.918+0000 7f2b5db4cf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.918+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3000 2024-09-13T23:56:59.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.918+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5559c0992b40 con 0x5559c08e3000 2024-09-13T23:56:59.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.918+0000 7f2b5db4cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.918+0000 7f2b5db4cf40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:56:59.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.918+0000 7f2b5db4cf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.918+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3c00 con 0x5559c08e3000 2024-09-13T23:56:59.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.922+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5559c0992b40 con 0x5559c08e3000 2024-09-13T23:56:59.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.922+0000 7f2b5db4cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.922+0000 7f2b5db4cf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.922+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/3066807163 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5559c08e3400 0x5559c0824100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.922+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3400 2024-09-13T23:56:59.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.922+0000 7f2b5c305700 1 --2- 172.21.15.173:0/3066807163 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5559c08e3400 0x5559c0824100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.922+0000 7f2b5c305700 1 --2- 172.21.15.173:0/3066807163 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5559c08e3400 0x5559c0824100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.922+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5559c0993200 con 0x5559c08e3400 2024-09-13T23:56:59.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.922+0000 7f2b5db4cf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:59.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.922+0000 7f2b5db4cf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.922+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/3066807163 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5559c08e3c00 0x5559c0824680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.922+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c099a000 con 0x5559c08e3c00 2024-09-13T23:56:59.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.922+0000 7f2b5bb04700 1 --2- 172.21.15.173:0/3066807163 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5559c08e3c00 0x5559c0824680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.922+0000 7f2b5bb04700 1 --2- 172.21.15.173:0/3066807163 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5559c08e3c00 0x5559c0824680 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.922+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5559c0993440 con 0x5559c08e3c00 2024-09-13T23:56:59.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.922+0000 7f2b5db4cf40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:56:59.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.922+0000 7f2b5db4cf40 20 searching for the correct realm 2024-09-13T23:56:59.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.922+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c099a400 con 0x5559c08e3c00 2024-09-13T23:56:59.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.926+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5559c0993440 con 0x5559c08e3c00 2024-09-13T23:56:59.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.926+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c099a000 con 0x5559c08e3400 2024-09-13T23:56:59.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.926+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0993200 con 0x5559c08e3400 2024-09-13T23:56:59.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.926+0000 7f2b5c305700 1 --2- 172.21.15.173:0/3066807163 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5559c099a000 0x5559c0824c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.926+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c099a000 2024-09-13T23:56:59.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.926+0000 7f2b5cb06700 1 --2- 172.21.15.173:0/3066807163 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5559c099a000 0x5559c0824c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.926+0000 7f2b5cb06700 1 --2- 172.21.15.173:0/3066807163 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5559c099a000 0x5559c0824c00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.926+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0992b40 con 0x5559c099a000 2024-09-13T23:56:59.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.926+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3000 2024-09-13T23:56:59.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.926+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5559c0992b40 con 0x5559c08e3000 2024-09-13T23:56:59.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.926+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3000 2024-09-13T23:56:59.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.926+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0992b40 con 0x5559c08e3000 2024-09-13T23:56:59.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.926+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3c00 2024-09-13T23:56:59.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.926+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0993440 con 0x5559c08e3c00 2024-09-13T23:56:59.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.926+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3000 2024-09-13T23:56:59.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.930+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0992b40 con 0x5559c08e3000 2024-09-13T23:56:59.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.930+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3400 2024-09-13T23:56:59.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.930+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0993200 con 0x5559c08e3400 2024-09-13T23:56:59.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.930+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3400 2024-09-13T23:56:59.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.930+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0993200 con 0x5559c08e3400 2024-09-13T23:56:59.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.930+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3000 2024-09-13T23:56:59.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.930+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0992b40 con 0x5559c08e3000 2024-09-13T23:56:59.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.930+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c099a000 2024-09-13T23:56:59.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.930+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0992b40 con 0x5559c099a000 2024-09-13T23:56:59.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.930+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3000 2024-09-13T23:56:59.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.930+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0992b40 con 0x5559c08e3000 2024-09-13T23:56:59.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.930+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c099a000 2024-09-13T23:56:59.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.930+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0992b40 con 0x5559c099a000 2024-09-13T23:56:59.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.930+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3400 2024-09-13T23:56:59.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.934+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0993200 con 0x5559c08e3400 2024-09-13T23:56:59.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.934+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3c00 2024-09-13T23:56:59.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.934+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0993440 con 0x5559c08e3c00 2024-09-13T23:56:59.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.934+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3000 2024-09-13T23:56:59.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.934+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0992b40 con 0x5559c08e3000 2024-09-13T23:56:59.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.934+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3400 2024-09-13T23:56:59.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.934+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0993200 con 0x5559c08e3400 2024-09-13T23:56:59.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.934+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3c00 2024-09-13T23:56:59.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.934+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0993440 con 0x5559c08e3c00 2024-09-13T23:56:59.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.934+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3000 2024-09-13T23:56:59.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.934+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0992b40 con 0x5559c08e3000 2024-09-13T23:56:59.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.934+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3000 2024-09-13T23:56:59.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.938+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0992b40 con 0x5559c08e3000 2024-09-13T23:56:59.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.938+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3000 2024-09-13T23:56:59.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.938+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0992b40 con 0x5559c08e3000 2024-09-13T23:56:59.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.938+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3c00 2024-09-13T23:56:59.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.938+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0993440 con 0x5559c08e3c00 2024-09-13T23:56:59.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.938+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c099a000 2024-09-13T23:56:59.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.938+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0992b40 con 0x5559c099a000 2024-09-13T23:56:59.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.938+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3000 2024-09-13T23:56:59.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.938+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0992b40 con 0x5559c08e3000 2024-09-13T23:56:59.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.938+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c099a000 2024-09-13T23:56:59.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.938+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0992b40 con 0x5559c099a000 2024-09-13T23:56:59.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.938+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3c00 2024-09-13T23:56:59.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.938+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0993440 con 0x5559c08e3c00 2024-09-13T23:56:59.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.938+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c099a000 2024-09-13T23:56:59.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.938+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0992b40 con 0x5559c099a000 2024-09-13T23:56:59.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.938+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3400 2024-09-13T23:56:59.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.942+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0993200 con 0x5559c08e3400 2024-09-13T23:56:59.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.942+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3400 2024-09-13T23:56:59.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.942+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0993200 con 0x5559c08e3400 2024-09-13T23:56:59.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.942+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3c00 2024-09-13T23:56:59.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.942+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0993440 con 0x5559c08e3c00 2024-09-13T23:56:59.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.942+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3400 2024-09-13T23:56:59.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.942+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5559c0993200 con 0x5559c08e3400 2024-09-13T23:56:59.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.942+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c08e3400 2024-09-13T23:56:59.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.942+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559c0993200 con 0x5559c08e3400 2024-09-13T23:56:59.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.942+0000 7f2b5db4cf40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:56:59.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.942+0000 7f2b5db4cf40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:56:59.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.942+0000 7f2b5db4cf40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:56:59.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.942+0000 7f2b5db4cf40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:56:59.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.942+0000 7f2b5db4cf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.942+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c099a800 con 0x5559c08e3000 2024-09-13T23:56:59.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5559c0992b40 con 0x5559c08e3000 2024-09-13T23:56:59.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5db4cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5db4cf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c099ac00 con 0x5559c08e3400 2024-09-13T23:56:59.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5559c0993200 con 0x5559c08e3400 2024-09-13T23:56:59.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5db4cf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:56:59.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5db4cf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c099b000 con 0x5559c08e3000 2024-09-13T23:56:59.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5559c0992b40 con 0x5559c08e3000 2024-09-13T23:56:59.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5db4cf40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:56:59.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5db4cf40 20 zone default found 2024-09-13T23:56:59.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5db4cf40 4 Realm: () 2024-09-13T23:56:59.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5db4cf40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:56:59.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5db4cf40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:56:59.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5db4cf40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:56:59.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5db4cf40 20 zonegroup default 2024-09-13T23:56:59.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5db4cf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c099b400 con 0x5559c099a000 2024-09-13T23:56:59.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5559c0992b40 con 0x5559c099a000 2024-09-13T23:56:59.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5db4cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5db4cf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c099b800 con 0x5559c08e3c00 2024-09-13T23:56:59.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5559c0993440 con 0x5559c08e3c00 2024-09-13T23:56:59.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5db4cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5db4cf40 20 rados->read ofs=0 len=0 2024-09-13T23:56:59.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.946+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c099bc00 con 0x5559c08e3c00 2024-09-13T23:56:59.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.950+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5559c0993440 con 0x5559c08e3c00 2024-09-13T23:56:59.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.950+0000 7f2b5db4cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:56:59.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.950+0000 7f2b5db4cf40 20 started sync module instance, tier type = 2024-09-13T23:56:59.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.950+0000 7f2b5db4cf40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:56:59.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.950+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c09a4000 con 0x5559c08e3400 2024-09-13T23:56:59.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.950+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559c0993200 con 0x5559c08e3400 2024-09-13T23:56:59.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.950+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93843970169600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c09a4400 con 0x5559c08e3400 2024-09-13T23:56:59.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.950+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c09a4800 con 0x5559c08e3000 2024-09-13T23:56:59.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.954+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559c0992b40 con 0x5559c08e3000 2024-09-13T23:56:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.954+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93843970170752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c09a4c00 con 0x5559c08e3000 2024-09-13T23:56:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.954+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93843970169600] v33'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559c0993200 con 0x5559c08e3400 2024-09-13T23:56:59.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.954+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c09a5000 con 0x5559c08e3400 2024-09-13T23:56:59.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.958+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93843970170752] v33'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559c0992b40 con 0x5559c08e3000 2024-09-13T23:56:59.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.958+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559c0993200 con 0x5559c08e3400 2024-09-13T23:56:59.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.958+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93843970171904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c09a5400 con 0x5559c08e3400 2024-09-13T23:56:59.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.958+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c09a5800 con 0x5559c099a000 2024-09-13T23:56:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.958+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559c0992b40 con 0x5559c099a000 2024-09-13T23:56:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.958+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93843970173056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c09a5c00 con 0x5559c099a000 2024-09-13T23:56:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.962+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c09a4800 con 0x5559c08e3400 2024-09-13T23:56:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.962+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93843970171904] v33'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559c0993200 con 0x5559c08e3400 2024-09-13T23:56:59.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.962+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93843970173056] v33'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559c0992b40 con 0x5559c099a000 2024-09-13T23:56:59.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.962+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559c0993200 con 0x5559c08e3400 2024-09-13T23:56:59.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.962+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93843970174208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c09a4000 con 0x5559c08e3400 2024-09-13T23:56:59.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.962+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c099a800 con 0x5559c08e3c00 2024-09-13T23:56:59.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.966+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93843970174208] v33'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559c0993200 con 0x5559c08e3400 2024-09-13T23:56:59.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.966+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559c0993440 con 0x5559c08e3c00 2024-09-13T23:56:59.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.966+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93843970175360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c099b000 con 0x5559c08e3c00 2024-09-13T23:56:59.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.966+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c099b400 con 0x5559c08e3c00 2024-09-13T23:56:59.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.966+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v33'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559c0993440 con 0x5559c08e3c00 2024-09-13T23:56:59.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.966+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93843970176512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c099ac00 con 0x5559c08e3c00 2024-09-13T23:56:59.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.966+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08e3800 con 0x5559c099a000 2024-09-13T23:56:59.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.966+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93843970175360] v33'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559c0993440 con 0x5559c08e3c00 2024-09-13T23:56:59.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.970+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93843970176512] v33'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559c0993440 con 0x5559c08e3c00 2024-09-13T23:56:59.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.974+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559c0992b40 con 0x5559c099a000 2024-09-13T23:56:59.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.974+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93843970177664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c09a4400 con 0x5559c099a000 2024-09-13T23:56:59.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.974+0000 7f2b5db4cf40 20 add_watcher() i=0 2024-09-13T23:56:59.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.974+0000 7f2b5db4cf40 20 add_watcher() i=1 2024-09-13T23:56:59.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.974+0000 7f2b5db4cf40 20 add_watcher() i=2 2024-09-13T23:56:59.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.974+0000 7f2b5db4cf40 20 add_watcher() i=3 2024-09-13T23:56:59.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.974+0000 7f2b5db4cf40 20 add_watcher() i=4 2024-09-13T23:56:59.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.974+0000 7f2b5db4cf40 20 add_watcher() i=5 2024-09-13T23:56:59.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.974+0000 7f2b5db4cf40 20 add_watcher() i=6 2024-09-13T23:56:59.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.974+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93843970177664] v33'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559c0992b40 con 0x5559c099a000 2024-09-13T23:56:59.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.974+0000 7f2b5db4cf40 20 add_watcher() i=7 2024-09-13T23:56:59.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.974+0000 7f2b5db4cf40 2 all 8 watchers are set, enabling cache 2024-09-13T23:56:59.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.974+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c09a5000 con 0x5559c08e3000 2024-09-13T23:56:59.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.974+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5559c0992b40 con 0x5559c08e3000 2024-09-13T23:56:59.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.974+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93843971809280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c09a5400 con 0x5559c08e3000 2024-09-13T23:56:59.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.978+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93843971809280] v33'62 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5559c0992b40 con 0x5559c08e3000 2024-09-13T23:56:59.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.978+0000 7f2b432d3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:56:59.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.978+0000 7f2b5db4cf40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:56:59.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.978+0000 7f2b5db4cf40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:56:59.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.978+0000 7f2b5db4cf40 1 Processor -- start 2024-09-13T23:56:59.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.978+0000 7f2b5db4cf40 1 -- start start 2024-09-13T23:56:59.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.978+0000 7f2b5db4cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c099a400 0x5559c0825180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.978+0000 7f2b5db4cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c0562780 con 0x5559c099a400 2024-09-13T23:56:59.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.978+0000 7f2b5bb04700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c099a400 0x5559c0825180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.978+0000 7f2b5bb04700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c099a400 0x5559c0825180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58748/0 (socket says 172.21.15.173:58748) 2024-09-13T23:56:59.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.978+0000 7f2b5bb04700 1 -- 172.21.15.173:0/374888264 learned_addr learned my addr 172.21.15.173:0/374888264 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.978+0000 7f2b5bb04700 1 -- 172.21.15.173:0/374888264 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559c054eb60 con 0x5559c099a400 2024-09-13T23:56:59.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.982+0000 7f2b5bb04700 1 --2- 172.21.15.173:0/374888264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c099a400 0x5559c0825180 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x5559c09b2000 tx=0x5559c06419e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6fd18a048d975b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.986+0000 7f2b42ad2700 1 -- 172.21.15.173:0/374888264 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559c05e1760 con 0x5559c099a400 2024-09-13T23:56:59.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.986+0000 7f2b42ad2700 1 -- 172.21.15.173:0/374888264 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5559c088e600 con 0x5559c099a400 2024-09-13T23:56:59.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.986+0000 7f2b42ad2700 1 -- 172.21.15.173:0/374888264 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559c09b4000 con 0x5559c099a400 2024-09-13T23:56:59.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.986+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/374888264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c099a400 msgr2=0x5559c0825180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:56:59.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.986+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/374888264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c099a400 0x5559c0825180 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x5559c09b2000 tx=0x5559c06419e0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.986+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/374888264 shutdown_connections 2024-09-13T23:56:59.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.986+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/374888264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c099a400 0x5559c0825180 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:56:59.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.986+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/374888264 >> 172.21.15.173:0/374888264 conn(0x5559c09a4800 msgr2=0x5559c063e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:56:59.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.986+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/374888264 shutdown_connections 2024-09-13T23:56:59.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.986+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/374888264 wait complete. 2024-09-13T23:56:59.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.986+0000 7f2b5db4cf40 1 Processor -- start 2024-09-13T23:56:59.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.990+0000 7f2b5db4cf40 1 -- start start 2024-09-13T23:56:59.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.990+0000 7f2b5db4cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c099a400 0x5559c0825180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.990+0000 7f2b5db4cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c05ca000 con 0x5559c099a400 2024-09-13T23:56:59.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.990+0000 7f2b5bb04700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c099a400 0x5559c0825180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.990+0000 7f2b5bb04700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c099a400 0x5559c0825180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58758/0 (socket says 172.21.15.173:58758) 2024-09-13T23:56:59.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.990+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3127059051 learned_addr learned my addr 172.21.15.173:0/3127059051 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:56:59.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.990+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3127059051 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559c054ed00 con 0x5559c099a400 2024-09-13T23:56:59.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.990+0000 7f2b5bb04700 1 --2- 172.21.15.173:0/3127059051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c099a400 0x5559c0825180 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x5559c09b2210 tx=0x5559c089fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:56:59.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.990+0000 7f2b412cf700 1 -- 172.21.15.173:0/3127059051 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559c09b4160 con 0x5559c099a400 2024-09-13T23:56:59.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.990+0000 7f2b412cf700 1 -- 172.21.15.173:0/3127059051 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5559c088e300 con 0x5559c099a400 2024-09-13T23:56:59.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.990+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3127059051 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5559c054e340 con 0x5559c099a400 2024-09-13T23:56:59.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.990+0000 7f2b412cf700 1 -- 172.21.15.173:0/3127059051 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559c09b42c0 con 0x5559c099a400 2024-09-13T23:56:59.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.990+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3127059051 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5559c054fd40 con 0x5559c099a400 2024-09-13T23:56:59.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.990+0000 7f2b412cf700 1 -- 172.21.15.173:0/3127059051 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x5559c0637b80 con 0x5559c099a400 2024-09-13T23:56:59.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.994+0000 7f2b412cf700 1 --2- 172.21.15.173:0/3127059051 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559c08e3800 0x5559c0a38000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:56:59.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.994+0000 7f2b412cf700 1 -- 172.21.15.173:0/3127059051 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5559c05a3500 con 0x5559c099a400 2024-09-13T23:56:59.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.994+0000 7f2b5cb06700 1 --2- 172.21.15.173:0/3127059051 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559c08e3800 0x5559c0a38000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:56:59.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.994+0000 7f2b5db4cf40 5 note: GC not initialized 2024-09-13T23:56:59.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.994+0000 7f2b5cb06700 1 --2- 172.21.15.173:0/3127059051 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559c08e3800 0x5559c0a38000 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x5559c09394a0 tx=0x5559c089c8a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.994+0000 7f2b3eaca700 20 reqs_thread_entry: start 2024-09-13T23:57:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.994+0000 7f2b5db4cf40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:00.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.994+0000 7f2b5db4cf40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:00.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.994+0000 7f2b3c2c5700 20 reqs_thread_entry: start 2024-09-13T23:57:00.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.994+0000 7f2b5db4cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.994+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c099a800 con 0x5559c08e3000 2024-09-13T23:57:00.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.994+0000 7f2b3cac6700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:30 2024 2024-09-13T23:57:00.001 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:00.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.998+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x5559c0992b40 con 0x5559c08e3000 2024-09-13T23:57:00.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.998+0000 7f2b5db4cf40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:57:00.002 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:00.002 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "foo", 2024-09-13T23:57:00.002 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Foo", 2024-09-13T23:57:00.002 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "foo@foo.com", 2024-09-13T23:57:00.002 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:57:00.002 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:57:00.002 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [], 2024-09-13T23:57:00.002 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:57:00.002 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:00.002 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:57:00.002 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-09-13T23:57:00.002 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-09-13T23:57:00.003 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:00.003 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:00.003 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [], 2024-09-13T23:57:00.003 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:57:00.003 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:57:00.003 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:57:00.003 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:57:00.003 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:57:00.003 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:57:00.003 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:00.003 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:00.003 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:00.003 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:00.003 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:00.004 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:00.004 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:57:00.004 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:00.004 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:00.004 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:00.004 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:00.004 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:00.004 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:00.004 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:57:00.004 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:57:00.004 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:57:00.004 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:00.004 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:57:00.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.998+0000 7f2b432d3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:00.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.998+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93843971809280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c09a4c00 con 0x5559c08e3000 2024-09-13T23:57:00.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:56:59.998+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93843971809280] v33'63 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5559c0992b40 con 0x5559c08e3000 2024-09-13T23:57:00.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.002+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93843970169600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c09a5800 con 0x5559c08e3400 2024-09-13T23:57:00.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.002+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93843970169600] v33'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559c0993200 con 0x5559c08e3400 2024-09-13T23:57:00.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.002+0000 7f2b5db4cf40 20 remove_watcher() i=0 2024-09-13T23:57:00.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.002+0000 7f2b5db4cf40 2 removed watcher, disabling cache 2024-09-13T23:57:00.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.002+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93843970170752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c09a5c00 con 0x5559c08e3000 2024-09-13T23:57:00.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.006+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93843970170752] v33'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559c0992b40 con 0x5559c08e3000 2024-09-13T23:57:00.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.006+0000 7f2b5db4cf40 20 remove_watcher() i=1 2024-09-13T23:57:00.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.006+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93843970171904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c09a4400 con 0x5559c08e3400 2024-09-13T23:57:00.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.010+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93843970171904] v33'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559c0993200 con 0x5559c08e3400 2024-09-13T23:57:00.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.010+0000 7f2b5db4cf40 20 remove_watcher() i=2 2024-09-13T23:57:00.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.010+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93843970173056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08a4000 con 0x5559c099a000 2024-09-13T23:57:00.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.010+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93843970173056] v33'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559c0992b40 con 0x5559c099a000 2024-09-13T23:57:00.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.010+0000 7f2b5db4cf40 20 remove_watcher() i=3 2024-09-13T23:57:00.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.010+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93843970174208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08a4400 con 0x5559c08e3400 2024-09-13T23:57:00.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.014+0000 7f2b5c305700 1 -- 172.21.15.173:0/3066807163 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93843970174208] v33'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559c0993200 con 0x5559c08e3400 2024-09-13T23:57:00.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.014+0000 7f2b5db4cf40 20 remove_watcher() i=4 2024-09-13T23:57:00.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.014+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93843970175360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08a4800 con 0x5559c08e3c00 2024-09-13T23:57:00.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.014+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93843970175360] v33'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559c0993440 con 0x5559c08e3c00 2024-09-13T23:57:00.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.014+0000 7f2b5db4cf40 20 remove_watcher() i=5 2024-09-13T23:57:00.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.014+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93843970176512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08a4c00 con 0x5559c08e3c00 2024-09-13T23:57:00.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.018+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93843970176512] v33'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559c0993440 con 0x5559c08e3c00 2024-09-13T23:57:00.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.018+0000 7f2b5db4cf40 20 remove_watcher() i=6 2024-09-13T23:57:00.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.018+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93843970177664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559c08a5000 con 0x5559c099a000 2024-09-13T23:57:00.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5cb06700 1 -- 172.21.15.173:0/3066807163 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93843970177664] v33'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559c0992b40 con 0x5559c099a000 2024-09-13T23:57:00.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 20 remove_watcher() i=7 2024-09-13T23:57:00.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5559c08e3400 msgr2=0x5559c0824100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/3066807163 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5559c08e3400 0x5559c0824100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5559c08e3000 msgr2=0x5559c0823b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/3066807163 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5559c08e3000 0x5559c0823b80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5559c099a000 msgr2=0x5559c0824c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/3066807163 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5559c099a000 0x5559c0824c00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5559c08e3c00 msgr2=0x5559c0824680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/3066807163 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5559c08e3c00 0x5559c0824680 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559c08e2c00 msgr2=0x5559c0823600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/3066807163 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559c08e2c00 0x5559c0823600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x5559c081d920 tx=0x5559c0641800 comp rx=0 tx=0).stop 2024-09-13T23:57:00.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d800 msgr2=0x5559c0822b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/3066807163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d800 0x5559c0822b00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x5559c0864150 tx=0x5559c0641b60 comp rx=0 tx=0).stop 2024-09-13T23:57:00.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 reap_dead start 2024-09-13T23:57:00.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5bb04700 1 -- 172.21.15.173:0/3066807163 reap_dead start 2024-09-13T23:57:00.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 shutdown_connections 2024-09-13T23:57:00.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 >> 172.21.15.173:0/3066807163 conn(0x5559c053d400 msgr2=0x5559c063d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 shutdown_connections 2024-09-13T23:57:00.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3066807163 wait complete. 2024-09-13T23:57:00.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3127059051 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559c08e3800 msgr2=0x5559c0a38000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/3127059051 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559c08e3800 0x5559c0a38000 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x5559c09394a0 tx=0x5559c089c8a0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3127059051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c099a400 msgr2=0x5559c0825180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/3127059051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c099a400 0x5559c0825180 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x5559c09b2210 tx=0x5559c089fb60 comp rx=0 tx=0).stop 2024-09-13T23:57:00.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3127059051 shutdown_connections 2024-09-13T23:57:00.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/3127059051 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559c08e3800 0x5559c0a38000 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/3127059051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c099a400 0x5559c0825180 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3127059051 >> 172.21.15.173:0/3127059051 conn(0x5559c09a4800 msgr2=0x5559c063e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3127059051 shutdown_connections 2024-09-13T23:57:00.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3127059051 wait complete. 2024-09-13T23:57:00.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3081415948 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559c08e2000 msgr2=0x5559c0823080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/3081415948 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559c08e2000 0x5559c0823080 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x5559c0865560 tx=0x5559c089c240 comp rx=0 tx=0).stop 2024-09-13T23:57:00.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3081415948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d000 msgr2=0x5559c0822580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/3081415948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d000 0x5559c0822580 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5559c1307e00 tx=0x5559c0641920 comp rx=0 tx=0).stop 2024-09-13T23:57:00.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3081415948 shutdown_connections 2024-09-13T23:57:00.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/3081415948 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559c08e2000 0x5559c0823080 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 --2- 172.21.15.173:0/3081415948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559c053d000 0x5559c0822580 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3081415948 >> 172.21.15.173:0/3081415948 conn(0x5559c053cc00 msgr2=0x5559c063d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3081415948 shutdown_connections 2024-09-13T23:57:00.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.022+0000 7f2b5db4cf40 1 -- 172.21.15.173:0/3081415948 wait complete. 2024-09-13T23:57:00.033 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:57:00.033 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-13T23:57:00.033 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-13T23:57:00.034 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-13T23:57:00.083 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:00.083 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:00.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.078+0000 7f5c85bb4f40 1 Processor -- start 2024-09-13T23:57:00.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.078+0000 7f5c85bb4f40 1 -- start start 2024-09-13T23:57:00.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.078+0000 7f5c85bb4f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55bb6802f000 0x55bb68314580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.078+0000 7f5c85bb4f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55bb680f3500 con 0x55bb6802f400 2024-09-13T23:57:00.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.078+0000 7f5c85bb4f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55bb680bca00 con 0x55bb6802f000 2024-09-13T23:57:00.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.078+0000 7f5c8436d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55bb6802f000 0x55bb68314580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.078+0000 7f5c83b6c700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55bb6802f400 0x55bb6812e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:57910/0 (socket says 172.21.15.173:57910) 2024-09-13T23:57:00.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.078+0000 7f5c83b6c700 1 -- 172.21.15.173:0/2368428773 learned_addr learned my addr 172.21.15.173:0/2368428773 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:00.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.078+0000 7f5c8436d700 1 -- 172.21.15.173:0/2368428773 >> v1:172.21.15.87:6789/0 conn(0x55bb6802f400 legacy=0x55bb6812e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.078+0000 7f5c8436d700 1 -- 172.21.15.173:0/2368428773 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb68041d40 con 0x55bb6802f000 2024-09-13T23:57:00.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c8436d700 1 --2- 172.21.15.173:0/2368428773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb6802f000 0x55bb68314580 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55bb6830fa70 tx=0x55bb68133920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c21319f1e02762 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c8336b700 1 -- 172.21.15.173:0/2368428773 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb680d34a0 con 0x55bb6802f000 2024-09-13T23:57:00.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c8336b700 1 -- 172.21.15.173:0/2368428773 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bb680f3800 con 0x55bb6802f000 2024-09-13T23:57:00.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c8336b700 1 -- 172.21.15.173:0/2368428773 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb680d3600 con 0x55bb6802f000 2024-09-13T23:57:00.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/2368428773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb6802f000 msgr2=0x55bb68314580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/2368428773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb6802f000 0x55bb68314580 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55bb6830fa70 tx=0x55bb68133920 comp rx=0 tx=0).stop 2024-09-13T23:57:00.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/2368428773 shutdown_connections 2024-09-13T23:57:00.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/2368428773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb6802f000 0x55bb68314580 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/2368428773 >> 172.21.15.173:0/2368428773 conn(0x55bb6802ec00 msgr2=0x55bb6812e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/2368428773 shutdown_connections 2024-09-13T23:57:00.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/2368428773 wait complete. 2024-09-13T23:57:00.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c85bb4f40 1 Processor -- start 2024-09-13T23:57:00.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c85bb4f40 1 -- start start 2024-09-13T23:57:00.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c85bb4f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb6802f400 0x55bb68314b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c85bb4f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb680bc500 con 0x55bb6802f400 2024-09-13T23:57:00.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c8436d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb6802f400 0x55bb68314b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c8436d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb6802f400 0x55bb68314b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58770/0 (socket says 172.21.15.173:58770) 2024-09-13T23:57:00.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c8436d700 1 -- 172.21.15.173:0/1781155065 learned_addr learned my addr 172.21.15.173:0/1781155065 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c8436d700 1 -- 172.21.15.173:0/1781155065 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb68041ba0 con 0x55bb6802f400 2024-09-13T23:57:00.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c8436d700 1 --2- 172.21.15.173:0/1781155065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb6802f400 0x55bb68314b00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55bb68e93860 tx=0x55bb68133800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bafd8e344d12c5ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c82b6a700 1 -- 172.21.15.173:0/1781155065 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb680d3760 con 0x55bb6802f400 2024-09-13T23:57:00.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c82b6a700 1 -- 172.21.15.173:0/1781155065 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bb680f3b00 con 0x55bb6802f400 2024-09-13T23:57:00.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c82b6a700 1 -- 172.21.15.173:0/1781155065 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb680d34a0 con 0x55bb6802f400 2024-09-13T23:57:00.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/1781155065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb6802f400 msgr2=0x55bb68314b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/1781155065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb6802f400 0x55bb68314b00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55bb68e93860 tx=0x55bb68133800 comp rx=0 tx=0).stop 2024-09-13T23:57:00.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/1781155065 shutdown_connections 2024-09-13T23:57:00.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/1781155065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb6802f400 0x55bb68314b00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/1781155065 >> 172.21.15.173:0/1781155065 conn(0x55bb6802ec00 msgr2=0x55bb6812f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/1781155065 shutdown_connections 2024-09-13T23:57:00.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.082+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/1781155065 wait complete. 2024-09-13T23:57:00.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.086+0000 7f5c85bb4f40 1 Processor -- start 2024-09-13T23:57:00.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.086+0000 7f5c85bb4f40 1 -- start start 2024-09-13T23:57:00.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.086+0000 7f5c85bb4f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb6802f400 0x55bb68314b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.086+0000 7f5c85bb4f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb680bc3c0 con 0x55bb6802f400 2024-09-13T23:57:00.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.086+0000 7f5c8436d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb6802f400 0x55bb68314b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.086+0000 7f5c8436d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb6802f400 0x55bb68314b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58782/0 (socket says 172.21.15.173:58782) 2024-09-13T23:57:00.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.086+0000 7f5c8436d700 1 -- 172.21.15.173:0/1403105782 learned_addr learned my addr 172.21.15.173:0/1403105782 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.086+0000 7f5c8436d700 1 -- 172.21.15.173:0/1403105782 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb68041a00 con 0x55bb6802f400 2024-09-13T23:57:00.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.086+0000 7f5c8436d700 1 --2- 172.21.15.173:0/1403105782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb6802f400 0x55bb68314b00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55bb68e93680 tx=0x55bb68133920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.086+0000 7f5c81367700 1 -- 172.21.15.173:0/1403105782 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb680d3600 con 0x55bb6802f400 2024-09-13T23:57:00.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.086+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/1403105782 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bb68041860 con 0x55bb6802f400 2024-09-13T23:57:00.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.086+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/1403105782 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bb680416c0 con 0x55bb6802f400 2024-09-13T23:57:00.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.086+0000 7f5c81367700 1 -- 172.21.15.173:0/1403105782 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bb680f3c80 con 0x55bb6802f400 2024-09-13T23:57:00.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.086+0000 7f5c81367700 1 -- 172.21.15.173:0/1403105782 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb680d38c0 con 0x55bb6802f400 2024-09-13T23:57:00.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.086+0000 7f5c81367700 1 -- 172.21.15.173:0/1403105782 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55bb68128b00 con 0x55bb6802f400 2024-09-13T23:57:00.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.086+0000 7f5c85bb4f40 1 Processor -- start 2024-09-13T23:57:00.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.086+0000 7f5c81367700 1 --2- 172.21.15.173:0/1403105782 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bb6802fc00 0x55bb68315080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.086+0000 7f5c81367700 1 -- 172.21.15.173:0/1403105782 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55bb68095180 con 0x55bb6802f400 2024-09-13T23:57:00.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.086+0000 7f5c85bb4f40 1 -- start start 2024-09-13T23:57:00.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.086+0000 7f5c84b6e700 1 --2- 172.21.15.173:0/1403105782 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bb6802fc00 0x55bb68315080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.090+0000 7f5c85bb4f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb683d2000 0x55bb68315600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.090+0000 7f5c85bb4f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb68054640 con 0x55bb683d2000 2024-09-13T23:57:00.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.090+0000 7f5c8436d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb683d2000 0x55bb68315600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.090+0000 7f5c8436d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb683d2000 0x55bb68315600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58790/0 (socket says 172.21.15.173:58790) 2024-09-13T23:57:00.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.090+0000 7f5c8436d700 1 -- 172.21.15.173:0/2464761958 learned_addr learned my addr 172.21.15.173:0/2464761958 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.090+0000 7f5c84b6e700 1 --2- 172.21.15.173:0/1403105782 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bb6802fc00 0x55bb68315080 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x55bb68ea2360 tx=0x55bb68388780 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.090+0000 7f5c8436d700 1 -- 172.21.15.173:0/2464761958 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb68040000 con 0x55bb683d2000 2024-09-13T23:57:00.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.090+0000 7f5c8436d700 1 --2- 172.21.15.173:0/2464761958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb683d2000 0x55bb68315600 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55bb68ea3080 tx=0x55bb683888a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=240f107ca1cb21c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.090+0000 7f5c7eb62700 1 -- 172.21.15.173:0/2464761958 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb680d3600 con 0x55bb683d2000 2024-09-13T23:57:00.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.090+0000 7f5c7eb62700 1 -- 172.21.15.173:0/2464761958 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bb680f3c80 con 0x55bb683d2000 2024-09-13T23:57:00.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.090+0000 7f5c7eb62700 1 -- 172.21.15.173:0/2464761958 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb680d38c0 con 0x55bb683d2000 2024-09-13T23:57:00.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.090+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/2464761958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb683d2000 msgr2=0x55bb68315600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.090+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/2464761958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb683d2000 0x55bb68315600 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55bb68ea3080 tx=0x55bb683888a0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.090+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/2464761958 shutdown_connections 2024-09-13T23:57:00.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.090+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/2464761958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb683d2000 0x55bb68315600 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.090+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/2464761958 >> 172.21.15.173:0/2464761958 conn(0x55bb6802f800 msgr2=0x55bb6812f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.090+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/2464761958 shutdown_connections 2024-09-13T23:57:00.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.090+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/2464761958 wait complete. 2024-09-13T23:57:00.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.090+0000 7f5c85bb4f40 1 Processor -- start 2024-09-13T23:57:00.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.090+0000 7f5c85bb4f40 1 -- start start 2024-09-13T23:57:00.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.090+0000 7f5c85bb4f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb683d2000 0x55bb68315600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.090+0000 7f5c85bb4f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb680548c0 con 0x55bb683d2000 2024-09-13T23:57:00.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.094+0000 7f5c8436d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb683d2000 0x55bb68315600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.094+0000 7f5c8436d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb683d2000 0x55bb68315600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58796/0 (socket says 172.21.15.173:58796) 2024-09-13T23:57:00.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.094+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 learned_addr learned my addr 172.21.15.173:0/160140266 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.094+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb68040ea0 con 0x55bb683d2000 2024-09-13T23:57:00.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.094+0000 7f5c8436d700 1 --2- 172.21.15.173:0/160140266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb683d2000 0x55bb68315600 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55bb68ea3170 tx=0x55bb68388a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.094+0000 7f5c7d35f700 1 -- 172.21.15.173:0/160140266 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb680d3760 con 0x55bb683d2000 2024-09-13T23:57:00.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.094+0000 7f5c7d35f700 1 -- 172.21.15.173:0/160140266 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bb683e8000 con 0x55bb683d2000 2024-09-13T23:57:00.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.094+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bb68040820 con 0x55bb683d2000 2024-09-13T23:57:00.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.094+0000 7f5c7d35f700 1 -- 172.21.15.173:0/160140266 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb680d34a0 con 0x55bb683d2000 2024-09-13T23:57:00.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.094+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bb680409c0 con 0x55bb683d2000 2024-09-13T23:57:00.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.094+0000 7f5c7d35f700 1 -- 172.21.15.173:0/160140266 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55bb68128dc0 con 0x55bb683d2000 2024-09-13T23:57:00.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.094+0000 7f5c7d35f700 1 --2- 172.21.15.173:0/160140266 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bb683d3800 0x55bb68316680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.094+0000 7f5c7d35f700 1 -- 172.21.15.173:0/160140266 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55bb68095340 con 0x55bb683d2000 2024-09-13T23:57:00.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.094+0000 7f5c85bb4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.094+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/160140266 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55bb683d2400 0x55bb68315b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.094+0000 7f5c83b6c700 1 --2- 172.21.15.173:0/160140266 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bb683d3800 0x55bb68316680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.094+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d2800 con 0x55bb683d2400 2024-09-13T23:57:00.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.094+0000 7f5c84b6e700 1 --2- 172.21.15.173:0/160140266 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55bb683d2400 0x55bb68315b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c83b6c700 1 --2- 172.21.15.173:0/160140266 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bb683d3800 0x55bb68316680 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55bb683bfbc0 tx=0x55bb68389860 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c84b6e700 1 --2- 172.21.15.173:0/160140266 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55bb683d2400 0x55bb68315b80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55bb68458b40 con 0x55bb683d2400 2024-09-13T23:57:00.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c85bb4f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c85bb4f40 20 realm 2024-09-13T23:57:00.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c85bb4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d2c00 con 0x55bb683d2400 2024-09-13T23:57:00.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55bb68458b40 con 0x55bb683d2400 2024-09-13T23:57:00.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c85bb4f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c85bb4f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:00.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c85bb4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d2800 con 0x55bb683d2400 2024-09-13T23:57:00.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55bb68458b40 con 0x55bb683d2400 2024-09-13T23:57:00.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c85bb4f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c85bb4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/160140266 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55bb683d2c00 0x55bb68316100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb683d2c00 2024-09-13T23:57:00.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c8436d700 1 --2- 172.21.15.173:0/160140266 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55bb683d2c00 0x55bb68316100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c8436d700 1 --2- 172.21.15.173:0/160140266 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55bb683d2c00 0x55bb68316100 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55bb68459200 con 0x55bb683d2c00 2024-09-13T23:57:00.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c85bb4f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:00.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c85bb4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/160140266 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55bb68446000 0x55bb68316c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb68446400 con 0x55bb68446000 2024-09-13T23:57:00.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.098+0000 7f5c83b6c700 1 --2- 172.21.15.173:0/160140266 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55bb68446000 0x55bb68316c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.102+0000 7f5c83b6c700 1 --2- 172.21.15.173:0/160140266 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55bb68446000 0x55bb68316c00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.102+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55bb68459440 con 0x55bb68446000 2024-09-13T23:57:00.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.102+0000 7f5c85bb4f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:00.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.102+0000 7f5c85bb4f40 20 searching for the correct realm 2024-09-13T23:57:00.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.102+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb68446800 con 0x55bb68446000 2024-09-13T23:57:00.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.102+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55bb68459440 con 0x55bb68446000 2024-09-13T23:57:00.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.102+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb68446400 con 0x55bb683d2c00 2024-09-13T23:57:00.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.102+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68459200 con 0x55bb683d2c00 2024-09-13T23:57:00.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.102+0000 7f5c8436d700 1 --2- 172.21.15.173:0/160140266 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55bb68446400 0x55bb68314580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.102+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb68446400 2024-09-13T23:57:00.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.102+0000 7f5c84b6e700 1 --2- 172.21.15.173:0/160140266 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55bb68446400 0x55bb68314580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.102+0000 7f5c84b6e700 1 --2- 172.21.15.173:0/160140266 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55bb68446400 0x55bb68314580 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.102+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68458b40 con 0x55bb68446400 2024-09-13T23:57:00.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.102+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb683d2400 2024-09-13T23:57:00.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.102+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55bb68458b40 con 0x55bb683d2400 2024-09-13T23:57:00.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.102+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb683d2400 2024-09-13T23:57:00.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.102+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68458b40 con 0x55bb683d2400 2024-09-13T23:57:00.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.102+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb68446000 2024-09-13T23:57:00.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.106+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68459440 con 0x55bb68446000 2024-09-13T23:57:00.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.106+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb683d2400 2024-09-13T23:57:00.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.106+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68458b40 con 0x55bb683d2400 2024-09-13T23:57:00.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.106+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb683d2c00 2024-09-13T23:57:00.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.106+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68459200 con 0x55bb683d2c00 2024-09-13T23:57:00.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.106+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb683d2c00 2024-09-13T23:57:00.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.106+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68459200 con 0x55bb683d2c00 2024-09-13T23:57:00.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.106+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb683d2400 2024-09-13T23:57:00.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.106+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68458b40 con 0x55bb683d2400 2024-09-13T23:57:00.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.106+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb68446400 2024-09-13T23:57:00.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.106+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68458b40 con 0x55bb68446400 2024-09-13T23:57:00.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.106+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb683d2400 2024-09-13T23:57:00.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.106+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68458b40 con 0x55bb683d2400 2024-09-13T23:57:00.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.106+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb68446400 2024-09-13T23:57:00.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.106+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68458b40 con 0x55bb68446400 2024-09-13T23:57:00.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.106+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb683d2c00 2024-09-13T23:57:00.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.110+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68459200 con 0x55bb683d2c00 2024-09-13T23:57:00.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.110+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb68446000 2024-09-13T23:57:00.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.110+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68459440 con 0x55bb68446000 2024-09-13T23:57:00.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.110+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb683d2400 2024-09-13T23:57:00.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.110+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68458b40 con 0x55bb683d2400 2024-09-13T23:57:00.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.110+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb683d2c00 2024-09-13T23:57:00.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.110+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68459200 con 0x55bb683d2c00 2024-09-13T23:57:00.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.110+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb68446000 2024-09-13T23:57:00.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.110+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68459440 con 0x55bb68446000 2024-09-13T23:57:00.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.110+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb683d2400 2024-09-13T23:57:00.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.110+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68458b40 con 0x55bb683d2400 2024-09-13T23:57:00.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.110+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb683d2400 2024-09-13T23:57:00.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.110+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68458b40 con 0x55bb683d2400 2024-09-13T23:57:00.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.110+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb683d2400 2024-09-13T23:57:00.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.110+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68458b40 con 0x55bb683d2400 2024-09-13T23:57:00.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.110+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb68446000 2024-09-13T23:57:00.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.110+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68459440 con 0x55bb68446000 2024-09-13T23:57:00.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.110+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb68446400 2024-09-13T23:57:00.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.110+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68458b40 con 0x55bb68446400 2024-09-13T23:57:00.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.114+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb683d2400 2024-09-13T23:57:00.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.114+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68458b40 con 0x55bb683d2400 2024-09-13T23:57:00.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.114+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb68446400 2024-09-13T23:57:00.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.114+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68458b40 con 0x55bb68446400 2024-09-13T23:57:00.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.114+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb68446000 2024-09-13T23:57:00.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.114+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68459440 con 0x55bb68446000 2024-09-13T23:57:00.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.114+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb68446400 2024-09-13T23:57:00.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.114+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68458b40 con 0x55bb68446400 2024-09-13T23:57:00.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.114+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb683d2c00 2024-09-13T23:57:00.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.114+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68459200 con 0x55bb683d2c00 2024-09-13T23:57:00.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.114+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb683d2c00 2024-09-13T23:57:00.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.114+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68459200 con 0x55bb683d2c00 2024-09-13T23:57:00.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.114+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb68446000 2024-09-13T23:57:00.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.114+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68459440 con 0x55bb68446000 2024-09-13T23:57:00.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.114+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb683d2c00 2024-09-13T23:57:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.114+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55bb68459200 con 0x55bb683d2c00 2024-09-13T23:57:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.114+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb683d2c00 2024-09-13T23:57:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.114+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bb68459200 con 0x55bb683d2c00 2024-09-13T23:57:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.114+0000 7f5c85bb4f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.114+0000 7f5c85bb4f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.114+0000 7f5c85bb4f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.114+0000 7f5c85bb4f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.114+0000 7f5c85bb4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.114+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb68446c00 con 0x55bb683d2400 2024-09-13T23:57:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55bb68458b40 con 0x55bb683d2400 2024-09-13T23:57:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb68447000 con 0x55bb683d2c00 2024-09-13T23:57:00.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55bb68459200 con 0x55bb683d2c00 2024-09-13T23:57:00.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:00.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb68447400 con 0x55bb683d2400 2024-09-13T23:57:00.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55bb68458b40 con 0x55bb683d2400 2024-09-13T23:57:00.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:00.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 20 zone default found 2024-09-13T23:57:00.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 4 Realm: () 2024-09-13T23:57:00.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:00.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 20 zonegroup default 2024-09-13T23:57:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb68446c00 con 0x55bb68446400 2024-09-13T23:57:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55bb68458b40 con 0x55bb68446400 2024-09-13T23:57:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb68447400 con 0x55bb68446000 2024-09-13T23:57:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55bb68459440 con 0x55bb68446000 2024-09-13T23:57:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb68447800 con 0x55bb68446000 2024-09-13T23:57:00.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55bb68459440 con 0x55bb68446000 2024-09-13T23:57:00.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 20 started sync module instance, tier type = 2024-09-13T23:57:00.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:00.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.118+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb68447c00 con 0x55bb683d2c00 2024-09-13T23:57:00.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.122+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68459200 con 0x55bb683d2c00 2024-09-13T23:57:00.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.122+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94263395269376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d2800 con 0x55bb683d2c00 2024-09-13T23:57:00.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.122+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb68447000 con 0x55bb683d2400 2024-09-13T23:57:00.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.122+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68458b40 con 0x55bb683d2400 2024-09-13T23:57:00.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.122+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94263395270528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb68447c00 con 0x55bb683d2400 2024-09-13T23:57:00.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.122+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb683d2c00 2024-09-13T23:57:00.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.122+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94263395269376] v33'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68459200 con 0x55bb683d2c00 2024-09-13T23:57:00.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.126+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94263395270528] v33'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68458b40 con 0x55bb683d2400 2024-09-13T23:57:00.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.126+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68459200 con 0x55bb683d2c00 2024-09-13T23:57:00.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.126+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94263395271680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb6846a000 con 0x55bb683d2c00 2024-09-13T23:57:00.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.126+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb6846a400 con 0x55bb68446400 2024-09-13T23:57:00.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.126+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68458b40 con 0x55bb68446400 2024-09-13T23:57:00.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.126+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94263395272832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb6846a800 con 0x55bb68446400 2024-09-13T23:57:00.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.126+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb6846ac00 con 0x55bb683d2c00 2024-09-13T23:57:00.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.126+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94263395271680] v33'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68459200 con 0x55bb683d2c00 2024-09-13T23:57:00.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.130+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94263395272832] v33'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68458b40 con 0x55bb68446400 2024-09-13T23:57:00.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.130+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68459200 con 0x55bb683d2c00 2024-09-13T23:57:00.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.130+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94263395273984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb6846b000 con 0x55bb683d2c00 2024-09-13T23:57:00.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.130+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb6846b400 con 0x55bb68446000 2024-09-13T23:57:00.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.130+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68459440 con 0x55bb68446000 2024-09-13T23:57:00.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.130+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94263395275136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb6846b800 con 0x55bb68446000 2024-09-13T23:57:00.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.130+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb6846bc00 con 0x55bb68446000 2024-09-13T23:57:00.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.130+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94263395273984] v33'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68459200 con 0x55bb683d2c00 2024-09-13T23:57:00.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.134+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94263395275136] v33'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68459440 con 0x55bb68446000 2024-09-13T23:57:00.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.134+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68459440 con 0x55bb68446000 2024-09-13T23:57:00.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.134+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94263395276288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb6846b400 con 0x55bb68446000 2024-09-13T23:57:00.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.134+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb6846a000 con 0x55bb68446400 2024-09-13T23:57:00.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.134+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94263395276288] v33'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68459440 con 0x55bb68446000 2024-09-13T23:57:00.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.138+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68458b40 con 0x55bb68446400 2024-09-13T23:57:00.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.138+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94263395277440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb68446800 con 0x55bb68446400 2024-09-13T23:57:00.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.138+0000 7f5c85bb4f40 20 add_watcher() i=0 2024-09-13T23:57:00.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.138+0000 7f5c85bb4f40 20 add_watcher() i=1 2024-09-13T23:57:00.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.138+0000 7f5c85bb4f40 20 add_watcher() i=2 2024-09-13T23:57:00.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.138+0000 7f5c85bb4f40 20 add_watcher() i=3 2024-09-13T23:57:00.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.138+0000 7f5c85bb4f40 20 add_watcher() i=4 2024-09-13T23:57:00.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.138+0000 7f5c85bb4f40 20 add_watcher() i=5 2024-09-13T23:57:00.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.138+0000 7f5c85bb4f40 20 add_watcher() i=6 2024-09-13T23:57:00.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.138+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94263395277440] v33'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68458b40 con 0x55bb68446400 2024-09-13T23:57:00.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.138+0000 7f5c85bb4f40 20 add_watcher() i=7 2024-09-13T23:57:00.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.138+0000 7f5c85bb4f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:00.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.138+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb68447400 con 0x55bb683d2400 2024-09-13T23:57:00.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.138+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55bb68458b40 con 0x55bb683d2400 2024-09-13T23:57:00.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.138+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94263396745216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb68447800 con 0x55bb683d2400 2024-09-13T23:57:00.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94263396745216] v33'64 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55bb68458b40 con 0x55bb683d2400 2024-09-13T23:57:00.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c6b33b700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:00.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c85bb4f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:00.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c85bb4f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:00.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c85bb4f40 1 Processor -- start 2024-09-13T23:57:00.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c85bb4f40 1 -- start start 2024-09-13T23:57:00.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c85bb4f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb68447000 0x55bb68317180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c85bb4f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb680bc3c0 con 0x55bb68447000 2024-09-13T23:57:00.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c83b6c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb68447000 0x55bb68317180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c83b6c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb68447000 0x55bb68317180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58810/0 (socket says 172.21.15.173:58810) 2024-09-13T23:57:00.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c83b6c700 1 -- 172.21.15.173:0/3289350103 learned_addr learned my addr 172.21.15.173:0/3289350103 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c83b6c700 1 -- 172.21.15.173:0/3289350103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb68040b60 con 0x55bb68447000 2024-09-13T23:57:00.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c83b6c700 1 --2- 172.21.15.173:0/3289350103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb68447000 0x55bb68317180 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55bb68478690 tx=0x55bb68389800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b44d5b5db43af4c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c6ab3a700 1 -- 172.21.15.173:0/3289350103 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb68472160 con 0x55bb68447000 2024-09-13T23:57:00.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c6ab3a700 1 -- 172.21.15.173:0/3289350103 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bb683e8a80 con 0x55bb68447000 2024-09-13T23:57:00.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c6ab3a700 1 -- 172.21.15.173:0/3289350103 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb684722c0 con 0x55bb68447000 2024-09-13T23:57:00.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/3289350103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb68447000 msgr2=0x55bb68317180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/3289350103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb68447000 0x55bb68317180 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55bb68478690 tx=0x55bb68389800 comp rx=0 tx=0).stop 2024-09-13T23:57:00.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/3289350103 shutdown_connections 2024-09-13T23:57:00.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/3289350103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb68447000 0x55bb68317180 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/3289350103 >> 172.21.15.173:0/3289350103 conn(0x55bb68446c00 msgr2=0x55bb68130000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/3289350103 shutdown_connections 2024-09-13T23:57:00.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/3289350103 wait complete. 2024-09-13T23:57:00.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c85bb4f40 1 Processor -- start 2024-09-13T23:57:00.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.142+0000 7f5c85bb4f40 1 -- start start 2024-09-13T23:57:00.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.146+0000 7f5c85bb4f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb68447000 0x55bb68317180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.146+0000 7f5c85bb4f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb680bc500 con 0x55bb68447000 2024-09-13T23:57:00.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.146+0000 7f5c83b6c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb68447000 0x55bb68317180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.146+0000 7f5c83b6c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb68447000 0x55bb68317180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58820/0 (socket says 172.21.15.173:58820) 2024-09-13T23:57:00.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.146+0000 7f5c83b6c700 1 -- 172.21.15.173:0/263635328 learned_addr learned my addr 172.21.15.173:0/263635328 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.146+0000 7f5c83b6c700 1 -- 172.21.15.173:0/263635328 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb68040d00 con 0x55bb68447000 2024-09-13T23:57:00.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.146+0000 7f5c83b6c700 1 --2- 172.21.15.173:0/263635328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb68447000 0x55bb68317180 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55bb684788d0 tx=0x55bb68389980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.146+0000 7f5c69337700 1 -- 172.21.15.173:0/263635328 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb68472420 con 0x55bb68447000 2024-09-13T23:57:00.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.146+0000 7f5c69337700 1 -- 172.21.15.173:0/263635328 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bb683e8780 con 0x55bb68447000 2024-09-13T23:57:00.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.146+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/263635328 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bb68040340 con 0x55bb68447000 2024-09-13T23:57:00.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.146+0000 7f5c69337700 1 -- 172.21.15.173:0/263635328 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bb68472160 con 0x55bb68447000 2024-09-13T23:57:00.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.146+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/263635328 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bb68040b60 con 0x55bb68447000 2024-09-13T23:57:00.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.146+0000 7f5c69337700 1 -- 172.21.15.173:0/263635328 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55bb68129b80 con 0x55bb68447000 2024-09-13T23:57:00.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.146+0000 7f5c69337700 1 --2- 172.21.15.173:0/263635328 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bb68446800 0x55bb6850a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.146+0000 7f5c69337700 1 -- 172.21.15.173:0/263635328 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55bb680956c0 con 0x55bb68447000 2024-09-13T23:57:00.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.146+0000 7f5c85bb4f40 5 note: GC not initialized 2024-09-13T23:57:00.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.146+0000 7f5c84b6e700 1 --2- 172.21.15.173:0/263635328 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bb68446800 0x55bb6850a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.146+0000 7f5c84b6e700 1 --2- 172.21.15.173:0/263635328 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bb68446800 0x55bb6850a000 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55bb68401470 tx=0x55bb68388720 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.150+0000 7f5c66b32700 20 reqs_thread_entry: start 2024-09-13T23:57:00.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.150+0000 7f5c85bb4f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:00.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.150+0000 7f5c85bb4f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:00.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.150+0000 7f5c64b2e700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:30 2024 2024-09-13T23:57:00.155 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:00.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.150+0000 7f5c85bb4f40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:57:00.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.150+0000 7f5c6430c700 20 reqs_thread_entry: start 2024-09-13T23:57:00.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.150+0000 7f5c85bb4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.150+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb683d3c00 con 0x55bb683d2400 2024-09-13T23:57:00.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.150+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55bb68458b40 con 0x55bb683d2400 2024-09-13T23:57:00.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.150+0000 7f5c85bb4f40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:57:00.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.150+0000 7f5c85bb4f40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:57:00.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.150+0000 7f5c85bb4f40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:00.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.150+0000 7f5c85bb4f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:00.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.150+0000 7f5c85bb4f40 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T23:57:00.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.150+0000 7f5c85bb4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.150+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb6846a800 con 0x55bb68446000 2024-09-13T23:57:00.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.150+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x55bb68459440 con 0x55bb68446000 2024-09-13T23:57:00.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.150+0000 7f5c85bb4f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.150+0000 7f5c85bb4f40 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T23:57:00.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.150+0000 7f5c85bb4f40 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:57:00.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.150+0000 7f5c85bb4f40 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T23:57:00.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.150+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~459 in=459b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb6846ac00 con 0x55bb683d2400 2024-09-13T23:57:00.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.154+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~459] v33'4 uv4 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x55bb68458b40 con 0x55bb683d2400 2024-09-13T23:57:00.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.154+0000 7f5c85bb4f40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:57:00.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.154+0000 7f5c85bb4f40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:00.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.154+0000 7f5c85bb4f40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:57:00.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.154+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94263396747520 in=647b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb6846a400 con 0x55bb683d2c00 2024-09-13T23:57:00.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.154+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== watch-notify(notify (1) cookie 94263395273984 notify 141733920771 ret 0) v3 ==== 677+0+0 (crc 0 0 0) 0x55bb680416c0 con 0x55bb683d2c00 2024-09-13T23:57:00.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.154+0000 7f5c7eb62700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920771 cookie 94263395273984 notifier 4360 bl.length()=635 2024-09-13T23:57:00.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.154+0000 7f5c7eb62700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:57:00.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.154+0000 7f5c7eb62700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:00.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.154+0000 7f5c7eb62700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb6857c000 con 0x55bb683d2c00 2024-09-13T23:57:00.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.154+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(65 notify.4 [notify cookie 94263396747520 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55bb68459200 con 0x55bb683d2c00 2024-09-13T23:57:00.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.154+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68459200 con 0x55bb683d2c00 2024-09-13T23:57:00.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.154+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== watch-notify(notify_complete (2) cookie 94263396747520 notify 141733920771 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55bb68041d40 con 0x55bb683d2c00 2024-09-13T23:57:00.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.154+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb68447400 con 0x55bb68446000 2024-09-13T23:57:00.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.158+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55bb68459440 con 0x55bb68446000 2024-09-13T23:57:00.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.158+0000 7f5c85bb4f40 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T23:57:00.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.158+0000 7f5c85bb4f40 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:57:00.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.158+0000 7f5c85bb4f40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T23:57:00.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.158+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94263396747520 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb68447800 con 0x55bb683d2c00 2024-09-13T23:57:00.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.158+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== watch-notify(notify (1) cookie 94263395271680 notify 141733920772 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55bb68041d40 con 0x55bb683d2c00 2024-09-13T23:57:00.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.158+0000 7f5c7e361700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920772 cookie 94263395271680 notifier 4360 bl.length()=177 2024-09-13T23:57:00.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.158+0000 7f5c7e361700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T23:57:00.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.158+0000 7f5c7e361700 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:57:00.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.158+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(68 notify.2 [notify cookie 94263396747520 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55bb68459200 con 0x55bb683d2c00 2024-09-13T23:57:00.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.158+0000 7f5c7e361700 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb6857c800 con 0x55bb683d2c00 2024-09-13T23:57:00.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.158+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68459200 con 0x55bb683d2c00 2024-09-13T23:57:00.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.158+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== watch-notify(notify_complete (2) cookie 94263396747520 notify 141733920772 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55bb68041ba0 con 0x55bb683d2c00 2024-09-13T23:57:00.164 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:00.164 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "foo", 2024-09-13T23:57:00.164 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Foo", 2024-09-13T23:57:00.164 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "foo@foo.com", 2024-09-13T23:57:00.164 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:57:00.164 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:57:00.164 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [], 2024-09-13T23:57:00.164 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:57:00.165 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:00.165 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:57:00.165 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-09-13T23:57:00.165 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-09-13T23:57:00.165 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:00.165 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:00.165 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:57:00.165 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "p5YnriCv1nAtykxBrupQ", 2024-09-13T23:57:00.165 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh" 2024-09-13T23:57:00.165 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:00.165 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:00.165 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [], 2024-09-13T23:57:00.165 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:57:00.165 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:57:00.166 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:57:00.166 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:57:00.166 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:57:00.166 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:57:00.166 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:00.166 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:00.166 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:00.166 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:00.166 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:00.166 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:00.166 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:57:00.166 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:00.166 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:00.166 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:00.166 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:00.167 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:00.167 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:00.167 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:57:00.167 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:57:00.167 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:57:00.167 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:00.167 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:57:00.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.158+0000 7f5c6b33b700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:00.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.158+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94263396745216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb6857c000 con 0x55bb683d2400 2024-09-13T23:57:00.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.162+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94263396745216] v33'65 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55bb68458b40 con 0x55bb683d2400 2024-09-13T23:57:00.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.162+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94263395269376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb6857c800 con 0x55bb683d2c00 2024-09-13T23:57:00.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.166+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94263395269376] v33'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68459200 con 0x55bb683d2c00 2024-09-13T23:57:00.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.166+0000 7f5c85bb4f40 20 remove_watcher() i=0 2024-09-13T23:57:00.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.166+0000 7f5c85bb4f40 2 removed watcher, disabling cache 2024-09-13T23:57:00.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.166+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94263395270528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb6857cc00 con 0x55bb683d2400 2024-09-13T23:57:00.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.166+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94263395270528] v33'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68458b40 con 0x55bb683d2400 2024-09-13T23:57:00.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.166+0000 7f5c85bb4f40 20 remove_watcher() i=1 2024-09-13T23:57:00.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.166+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94263395271680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb6857d000 con 0x55bb683d2c00 2024-09-13T23:57:00.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.170+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 27 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94263395271680] v33'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68459200 con 0x55bb683d2c00 2024-09-13T23:57:00.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.170+0000 7f5c85bb4f40 20 remove_watcher() i=2 2024-09-13T23:57:00.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.170+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94263395272832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb6857d400 con 0x55bb68446400 2024-09-13T23:57:00.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.170+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94263395272832] v33'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68458b40 con 0x55bb68446400 2024-09-13T23:57:00.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.170+0000 7f5c85bb4f40 20 remove_watcher() i=3 2024-09-13T23:57:00.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.170+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94263395273984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb6857d800 con 0x55bb683d2c00 2024-09-13T23:57:00.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.174+0000 7f5c8436d700 1 -- 172.21.15.173:0/160140266 <== osd.0 v2:172.21.15.87:6800/3507919120 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94263395273984] v33'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68459200 con 0x55bb683d2c00 2024-09-13T23:57:00.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.174+0000 7f5c85bb4f40 20 remove_watcher() i=4 2024-09-13T23:57:00.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.174+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94263395275136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb6857dc00 con 0x55bb68446000 2024-09-13T23:57:00.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.174+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94263395275136] v33'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68459440 con 0x55bb68446000 2024-09-13T23:57:00.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.174+0000 7f5c85bb4f40 20 remove_watcher() i=5 2024-09-13T23:57:00.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.174+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94263395276288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb68447800 con 0x55bb68446000 2024-09-13T23:57:00.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94263395276288] v33'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68459440 con 0x55bb68446000 2024-09-13T23:57:00.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c85bb4f40 20 remove_watcher() i=6 2024-09-13T23:57:00.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94263395277440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bb6846b000 con 0x55bb68446400 2024-09-13T23:57:00.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c84b6e700 1 -- 172.21.15.173:0/160140266 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94263395277440] v33'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bb68458b40 con 0x55bb68446400 2024-09-13T23:57:00.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c85bb4f40 20 remove_watcher() i=7 2024-09-13T23:57:00.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55bb683d2c00 msgr2=0x55bb68316100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/160140266 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55bb683d2c00 0x55bb68316100 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55bb683d2400 msgr2=0x55bb68315b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/160140266 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55bb683d2400 0x55bb68315b80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55bb68446400 msgr2=0x55bb68314580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/160140266 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55bb68446400 0x55bb68314580 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55bb68446000 msgr2=0x55bb68316c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/160140266 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55bb68446000 0x55bb68316c00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bb683d3800 msgr2=0x55bb68316680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/160140266 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bb683d3800 0x55bb68316680 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55bb683bfbc0 tx=0x55bb68389860 comp rx=0 tx=0).stop 2024-09-13T23:57:00.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb683d2000 msgr2=0x55bb68315600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c83b6c700 1 -- 172.21.15.173:0/160140266 reap_dead start 2024-09-13T23:57:00.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/160140266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb683d2000 0x55bb68315600 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55bb68ea3170 tx=0x55bb68388a80 comp rx=0 tx=0).stop 2024-09-13T23:57:00.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 shutdown_connections 2024-09-13T23:57:00.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/160140266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb683d2000 0x55bb68315600 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 >> 172.21.15.173:0/160140266 conn(0x55bb6802f800 msgr2=0x55bb6812f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 shutdown_connections 2024-09-13T23:57:00.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/160140266 wait complete. 2024-09-13T23:57:00.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/263635328 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bb68446800 msgr2=0x55bb6850a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/263635328 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bb68446800 0x55bb6850a000 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55bb68401470 tx=0x55bb68388720 comp rx=0 tx=0).stop 2024-09-13T23:57:00.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/263635328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb68447000 msgr2=0x55bb68317180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.178+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/263635328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb68447000 0x55bb68317180 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55bb684788d0 tx=0x55bb68389980 comp rx=0 tx=0).stop 2024-09-13T23:57:00.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.182+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/263635328 shutdown_connections 2024-09-13T23:57:00.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.182+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/263635328 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bb68446800 0x55bb6850a000 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.182+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/263635328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb68447000 0x55bb68317180 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.182+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/263635328 >> 172.21.15.173:0/263635328 conn(0x55bb68446c00 msgr2=0x55bb68130000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.182+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/263635328 shutdown_connections 2024-09-13T23:57:00.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.182+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/263635328 wait complete. 2024-09-13T23:57:00.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.182+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/1403105782 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bb6802fc00 msgr2=0x55bb68315080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.182+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/1403105782 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bb6802fc00 0x55bb68315080 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x55bb68ea2360 tx=0x55bb68388780 comp rx=0 tx=0).stop 2024-09-13T23:57:00.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.182+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/1403105782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb6802f400 msgr2=0x55bb68314b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.182+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/1403105782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb6802f400 0x55bb68314b00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55bb68e93680 tx=0x55bb68133920 comp rx=0 tx=0).stop 2024-09-13T23:57:00.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.182+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/1403105782 shutdown_connections 2024-09-13T23:57:00.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.182+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/1403105782 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bb6802fc00 0x55bb68315080 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.182+0000 7f5c85bb4f40 1 --2- 172.21.15.173:0/1403105782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bb6802f400 0x55bb68314b00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.182+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/1403105782 >> 172.21.15.173:0/1403105782 conn(0x55bb6802ec00 msgr2=0x55bb6812f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.182+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/1403105782 shutdown_connections 2024-09-13T23:57:00.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.182+0000 7f5c85bb4f40 1 -- 172.21.15.173:0/1403105782 wait complete. 2024-09-13T23:57:00.190 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:57:00.191 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:57:00.191 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:57:00.191 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:57:00.226 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:00.226 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:00.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.222+0000 7f5b80824f40 1 Processor -- start 2024-09-13T23:57:00.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.222+0000 7f5b80824f40 1 -- start start 2024-09-13T23:57:00.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.222+0000 7f5b80824f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55f3a65cd400 0x55f3a68b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.222+0000 7f5b80824f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f3a6691500 con 0x55f3a65cd000 2024-09-13T23:57:00.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.222+0000 7f5b80824f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f3a665aa00 con 0x55f3a65cd400 2024-09-13T23:57:00.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.222+0000 7f5b7efdd700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55f3a65cd000 0x55f3a66cc800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:57922/0 (socket says 172.21.15.173:57922) 2024-09-13T23:57:00.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.222+0000 7f5b7e7dc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55f3a65cd400 0x55f3a68b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.222+0000 7f5b7efdd700 1 -- 172.21.15.173:0/3958087193 learned_addr learned my addr 172.21.15.173:0/3958087193 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:00.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.222+0000 7f5b7dfdb700 1 -- 172.21.15.173:0/3958087193 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1041951502 0 0) 0x55f3a6728000 con 0x55f3a65cd000 2024-09-13T23:57:00.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.222+0000 7f5b7dfdb700 1 -- 172.21.15.173:0/3958087193 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x55f3a6691680 con 0x55f3a65cd000 2024-09-13T23:57:00.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.222+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/3958087193 >> v1:172.21.15.87:6789/0 conn(0x55f3a65cd000 legacy=0x55f3a66cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.222+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/3958087193 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3a65dfd40 con 0x55f3a65cd400 2024-09-13T23:57:00.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.222+0000 7f5b7e7dc700 1 --2- 172.21.15.173:0/3958087193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd400 0x55f3a68b2580 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55f3a68ad920 tx=0x55f3a66d1980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb440e2fd4f3b5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.222+0000 7f5b7dfdb700 1 -- 172.21.15.173:0/3958087193 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f3a66714a0 con 0x55f3a65cd400 2024-09-13T23:57:00.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.222+0000 7f5b7dfdb700 1 -- 172.21.15.173:0/3958087193 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f3a6691500 con 0x55f3a65cd400 2024-09-13T23:57:00.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.222+0000 7f5b7dfdb700 1 -- 172.21.15.173:0/3958087193 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f3a6671600 con 0x55f3a65cd400 2024-09-13T23:57:00.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b80824f40 1 -- 172.21.15.173:0/3958087193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd400 msgr2=0x55f3a68b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b80824f40 1 --2- 172.21.15.173:0/3958087193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd400 0x55f3a68b2580 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55f3a68ad920 tx=0x55f3a66d1980 comp rx=0 tx=0).stop 2024-09-13T23:57:00.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b80824f40 1 -- 172.21.15.173:0/3958087193 shutdown_connections 2024-09-13T23:57:00.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b80824f40 1 --2- 172.21.15.173:0/3958087193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd400 0x55f3a68b2580 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b80824f40 1 -- 172.21.15.173:0/3958087193 >> 172.21.15.173:0/3958087193 conn(0x55f3a65ccc00 msgr2=0x55f3a66cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b80824f40 1 -- 172.21.15.173:0/3958087193 shutdown_connections 2024-09-13T23:57:00.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b80824f40 1 -- 172.21.15.173:0/3958087193 wait complete. 2024-09-13T23:57:00.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b80824f40 1 Processor -- start 2024-09-13T23:57:00.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b80824f40 1 -- start start 2024-09-13T23:57:00.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b80824f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd000 0x55f3a68b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b80824f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3a665a500 con 0x55f3a65cd000 2024-09-13T23:57:00.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b7efdd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd000 0x55f3a68b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b7efdd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd000 0x55f3a68b2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58836/0 (socket says 172.21.15.173:58836) 2024-09-13T23:57:00.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b7efdd700 1 -- 172.21.15.173:0/3073352156 learned_addr learned my addr 172.21.15.173:0/3073352156 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b7efdd700 1 -- 172.21.15.173:0/3073352156 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3a65dfba0 con 0x55f3a65cd000 2024-09-13T23:57:00.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b7efdd700 1 --2- 172.21.15.173:0/3073352156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd000 0x55f3a68b2580 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55f3a7397d70 tx=0x55f3a66d1b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422a78b6dc0d512 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b7d7da700 1 -- 172.21.15.173:0/3073352156 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f3a66714a0 con 0x55f3a65cd000 2024-09-13T23:57:00.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b7d7da700 1 -- 172.21.15.173:0/3073352156 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f3a6691b00 con 0x55f3a65cd000 2024-09-13T23:57:00.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b7d7da700 1 -- 172.21.15.173:0/3073352156 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f3a6671600 con 0x55f3a65cd000 2024-09-13T23:57:00.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b80824f40 1 -- 172.21.15.173:0/3073352156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd000 msgr2=0x55f3a68b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b80824f40 1 --2- 172.21.15.173:0/3073352156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd000 0x55f3a68b2580 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55f3a7397d70 tx=0x55f3a66d1b60 comp rx=0 tx=0).stop 2024-09-13T23:57:00.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b80824f40 1 -- 172.21.15.173:0/3073352156 shutdown_connections 2024-09-13T23:57:00.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b80824f40 1 --2- 172.21.15.173:0/3073352156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd000 0x55f3a68b2580 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b80824f40 1 -- 172.21.15.173:0/3073352156 >> 172.21.15.173:0/3073352156 conn(0x55f3a65ccc00 msgr2=0x55f3a66cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b80824f40 1 -- 172.21.15.173:0/3073352156 shutdown_connections 2024-09-13T23:57:00.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b80824f40 1 -- 172.21.15.173:0/3073352156 wait complete. 2024-09-13T23:57:00.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b80824f40 1 Processor -- start 2024-09-13T23:57:00.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b80824f40 1 -- start start 2024-09-13T23:57:00.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b80824f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd000 0x55f3a68b2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.226+0000 7f5b80824f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3a665a3c0 con 0x55f3a65cd000 2024-09-13T23:57:00.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.230+0000 7f5b7efdd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd000 0x55f3a68b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.230+0000 7f5b7efdd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd000 0x55f3a68b2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58844/0 (socket says 172.21.15.173:58844) 2024-09-13T23:57:00.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.230+0000 7f5b7efdd700 1 -- 172.21.15.173:0/3836187598 learned_addr learned my addr 172.21.15.173:0/3836187598 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.230+0000 7f5b7efdd700 1 -- 172.21.15.173:0/3836187598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3a65dfa00 con 0x55f3a65cd000 2024-09-13T23:57:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.230+0000 7f5b7efdd700 1 --2- 172.21.15.173:0/3836187598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd000 0x55f3a68b2580 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55f3a7397e60 tx=0x55f3a66d1920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.230+0000 7f5b7bfd7700 1 -- 172.21.15.173:0/3836187598 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f3a66718c0 con 0x55f3a65cd000 2024-09-13T23:57:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.230+0000 7f5b7bfd7700 1 -- 172.21.15.173:0/3836187598 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f3a6691c80 con 0x55f3a65cd000 2024-09-13T23:57:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.230+0000 7f5b80824f40 1 -- 172.21.15.173:0/3836187598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f3a65df860 con 0x55f3a65cd000 2024-09-13T23:57:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.230+0000 7f5b7bfd7700 1 -- 172.21.15.173:0/3836187598 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f3a66714a0 con 0x55f3a65cd000 2024-09-13T23:57:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.230+0000 7f5b80824f40 1 -- 172.21.15.173:0/3836187598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f3a65df6c0 con 0x55f3a65cd000 2024-09-13T23:57:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.230+0000 7f5b80824f40 1 Processor -- start 2024-09-13T23:57:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.230+0000 7f5b80824f40 1 -- start start 2024-09-13T23:57:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.230+0000 7f5b80824f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd800 0x55f3a68b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.230+0000 7f5b80824f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3a665a000 con 0x55f3a65cd800 2024-09-13T23:57:00.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.230+0000 7f5b7f7de700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd800 0x55f3a68b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.230+0000 7f5b7bfd7700 1 -- 172.21.15.173:0/3836187598 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55f3a66c6b00 con 0x55f3a65cd000 2024-09-13T23:57:00.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.230+0000 7f5b7f7de700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd800 0x55f3a68b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58850/0 (socket says 172.21.15.173:58850) 2024-09-13T23:57:00.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.230+0000 7f5b7f7de700 1 -- 172.21.15.173:0/2540437663 learned_addr learned my addr 172.21.15.173:0/2540437663 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.230+0000 7f5b7bfd7700 1 --2- 172.21.15.173:0/3836187598 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f3a696e000 0x55f3a68b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.230+0000 7f5b7bfd7700 1 -- 172.21.15.173:0/3836187598 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55f3a6633180 con 0x55f3a65cd000 2024-09-13T23:57:00.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.230+0000 7f5b7efdd700 1 --2- 172.21.15.173:0/3836187598 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f3a696e000 0x55f3a68b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.230+0000 7f5b7f7de700 1 -- 172.21.15.173:0/2540437663 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3a65de000 con 0x55f3a65cd800 2024-09-13T23:57:00.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.230+0000 7f5b7f7de700 1 --2- 172.21.15.173:0/2540437663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd800 0x55f3a68b2b00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55f3a68fd200 tx=0x55f3a692ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23b98fc6485e071 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.230+0000 7f5b7efdd700 1 --2- 172.21.15.173:0/3836187598 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f3a696e000 0x55f3a68b3080 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55f3a68fcff0 tx=0x55f3a692c2a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b797d2700 1 -- 172.21.15.173:0/2540437663 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f3a66718c0 con 0x55f3a65cd800 2024-09-13T23:57:00.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b797d2700 1 -- 172.21.15.173:0/2540437663 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f3a6986000 con 0x55f3a65cd800 2024-09-13T23:57:00.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b797d2700 1 -- 172.21.15.173:0/2540437663 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f3a66714a0 con 0x55f3a65cd800 2024-09-13T23:57:00.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b80824f40 1 -- 172.21.15.173:0/2540437663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd800 msgr2=0x55f3a68b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b80824f40 1 --2- 172.21.15.173:0/2540437663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd800 0x55f3a68b2b00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55f3a68fd200 tx=0x55f3a692ca20 comp rx=0 tx=0).stop 2024-09-13T23:57:00.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b80824f40 1 -- 172.21.15.173:0/2540437663 shutdown_connections 2024-09-13T23:57:00.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b80824f40 1 --2- 172.21.15.173:0/2540437663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd800 0x55f3a68b2b00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b80824f40 1 -- 172.21.15.173:0/2540437663 >> 172.21.15.173:0/2540437663 conn(0x55f3a65cd400 msgr2=0x55f3a66cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b80824f40 1 -- 172.21.15.173:0/2540437663 shutdown_connections 2024-09-13T23:57:00.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b80824f40 1 -- 172.21.15.173:0/2540437663 wait complete. 2024-09-13T23:57:00.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b80824f40 1 Processor -- start 2024-09-13T23:57:00.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b80824f40 1 -- start start 2024-09-13T23:57:00.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b80824f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd800 0x55f3a68b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b80824f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3a65f2640 con 0x55f3a65cd800 2024-09-13T23:57:00.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b7f7de700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd800 0x55f3a68b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b7f7de700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd800 0x55f3a68b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58860/0 (socket says 172.21.15.173:58860) 2024-09-13T23:57:00.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 learned_addr learned my addr 172.21.15.173:0/1145537389 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3a65deea0 con 0x55f3a65cd800 2024-09-13T23:57:00.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b7f7de700 1 --2- 172.21.15.173:0/1145537389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd800 0x55f3a68b2b00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55f3a7397f80 tx=0x55f3a692c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b77fcf700 1 -- 172.21.15.173:0/1145537389 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f3a6671b80 con 0x55f3a65cd800 2024-09-13T23:57:00.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f3a65de820 con 0x55f3a65cd800 2024-09-13T23:57:00.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f3a65de9c0 con 0x55f3a65cd800 2024-09-13T23:57:00.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b77fcf700 1 -- 172.21.15.173:0/1145537389 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f3a6986180 con 0x55f3a65cd800 2024-09-13T23:57:00.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b77fcf700 1 -- 172.21.15.173:0/1145537389 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f3a66718c0 con 0x55f3a65cd800 2024-09-13T23:57:00.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.234+0000 7f5b80824f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b77fcf700 1 -- 172.21.15.173:0/1145537389 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55f3a66c6dc0 con 0x55f3a65cd800 2024-09-13T23:57:00.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b77fcf700 1 --2- 172.21.15.173:0/1145537389 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f3a696ec00 0x55f3a68b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b77fcf700 1 -- 172.21.15.173:0/1145537389 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55f3a6633340 con 0x55f3a65cd800 2024-09-13T23:57:00.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b80824f40 1 --2- 172.21.15.173:0/1145537389 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f3a696f000 0x55f3a68b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b7e7dc700 1 --2- 172.21.15.173:0/1145537389 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f3a696ec00 0x55f3a68b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f400 con 0x55f3a696f000 2024-09-13T23:57:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b7f7de700 1 --2- 172.21.15.173:0/1145537389 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f3a696f000 0x55f3a68b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b7e7dc700 1 --2- 172.21.15.173:0/1145537389 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f3a696ec00 0x55f3a68b3600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55f3a68ad920 tx=0x55f3a66d1800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b7f7de700 1 --2- 172.21.15.173:0/1145537389 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f3a696f000 0x55f3a68b3b80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a696f000 2024-09-13T23:57:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b80824f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b80824f40 20 realm 2024-09-13T23:57:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b80824f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696f000 2024-09-13T23:57:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a696f000 2024-09-13T23:57:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b80824f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b80824f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b80824f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696fc00 con 0x55f3a696f000 2024-09-13T23:57:00.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a696f000 2024-09-13T23:57:00.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b80824f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b80824f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b80824f40 1 --2- 172.21.15.173:0/1145537389 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f3a696f400 0x55f3a68b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696f400 2024-09-13T23:57:00.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b7efdd700 1 --2- 172.21.15.173:0/1145537389 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f3a696f400 0x55f3a68b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.238+0000 7f5b7efdd700 1 --2- 172.21.15.173:0/1145537389 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f3a696f400 0x55f3a68b4100 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.242+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55f3a69ff200 con 0x55f3a696f400 2024-09-13T23:57:00.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.242+0000 7f5b80824f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:00.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.242+0000 7f5b80824f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.242+0000 7f5b80824f40 1 --2- 172.21.15.173:0/1145537389 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f3a696fc00 0x55f3a68b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.242+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a2c000 con 0x55f3a696fc00 2024-09-13T23:57:00.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.242+0000 7f5b7e7dc700 1 --2- 172.21.15.173:0/1145537389 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f3a696fc00 0x55f3a68b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.242+0000 7f5b7e7dc700 1 --2- 172.21.15.173:0/1145537389 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f3a696fc00 0x55f3a68b4680 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.242+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1145537389 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55f3a69ff440 con 0x55f3a696fc00 2024-09-13T23:57:00.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.242+0000 7f5b80824f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:00.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.242+0000 7f5b80824f40 20 searching for the correct realm 2024-09-13T23:57:00.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.242+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a2c400 con 0x55f3a696fc00 2024-09-13T23:57:00.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.242+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1145537389 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55f3a69ff440 con 0x55f3a696fc00 2024-09-13T23:57:00.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.242+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a2c000 con 0x55f3a696f400 2024-09-13T23:57:00.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.242+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69ff200 con 0x55f3a696f400 2024-09-13T23:57:00.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.242+0000 7f5b7efdd700 1 --2- 172.21.15.173:0/1145537389 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f3a6a2c000 0x55f3a68b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.242+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a6a2c000 2024-09-13T23:57:00.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.242+0000 7f5b7f7de700 1 --2- 172.21.15.173:0/1145537389 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f3a6a2c000 0x55f3a68b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.242+0000 7f5b7f7de700 1 --2- 172.21.15.173:0/1145537389 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f3a6a2c000 0x55f3a68b4c00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.246+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a6a2c000 2024-09-13T23:57:00.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.246+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696f000 2024-09-13T23:57:00.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.246+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a696f000 2024-09-13T23:57:00.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.246+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696f000 2024-09-13T23:57:00.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.246+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a696f000 2024-09-13T23:57:00.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.246+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696fc00 2024-09-13T23:57:00.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.246+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1145537389 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69ff440 con 0x55f3a696fc00 2024-09-13T23:57:00.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.246+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696f000 2024-09-13T23:57:00.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.246+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a696f000 2024-09-13T23:57:00.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.246+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696f400 2024-09-13T23:57:00.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.246+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69ff200 con 0x55f3a696f400 2024-09-13T23:57:00.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.246+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696f400 2024-09-13T23:57:00.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.246+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69ff200 con 0x55f3a696f400 2024-09-13T23:57:00.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.246+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696f000 2024-09-13T23:57:00.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.246+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a696f000 2024-09-13T23:57:00.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.246+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a6a2c000 2024-09-13T23:57:00.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.246+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a6a2c000 2024-09-13T23:57:00.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.246+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696f000 2024-09-13T23:57:00.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.250+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a696f000 2024-09-13T23:57:00.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.250+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a6a2c000 2024-09-13T23:57:00.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.250+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a6a2c000 2024-09-13T23:57:00.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.250+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696f400 2024-09-13T23:57:00.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.250+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69ff200 con 0x55f3a696f400 2024-09-13T23:57:00.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.250+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696fc00 2024-09-13T23:57:00.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.250+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1145537389 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69ff440 con 0x55f3a696fc00 2024-09-13T23:57:00.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.250+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696f000 2024-09-13T23:57:00.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.250+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a696f000 2024-09-13T23:57:00.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.250+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696f400 2024-09-13T23:57:00.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.250+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69ff200 con 0x55f3a696f400 2024-09-13T23:57:00.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.250+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696fc00 2024-09-13T23:57:00.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.250+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1145537389 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69ff440 con 0x55f3a696fc00 2024-09-13T23:57:00.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.250+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696f000 2024-09-13T23:57:00.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.250+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a696f000 2024-09-13T23:57:00.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.250+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696f000 2024-09-13T23:57:00.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.250+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a696f000 2024-09-13T23:57:00.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.250+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696f000 2024-09-13T23:57:00.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.254+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a696f000 2024-09-13T23:57:00.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.254+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696fc00 2024-09-13T23:57:00.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.254+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1145537389 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69ff440 con 0x55f3a696fc00 2024-09-13T23:57:00.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.254+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a6a2c000 2024-09-13T23:57:00.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.254+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a6a2c000 2024-09-13T23:57:00.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.254+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696f000 2024-09-13T23:57:00.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.254+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a696f000 2024-09-13T23:57:00.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.254+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a6a2c000 2024-09-13T23:57:00.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.254+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a6a2c000 2024-09-13T23:57:00.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.254+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696fc00 2024-09-13T23:57:00.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.254+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1145537389 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69ff440 con 0x55f3a696fc00 2024-09-13T23:57:00.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.254+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a6a2c000 2024-09-13T23:57:00.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.254+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a6a2c000 2024-09-13T23:57:00.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.254+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696f400 2024-09-13T23:57:00.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.258+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69ff200 con 0x55f3a696f400 2024-09-13T23:57:00.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.258+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696f400 2024-09-13T23:57:00.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.258+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69ff200 con 0x55f3a696f400 2024-09-13T23:57:00.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.258+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696fc00 2024-09-13T23:57:00.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.258+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1145537389 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69ff440 con 0x55f3a696fc00 2024-09-13T23:57:00.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.258+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696f400 2024-09-13T23:57:00.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.258+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55f3a69ff200 con 0x55f3a696f400 2024-09-13T23:57:00.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.258+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a696f400 2024-09-13T23:57:00.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.258+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f3a69ff200 con 0x55f3a696f400 2024-09-13T23:57:00.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.258+0000 7f5b80824f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:00.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.258+0000 7f5b80824f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:00.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.258+0000 7f5b80824f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:00.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.258+0000 7f5b80824f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:00.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.258+0000 7f5b80824f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.258+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a2c800 con 0x55f3a696f000 2024-09-13T23:57:00.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.258+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a696f000 2024-09-13T23:57:00.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.258+0000 7f5b80824f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.258+0000 7f5b80824f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.258+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a2cc00 con 0x55f3a696f400 2024-09-13T23:57:00.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.258+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55f3a69ff200 con 0x55f3a696f400 2024-09-13T23:57:00.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.258+0000 7f5b80824f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:00.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.258+0000 7f5b80824f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.258+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a2d000 con 0x55f3a696f000 2024-09-13T23:57:00.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.262+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a696f000 2024-09-13T23:57:00.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.262+0000 7f5b80824f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.262+0000 7f5b80824f40 20 zone default found 2024-09-13T23:57:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.262+0000 7f5b80824f40 4 Realm: () 2024-09-13T23:57:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.262+0000 7f5b80824f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.262+0000 7f5b80824f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.262+0000 7f5b80824f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.262+0000 7f5b80824f40 20 zonegroup default 2024-09-13T23:57:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.262+0000 7f5b80824f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.262+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a2d400 con 0x55f3a6a2c000 2024-09-13T23:57:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.262+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a6a2c000 2024-09-13T23:57:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.262+0000 7f5b80824f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.262+0000 7f5b80824f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.262+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a2d800 con 0x55f3a696fc00 2024-09-13T23:57:00.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.262+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1145537389 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55f3a69ff440 con 0x55f3a696fc00 2024-09-13T23:57:00.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.262+0000 7f5b80824f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.262+0000 7f5b80824f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.262+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a2dc00 con 0x55f3a696fc00 2024-09-13T23:57:00.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.262+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1145537389 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55f3a69ff440 con 0x55f3a696fc00 2024-09-13T23:57:00.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.262+0000 7f5b80824f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.262+0000 7f5b80824f40 20 started sync module instance, tier type = 2024-09-13T23:57:00.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.262+0000 7f5b80824f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:00.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.262+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a36000 con 0x55f3a696f400 2024-09-13T23:57:00.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.266+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f3a69ff200 con 0x55f3a696f400 2024-09-13T23:57:00.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.266+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94504959515392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a36400 con 0x55f3a696f400 2024-09-13T23:57:00.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.266+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a36800 con 0x55f3a696f000 2024-09-13T23:57:00.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.266+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94504959515392] v33'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f3a69ff200 con 0x55f3a696f400 2024-09-13T23:57:00.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.266+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a696f000 2024-09-13T23:57:00.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.266+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94504959516544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a36c00 con 0x55f3a696f000 2024-09-13T23:57:00.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.266+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a37000 con 0x55f3a696f400 2024-09-13T23:57:00.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.270+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f3a69ff200 con 0x55f3a696f400 2024-09-13T23:57:00.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.270+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94504959517696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a37400 con 0x55f3a696f400 2024-09-13T23:57:00.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.270+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94504959516544] v33'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a696f000 2024-09-13T23:57:00.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.270+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a37800 con 0x55f3a6a2c000 2024-09-13T23:57:00.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.270+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94504959517696] v33'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f3a69ff200 con 0x55f3a696f400 2024-09-13T23:57:00.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.270+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a6a2c000 2024-09-13T23:57:00.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.270+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94504959518848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a37c00 con 0x55f3a6a2c000 2024-09-13T23:57:00.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.270+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a36800 con 0x55f3a696f400 2024-09-13T23:57:00.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.274+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94504959518848] v33'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a6a2c000 2024-09-13T23:57:00.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.274+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f3a69ff200 con 0x55f3a696f400 2024-09-13T23:57:00.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.274+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94504959520000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a36000 con 0x55f3a696f400 2024-09-13T23:57:00.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.274+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a2c800 con 0x55f3a696fc00 2024-09-13T23:57:00.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.278+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1145537389 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f3a69ff440 con 0x55f3a696fc00 2024-09-13T23:57:00.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.278+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94504959521152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a2d000 con 0x55f3a696fc00 2024-09-13T23:57:00.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.278+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a2d400 con 0x55f3a696fc00 2024-09-13T23:57:00.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.278+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94504959520000] v33'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f3a69ff200 con 0x55f3a696f400 2024-09-13T23:57:00.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.278+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1145537389 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94504959521152] v33'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f3a69ff440 con 0x55f3a696fc00 2024-09-13T23:57:00.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.278+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1145537389 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f3a69ff440 con 0x55f3a696fc00 2024-09-13T23:57:00.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.278+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94504959522304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a2cc00 con 0x55f3a696fc00 2024-09-13T23:57:00.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.278+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a696f800 con 0x55f3a6a2c000 2024-09-13T23:57:00.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.282+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1145537389 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94504959522304] v33'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f3a69ff440 con 0x55f3a696fc00 2024-09-13T23:57:00.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.282+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a6a2c000 2024-09-13T23:57:00.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.282+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94504959523456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a36400 con 0x55f3a6a2c000 2024-09-13T23:57:00.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.282+0000 7f5b80824f40 20 add_watcher() i=0 2024-09-13T23:57:00.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.282+0000 7f5b80824f40 20 add_watcher() i=1 2024-09-13T23:57:00.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.282+0000 7f5b80824f40 20 add_watcher() i=2 2024-09-13T23:57:00.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.282+0000 7f5b80824f40 20 add_watcher() i=3 2024-09-13T23:57:00.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.282+0000 7f5b80824f40 20 add_watcher() i=4 2024-09-13T23:57:00.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.282+0000 7f5b80824f40 20 add_watcher() i=5 2024-09-13T23:57:00.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.282+0000 7f5b80824f40 20 add_watcher() i=6 2024-09-13T23:57:00.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.286+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94504959523456] v33'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a6a2c000 2024-09-13T23:57:00.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.286+0000 7f5b80824f40 20 add_watcher() i=7 2024-09-13T23:57:00.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.286+0000 7f5b80824f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:00.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.286+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a37000 con 0x55f3a696f000 2024-09-13T23:57:00.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.286+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a696f000 2024-09-13T23:57:00.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.286+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94504961163264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a37400 con 0x55f3a696f000 2024-09-13T23:57:00.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.290+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94504961163264] v33'66 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a696f000 2024-09-13T23:57:00.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.290+0000 7f5b65fab700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:00.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.290+0000 7f5b80824f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:00.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.290+0000 7f5b80824f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:00.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.290+0000 7f5b80824f40 1 Processor -- start 2024-09-13T23:57:00.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.290+0000 7f5b80824f40 1 -- start start 2024-09-13T23:57:00.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.290+0000 7f5b80824f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a6a2c400 0x55f3a68b5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.290+0000 7f5b80824f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3a65f2780 con 0x55f3a6a2c400 2024-09-13T23:57:00.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.290+0000 7f5b7e7dc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a6a2c400 0x55f3a68b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.290+0000 7f5b7e7dc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a6a2c400 0x55f3a68b5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58874/0 (socket says 172.21.15.173:58874) 2024-09-13T23:57:00.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.290+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/2841824386 learned_addr learned my addr 172.21.15.173:0/2841824386 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.290+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/2841824386 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3a65deb60 con 0x55f3a6a2c400 2024-09-13T23:57:00.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.290+0000 7f5b7e7dc700 1 --2- 172.21.15.173:0/2841824386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a6a2c400 0x55f3a68b5180 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55f3a6a460c0 tx=0x55f3a66d19e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d377e31d79e7013 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.290+0000 7f5b657aa700 1 -- 172.21.15.173:0/2841824386 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f3a6671760 con 0x55f3a6a2c400 2024-09-13T23:57:00.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.294+0000 7f5b657aa700 1 -- 172.21.15.173:0/2841824386 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f3a6986600 con 0x55f3a6a2c400 2024-09-13T23:57:00.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.294+0000 7f5b657aa700 1 -- 172.21.15.173:0/2841824386 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f3a6a4e000 con 0x55f3a6a2c400 2024-09-13T23:57:00.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.294+0000 7f5b80824f40 1 -- 172.21.15.173:0/2841824386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a6a2c400 msgr2=0x55f3a68b5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.294+0000 7f5b80824f40 1 --2- 172.21.15.173:0/2841824386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a6a2c400 0x55f3a68b5180 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55f3a6a460c0 tx=0x55f3a66d19e0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.294+0000 7f5b80824f40 1 -- 172.21.15.173:0/2841824386 shutdown_connections 2024-09-13T23:57:00.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.294+0000 7f5b80824f40 1 --2- 172.21.15.173:0/2841824386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a6a2c400 0x55f3a68b5180 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.294+0000 7f5b80824f40 1 -- 172.21.15.173:0/2841824386 >> 172.21.15.173:0/2841824386 conn(0x55f3a6a36800 msgr2=0x55f3a66ce000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.294+0000 7f5b80824f40 1 -- 172.21.15.173:0/2841824386 shutdown_connections 2024-09-13T23:57:00.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.294+0000 7f5b80824f40 1 -- 172.21.15.173:0/2841824386 wait complete. 2024-09-13T23:57:00.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.294+0000 7f5b80824f40 1 Processor -- start 2024-09-13T23:57:00.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.294+0000 7f5b80824f40 1 -- start start 2024-09-13T23:57:00.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.294+0000 7f5b80824f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a6a2c400 0x55f3a68b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.294+0000 7f5b80824f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3a665a000 con 0x55f3a6a2c400 2024-09-13T23:57:00.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.294+0000 7f5b7e7dc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a6a2c400 0x55f3a68b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.294+0000 7f5b7e7dc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a6a2c400 0x55f3a68b5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58878/0 (socket says 172.21.15.173:58878) 2024-09-13T23:57:00.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.294+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1156240645 learned_addr learned my addr 172.21.15.173:0/1156240645 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.294+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1156240645 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3a65ded00 con 0x55f3a6a2c400 2024-09-13T23:57:00.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.294+0000 7f5b7e7dc700 1 --2- 172.21.15.173:0/1156240645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a6a2c400 0x55f3a68b5180 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55f3a6a462d0 tx=0x55f3a692dc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.294+0000 7f5b63fa7700 1 -- 172.21.15.173:0/1156240645 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f3a6a4e160 con 0x55f3a6a2c400 2024-09-13T23:57:00.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.294+0000 7f5b63fa7700 1 -- 172.21.15.173:0/1156240645 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f3a6986300 con 0x55f3a6a2c400 2024-09-13T23:57:00.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.294+0000 7f5b80824f40 1 -- 172.21.15.173:0/1156240645 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f3a65de340 con 0x55f3a6a2c400 2024-09-13T23:57:00.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.294+0000 7f5b63fa7700 1 -- 172.21.15.173:0/1156240645 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f3a6a4e2c0 con 0x55f3a6a2c400 2024-09-13T23:57:00.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.294+0000 7f5b80824f40 1 -- 172.21.15.173:0/1156240645 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f3a65dfd40 con 0x55f3a6a2c400 2024-09-13T23:57:00.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.298+0000 7f5b63fa7700 1 -- 172.21.15.173:0/1156240645 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55f3a66c7b80 con 0x55f3a6a2c400 2024-09-13T23:57:00.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.298+0000 7f5b63fa7700 1 --2- 172.21.15.173:0/1156240645 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f3a696f800 0x55f3a6ac6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.298+0000 7f5b63fa7700 1 -- 172.21.15.173:0/1156240645 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55f3a6633500 con 0x55f3a6a2c400 2024-09-13T23:57:00.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.298+0000 7f5b7f7de700 1 --2- 172.21.15.173:0/1156240645 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f3a696f800 0x55f3a6ac6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.298+0000 7f5b80824f40 5 note: GC not initialized 2024-09-13T23:57:00.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.298+0000 7f5b7f7de700 1 --2- 172.21.15.173:0/1156240645 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f3a696f800 0x55f3a6ac6000 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55f3a69752c0 tx=0x55f3a6a8cae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.298+0000 7f5b80824f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:00.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.298+0000 7f5b617a2700 20 reqs_thread_entry: start 2024-09-13T23:57:00.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.298+0000 7f5b80824f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:00.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.298+0000 7f5b5f79e700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:30 2024 2024-09-13T23:57:00.305 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:00.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.302+0000 7f5b5ef7c700 20 reqs_thread_entry: start 2024-09-13T23:57:00.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.302+0000 7f5b80824f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.302+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a2c800 con 0x55f3a696f000 2024-09-13T23:57:00.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.302+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~459 out=459b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+582 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a696f000 2024-09-13T23:57:00.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.302+0000 7f5b80824f40 20 rados_obj.operate() r=0 bl.length=459 2024-09-13T23:57:00.306 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:00.306 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "foo", 2024-09-13T23:57:00.307 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Foo", 2024-09-13T23:57:00.307 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "foo@foo.com", 2024-09-13T23:57:00.307 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:57:00.307 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:57:00.307 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [], 2024-09-13T23:57:00.307 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:57:00.307 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:00.307 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:57:00.307 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-09-13T23:57:00.307 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-09-13T23:57:00.307 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:00.307 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:00.307 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:57:00.307 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "p5YnriCv1nAtykxBrupQ", 2024-09-13T23:57:00.308 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh" 2024-09-13T23:57:00.308 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:00.308 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:00.308 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [], 2024-09-13T23:57:00.308 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:57:00.308 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:57:00.308 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:57:00.308 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:57:00.308 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:57:00.308 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:57:00.308 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:00.308 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:00.308 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:00.309 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:00.309 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:00.309 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:00.309 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:57:00.309 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:00.309 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:00.309 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:00.309 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:00.309 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:00.309 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:00.309 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:57:00.309 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:57:00.309 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:57:00.309 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:00.310 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:57:00.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.302+0000 7f5b65fab700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:00.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.302+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94504961163264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a36c00 con 0x55f3a696f000 2024-09-13T23:57:00.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.306+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94504961163264] v33'67 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a696f000 2024-09-13T23:57:00.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.306+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94504959515392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a37800 con 0x55f3a696f400 2024-09-13T23:57:00.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.306+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94504959515392] v33'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f3a69ff200 con 0x55f3a696f400 2024-09-13T23:57:00.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.306+0000 7f5b80824f40 20 remove_watcher() i=0 2024-09-13T23:57:00.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.306+0000 7f5b80824f40 2 removed watcher, disabling cache 2024-09-13T23:57:00.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.306+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94504959516544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a37c00 con 0x55f3a696f000 2024-09-13T23:57:00.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.310+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94504959516544] v33'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a696f000 2024-09-13T23:57:00.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.310+0000 7f5b80824f40 20 remove_watcher() i=1 2024-09-13T23:57:00.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.310+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94504959517696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6a36400 con 0x55f3a696f400 2024-09-13T23:57:00.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.310+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94504959517696] v33'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f3a69ff200 con 0x55f3a696f400 2024-09-13T23:57:00.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.310+0000 7f5b80824f40 20 remove_watcher() i=2 2024-09-13T23:57:00.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.310+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94504959518848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6994000 con 0x55f3a6a2c000 2024-09-13T23:57:00.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.314+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94504959518848] v33'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a6a2c000 2024-09-13T23:57:00.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.314+0000 7f5b80824f40 20 remove_watcher() i=3 2024-09-13T23:57:00.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.314+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94504959520000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6994400 con 0x55f3a696f400 2024-09-13T23:57:00.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.314+0000 7f5b7efdd700 1 -- 172.21.15.173:0/1145537389 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94504959520000] v33'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f3a69ff200 con 0x55f3a696f400 2024-09-13T23:57:00.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.314+0000 7f5b80824f40 20 remove_watcher() i=4 2024-09-13T23:57:00.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.314+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94504959521152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6994800 con 0x55f3a696fc00 2024-09-13T23:57:00.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.318+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1145537389 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94504959521152] v33'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f3a69ff440 con 0x55f3a696fc00 2024-09-13T23:57:00.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.318+0000 7f5b80824f40 20 remove_watcher() i=5 2024-09-13T23:57:00.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.318+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94504959522304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6994c00 con 0x55f3a696fc00 2024-09-13T23:57:00.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.322+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1145537389 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94504959522304] v33'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f3a69ff440 con 0x55f3a696fc00 2024-09-13T23:57:00.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.322+0000 7f5b80824f40 20 remove_watcher() i=6 2024-09-13T23:57:00.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.322+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94504959523456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3a6995000 con 0x55f3a6a2c000 2024-09-13T23:57:00.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.322+0000 7f5b7f7de700 1 -- 172.21.15.173:0/1145537389 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94504959523456] v33'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f3a69feb40 con 0x55f3a6a2c000 2024-09-13T23:57:00.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.322+0000 7f5b80824f40 20 remove_watcher() i=7 2024-09-13T23:57:00.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.322+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f3a696f400 msgr2=0x55f3a68b4100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.322+0000 7f5b80824f40 1 --2- 172.21.15.173:0/1145537389 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f3a696f400 0x55f3a68b4100 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.322+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f3a696f000 msgr2=0x55f3a68b3b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.322+0000 7f5b80824f40 1 --2- 172.21.15.173:0/1145537389 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f3a696f000 0x55f3a68b3b80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.322+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f3a6a2c000 msgr2=0x55f3a68b4c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.322+0000 7f5b80824f40 1 --2- 172.21.15.173:0/1145537389 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f3a6a2c000 0x55f3a68b4c00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.322+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f3a696fc00 msgr2=0x55f3a68b4680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.322+0000 7f5b80824f40 1 --2- 172.21.15.173:0/1145537389 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f3a696fc00 0x55f3a68b4680 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.322+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f3a696ec00 msgr2=0x55f3a68b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.322+0000 7f5b80824f40 1 --2- 172.21.15.173:0/1145537389 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f3a696ec00 0x55f3a68b3600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55f3a68ad920 tx=0x55f3a66d1800 comp rx=0 tx=0).stop 2024-09-13T23:57:00.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.322+0000 7f5b7e7dc700 1 -- 172.21.15.173:0/1145537389 reap_dead start 2024-09-13T23:57:00.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.322+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd800 msgr2=0x55f3a68b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.322+0000 7f5b80824f40 1 --2- 172.21.15.173:0/1145537389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd800 0x55f3a68b2b00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55f3a7397f80 tx=0x55f3a692c000 comp rx=0 tx=0).stop 2024-09-13T23:57:00.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.322+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 shutdown_connections 2024-09-13T23:57:00.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.322+0000 7f5b80824f40 1 --2- 172.21.15.173:0/1145537389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd800 0x55f3a68b2b00 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.322+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 >> 172.21.15.173:0/1145537389 conn(0x55f3a65cd400 msgr2=0x55f3a66cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.322+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 shutdown_connections 2024-09-13T23:57:00.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.322+0000 7f5b80824f40 1 -- 172.21.15.173:0/1145537389 wait complete. 2024-09-13T23:57:00.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.326+0000 7f5b80824f40 1 -- 172.21.15.173:0/1156240645 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f3a696f800 msgr2=0x55f3a6ac6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.326+0000 7f5b80824f40 1 --2- 172.21.15.173:0/1156240645 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f3a696f800 0x55f3a6ac6000 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55f3a69752c0 tx=0x55f3a6a8cae0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.326+0000 7f5b80824f40 1 -- 172.21.15.173:0/1156240645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a6a2c400 msgr2=0x55f3a68b5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.326+0000 7f5b80824f40 1 --2- 172.21.15.173:0/1156240645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a6a2c400 0x55f3a68b5180 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55f3a6a462d0 tx=0x55f3a692dc20 comp rx=0 tx=0).stop 2024-09-13T23:57:00.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.326+0000 7f5b80824f40 1 -- 172.21.15.173:0/1156240645 shutdown_connections 2024-09-13T23:57:00.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.326+0000 7f5b80824f40 1 --2- 172.21.15.173:0/1156240645 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f3a696f800 0x55f3a6ac6000 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.326+0000 7f5b80824f40 1 --2- 172.21.15.173:0/1156240645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a6a2c400 0x55f3a68b5180 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.326+0000 7f5b80824f40 1 -- 172.21.15.173:0/1156240645 >> 172.21.15.173:0/1156240645 conn(0x55f3a6a36800 msgr2=0x55f3a66ce000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.326+0000 7f5b80824f40 1 -- 172.21.15.173:0/1156240645 shutdown_connections 2024-09-13T23:57:00.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.326+0000 7f5b80824f40 1 -- 172.21.15.173:0/1156240645 wait complete. 2024-09-13T23:57:00.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.326+0000 7f5b80824f40 1 -- 172.21.15.173:0/3836187598 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f3a696e000 msgr2=0x55f3a68b3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.326+0000 7f5b80824f40 1 --2- 172.21.15.173:0/3836187598 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f3a696e000 0x55f3a68b3080 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55f3a68fcff0 tx=0x55f3a692c2a0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.326+0000 7f5b80824f40 1 -- 172.21.15.173:0/3836187598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd000 msgr2=0x55f3a68b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.326+0000 7f5b80824f40 1 --2- 172.21.15.173:0/3836187598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd000 0x55f3a68b2580 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55f3a7397e60 tx=0x55f3a66d1920 comp rx=0 tx=0).stop 2024-09-13T23:57:00.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.326+0000 7f5b80824f40 1 -- 172.21.15.173:0/3836187598 shutdown_connections 2024-09-13T23:57:00.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.326+0000 7f5b80824f40 1 --2- 172.21.15.173:0/3836187598 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f3a696e000 0x55f3a68b3080 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.326+0000 7f5b80824f40 1 --2- 172.21.15.173:0/3836187598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f3a65cd000 0x55f3a68b2580 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.326+0000 7f5b80824f40 1 -- 172.21.15.173:0/3836187598 >> 172.21.15.173:0/3836187598 conn(0x55f3a65ccc00 msgr2=0x55f3a66cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.326+0000 7f5b80824f40 1 -- 172.21.15.173:0/3836187598 shutdown_connections 2024-09-13T23:57:00.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.326+0000 7f5b80824f40 1 -- 172.21.15.173:0/3836187598 wait complete. 2024-09-13T23:57:00.335 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:57:00.336 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-13T23:57:00.336 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-13T23:57:00.336 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-13T23:57:00.418 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:00.418 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:00.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.414+0000 7f2257913f40 1 Processor -- start 2024-09-13T23:57:00.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.414+0000 7f2257913f40 1 -- start start 2024-09-13T23:57:00.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.414+0000 7f2257913f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x5627aa5c5000 0x5627aa8aa580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.414+0000 7f2257913f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5627aa689500 con 0x5627aa5c5400 2024-09-13T23:57:00.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.414+0000 7f2257913f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x5627aa652a00 con 0x5627aa5c5000 2024-09-13T23:57:00.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.414+0000 7f22560cc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x5627aa5c5000 0x5627aa8aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.414+0000 7f22558cb700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x5627aa5c5400 0x5627aa6c4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:57932/0 (socket says 172.21.15.173:57932) 2024-09-13T23:57:00.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.414+0000 7f22558cb700 1 -- 172.21.15.173:0/4102804922 learned_addr learned my addr 172.21.15.173:0/4102804922 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:00.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.414+0000 7f22550ca700 1 -- 172.21.15.173:0/4102804922 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3515535589 0 0) 0x5627aa720000 con 0x5627aa5c5400 2024-09-13T23:57:00.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.414+0000 7f22550ca700 1 -- 172.21.15.173:0/4102804922 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x5627aa689680 con 0x5627aa5c5400 2024-09-13T23:57:00.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.414+0000 7f22560cc700 1 -- 172.21.15.173:0/4102804922 >> v1:172.21.15.87:6789/0 conn(0x5627aa5c5400 legacy=0x5627aa6c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.414+0000 7f22560cc700 1 -- 172.21.15.173:0/4102804922 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627aa5d7d40 con 0x5627aa5c5000 2024-09-13T23:57:00.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.414+0000 7f22560cc700 1 --2- 172.21.15.173:0/4102804922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5000 0x5627aa8aa580 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x5627aa8a5a70 tx=0x5627aa6c9980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d98a373a9f1e2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.418+0000 7f22550ca700 1 -- 172.21.15.173:0/4102804922 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5627aa6694a0 con 0x5627aa5c5000 2024-09-13T23:57:00.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.418+0000 7f22550ca700 1 -- 172.21.15.173:0/4102804922 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5627aa689680 con 0x5627aa5c5000 2024-09-13T23:57:00.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.418+0000 7f22550ca700 1 -- 172.21.15.173:0/4102804922 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5627aa669600 con 0x5627aa5c5000 2024-09-13T23:57:00.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.418+0000 7f2257913f40 1 -- 172.21.15.173:0/4102804922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5000 msgr2=0x5627aa8aa580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.418+0000 7f2257913f40 1 --2- 172.21.15.173:0/4102804922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5000 0x5627aa8aa580 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x5627aa8a5a70 tx=0x5627aa6c9980 comp rx=0 tx=0).stop 2024-09-13T23:57:00.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.418+0000 7f2257913f40 1 -- 172.21.15.173:0/4102804922 shutdown_connections 2024-09-13T23:57:00.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.418+0000 7f2257913f40 1 --2- 172.21.15.173:0/4102804922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5000 0x5627aa8aa580 secure :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0x5627aa8a5a70 tx=0x5627aa6c9980 comp rx=0 tx=0).stop 2024-09-13T23:57:00.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.418+0000 7f2257913f40 1 -- 172.21.15.173:0/4102804922 >> 172.21.15.173:0/4102804922 conn(0x5627aa5c4c00 msgr2=0x5627aa6c4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.418+0000 7f2257913f40 1 -- 172.21.15.173:0/4102804922 shutdown_connections 2024-09-13T23:57:00.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.418+0000 7f2257913f40 1 -- 172.21.15.173:0/4102804922 wait complete. 2024-09-13T23:57:00.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.418+0000 7f2257913f40 1 Processor -- start 2024-09-13T23:57:00.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.418+0000 7f2257913f40 1 -- start start 2024-09-13T23:57:00.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.418+0000 7f2257913f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5400 0x5627aa8aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.418+0000 7f2257913f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627aa652500 con 0x5627aa5c5400 2024-09-13T23:57:00.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.422+0000 7f22560cc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5400 0x5627aa8aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.422+0000 7f22560cc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5400 0x5627aa8aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58906/0 (socket says 172.21.15.173:58906) 2024-09-13T23:57:00.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.422+0000 7f22560cc700 1 -- 172.21.15.173:0/4131574512 learned_addr learned my addr 172.21.15.173:0/4131574512 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.422+0000 7f22560cc700 1 -- 172.21.15.173:0/4131574512 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627aa5d7ba0 con 0x5627aa5c5400 2024-09-13T23:57:00.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.422+0000 7f22560cc700 1 --2- 172.21.15.173:0/4131574512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5400 0x5627aa8aab00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x5627aa8a5a70 tx=0x5627aa6c9800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a92477ee90bd4b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.422+0000 7f22548c9700 1 -- 172.21.15.173:0/4131574512 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5627aa669760 con 0x5627aa5c5400 2024-09-13T23:57:00.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.422+0000 7f22548c9700 1 -- 172.21.15.173:0/4131574512 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5627aa689980 con 0x5627aa5c5400 2024-09-13T23:57:00.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.422+0000 7f22548c9700 1 -- 172.21.15.173:0/4131574512 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5627aa6694a0 con 0x5627aa5c5400 2024-09-13T23:57:00.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.422+0000 7f2257913f40 1 -- 172.21.15.173:0/4131574512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5400 msgr2=0x5627aa8aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.422+0000 7f2257913f40 1 --2- 172.21.15.173:0/4131574512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5400 0x5627aa8aab00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x5627aa8a5a70 tx=0x5627aa6c9800 comp rx=0 tx=0).stop 2024-09-13T23:57:00.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.422+0000 7f2257913f40 1 -- 172.21.15.173:0/4131574512 shutdown_connections 2024-09-13T23:57:00.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.422+0000 7f2257913f40 1 --2- 172.21.15.173:0/4131574512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5400 0x5627aa8aab00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.422+0000 7f2257913f40 1 -- 172.21.15.173:0/4131574512 >> 172.21.15.173:0/4131574512 conn(0x5627aa5c4c00 msgr2=0x5627aa6c5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.422+0000 7f2257913f40 1 -- 172.21.15.173:0/4131574512 shutdown_connections 2024-09-13T23:57:00.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.422+0000 7f2257913f40 1 -- 172.21.15.173:0/4131574512 wait complete. 2024-09-13T23:57:00.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.422+0000 7f2257913f40 1 Processor -- start 2024-09-13T23:57:00.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.422+0000 7f2257913f40 1 -- start start 2024-09-13T23:57:00.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.422+0000 7f2257913f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5400 0x5627aa8aab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.422+0000 7f2257913f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627aa6523c0 con 0x5627aa5c5400 2024-09-13T23:57:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.426+0000 7f22560cc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5400 0x5627aa8aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.426+0000 7f22560cc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5400 0x5627aa8aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58912/0 (socket says 172.21.15.173:58912) 2024-09-13T23:57:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.426+0000 7f22560cc700 1 -- 172.21.15.173:0/1624558395 learned_addr learned my addr 172.21.15.173:0/1624558395 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.426+0000 7f22560cc700 1 -- 172.21.15.173:0/1624558395 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627aa5d7a00 con 0x5627aa5c5400 2024-09-13T23:57:00.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.426+0000 7f22560cc700 1 --2- 172.21.15.173:0/1624558395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5400 0x5627aa8aab00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x5627ab38ff50 tx=0x5627aa6c9980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.426+0000 7f22530c6700 1 -- 172.21.15.173:0/1624558395 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5627aa669600 con 0x5627aa5c5400 2024-09-13T23:57:00.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.426+0000 7f22530c6700 1 -- 172.21.15.173:0/1624558395 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5627aa689b00 con 0x5627aa5c5400 2024-09-13T23:57:00.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.426+0000 7f22530c6700 1 -- 172.21.15.173:0/1624558395 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5627aa6698c0 con 0x5627aa5c5400 2024-09-13T23:57:00.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.426+0000 7f2257913f40 1 -- 172.21.15.173:0/1624558395 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5627aa5d7860 con 0x5627aa5c5400 2024-09-13T23:57:00.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.426+0000 7f2257913f40 1 -- 172.21.15.173:0/1624558395 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627aa5d76c0 con 0x5627aa5c5400 2024-09-13T23:57:00.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.426+0000 7f2257913f40 1 Processor -- start 2024-09-13T23:57:00.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.426+0000 7f22530c6700 1 -- 172.21.15.173:0/1624558395 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x5627aa6beb00 con 0x5627aa5c5400 2024-09-13T23:57:00.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.426+0000 7f2257913f40 1 -- start start 2024-09-13T23:57:00.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.426+0000 7f2257913f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5c00 0x5627aa8ab080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.426+0000 7f2257913f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627aa5ea640 con 0x5627aa5c5c00 2024-09-13T23:57:00.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.426+0000 7f22530c6700 1 --2- 172.21.15.173:0/1624558395 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5627aa962000 0x5627aa8ac100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.426+0000 7f22530c6700 1 -- 172.21.15.173:0/1624558395 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5627aa62b180 con 0x5627aa5c5400 2024-09-13T23:57:00.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.426+0000 7f22560cc700 1 --2- 172.21.15.173:0/1624558395 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5627aa962000 0x5627aa8ac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.426+0000 7f22568cd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5c00 0x5627aa8ab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.426+0000 7f22568cd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5c00 0x5627aa8ab080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58924/0 (socket says 172.21.15.173:58924) 2024-09-13T23:57:00.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.426+0000 7f22568cd700 1 -- 172.21.15.173:0/454847977 learned_addr learned my addr 172.21.15.173:0/454847977 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f22560cc700 1 --2- 172.21.15.173:0/1624558395 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5627aa962000 0x5627aa8ac100 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x5627aa8f14a0 tx=0x5627aa926780 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f22568cd700 1 -- 172.21.15.173:0/454847977 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627aa5d6000 con 0x5627aa5c5c00 2024-09-13T23:57:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f22568cd700 1 --2- 172.21.15.173:0/454847977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5c00 0x5627aa8ab080 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x5627aa8a5f80 tx=0x5627aa926a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3f8d124f930351 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f22508c1700 1 -- 172.21.15.173:0/454847977 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5627aa669600 con 0x5627aa5c5c00 2024-09-13T23:57:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f22508c1700 1 -- 172.21.15.173:0/454847977 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5627aa689b00 con 0x5627aa5c5c00 2024-09-13T23:57:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f22508c1700 1 -- 172.21.15.173:0/454847977 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5627aa6698c0 con 0x5627aa5c5c00 2024-09-13T23:57:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f2257913f40 1 -- 172.21.15.173:0/454847977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5c00 msgr2=0x5627aa8ab080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f2257913f40 1 --2- 172.21.15.173:0/454847977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5c00 0x5627aa8ab080 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x5627aa8a5f80 tx=0x5627aa926a80 comp rx=0 tx=0).stop 2024-09-13T23:57:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f2257913f40 1 -- 172.21.15.173:0/454847977 shutdown_connections 2024-09-13T23:57:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f2257913f40 1 --2- 172.21.15.173:0/454847977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5c00 0x5627aa8ab080 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f2257913f40 1 -- 172.21.15.173:0/454847977 >> 172.21.15.173:0/454847977 conn(0x5627aa5c5800 msgr2=0x5627aa6c5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f2257913f40 1 -- 172.21.15.173:0/454847977 shutdown_connections 2024-09-13T23:57:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f2257913f40 1 -- 172.21.15.173:0/454847977 wait complete. 2024-09-13T23:57:00.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f2257913f40 1 Processor -- start 2024-09-13T23:57:00.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f2257913f40 1 -- start start 2024-09-13T23:57:00.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f2257913f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5c00 0x5627aa8ab080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f2257913f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627aa5ea8c0 con 0x5627aa5c5c00 2024-09-13T23:57:00.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f22568cd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5c00 0x5627aa8ab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f22568cd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5c00 0x5627aa8ab080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58938/0 (socket says 172.21.15.173:58938) 2024-09-13T23:57:00.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 learned_addr learned my addr 172.21.15.173:0/3910850147 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627aa5d6ea0 con 0x5627aa5c5c00 2024-09-13T23:57:00.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f22568cd700 1 --2- 172.21.15.173:0/3910850147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5c00 0x5627aa8ab080 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x5627ab38fda0 tx=0x5627aa6c9ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f224f0be700 1 -- 172.21.15.173:0/3910850147 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5627aa669760 con 0x5627aa5c5c00 2024-09-13T23:57:00.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f224f0be700 1 -- 172.21.15.173:0/3910850147 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5627aa988000 con 0x5627aa5c5c00 2024-09-13T23:57:00.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.430+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5627aa5d6820 con 0x5627aa5c5c00 2024-09-13T23:57:00.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f224f0be700 1 -- 172.21.15.173:0/3910850147 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5627aa669600 con 0x5627aa5c5c00 2024-09-13T23:57:00.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627aa5d69c0 con 0x5627aa5c5c00 2024-09-13T23:57:00.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f224f0be700 1 -- 172.21.15.173:0/3910850147 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x5627aa6bedc0 con 0x5627aa5c5c00 2024-09-13T23:57:00.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f224f0be700 1 --2- 172.21.15.173:0/3910850147 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5627aa962c00 0x5627aa8ac680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f224f0be700 1 -- 172.21.15.173:0/3910850147 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5627aa62b340 con 0x5627aa5c5c00 2024-09-13T23:57:00.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f22558cb700 1 --2- 172.21.15.173:0/3910850147 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5627aa962c00 0x5627aa8ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f22558cb700 1 --2- 172.21.15.173:0/3910850147 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5627aa962c00 0x5627aa8ac680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x5627ab38e030 tx=0x5627aa9279e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f2257913f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f2257913f40 1 --2- 172.21.15.173:0/3910850147 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5627aa963000 0x5627aa8ab600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963400 con 0x5627aa963000 2024-09-13T23:57:00.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f22568cd700 1 --2- 172.21.15.173:0/3910850147 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5627aa963000 0x5627aa8ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f22568cd700 1 --2- 172.21.15.173:0/3910850147 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5627aa963000 0x5627aa8ab600 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aa963000 2024-09-13T23:57:00.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f2257913f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f2257913f40 20 realm 2024-09-13T23:57:00.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f2257913f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963000 2024-09-13T23:57:00.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aa963000 2024-09-13T23:57:00.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f2257913f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f2257913f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:00.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f2257913f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963c00 con 0x5627aa963000 2024-09-13T23:57:00.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aa963000 2024-09-13T23:57:00.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f2257913f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f2257913f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f2257913f40 1 --2- 172.21.15.173:0/3910850147 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5627aa963400 0x5627aa8abb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.434+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963400 2024-09-13T23:57:00.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.438+0000 7f22560cc700 1 --2- 172.21.15.173:0/3910850147 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5627aa963400 0x5627aa8abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.438+0000 7f22560cc700 1 --2- 172.21.15.173:0/3910850147 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5627aa963400 0x5627aa8abb80 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.438+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5627aaa19200 con 0x5627aa963400 2024-09-13T23:57:00.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.438+0000 7f2257913f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:00.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.438+0000 7f2257913f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.438+0000 7f2257913f40 1 --2- 172.21.15.173:0/3910850147 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5627aa963c00 0x5627aa8acc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.438+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa20000 con 0x5627aa963c00 2024-09-13T23:57:00.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.438+0000 7f22558cb700 1 --2- 172.21.15.173:0/3910850147 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5627aa963c00 0x5627aa8acc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.438+0000 7f22558cb700 1 --2- 172.21.15.173:0/3910850147 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5627aa963c00 0x5627aa8acc00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.438+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5627aaa19440 con 0x5627aa963c00 2024-09-13T23:57:00.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.438+0000 7f2257913f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:00.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.438+0000 7f2257913f40 20 searching for the correct realm 2024-09-13T23:57:00.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.438+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa20400 con 0x5627aa963c00 2024-09-13T23:57:00.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.438+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5627aaa19440 con 0x5627aa963c00 2024-09-13T23:57:00.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.438+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa20000 con 0x5627aa963400 2024-09-13T23:57:00.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.438+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa19200 con 0x5627aa963400 2024-09-13T23:57:00.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.438+0000 7f22560cc700 1 --2- 172.21.15.173:0/3910850147 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5627aaa20000 0x5627aa8aa580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.438+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aaa20000 2024-09-13T23:57:00.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.438+0000 7f22568cd700 1 --2- 172.21.15.173:0/3910850147 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5627aaa20000 0x5627aa8aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.442+0000 7f22568cd700 1 --2- 172.21.15.173:0/3910850147 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5627aaa20000 0x5627aa8aa580 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.442+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aaa20000 2024-09-13T23:57:00.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.442+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963000 2024-09-13T23:57:00.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.442+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aa963000 2024-09-13T23:57:00.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.442+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963000 2024-09-13T23:57:00.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.442+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aa963000 2024-09-13T23:57:00.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.442+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963c00 2024-09-13T23:57:00.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.442+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa19440 con 0x5627aa963c00 2024-09-13T23:57:00.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.442+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963000 2024-09-13T23:57:00.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.442+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aa963000 2024-09-13T23:57:00.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.442+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963400 2024-09-13T23:57:00.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.442+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa19200 con 0x5627aa963400 2024-09-13T23:57:00.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.442+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963400 2024-09-13T23:57:00.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.442+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa19200 con 0x5627aa963400 2024-09-13T23:57:00.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.442+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963000 2024-09-13T23:57:00.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.446+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aa963000 2024-09-13T23:57:00.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.446+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aaa20000 2024-09-13T23:57:00.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.446+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aaa20000 2024-09-13T23:57:00.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.446+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963000 2024-09-13T23:57:00.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.446+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aa963000 2024-09-13T23:57:00.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.446+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aaa20000 2024-09-13T23:57:00.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.446+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aaa20000 2024-09-13T23:57:00.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.446+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963400 2024-09-13T23:57:00.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.446+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa19200 con 0x5627aa963400 2024-09-13T23:57:00.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.446+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963c00 2024-09-13T23:57:00.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.446+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa19440 con 0x5627aa963c00 2024-09-13T23:57:00.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.446+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963000 2024-09-13T23:57:00.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.446+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aa963000 2024-09-13T23:57:00.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.446+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963400 2024-09-13T23:57:00.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.446+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa19200 con 0x5627aa963400 2024-09-13T23:57:00.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.446+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963c00 2024-09-13T23:57:00.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.450+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa19440 con 0x5627aa963c00 2024-09-13T23:57:00.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.450+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963000 2024-09-13T23:57:00.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.450+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aa963000 2024-09-13T23:57:00.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.450+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963000 2024-09-13T23:57:00.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.450+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aa963000 2024-09-13T23:57:00.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.450+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963000 2024-09-13T23:57:00.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.450+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aa963000 2024-09-13T23:57:00.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.450+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963c00 2024-09-13T23:57:00.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.450+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa19440 con 0x5627aa963c00 2024-09-13T23:57:00.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.450+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aaa20000 2024-09-13T23:57:00.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.450+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aaa20000 2024-09-13T23:57:00.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.450+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963000 2024-09-13T23:57:00.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.450+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aa963000 2024-09-13T23:57:00.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.450+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aaa20000 2024-09-13T23:57:00.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.450+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aaa20000 2024-09-13T23:57:00.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.450+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963c00 2024-09-13T23:57:00.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.450+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa19440 con 0x5627aa963c00 2024-09-13T23:57:00.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.450+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aaa20000 2024-09-13T23:57:00.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.454+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aaa20000 2024-09-13T23:57:00.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.454+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963400 2024-09-13T23:57:00.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.454+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa19200 con 0x5627aa963400 2024-09-13T23:57:00.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.454+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963400 2024-09-13T23:57:00.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.454+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa19200 con 0x5627aa963400 2024-09-13T23:57:00.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.454+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963c00 2024-09-13T23:57:00.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.454+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa19440 con 0x5627aa963c00 2024-09-13T23:57:00.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.454+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963400 2024-09-13T23:57:00.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.454+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5627aaa19200 con 0x5627aa963400 2024-09-13T23:57:00.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.454+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963400 2024-09-13T23:57:00.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.454+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5627aaa19200 con 0x5627aa963400 2024-09-13T23:57:00.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.454+0000 7f2257913f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:00.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.454+0000 7f2257913f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:00.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.454+0000 7f2257913f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:00.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.454+0000 7f2257913f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:00.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.454+0000 7f2257913f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.454+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa20800 con 0x5627aa963000 2024-09-13T23:57:00.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aa963000 2024-09-13T23:57:00.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa20c00 con 0x5627aa963400 2024-09-13T23:57:00.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5627aaa19200 con 0x5627aa963400 2024-09-13T23:57:00.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:00.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa21000 con 0x5627aa963000 2024-09-13T23:57:00.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aa963000 2024-09-13T23:57:00.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:00.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 20 zone default found 2024-09-13T23:57:00.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 4 Realm: () 2024-09-13T23:57:00.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:00.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:00.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:00.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 20 zonegroup default 2024-09-13T23:57:00.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa21400 con 0x5627aaa20000 2024-09-13T23:57:00.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aaa20000 2024-09-13T23:57:00.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa21800 con 0x5627aa963c00 2024-09-13T23:57:00.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5627aaa19440 con 0x5627aa963c00 2024-09-13T23:57:00.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa21c00 con 0x5627aa963c00 2024-09-13T23:57:00.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5627aaa19440 con 0x5627aa963c00 2024-09-13T23:57:00.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 20 started sync module instance, tier type = 2024-09-13T23:57:00.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:00.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.458+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa2a000 con 0x5627aa963400 2024-09-13T23:57:00.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.462+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa19200 con 0x5627aa963400 2024-09-13T23:57:00.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.462+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94728364890880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa2a400 con 0x5627aa963400 2024-09-13T23:57:00.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.462+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa2a800 con 0x5627aa963000 2024-09-13T23:57:00.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.466+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94728364890880] v33'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa19200 con 0x5627aa963400 2024-09-13T23:57:00.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.466+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aa963000 2024-09-13T23:57:00.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.466+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94728364892032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa2ac00 con 0x5627aa963000 2024-09-13T23:57:00.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.466+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa2b000 con 0x5627aa963400 2024-09-13T23:57:00.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.466+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94728364892032] v33'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aa963000 2024-09-13T23:57:00.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.466+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa19200 con 0x5627aa963400 2024-09-13T23:57:00.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.466+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94728364893184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa2b400 con 0x5627aa963400 2024-09-13T23:57:00.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.466+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa2b800 con 0x5627aaa20000 2024-09-13T23:57:00.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.470+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94728364893184] v33'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa19200 con 0x5627aa963400 2024-09-13T23:57:00.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.470+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aaa20000 2024-09-13T23:57:00.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.470+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94728364894336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa2bc00 con 0x5627aaa20000 2024-09-13T23:57:00.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.470+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa2a800 con 0x5627aa963400 2024-09-13T23:57:00.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.474+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94728364894336] v33'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aaa20000 2024-09-13T23:57:00.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.474+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa19200 con 0x5627aa963400 2024-09-13T23:57:00.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.474+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94728364895488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa2a000 con 0x5627aa963400 2024-09-13T23:57:00.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.474+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa2a400 con 0x5627aa963c00 2024-09-13T23:57:00.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.474+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa19440 con 0x5627aa963c00 2024-09-13T23:57:00.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.474+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94728364896640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa20800 con 0x5627aa963c00 2024-09-13T23:57:00.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.474+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa21000 con 0x5627aa963c00 2024-09-13T23:57:00.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.474+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94728364895488] v33'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa19200 con 0x5627aa963400 2024-09-13T23:57:00.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.474+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94728364896640] v33'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa19440 con 0x5627aa963c00 2024-09-13T23:57:00.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.478+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa19440 con 0x5627aa963c00 2024-09-13T23:57:00.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.478+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94728364897792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa21400 con 0x5627aa963c00 2024-09-13T23:57:00.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.478+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa20c00 con 0x5627aaa20000 2024-09-13T23:57:00.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.478+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aaa20000 2024-09-13T23:57:00.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.478+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94728364898944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aaa20000 2024-09-13T23:57:00.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.478+0000 7f2257913f40 20 add_watcher() i=0 2024-09-13T23:57:00.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.478+0000 7f2257913f40 20 add_watcher() i=1 2024-09-13T23:57:00.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.478+0000 7f2257913f40 20 add_watcher() i=2 2024-09-13T23:57:00.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.478+0000 7f2257913f40 20 add_watcher() i=3 2024-09-13T23:57:00.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.478+0000 7f2257913f40 20 add_watcher() i=4 2024-09-13T23:57:00.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.478+0000 7f2257913f40 20 add_watcher() i=5 2024-09-13T23:57:00.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.482+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94728364897792] v33'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa19440 con 0x5627aa963c00 2024-09-13T23:57:00.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.482+0000 7f2257913f40 20 add_watcher() i=6 2024-09-13T23:57:00.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.482+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94728364898944] v33'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aaa20000 2024-09-13T23:57:00.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.482+0000 7f2257913f40 20 add_watcher() i=7 2024-09-13T23:57:00.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.482+0000 7f2257913f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:00.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.482+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa2ac00 con 0x5627aa963000 2024-09-13T23:57:00.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.482+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aa963000 2024-09-13T23:57:00.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.482+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94728366522368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa2b800 con 0x5627aa963000 2024-09-13T23:57:00.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.486+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94728366522368] v33'68 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aa963000 2024-09-13T23:57:00.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.486+0000 7f223d09a700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:00.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.486+0000 7f2257913f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:00.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.486+0000 7f2257913f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:00.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.486+0000 7f2257913f40 1 Processor -- start 2024-09-13T23:57:00.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.486+0000 7f2257913f40 1 -- start start 2024-09-13T23:57:00.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.486+0000 7f2257913f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aaa2a400 0x5627aa8ad180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.486+0000 7f2257913f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627aa6523c0 con 0x5627aaa2a400 2024-09-13T23:57:00.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.486+0000 7f22558cb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aaa2a400 0x5627aa8ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.486+0000 7f22558cb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aaa2a400 0x5627aa8ad180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58954/0 (socket says 172.21.15.173:58954) 2024-09-13T23:57:00.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.486+0000 7f22558cb700 1 -- 172.21.15.173:0/720664340 learned_addr learned my addr 172.21.15.173:0/720664340 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.486+0000 7f22558cb700 1 -- 172.21.15.173:0/720664340 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627aa5d6b60 con 0x5627aaa2a400 2024-09-13T23:57:00.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.486+0000 7f22558cb700 1 --2- 172.21.15.173:0/720664340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aaa2a400 0x5627aa8ad180 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x5627aaa346c0 tx=0x5627aa927980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7d0eaa4ea7ddb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.486+0000 7f223c899700 1 -- 172.21.15.173:0/720664340 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5627aaa3c000 con 0x5627aaa2a400 2024-09-13T23:57:00.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.486+0000 7f223c899700 1 -- 172.21.15.173:0/720664340 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5627aa988a80 con 0x5627aaa2a400 2024-09-13T23:57:00.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.486+0000 7f223c899700 1 -- 172.21.15.173:0/720664340 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5627aaa3c160 con 0x5627aaa2a400 2024-09-13T23:57:00.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.490+0000 7f2257913f40 1 -- 172.21.15.173:0/720664340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aaa2a400 msgr2=0x5627aa8ad180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.490+0000 7f2257913f40 1 --2- 172.21.15.173:0/720664340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aaa2a400 0x5627aa8ad180 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x5627aaa346c0 tx=0x5627aa927980 comp rx=0 tx=0).stop 2024-09-13T23:57:00.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.490+0000 7f2257913f40 1 -- 172.21.15.173:0/720664340 shutdown_connections 2024-09-13T23:57:00.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.490+0000 7f2257913f40 1 --2- 172.21.15.173:0/720664340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aaa2a400 0x5627aa8ad180 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.490+0000 7f2257913f40 1 -- 172.21.15.173:0/720664340 >> 172.21.15.173:0/720664340 conn(0x5627aaa2bc00 msgr2=0x5627aa6c6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.490+0000 7f2257913f40 1 -- 172.21.15.173:0/720664340 shutdown_connections 2024-09-13T23:57:00.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.490+0000 7f2257913f40 1 -- 172.21.15.173:0/720664340 wait complete. 2024-09-13T23:57:00.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.490+0000 7f2257913f40 1 Processor -- start 2024-09-13T23:57:00.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.490+0000 7f2257913f40 1 -- start start 2024-09-13T23:57:00.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.490+0000 7f2257913f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aaa2a400 0x5627aa8ad180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.490+0000 7f2257913f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627aa652500 con 0x5627aaa2a400 2024-09-13T23:57:00.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.490+0000 7f22558cb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aaa2a400 0x5627aa8ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.490+0000 7f22558cb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aaa2a400 0x5627aa8ad180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58968/0 (socket says 172.21.15.173:58968) 2024-09-13T23:57:00.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.490+0000 7f22558cb700 1 -- 172.21.15.173:0/615337905 learned_addr learned my addr 172.21.15.173:0/615337905 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.490+0000 7f22558cb700 1 -- 172.21.15.173:0/615337905 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627aa5d6d00 con 0x5627aaa2a400 2024-09-13T23:57:00.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.490+0000 7f22558cb700 1 --2- 172.21.15.173:0/615337905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aaa2a400 0x5627aa8ad180 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x5627aaa348d0 tx=0x5627aa927b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.490+0000 7f223b096700 1 -- 172.21.15.173:0/615337905 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5627aaa3c2c0 con 0x5627aaa2a400 2024-09-13T23:57:00.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.490+0000 7f223b096700 1 -- 172.21.15.173:0/615337905 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5627aa988c00 con 0x5627aaa2a400 2024-09-13T23:57:00.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.490+0000 7f223b096700 1 -- 172.21.15.173:0/615337905 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5627aaa3c000 con 0x5627aaa2a400 2024-09-13T23:57:00.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.490+0000 7f2257913f40 1 -- 172.21.15.173:0/615337905 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5627aa5d6340 con 0x5627aaa2a400 2024-09-13T23:57:00.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.490+0000 7f2257913f40 1 -- 172.21.15.173:0/615337905 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627aaa4c000 con 0x5627aaa2a400 2024-09-13T23:57:00.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.494+0000 7f223b096700 1 -- 172.21.15.173:0/615337905 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x5627aa6bf8c0 con 0x5627aaa2a400 2024-09-13T23:57:00.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.494+0000 7f223b096700 1 --2- 172.21.15.173:0/615337905 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5627aaabe000 0x5627aaac4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.494+0000 7f223b096700 1 -- 172.21.15.173:0/615337905 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5627aa62b500 con 0x5627aaa2a400 2024-09-13T23:57:00.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.494+0000 7f22568cd700 1 --2- 172.21.15.173:0/615337905 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5627aaabe000 0x5627aaac4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.494+0000 7f2257913f40 5 note: GC not initialized 2024-09-13T23:57:00.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.494+0000 7f22568cd700 1 --2- 172.21.15.173:0/615337905 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5627aaabe000 0x5627aaac4000 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x5627aa9cb830 tx=0x5627aa9271a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.494+0000 7f2238891700 20 reqs_thread_entry: start 2024-09-13T23:57:00.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.494+0000 7f2257913f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:00.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.494+0000 7f2257913f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:00.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.494+0000 7f223688d700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:30 2024 2024-09-13T23:57:00.501 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:00.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.494+0000 7f2257913f40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:57:00.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.494+0000 7f2257913f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.494+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa21800 con 0x5627aa963000 2024-09-13T23:57:00.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.494+0000 7f223606b700 20 reqs_thread_entry: start 2024-09-13T23:57:00.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.494+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~459 out=459b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+582 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aa963000 2024-09-13T23:57:00.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.494+0000 7f2257913f40 20 rados_obj.operate() r=0 bl.length=459 2024-09-13T23:57:00.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.494+0000 7f2257913f40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:57:00.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.494+0000 7f2257913f40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:00.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.494+0000 7f2257913f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:00.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.494+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aa963800 con 0x5627aa963000 2024-09-13T23:57:00.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.498+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~357] v33'5 uv5 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aa963000 2024-09-13T23:57:00.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.498+0000 7f2257913f40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:57:00.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.498+0000 7f2257913f40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:00.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.498+0000 7f2257913f40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:57:00.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.498+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94728366524672 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaabe400 con 0x5627aa963400 2024-09-13T23:57:00.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.498+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== watch-notify(notify (1) cookie 94728364895488 notify 141733920773 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x5627aa924680 con 0x5627aa963400 2024-09-13T23:57:00.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.498+0000 7f22508c1700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920773 cookie 94728364895488 notifier 4376 bl.length()=533 2024-09-13T23:57:00.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.498+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(64 notify.4 [notify cookie 94728366524672 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x5627aaa19200 con 0x5627aa963400 2024-09-13T23:57:00.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.498+0000 7f22508c1700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:57:00.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.498+0000 7f22508c1700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:00.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.498+0000 7f22508c1700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa2b000 con 0x5627aa963400 2024-09-13T23:57:00.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.498+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa19200 con 0x5627aa963400 2024-09-13T23:57:00.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.498+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== watch-notify(notify_complete (2) cookie 94728366524672 notify 141733920773 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5627aa924820 con 0x5627aa963400 2024-09-13T23:57:00.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.498+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaabe800 con 0x5627aa963c00 2024-09-13T23:57:00.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.502+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v33'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5627aaa19440 con 0x5627aa963c00 2024-09-13T23:57:00.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.502+0000 7f2257913f40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T23:57:00.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.502+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94728366524672 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaabec00 con 0x5627aa963400 2024-09-13T23:57:00.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.502+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== watch-notify(notify (1) cookie 94728364893184 notify 141733920774 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x5627aa924820 con 0x5627aa963400 2024-09-13T23:57:00.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.502+0000 7f22500c0700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920774 cookie 94728364893184 notifier 4376 bl.length()=170 2024-09-13T23:57:00.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.502+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(67 notify.2 [notify cookie 94728366524672 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x5627aaa19200 con 0x5627aa963400 2024-09-13T23:57:00.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.502+0000 7f22500c0700 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa2a800 con 0x5627aa963400 2024-09-13T23:57:00.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.502+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== watch-notify(notify_complete (2) cookie 94728366524672 notify 141733920774 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5627aa9249c0 con 0x5627aa963400 2024-09-13T23:57:00.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.502+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa19200 con 0x5627aa963400 2024-09-13T23:57:00.508 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:00.509 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "foo", 2024-09-13T23:57:00.509 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Foo", 2024-09-13T23:57:00.509 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "foo@foo.com", 2024-09-13T23:57:00.509 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:57:00.509 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:57:00.509 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [], 2024-09-13T23:57:00.509 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:57:00.509 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:00.509 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:57:00.509 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-09-13T23:57:00.509 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-09-13T23:57:00.509 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:00.509 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:00.510 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [], 2024-09-13T23:57:00.510 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:57:00.510 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:57:00.510 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:57:00.510 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:57:00.510 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:57:00.510 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:57:00.510 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:00.510 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:00.510 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:00.510 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:00.510 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:00.510 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:00.510 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:57:00.511 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:00.511 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:00.511 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:00.511 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:00.511 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:00.511 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:00.511 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:57:00.511 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:57:00.511 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:57:00.511 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:00.511 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:57:00.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.506+0000 7f223d09a700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:00.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.506+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94728366522368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaabf000 con 0x5627aa963000 2024-09-13T23:57:00.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.506+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94728366522368] v33'69 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aa963000 2024-09-13T23:57:00.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.506+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94728364890880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaabf400 con 0x5627aa963400 2024-09-13T23:57:00.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.510+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94728364890880] v33'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa19200 con 0x5627aa963400 2024-09-13T23:57:00.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.510+0000 7f2257913f40 20 remove_watcher() i=0 2024-09-13T23:57:00.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.510+0000 7f2257913f40 2 removed watcher, disabling cache 2024-09-13T23:57:00.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.510+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94728364892032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaabf800 con 0x5627aa963000 2024-09-13T23:57:00.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.510+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94728364892032] v33'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aa963000 2024-09-13T23:57:00.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.510+0000 7f2257913f40 20 remove_watcher() i=1 2024-09-13T23:57:00.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.510+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94728364893184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaabfc00 con 0x5627aa963400 2024-09-13T23:57:00.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.514+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 27 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94728364893184] v33'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa19200 con 0x5627aa963400 2024-09-13T23:57:00.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.514+0000 7f2257913f40 20 remove_watcher() i=2 2024-09-13T23:57:00.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.514+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94728364894336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaabf000 con 0x5627aaa20000 2024-09-13T23:57:00.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.514+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94728364894336] v33'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aaa20000 2024-09-13T23:57:00.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.514+0000 7f2257913f40 20 remove_watcher() i=3 2024-09-13T23:57:00.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.514+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94728364895488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaabe400 con 0x5627aa963400 2024-09-13T23:57:00.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.518+0000 7f22560cc700 1 -- 172.21.15.173:0/3910850147 <== osd.0 v2:172.21.15.87:6800/3507919120 28 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94728364895488] v33'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa19200 con 0x5627aa963400 2024-09-13T23:57:00.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.518+0000 7f2257913f40 20 remove_watcher() i=4 2024-09-13T23:57:00.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.518+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94728364896640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa2ac00 con 0x5627aa963c00 2024-09-13T23:57:00.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.522+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94728364896640] v33'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa19440 con 0x5627aa963c00 2024-09-13T23:57:00.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.522+0000 7f2257913f40 20 remove_watcher() i=5 2024-09-13T23:57:00.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.522+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94728364897792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa2b800 con 0x5627aa963c00 2024-09-13T23:57:00.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.522+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94728364897792] v33'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa19440 con 0x5627aa963c00 2024-09-13T23:57:00.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.522+0000 7f2257913f40 20 remove_watcher() i=6 2024-09-13T23:57:00.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.522+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94728364898944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5627aaa2a000 con 0x5627aaa20000 2024-09-13T23:57:00.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.522+0000 7f22568cd700 1 -- 172.21.15.173:0/3910850147 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94728364898944] v33'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5627aaa18b40 con 0x5627aaa20000 2024-09-13T23:57:00.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 20 remove_watcher() i=7 2024-09-13T23:57:00.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5627aa963400 msgr2=0x5627aa8abb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 --2- 172.21.15.173:0/3910850147 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5627aa963400 0x5627aa8abb80 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5627aa963000 msgr2=0x5627aa8ab600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 --2- 172.21.15.173:0/3910850147 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5627aa963000 0x5627aa8ab600 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5627aaa20000 msgr2=0x5627aa8aa580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 --2- 172.21.15.173:0/3910850147 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5627aaa20000 0x5627aa8aa580 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5627aa963c00 msgr2=0x5627aa8acc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 --2- 172.21.15.173:0/3910850147 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5627aa963c00 0x5627aa8acc00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5627aa962c00 msgr2=0x5627aa8ac680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 --2- 172.21.15.173:0/3910850147 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5627aa962c00 0x5627aa8ac680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x5627ab38e030 tx=0x5627aa9279e0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f22558cb700 1 -- 172.21.15.173:0/3910850147 reap_dead start 2024-09-13T23:57:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5c00 msgr2=0x5627aa8ab080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 --2- 172.21.15.173:0/3910850147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5c00 0x5627aa8ab080 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x5627ab38fda0 tx=0x5627aa6c9ce0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 shutdown_connections 2024-09-13T23:57:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 --2- 172.21.15.173:0/3910850147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5c00 0x5627aa8ab080 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 >> 172.21.15.173:0/3910850147 conn(0x5627aa5c5800 msgr2=0x5627aa6c5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 shutdown_connections 2024-09-13T23:57:00.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 -- 172.21.15.173:0/3910850147 wait complete. 2024-09-13T23:57:00.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 -- 172.21.15.173:0/615337905 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5627aaabe000 msgr2=0x5627aaac4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 --2- 172.21.15.173:0/615337905 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5627aaabe000 0x5627aaac4000 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x5627aa9cb830 tx=0x5627aa9271a0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 -- 172.21.15.173:0/615337905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aaa2a400 msgr2=0x5627aa8ad180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 --2- 172.21.15.173:0/615337905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aaa2a400 0x5627aa8ad180 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x5627aaa348d0 tx=0x5627aa927b00 comp rx=0 tx=0).stop 2024-09-13T23:57:00.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 -- 172.21.15.173:0/615337905 shutdown_connections 2024-09-13T23:57:00.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 --2- 172.21.15.173:0/615337905 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5627aaabe000 0x5627aaac4000 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 --2- 172.21.15.173:0/615337905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aaa2a400 0x5627aa8ad180 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 -- 172.21.15.173:0/615337905 >> 172.21.15.173:0/615337905 conn(0x5627aaa2bc00 msgr2=0x5627aa6c6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 -- 172.21.15.173:0/615337905 shutdown_connections 2024-09-13T23:57:00.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 -- 172.21.15.173:0/615337905 wait complete. 2024-09-13T23:57:00.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 -- 172.21.15.173:0/1624558395 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5627aa962000 msgr2=0x5627aa8ac100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 --2- 172.21.15.173:0/1624558395 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5627aa962000 0x5627aa8ac100 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x5627aa8f14a0 tx=0x5627aa926780 comp rx=0 tx=0).stop 2024-09-13T23:57:00.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 -- 172.21.15.173:0/1624558395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5400 msgr2=0x5627aa8aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 --2- 172.21.15.173:0/1624558395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5400 0x5627aa8aab00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x5627ab38ff50 tx=0x5627aa6c9980 comp rx=0 tx=0).stop 2024-09-13T23:57:00.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 -- 172.21.15.173:0/1624558395 shutdown_connections 2024-09-13T23:57:00.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 --2- 172.21.15.173:0/1624558395 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5627aa962000 0x5627aa8ac100 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 --2- 172.21.15.173:0/1624558395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5627aa5c5400 0x5627aa8aab00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 -- 172.21.15.173:0/1624558395 >> 172.21.15.173:0/1624558395 conn(0x5627aa5c4c00 msgr2=0x5627aa6c5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 -- 172.21.15.173:0/1624558395 shutdown_connections 2024-09-13T23:57:00.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.526+0000 7f2257913f40 1 -- 172.21.15.173:0/1624558395 wait complete. 2024-09-13T23:57:00.537 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:57:00.537 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-13T23:57:00.537 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-13T23:57:00.537 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-13T23:57:00.578 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:00.578 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:00.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.574+0000 7fe582a91f40 1 Processor -- start 2024-09-13T23:57:00.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.574+0000 7fe582a91f40 1 -- start start 2024-09-13T23:57:00.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.574+0000 7fe582a91f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x556fae9b3000 0x556faec98580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.574+0000 7fe582a91f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556faea77500 con 0x556fae9b3400 2024-09-13T23:57:00.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.574+0000 7fe582a91f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x556faea40a00 con 0x556fae9b3000 2024-09-13T23:57:00.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.574+0000 7fe58124a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x556fae9b3000 0x556faec98580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.574+0000 7fe580a49700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x556fae9b3400 0x556faeab2800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:57934/0 (socket says 172.21.15.173:57934) 2024-09-13T23:57:00.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.574+0000 7fe58124a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x556fae9b3000 0x556faec98580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58978/0 (socket says 172.21.15.173:58978) 2024-09-13T23:57:00.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.574+0000 7fe580a49700 1 -- 172.21.15.173:0/2702164764 learned_addr learned my addr 172.21.15.173:0/2702164764 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:00.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.574+0000 7fe58124a700 1 -- 172.21.15.173:0/2702164764 >> v1:172.21.15.87:6789/0 conn(0x556fae9b3400 legacy=0x556faeab2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.574+0000 7fe58124a700 1 -- 172.21.15.173:0/2702164764 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fae9c5d40 con 0x556fae9b3000 2024-09-13T23:57:00.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.574+0000 7fe58124a700 1 --2- 172.21.15.173:0/2702164764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3000 0x556faec98580 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x556faec93a70 tx=0x556faeab7920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce38985a9255ff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe580248700 1 -- 172.21.15.173:0/2702164764 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556faea574a0 con 0x556fae9b3000 2024-09-13T23:57:00.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe580248700 1 -- 172.21.15.173:0/2702164764 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556faea77800 con 0x556fae9b3000 2024-09-13T23:57:00.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe580248700 1 -- 172.21.15.173:0/2702164764 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556faea57600 con 0x556fae9b3000 2024-09-13T23:57:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe582a91f40 1 -- 172.21.15.173:0/2702164764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3000 msgr2=0x556faec98580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe582a91f40 1 --2- 172.21.15.173:0/2702164764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3000 0x556faec98580 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x556faec93a70 tx=0x556faeab7920 comp rx=0 tx=0).stop 2024-09-13T23:57:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe582a91f40 1 -- 172.21.15.173:0/2702164764 shutdown_connections 2024-09-13T23:57:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe582a91f40 1 --2- 172.21.15.173:0/2702164764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3000 0x556faec98580 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe582a91f40 1 -- 172.21.15.173:0/2702164764 >> 172.21.15.173:0/2702164764 conn(0x556fae9b2c00 msgr2=0x556faeab2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe582a91f40 1 -- 172.21.15.173:0/2702164764 shutdown_connections 2024-09-13T23:57:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe582a91f40 1 -- 172.21.15.173:0/2702164764 wait complete. 2024-09-13T23:57:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe582a91f40 1 Processor -- start 2024-09-13T23:57:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe582a91f40 1 -- start start 2024-09-13T23:57:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe582a91f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3000 0x556faec98580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe582a91f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556faea40500 con 0x556fae9b3000 2024-09-13T23:57:00.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe58124a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3000 0x556faec98580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe58124a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3000 0x556faec98580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58984/0 (socket says 172.21.15.173:58984) 2024-09-13T23:57:00.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe58124a700 1 -- 172.21.15.173:0/1845697689 learned_addr learned my addr 172.21.15.173:0/1845697689 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe58124a700 1 -- 172.21.15.173:0/1845697689 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fae9c5ba0 con 0x556fae9b3000 2024-09-13T23:57:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe58124a700 1 --2- 172.21.15.173:0/1845697689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3000 0x556faec98580 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x556faeb0fd40 tx=0x556faeab7800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d60371f1a31fbd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe57fa47700 1 -- 172.21.15.173:0/1845697689 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556faea57760 con 0x556fae9b3000 2024-09-13T23:57:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe57fa47700 1 -- 172.21.15.173:0/1845697689 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556faea77b00 con 0x556fae9b3000 2024-09-13T23:57:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe57fa47700 1 -- 172.21.15.173:0/1845697689 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556faea571e0 con 0x556fae9b3000 2024-09-13T23:57:00.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe582a91f40 1 -- 172.21.15.173:0/1845697689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3000 msgr2=0x556faec98580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe582a91f40 1 --2- 172.21.15.173:0/1845697689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3000 0x556faec98580 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x556faeb0fd40 tx=0x556faeab7800 comp rx=0 tx=0).stop 2024-09-13T23:57:00.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe582a91f40 1 -- 172.21.15.173:0/1845697689 shutdown_connections 2024-09-13T23:57:00.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe582a91f40 1 --2- 172.21.15.173:0/1845697689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3000 0x556faec98580 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe582a91f40 1 -- 172.21.15.173:0/1845697689 >> 172.21.15.173:0/1845697689 conn(0x556fae9b2c00 msgr2=0x556faeab3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe582a91f40 1 -- 172.21.15.173:0/1845697689 shutdown_connections 2024-09-13T23:57:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.578+0000 7fe582a91f40 1 -- 172.21.15.173:0/1845697689 wait complete. 2024-09-13T23:57:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.582+0000 7fe582a91f40 1 Processor -- start 2024-09-13T23:57:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.582+0000 7fe582a91f40 1 -- start start 2024-09-13T23:57:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.582+0000 7fe582a91f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3000 0x556faec98580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.582+0000 7fe582a91f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556faea403c0 con 0x556fae9b3000 2024-09-13T23:57:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.582+0000 7fe58124a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3000 0x556faec98580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.582+0000 7fe58124a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3000 0x556faec98580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59000/0 (socket says 172.21.15.173:59000) 2024-09-13T23:57:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.582+0000 7fe58124a700 1 -- 172.21.15.173:0/2991441987 learned_addr learned my addr 172.21.15.173:0/2991441987 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.582+0000 7fe58124a700 1 -- 172.21.15.173:0/2991441987 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fae9c5a00 con 0x556fae9b3000 2024-09-13T23:57:00.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.582+0000 7fe58124a700 1 --2- 172.21.15.173:0/2991441987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3000 0x556faec98580 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x556faeb0f6b0 tx=0x556faeab7920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.582+0000 7fe57e244700 1 -- 172.21.15.173:0/2991441987 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556faea574a0 con 0x556fae9b3000 2024-09-13T23:57:00.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.582+0000 7fe57e244700 1 -- 172.21.15.173:0/2991441987 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556faea77c80 con 0x556fae9b3000 2024-09-13T23:57:00.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.582+0000 7fe57e244700 1 -- 172.21.15.173:0/2991441987 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556faea57600 con 0x556fae9b3000 2024-09-13T23:57:00.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.582+0000 7fe582a91f40 1 -- 172.21.15.173:0/2991441987 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556fae9c5860 con 0x556fae9b3000 2024-09-13T23:57:00.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.582+0000 7fe582a91f40 1 -- 172.21.15.173:0/2991441987 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556fae9c56c0 con 0x556fae9b3000 2024-09-13T23:57:00.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.582+0000 7fe582a91f40 1 Processor -- start 2024-09-13T23:57:00.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.582+0000 7fe582a91f40 1 -- start start 2024-09-13T23:57:00.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.582+0000 7fe582a91f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3800 0x556faec98b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.582+0000 7fe582a91f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fae9d8640 con 0x556fae9b3800 2024-09-13T23:57:00.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.582+0000 7fe581a4b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3800 0x556faec98b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.582+0000 7fe581a4b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3800 0x556faec98b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59002/0 (socket says 172.21.15.173:59002) 2024-09-13T23:57:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.582+0000 7fe581a4b700 1 -- 172.21.15.173:0/2417310983 learned_addr learned my addr 172.21.15.173:0/2417310983 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.582+0000 7fe57e244700 1 -- 172.21.15.173:0/2991441987 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x556faeaacb00 con 0x556fae9b3000 2024-09-13T23:57:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe57e244700 1 --2- 172.21.15.173:0/2991441987 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556faed5e000 0x556faec99080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe57e244700 1 -- 172.21.15.173:0/2991441987 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x556faea19180 con 0x556fae9b3000 2024-09-13T23:57:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe58124a700 1 --2- 172.21.15.173:0/2991441987 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556faed5e000 0x556faec99080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe581a4b700 1 -- 172.21.15.173:0/2417310983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fae9c4000 con 0x556fae9b3800 2024-09-13T23:57:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe581a4b700 1 --2- 172.21.15.173:0/2417310983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3800 0x556faec98b00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x556faece7620 tx=0x556faed22360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939954b2a0ac360a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe57ba3f700 1 -- 172.21.15.173:0/2417310983 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556faea574a0 con 0x556fae9b3800 2024-09-13T23:57:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe57ba3f700 1 -- 172.21.15.173:0/2417310983 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556faed70000 con 0x556fae9b3800 2024-09-13T23:57:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe57ba3f700 1 -- 172.21.15.173:0/2417310983 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556faea57600 con 0x556fae9b3800 2024-09-13T23:57:00.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe582a91f40 1 -- 172.21.15.173:0/2417310983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3800 msgr2=0x556faec98b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe582a91f40 1 --2- 172.21.15.173:0/2417310983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3800 0x556faec98b00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x556faece7620 tx=0x556faed22360 comp rx=0 tx=0).stop 2024-09-13T23:57:00.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe58124a700 1 --2- 172.21.15.173:0/2991441987 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556faed5e000 0x556faec99080 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x556faece7560 tx=0x556faed224e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe582a91f40 1 -- 172.21.15.173:0/2417310983 shutdown_connections 2024-09-13T23:57:00.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe582a91f40 1 --2- 172.21.15.173:0/2417310983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3800 0x556faec98b00 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe582a91f40 1 -- 172.21.15.173:0/2417310983 >> 172.21.15.173:0/2417310983 conn(0x556fae9b3400 msgr2=0x556faeab3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe582a91f40 1 -- 172.21.15.173:0/2417310983 shutdown_connections 2024-09-13T23:57:00.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe582a91f40 1 -- 172.21.15.173:0/2417310983 wait complete. 2024-09-13T23:57:00.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe582a91f40 1 Processor -- start 2024-09-13T23:57:00.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe582a91f40 1 -- start start 2024-09-13T23:57:00.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe582a91f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3800 0x556faec98b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe582a91f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fae9d88c0 con 0x556fae9b3800 2024-09-13T23:57:00.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe581a4b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3800 0x556faec98b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe581a4b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3800 0x556faec98b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59014/0 (socket says 172.21.15.173:59014) 2024-09-13T23:57:00.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 learned_addr learned my addr 172.21.15.173:0/3824031535 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fae9c4ea0 con 0x556fae9b3800 2024-09-13T23:57:00.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.586+0000 7fe581a4b700 1 --2- 172.21.15.173:0/3824031535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3800 0x556faec98b00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x556faeb0fda0 tx=0x556faed22000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.590+0000 7fe57a23c700 1 -- 172.21.15.173:0/3824031535 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556faea57760 con 0x556fae9b3800 2024-09-13T23:57:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.590+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556fae9c4820 con 0x556fae9b3800 2024-09-13T23:57:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.590+0000 7fe57a23c700 1 -- 172.21.15.173:0/3824031535 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556faed70180 con 0x556fae9b3800 2024-09-13T23:57:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.590+0000 7fe57a23c700 1 -- 172.21.15.173:0/3824031535 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556faea574a0 con 0x556fae9b3800 2024-09-13T23:57:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.590+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556fae9c49c0 con 0x556fae9b3800 2024-09-13T23:57:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.590+0000 7fe582a91f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.590+0000 7fe57a23c700 1 -- 172.21.15.173:0/3824031535 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x556faeaacdc0 con 0x556fae9b3800 2024-09-13T23:57:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.590+0000 7fe57a23c700 1 --2- 172.21.15.173:0/3824031535 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556faed5ec00 0x556faec99600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.590+0000 7fe57a23c700 1 -- 172.21.15.173:0/3824031535 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x556faea19340 con 0x556fae9b3800 2024-09-13T23:57:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.590+0000 7fe582a91f40 1 --2- 172.21.15.173:0/3824031535 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x556faed5f000 0x556faec99b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.590+0000 7fe580a49700 1 --2- 172.21.15.173:0/3824031535 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556faed5ec00 0x556faec99600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.590+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f400 con 0x556faed5f000 2024-09-13T23:57:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.590+0000 7fe581a4b700 1 --2- 172.21.15.173:0/3824031535 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x556faed5f000 0x556faec99b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.590+0000 7fe581a4b700 1 --2- 172.21.15.173:0/3824031535 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x556faed5f000 0x556faec99b80 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.590+0000 7fe580a49700 1 --2- 172.21.15.173:0/3824031535 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556faed5ec00 0x556faec99600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x556faed3f650 tx=0x556faed23500 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.590+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.590+0000 7fe582a91f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.590+0000 7fe582a91f40 20 realm 2024-09-13T23:57:00.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.590+0000 7fe582a91f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.590+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5f000 2024-09-13T23:57:00.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.594+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.594+0000 7fe582a91f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.594+0000 7fe582a91f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:00.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.594+0000 7fe582a91f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.594+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5fc00 con 0x556faed5f000 2024-09-13T23:57:00.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.594+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.594+0000 7fe582a91f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.594+0000 7fe582a91f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.594+0000 7fe582a91f40 1 --2- 172.21.15.173:0/3824031535 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x556faed5f400 0x556faec9a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.594+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5f400 2024-09-13T23:57:00.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.594+0000 7fe58124a700 1 --2- 172.21.15.173:0/3824031535 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x556faed5f400 0x556faec9a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.594+0000 7fe58124a700 1 --2- 172.21.15.173:0/3824031535 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x556faed5f400 0x556faec9a100 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.594+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x556faedf1200 con 0x556faed5f400 2024-09-13T23:57:00.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.594+0000 7fe582a91f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:00.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.594+0000 7fe582a91f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.594+0000 7fe582a91f40 1 --2- 172.21.15.173:0/3824031535 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x556faed5fc00 0x556faec9a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.594+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee1a000 con 0x556faed5fc00 2024-09-13T23:57:00.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.594+0000 7fe580a49700 1 --2- 172.21.15.173:0/3824031535 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x556faed5fc00 0x556faec9a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.594+0000 7fe580a49700 1 --2- 172.21.15.173:0/3824031535 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x556faed5fc00 0x556faec9a680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.594+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x556faedf1440 con 0x556faed5fc00 2024-09-13T23:57:00.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.594+0000 7fe582a91f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:00.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.594+0000 7fe582a91f40 20 searching for the correct realm 2024-09-13T23:57:00.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.594+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee1a400 con 0x556faed5fc00 2024-09-13T23:57:00.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.598+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x556faedf1440 con 0x556faed5fc00 2024-09-13T23:57:00.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.598+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee1a000 con 0x556faed5f400 2024-09-13T23:57:00.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.598+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf1200 con 0x556faed5f400 2024-09-13T23:57:00.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.598+0000 7fe58124a700 1 --2- 172.21.15.173:0/3824031535 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x556faee1a000 0x556faec9ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.598+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faee1a000 2024-09-13T23:57:00.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.598+0000 7fe581a4b700 1 --2- 172.21.15.173:0/3824031535 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x556faee1a000 0x556faec9ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.598+0000 7fe581a4b700 1 --2- 172.21.15.173:0/3824031535 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x556faee1a000 0x556faec9ac00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.598+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf0b40 con 0x556faee1a000 2024-09-13T23:57:00.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.598+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5f000 2024-09-13T23:57:00.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.598+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.598+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5f000 2024-09-13T23:57:00.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.598+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.598+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5fc00 2024-09-13T23:57:00.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.598+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf1440 con 0x556faed5fc00 2024-09-13T23:57:00.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.598+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5f000 2024-09-13T23:57:00.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.598+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.598+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5f400 2024-09-13T23:57:00.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.602+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf1200 con 0x556faed5f400 2024-09-13T23:57:00.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.602+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5f400 2024-09-13T23:57:00.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.602+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf1200 con 0x556faed5f400 2024-09-13T23:57:00.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.602+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5f000 2024-09-13T23:57:00.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.602+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.602+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faee1a000 2024-09-13T23:57:00.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.602+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf0b40 con 0x556faee1a000 2024-09-13T23:57:00.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.602+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5f000 2024-09-13T23:57:00.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.602+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.602+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faee1a000 2024-09-13T23:57:00.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.602+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf0b40 con 0x556faee1a000 2024-09-13T23:57:00.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.602+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5f400 2024-09-13T23:57:00.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.606+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf1200 con 0x556faed5f400 2024-09-13T23:57:00.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.606+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5fc00 2024-09-13T23:57:00.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.606+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf1440 con 0x556faed5fc00 2024-09-13T23:57:00.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.606+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5f000 2024-09-13T23:57:00.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.606+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.606+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5f400 2024-09-13T23:57:00.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.606+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf1200 con 0x556faed5f400 2024-09-13T23:57:00.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.606+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5fc00 2024-09-13T23:57:00.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.606+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf1440 con 0x556faed5fc00 2024-09-13T23:57:00.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.606+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5f000 2024-09-13T23:57:00.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.606+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.606+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5f000 2024-09-13T23:57:00.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.606+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.606+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5f000 2024-09-13T23:57:00.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.610+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.610+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5fc00 2024-09-13T23:57:00.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.610+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf1440 con 0x556faed5fc00 2024-09-13T23:57:00.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.610+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faee1a000 2024-09-13T23:57:00.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.610+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf0b40 con 0x556faee1a000 2024-09-13T23:57:00.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.610+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5f000 2024-09-13T23:57:00.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.610+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.610+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faee1a000 2024-09-13T23:57:00.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.610+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf0b40 con 0x556faee1a000 2024-09-13T23:57:00.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.610+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5fc00 2024-09-13T23:57:00.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.610+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf1440 con 0x556faed5fc00 2024-09-13T23:57:00.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.610+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faee1a000 2024-09-13T23:57:00.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.610+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf0b40 con 0x556faee1a000 2024-09-13T23:57:00.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.610+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5f400 2024-09-13T23:57:00.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.614+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf1200 con 0x556faed5f400 2024-09-13T23:57:00.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.614+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5f400 2024-09-13T23:57:00.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.614+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf1200 con 0x556faed5f400 2024-09-13T23:57:00.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.614+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5fc00 2024-09-13T23:57:00.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.614+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf1440 con 0x556faed5fc00 2024-09-13T23:57:00.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.614+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5f400 2024-09-13T23:57:00.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.614+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x556faedf1200 con 0x556faed5f400 2024-09-13T23:57:00.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.614+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faed5f400 2024-09-13T23:57:00.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.614+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556faedf1200 con 0x556faed5f400 2024-09-13T23:57:00.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.614+0000 7fe582a91f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:00.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.614+0000 7fe582a91f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:00.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.614+0000 7fe582a91f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:00.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.614+0000 7fe582a91f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:00.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.614+0000 7fe582a91f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.614+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee1a800 con 0x556faed5f000 2024-09-13T23:57:00.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.614+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.614+0000 7fe582a91f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.614+0000 7fe582a91f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.614+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee1ac00 con 0x556faed5f400 2024-09-13T23:57:00.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x556faedf1200 con 0x556faed5f400 2024-09-13T23:57:00.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe582a91f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:00.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe582a91f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee1b000 con 0x556faed5f000 2024-09-13T23:57:00.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe582a91f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:00.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe582a91f40 20 zone default found 2024-09-13T23:57:00.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe582a91f40 4 Realm: () 2024-09-13T23:57:00.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe582a91f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:00.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe582a91f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:00.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe582a91f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:00.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe582a91f40 20 zonegroup default 2024-09-13T23:57:00.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe582a91f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee1b400 con 0x556faee1a000 2024-09-13T23:57:00.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x556faedf0b40 con 0x556faee1a000 2024-09-13T23:57:00.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe582a91f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe582a91f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee1b800 con 0x556faed5fc00 2024-09-13T23:57:00.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x556faedf1440 con 0x556faed5fc00 2024-09-13T23:57:00.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe582a91f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe582a91f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee1bc00 con 0x556faed5fc00 2024-09-13T23:57:00.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x556faedf1440 con 0x556faed5fc00 2024-09-13T23:57:00.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe582a91f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe582a91f40 20 started sync module instance, tier type = 2024-09-13T23:57:00.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe582a91f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:00.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.618+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee20000 con 0x556faed5f400 2024-09-13T23:57:00.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.622+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf1200 con 0x556faed5f400 2024-09-13T23:57:00.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.622+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93938162137856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee20400 con 0x556faed5f400 2024-09-13T23:57:00.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.622+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee20800 con 0x556faed5f000 2024-09-13T23:57:00.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.626+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.626+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93938162139008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee20c00 con 0x556faed5f000 2024-09-13T23:57:00.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.626+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee21000 con 0x556faed5f400 2024-09-13T23:57:00.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.626+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93938162137856] v33'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf1200 con 0x556faed5f400 2024-09-13T23:57:00.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.626+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf1200 con 0x556faed5f400 2024-09-13T23:57:00.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.626+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93938162139008] v33'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.626+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93938162140160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee21400 con 0x556faed5f400 2024-09-13T23:57:00.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.626+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee21800 con 0x556faee1a000 2024-09-13T23:57:00.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.630+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf0b40 con 0x556faee1a000 2024-09-13T23:57:00.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.630+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93938162141312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee21c00 con 0x556faee1a000 2024-09-13T23:57:00.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.630+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee20800 con 0x556faed5f400 2024-09-13T23:57:00.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.634+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93938162140160] v33'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf1200 con 0x556faed5f400 2024-09-13T23:57:00.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.634+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93938162141312] v33'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf0b40 con 0x556faee1a000 2024-09-13T23:57:00.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.634+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf1200 con 0x556faed5f400 2024-09-13T23:57:00.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.634+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93938162142464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee20000 con 0x556faed5f400 2024-09-13T23:57:00.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.634+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee1a800 con 0x556faed5fc00 2024-09-13T23:57:00.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.634+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf1440 con 0x556faed5fc00 2024-09-13T23:57:00.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.634+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93938162143616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee1b000 con 0x556faed5fc00 2024-09-13T23:57:00.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.634+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee1b400 con 0x556faed5fc00 2024-09-13T23:57:00.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.634+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93938162142464] v33'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf1200 con 0x556faed5f400 2024-09-13T23:57:00.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.638+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93938162143616] v33'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf1440 con 0x556faed5fc00 2024-09-13T23:57:00.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.638+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf1440 con 0x556faed5fc00 2024-09-13T23:57:00.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.638+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93938162144768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee1ac00 con 0x556faed5fc00 2024-09-13T23:57:00.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.638+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed5f800 con 0x556faee1a000 2024-09-13T23:57:00.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.638+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93938162144768] v33'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf1440 con 0x556faed5fc00 2024-09-13T23:57:00.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.638+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf0b40 con 0x556faee1a000 2024-09-13T23:57:00.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.638+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93938162145920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee20400 con 0x556faee1a000 2024-09-13T23:57:00.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.638+0000 7fe582a91f40 20 add_watcher() i=0 2024-09-13T23:57:00.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.638+0000 7fe582a91f40 20 add_watcher() i=1 2024-09-13T23:57:00.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.638+0000 7fe582a91f40 20 add_watcher() i=2 2024-09-13T23:57:00.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.638+0000 7fe582a91f40 20 add_watcher() i=3 2024-09-13T23:57:00.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.638+0000 7fe582a91f40 20 add_watcher() i=4 2024-09-13T23:57:00.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.638+0000 7fe582a91f40 20 add_watcher() i=5 2024-09-13T23:57:00.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.638+0000 7fe582a91f40 20 add_watcher() i=6 2024-09-13T23:57:00.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.642+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93938162145920] v33'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf0b40 con 0x556faee1a000 2024-09-13T23:57:00.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.642+0000 7fe582a91f40 20 add_watcher() i=7 2024-09-13T23:57:00.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.642+0000 7fe582a91f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:00.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.642+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee21000 con 0x556faed5f000 2024-09-13T23:57:00.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.642+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.642+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93938163802112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee21400 con 0x556faed5f000 2024-09-13T23:57:00.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.642+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93938163802112] v33'70 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.642+0000 7fe568218700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:00.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.642+0000 7fe582a91f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:00.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.642+0000 7fe582a91f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:00.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.642+0000 7fe582a91f40 1 Processor -- start 2024-09-13T23:57:00.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.642+0000 7fe582a91f40 1 -- start start 2024-09-13T23:57:00.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.642+0000 7fe582a91f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556faee1a400 0x556faec9b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.642+0000 7fe582a91f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556faea403c0 con 0x556faee1a400 2024-09-13T23:57:00.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.646+0000 7fe580a49700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556faee1a400 0x556faec9b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.646+0000 7fe580a49700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556faee1a400 0x556faec9b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59022/0 (socket says 172.21.15.173:59022) 2024-09-13T23:57:00.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.646+0000 7fe580a49700 1 -- 172.21.15.173:0/43762756 learned_addr learned my addr 172.21.15.173:0/43762756 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.646+0000 7fe580a49700 1 -- 172.21.15.173:0/43762756 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fae9c4b60 con 0x556faee1a400 2024-09-13T23:57:00.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.646+0000 7fe580a49700 1 --2- 172.21.15.173:0/43762756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556faee1a400 0x556faec9b180 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x556faee30030 tx=0x556faed234a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecaa76ff242ea79b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.646+0000 7fe567a17700 1 -- 172.21.15.173:0/43762756 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556faee38000 con 0x556faee1a400 2024-09-13T23:57:00.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.646+0000 7fe567a17700 1 -- 172.21.15.173:0/43762756 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556faed70600 con 0x556faee1a400 2024-09-13T23:57:00.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.646+0000 7fe567a17700 1 -- 172.21.15.173:0/43762756 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556faee38160 con 0x556faee1a400 2024-09-13T23:57:00.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.646+0000 7fe582a91f40 1 -- 172.21.15.173:0/43762756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556faee1a400 msgr2=0x556faec9b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.646+0000 7fe582a91f40 1 --2- 172.21.15.173:0/43762756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556faee1a400 0x556faec9b180 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x556faee30030 tx=0x556faed234a0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.646+0000 7fe582a91f40 1 -- 172.21.15.173:0/43762756 shutdown_connections 2024-09-13T23:57:00.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.646+0000 7fe582a91f40 1 --2- 172.21.15.173:0/43762756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556faee1a400 0x556faec9b180 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.646+0000 7fe582a91f40 1 -- 172.21.15.173:0/43762756 >> 172.21.15.173:0/43762756 conn(0x556faee20800 msgr2=0x556faeab4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.646+0000 7fe582a91f40 1 -- 172.21.15.173:0/43762756 shutdown_connections 2024-09-13T23:57:00.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.646+0000 7fe582a91f40 1 -- 172.21.15.173:0/43762756 wait complete. 2024-09-13T23:57:00.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.646+0000 7fe582a91f40 1 Processor -- start 2024-09-13T23:57:00.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.646+0000 7fe582a91f40 1 -- start start 2024-09-13T23:57:00.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.646+0000 7fe582a91f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556faee1a400 0x556faec9b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.646+0000 7fe582a91f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556faea40500 con 0x556faee1a400 2024-09-13T23:57:00.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.646+0000 7fe580a49700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556faee1a400 0x556faec9b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.646+0000 7fe580a49700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556faee1a400 0x556faec9b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59028/0 (socket says 172.21.15.173:59028) 2024-09-13T23:57:00.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.646+0000 7fe580a49700 1 -- 172.21.15.173:0/3799001904 learned_addr learned my addr 172.21.15.173:0/3799001904 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.650+0000 7fe580a49700 1 -- 172.21.15.173:0/3799001904 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fae9c4d00 con 0x556faee1a400 2024-09-13T23:57:00.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.650+0000 7fe580a49700 1 --2- 172.21.15.173:0/3799001904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556faee1a400 0x556faec9b180 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x556faee30240 tx=0x556faed23620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.650+0000 7fe566214700 1 -- 172.21.15.173:0/3799001904 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556faee382c0 con 0x556faee1a400 2024-09-13T23:57:00.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.650+0000 7fe566214700 1 -- 172.21.15.173:0/3799001904 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556faed70300 con 0x556faee1a400 2024-09-13T23:57:00.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.650+0000 7fe582a91f40 1 -- 172.21.15.173:0/3799001904 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556fae9c4340 con 0x556faee1a400 2024-09-13T23:57:00.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.650+0000 7fe566214700 1 -- 172.21.15.173:0/3799001904 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556faee38000 con 0x556faee1a400 2024-09-13T23:57:00.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.650+0000 7fe582a91f40 1 -- 172.21.15.173:0/3799001904 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556fae9c4b60 con 0x556faee1a400 2024-09-13T23:57:00.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.650+0000 7fe566214700 1 -- 172.21.15.173:0/3799001904 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x556faeaadb80 con 0x556faee1a400 2024-09-13T23:57:00.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.650+0000 7fe566214700 1 --2- 172.21.15.173:0/3799001904 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556faed5f800 0x556faeeb8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.650+0000 7fe566214700 1 -- 172.21.15.173:0/3799001904 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x556faea19500 con 0x556faee1a400 2024-09-13T23:57:00.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.650+0000 7fe582a91f40 5 note: GC not initialized 2024-09-13T23:57:00.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.650+0000 7fe581a4b700 1 --2- 172.21.15.173:0/3799001904 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556faed5f800 0x556faeeb8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.650+0000 7fe581a4b700 1 --2- 172.21.15.173:0/3799001904 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556faed5f800 0x556faeeb8000 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x556faece6750 tx=0x556faed207e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.654+0000 7fe582a91f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:00.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.654+0000 7fe582a91f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:00.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.654+0000 7fe561a0b700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:30 2024 2024-09-13T23:57:00.659 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:00.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.654+0000 7fe5611e9700 20 reqs_thread_entry: start 2024-09-13T23:57:00.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.654+0000 7fe582a91f40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:57:00.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.654+0000 7fe582a91f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.654+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee1a800 con 0x556faed5f000 2024-09-13T23:57:00.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.654+0000 7fe563a0f700 20 reqs_thread_entry: start 2024-09-13T23:57:00.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.654+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.654+0000 7fe582a91f40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:57:00.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.654+0000 7fe582a91f40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:57:00.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.654+0000 7fe582a91f40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:00.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.654+0000 7fe582a91f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:00.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.654+0000 7fe582a91f40 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-13T23:57:00.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.654+0000 7fe582a91f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.654+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee20c00 con 0x556faed5f000 2024-09-13T23:57:00.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.654+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.654+0000 7fe582a91f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.654+0000 7fe582a91f40 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-13T23:57:00.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.654+0000 7fe582a91f40 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-13T23:57:00.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.654+0000 7fe582a91f40 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-13T23:57:00.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.654+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~513 in=513b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee21c00 con 0x556faed5f000 2024-09-13T23:57:00.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.658+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~513] v33'6 uv6 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.658+0000 7fe582a91f40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:57:00.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.658+0000 7fe582a91f40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:00.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.658+0000 7fe582a91f40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:57:00.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.658+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93938163804416 in=701b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee20400 con 0x556faed5f400 2024-09-13T23:57:00.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.658+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== watch-notify(notify (1) cookie 93938162142464 notify 141733920775 ret 0) v3 ==== 731+0+0 (crc 0 0 0) 0x556faed1a680 con 0x556faed5f400 2024-09-13T23:57:00.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.658+0000 7fe57ba3f700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920775 cookie 93938162142464 notifier 4384 bl.length()=689 2024-09-13T23:57:00.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.658+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(65 notify.4 [notify cookie 93938163804416 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x556faedf1200 con 0x556faed5f400 2024-09-13T23:57:00.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.658+0000 7fe57ba3f700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:57:00.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.658+0000 7fe57ba3f700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:00.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.658+0000 7fe57ba3f700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee21000 con 0x556faed5f400 2024-09-13T23:57:00.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.658+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf1200 con 0x556faed5f400 2024-09-13T23:57:00.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.658+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== watch-notify(notify_complete (2) cookie 93938163804416 notify 141733920775 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556faed1a820 con 0x556faed5f400 2024-09-13T23:57:00.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.658+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee21400 con 0x556faed5f000 2024-09-13T23:57:00.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.662+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.662+0000 7fe582a91f40 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-13T23:57:00.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.662+0000 7fe582a91f40 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-13T23:57:00.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.662+0000 7fe582a91f40 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-13T23:57:00.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.662+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93938163804416 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee20c00 con 0x556faed5f400 2024-09-13T23:57:00.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.662+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== watch-notify(notify (1) cookie 93938162137856 notify 141733920776 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x556faed1a820 con 0x556faed5f400 2024-09-13T23:57:00.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.662+0000 7fe57ba3f700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920776 cookie 93938162137856 notifier 4384 bl.length()=166 2024-09-13T23:57:00.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.662+0000 7fe57ba3f700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-13T23:57:00.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.662+0000 7fe57ba3f700 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-13T23:57:00.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.662+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(68 notify.0 [notify cookie 93938163804416 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x556faedf1200 con 0x556faed5f400 2024-09-13T23:57:00.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.662+0000 7fe57ba3f700 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee1a800 con 0x556faed5f400 2024-09-13T23:57:00.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.662+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf1200 con 0x556faed5f400 2024-09-13T23:57:00.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.662+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== watch-notify(notify_complete (2) cookie 93938163804416 notify 141733920776 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556faed1a9c0 con 0x556faed5f400 2024-09-13T23:57:00.669 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:00.669 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "foo", 2024-09-13T23:57:00.669 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Foo", 2024-09-13T23:57:00.669 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "foo@foo.com", 2024-09-13T23:57:00.669 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:57:00.669 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:57:00.669 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [ 2024-09-13T23:57:00.669 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:00.669 INFO:teuthology.orchestra.run.smithi173.stdout: "id": "foo:foo1", 2024-09-13T23:57:00.670 INFO:teuthology.orchestra.run.smithi173.stdout: "permissions": "full-control" 2024-09-13T23:57:00.670 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:00.670 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:00.670 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:57:00.670 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:00.670 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:57:00.670 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-09-13T23:57:00.670 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-09-13T23:57:00.670 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:00.670 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:00.670 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [ 2024-09-13T23:57:00.670 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:00.670 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo:foo1", 2024-09-13T23:57:00.670 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "iXiDRIl0gqQ2pOC0pi9ct01BuF8XarP6wLNBt0U4" 2024-09-13T23:57:00.671 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:00.671 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:00.671 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:57:00.671 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:57:00.671 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:57:00.671 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:57:00.671 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:57:00.671 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:57:00.671 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:00.671 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:00.671 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:00.672 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:00.672 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:00.672 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:00.672 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:57:00.672 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:00.672 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:00.672 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:00.672 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:00.672 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:00.672 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:00.673 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:57:00.673 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:57:00.673 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:57:00.673 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:00.673 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:57:00.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.666+0000 7fe568218700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:00.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.666+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93938163802112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee21c00 con 0x556faed5f000 2024-09-13T23:57:00.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.666+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93938163802112] v33'71 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.666+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93938162137856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee21800 con 0x556faed5f400 2024-09-13T23:57:00.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.670+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93938162137856] v33'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf1200 con 0x556faed5f400 2024-09-13T23:57:00.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.670+0000 7fe582a91f40 20 remove_watcher() i=0 2024-09-13T23:57:00.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.670+0000 7fe582a91f40 2 removed watcher, disabling cache 2024-09-13T23:57:00.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.670+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93938162139008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee1a800 con 0x556faed5f000 2024-09-13T23:57:00.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.674+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.1 v2:172.21.15.173:6808/3256211813 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93938162139008] v33'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf0b40 con 0x556faed5f000 2024-09-13T23:57:00.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.674+0000 7fe582a91f40 20 remove_watcher() i=1 2024-09-13T23:57:00.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.674+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93938162140160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee20000 con 0x556faed5f400 2024-09-13T23:57:00.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.674+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 27 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93938162140160] v33'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf1200 con 0x556faed5f400 2024-09-13T23:57:00.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.674+0000 7fe582a91f40 20 remove_watcher() i=2 2024-09-13T23:57:00.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.674+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93938162141312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee20400 con 0x556faee1a000 2024-09-13T23:57:00.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.678+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93938162141312] v33'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf0b40 con 0x556faee1a000 2024-09-13T23:57:00.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.678+0000 7fe582a91f40 20 remove_watcher() i=3 2024-09-13T23:57:00.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.678+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93938162142464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee21000 con 0x556faed5f400 2024-09-13T23:57:00.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.678+0000 7fe58124a700 1 -- 172.21.15.173:0/3824031535 <== osd.0 v2:172.21.15.87:6800/3507919120 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93938162142464] v33'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf1200 con 0x556faed5f400 2024-09-13T23:57:00.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.678+0000 7fe582a91f40 20 remove_watcher() i=4 2024-09-13T23:57:00.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.682+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93938162143616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faee20c00 con 0x556faed5fc00 2024-09-13T23:57:00.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.682+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93938162143616] v33'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf1440 con 0x556faed5fc00 2024-09-13T23:57:00.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.682+0000 7fe582a91f40 20 remove_watcher() i=5 2024-09-13T23:57:00.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.682+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93938162144768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed1c000 con 0x556faed5fc00 2024-09-13T23:57:00.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.686+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93938162144768] v33'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf1440 con 0x556faed5fc00 2024-09-13T23:57:00.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.686+0000 7fe582a91f40 20 remove_watcher() i=6 2024-09-13T23:57:00.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.686+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93938162145920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556faed1c400 con 0x556faee1a000 2024-09-13T23:57:00.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.686+0000 7fe581a4b700 1 -- 172.21.15.173:0/3824031535 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93938162145920] v33'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556faedf0b40 con 0x556faee1a000 2024-09-13T23:57:00.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.686+0000 7fe582a91f40 20 remove_watcher() i=7 2024-09-13T23:57:00.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.686+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x556faed5f400 msgr2=0x556faec9a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.686+0000 7fe582a91f40 1 --2- 172.21.15.173:0/3824031535 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x556faed5f400 0x556faec9a100 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.686+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x556faed5f000 msgr2=0x556faec99b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.686+0000 7fe582a91f40 1 --2- 172.21.15.173:0/3824031535 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x556faed5f000 0x556faec99b80 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.686+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x556faee1a000 msgr2=0x556faec9ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.686+0000 7fe582a91f40 1 --2- 172.21.15.173:0/3824031535 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x556faee1a000 0x556faec9ac00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.686+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x556faed5fc00 msgr2=0x556faec9a680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.686+0000 7fe582a91f40 1 --2- 172.21.15.173:0/3824031535 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x556faed5fc00 0x556faec9a680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.686+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556faed5ec00 msgr2=0x556faec99600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.686+0000 7fe582a91f40 1 --2- 172.21.15.173:0/3824031535 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556faed5ec00 0x556faec99600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x556faed3f650 tx=0x556faed23500 comp rx=0 tx=0).stop 2024-09-13T23:57:00.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.686+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3800 msgr2=0x556faec98b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.686+0000 7fe582a91f40 1 --2- 172.21.15.173:0/3824031535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3800 0x556faec98b00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x556faeb0fda0 tx=0x556faed22000 comp rx=0 tx=0).stop 2024-09-13T23:57:00.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.686+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 reap_dead start 2024-09-13T23:57:00.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.686+0000 7fe580a49700 1 -- 172.21.15.173:0/3824031535 reap_dead start 2024-09-13T23:57:00.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.686+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 shutdown_connections 2024-09-13T23:57:00.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.686+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 >> 172.21.15.173:0/3824031535 conn(0x556fae9b3400 msgr2=0x556faeab3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.686+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 shutdown_connections 2024-09-13T23:57:00.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.686+0000 7fe582a91f40 1 -- 172.21.15.173:0/3824031535 wait complete. 2024-09-13T23:57:00.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.690+0000 7fe582a91f40 1 -- 172.21.15.173:0/3799001904 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556faed5f800 msgr2=0x556faeeb8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.690+0000 7fe582a91f40 1 --2- 172.21.15.173:0/3799001904 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556faed5f800 0x556faeeb8000 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x556faece6750 tx=0x556faed207e0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.690+0000 7fe582a91f40 1 -- 172.21.15.173:0/3799001904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556faee1a400 msgr2=0x556faec9b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.690+0000 7fe582a91f40 1 --2- 172.21.15.173:0/3799001904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556faee1a400 0x556faec9b180 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x556faee30240 tx=0x556faed23620 comp rx=0 tx=0).stop 2024-09-13T23:57:00.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.690+0000 7fe582a91f40 1 -- 172.21.15.173:0/3799001904 shutdown_connections 2024-09-13T23:57:00.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.690+0000 7fe582a91f40 1 --2- 172.21.15.173:0/3799001904 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556faed5f800 0x556faeeb8000 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.690+0000 7fe582a91f40 1 --2- 172.21.15.173:0/3799001904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556faee1a400 0x556faec9b180 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.690+0000 7fe582a91f40 1 -- 172.21.15.173:0/3799001904 >> 172.21.15.173:0/3799001904 conn(0x556faee20800 msgr2=0x556faeab4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.690+0000 7fe582a91f40 1 -- 172.21.15.173:0/3799001904 shutdown_connections 2024-09-13T23:57:00.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.690+0000 7fe582a91f40 1 -- 172.21.15.173:0/3799001904 wait complete. 2024-09-13T23:57:00.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.690+0000 7fe582a91f40 1 -- 172.21.15.173:0/2991441987 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556faed5e000 msgr2=0x556faec99080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.690+0000 7fe582a91f40 1 --2- 172.21.15.173:0/2991441987 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556faed5e000 0x556faec99080 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x556faece7560 tx=0x556faed224e0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.690+0000 7fe582a91f40 1 -- 172.21.15.173:0/2991441987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3000 msgr2=0x556faec98580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.690+0000 7fe582a91f40 1 --2- 172.21.15.173:0/2991441987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3000 0x556faec98580 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x556faeb0f6b0 tx=0x556faeab7920 comp rx=0 tx=0).stop 2024-09-13T23:57:00.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.690+0000 7fe582a91f40 1 -- 172.21.15.173:0/2991441987 shutdown_connections 2024-09-13T23:57:00.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.690+0000 7fe582a91f40 1 --2- 172.21.15.173:0/2991441987 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556faed5e000 0x556faec99080 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.690+0000 7fe582a91f40 1 --2- 172.21.15.173:0/2991441987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556fae9b3000 0x556faec98580 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.690+0000 7fe582a91f40 1 -- 172.21.15.173:0/2991441987 >> 172.21.15.173:0/2991441987 conn(0x556fae9b2c00 msgr2=0x556faeab3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.690+0000 7fe582a91f40 1 -- 172.21.15.173:0/2991441987 shutdown_connections 2024-09-13T23:57:00.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.690+0000 7fe582a91f40 1 -- 172.21.15.173:0/2991441987 wait complete. 2024-09-13T23:57:00.700 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'iXiDRIl0gqQ2pOC0pi9ct01BuF8XarP6wLNBt0U4'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:57:00.700 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-13T23:57:00.700 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-13T23:57:00.700 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-13T23:57:00.747 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:00.747 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:00.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.742+0000 7f2e8224ef40 1 Processor -- start 2024-09-13T23:57:00.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.742+0000 7f2e8224ef40 1 -- start start 2024-09-13T23:57:00.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.742+0000 7f2e8224ef40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x556ed1c71400 0x556ed1f56580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.742+0000 7f2e8224ef40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556ed1d35500 con 0x556ed1c71000 2024-09-13T23:57:00.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.742+0000 7f2e8224ef40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x556ed1cfea00 con 0x556ed1c71400 2024-09-13T23:57:00.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.742+0000 7f2e80206700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x556ed1c71400 0x556ed1f56580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.742+0000 7f2e80a07700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x556ed1c71000 0x556ed1d70800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:57938/0 (socket says 172.21.15.173:57938) 2024-09-13T23:57:00.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.742+0000 7f2e80a07700 1 -- 172.21.15.173:0/3074764792 learned_addr learned my addr 172.21.15.173:0/3074764792 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.742+0000 7f2e7fa05700 1 -- 172.21.15.173:0/3074764792 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2364736065 0 0) 0x556ed1dcc000 con 0x556ed1c71000 2024-09-13T23:57:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.742+0000 7f2e7fa05700 1 -- 172.21.15.173:0/3074764792 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x556ed1d35680 con 0x556ed1c71000 2024-09-13T23:57:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.742+0000 7f2e80206700 1 -- 172.21.15.173:0/3074764792 >> v1:172.21.15.87:6789/0 conn(0x556ed1c71000 legacy=0x556ed1d70800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.746+0000 7f2e80206700 1 -- 172.21.15.173:0/3074764792 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ed1c83d40 con 0x556ed1c71400 2024-09-13T23:57:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.746+0000 7f2e80206700 1 --2- 172.21.15.173:0/3074764792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71400 0x556ed1f56580 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x556ed1f51920 tx=0x556ed1d75980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e640e8ab45d680bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.746+0000 7f2e7fa05700 1 -- 172.21.15.173:0/3074764792 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556ed1d154a0 con 0x556ed1c71400 2024-09-13T23:57:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.746+0000 7f2e7fa05700 1 -- 172.21.15.173:0/3074764792 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556ed1d35500 con 0x556ed1c71400 2024-09-13T23:57:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.746+0000 7f2e7fa05700 1 -- 172.21.15.173:0/3074764792 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556ed1d15600 con 0x556ed1c71400 2024-09-13T23:57:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.746+0000 7f2e8224ef40 1 -- 172.21.15.173:0/3074764792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71400 msgr2=0x556ed1f56580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.746+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/3074764792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71400 0x556ed1f56580 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x556ed1f51920 tx=0x556ed1d75980 comp rx=0 tx=0).stop 2024-09-13T23:57:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.746+0000 7f2e8224ef40 1 -- 172.21.15.173:0/3074764792 shutdown_connections 2024-09-13T23:57:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.746+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/3074764792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71400 0x556ed1f56580 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.746+0000 7f2e8224ef40 1 -- 172.21.15.173:0/3074764792 >> 172.21.15.173:0/3074764792 conn(0x556ed1c70c00 msgr2=0x556ed1d70000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.746+0000 7f2e8224ef40 1 -- 172.21.15.173:0/3074764792 shutdown_connections 2024-09-13T23:57:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.746+0000 7f2e8224ef40 1 -- 172.21.15.173:0/3074764792 wait complete. 2024-09-13T23:57:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.746+0000 7f2e8224ef40 1 Processor -- start 2024-09-13T23:57:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.746+0000 7f2e8224ef40 1 -- start start 2024-09-13T23:57:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.746+0000 7f2e8224ef40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71000 0x556ed1f56580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.746+0000 7f2e8224ef40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ed1cfe500 con 0x556ed1c71000 2024-09-13T23:57:00.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.746+0000 7f2e80a07700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71000 0x556ed1f56580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.746+0000 7f2e80a07700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71000 0x556ed1f56580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59050/0 (socket says 172.21.15.173:59050) 2024-09-13T23:57:00.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.746+0000 7f2e80a07700 1 -- 172.21.15.173:0/703819302 learned_addr learned my addr 172.21.15.173:0/703819302 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.750+0000 7f2e80a07700 1 -- 172.21.15.173:0/703819302 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ed1c83ba0 con 0x556ed1c71000 2024-09-13T23:57:00.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.750+0000 7f2e80a07700 1 --2- 172.21.15.173:0/703819302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71000 0x556ed1f56580 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x556ed2a3bd70 tx=0x556ed1d75b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa1ebde4e83d672 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.750+0000 7f2e7f204700 1 -- 172.21.15.173:0/703819302 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556ed1d154a0 con 0x556ed1c71000 2024-09-13T23:57:00.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.750+0000 7f2e7f204700 1 -- 172.21.15.173:0/703819302 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556ed1d35b00 con 0x556ed1c71000 2024-09-13T23:57:00.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.750+0000 7f2e7f204700 1 -- 172.21.15.173:0/703819302 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556ed1d15600 con 0x556ed1c71000 2024-09-13T23:57:00.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.750+0000 7f2e8224ef40 1 -- 172.21.15.173:0/703819302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71000 msgr2=0x556ed1f56580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.750+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/703819302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71000 0x556ed1f56580 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x556ed2a3bd70 tx=0x556ed1d75b60 comp rx=0 tx=0).stop 2024-09-13T23:57:00.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.750+0000 7f2e8224ef40 1 -- 172.21.15.173:0/703819302 shutdown_connections 2024-09-13T23:57:00.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.750+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/703819302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71000 0x556ed1f56580 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.750+0000 7f2e8224ef40 1 -- 172.21.15.173:0/703819302 >> 172.21.15.173:0/703819302 conn(0x556ed1c70c00 msgr2=0x556ed1d71000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.750+0000 7f2e8224ef40 1 -- 172.21.15.173:0/703819302 shutdown_connections 2024-09-13T23:57:00.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.750+0000 7f2e8224ef40 1 -- 172.21.15.173:0/703819302 wait complete. 2024-09-13T23:57:00.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.750+0000 7f2e8224ef40 1 Processor -- start 2024-09-13T23:57:00.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.750+0000 7f2e8224ef40 1 -- start start 2024-09-13T23:57:00.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.750+0000 7f2e8224ef40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71000 0x556ed1f56580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.750+0000 7f2e8224ef40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ed1cfe3c0 con 0x556ed1c71000 2024-09-13T23:57:00.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.754+0000 7f2e80a07700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71000 0x556ed1f56580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.754+0000 7f2e80a07700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71000 0x556ed1f56580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59062/0 (socket says 172.21.15.173:59062) 2024-09-13T23:57:00.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.754+0000 7f2e80a07700 1 -- 172.21.15.173:0/2077256224 learned_addr learned my addr 172.21.15.173:0/2077256224 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.754+0000 7f2e80a07700 1 -- 172.21.15.173:0/2077256224 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ed1c83a00 con 0x556ed1c71000 2024-09-13T23:57:00.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.754+0000 7f2e80a07700 1 --2- 172.21.15.173:0/2077256224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71000 0x556ed1f56580 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x556ed2a3be60 tx=0x556ed1d75920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.754+0000 7f2e7da01700 1 -- 172.21.15.173:0/2077256224 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556ed1d158c0 con 0x556ed1c71000 2024-09-13T23:57:00.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.754+0000 7f2e7da01700 1 -- 172.21.15.173:0/2077256224 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556ed1d35c80 con 0x556ed1c71000 2024-09-13T23:57:00.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.754+0000 7f2e7da01700 1 -- 172.21.15.173:0/2077256224 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556ed1d154a0 con 0x556ed1c71000 2024-09-13T23:57:00.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.754+0000 7f2e8224ef40 1 -- 172.21.15.173:0/2077256224 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556ed1c83860 con 0x556ed1c71000 2024-09-13T23:57:00.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.754+0000 7f2e8224ef40 1 -- 172.21.15.173:0/2077256224 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556ed1c836c0 con 0x556ed1c71000 2024-09-13T23:57:00.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.754+0000 7f2e8224ef40 1 Processor -- start 2024-09-13T23:57:00.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.754+0000 7f2e7da01700 1 -- 172.21.15.173:0/2077256224 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x556ed1d6ab00 con 0x556ed1c71000 2024-09-13T23:57:00.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.754+0000 7f2e8224ef40 1 -- start start 2024-09-13T23:57:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.754+0000 7f2e7da01700 1 --2- 172.21.15.173:0/2077256224 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556ed2008000 0x556ed1f57080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.754+0000 7f2e7da01700 1 -- 172.21.15.173:0/2077256224 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x556ed1cd7180 con 0x556ed1c71000 2024-09-13T23:57:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.754+0000 7f2e8224ef40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71800 0x556ed1f56b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.754+0000 7f2e8224ef40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ed1c96640 con 0x556ed1c71800 2024-09-13T23:57:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.754+0000 7f2e81208700 1 --2- 172.21.15.173:0/2077256224 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556ed2008000 0x556ed1f57080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.758+0000 7f2e80a07700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71800 0x556ed1f56b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.758+0000 7f2e80a07700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71800 0x556ed1f56b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59078/0 (socket says 172.21.15.173:59078) 2024-09-13T23:57:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.758+0000 7f2e80a07700 1 -- 172.21.15.173:0/2374042257 learned_addr learned my addr 172.21.15.173:0/2374042257 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.758+0000 7f2e80a07700 1 -- 172.21.15.173:0/2374042257 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ed1c82000 con 0x556ed1c71800 2024-09-13T23:57:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.758+0000 7f2e81208700 1 --2- 172.21.15.173:0/2077256224 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556ed2008000 0x556ed1f57080 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x556ed2a3be90 tx=0x556ed1fcca20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.758+0000 7f2e80a07700 1 --2- 172.21.15.173:0/2374042257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71800 0x556ed1f56b00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x556ed1f96300 tx=0x556ed1fcc240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88138e09578b08d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.758+0000 7f2e7b1fc700 1 -- 172.21.15.173:0/2374042257 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556ed1d15600 con 0x556ed1c71800 2024-09-13T23:57:00.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.758+0000 7f2e7b1fc700 1 -- 172.21.15.173:0/2374042257 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556ed1d35c80 con 0x556ed1c71800 2024-09-13T23:57:00.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.758+0000 7f2e7b1fc700 1 -- 172.21.15.173:0/2374042257 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556ed1d15a20 con 0x556ed1c71800 2024-09-13T23:57:00.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.758+0000 7f2e8224ef40 1 -- 172.21.15.173:0/2374042257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71800 msgr2=0x556ed1f56b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.758+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/2374042257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71800 0x556ed1f56b00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x556ed1f96300 tx=0x556ed1fcc240 comp rx=0 tx=0).stop 2024-09-13T23:57:00.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.758+0000 7f2e8224ef40 1 -- 172.21.15.173:0/2374042257 shutdown_connections 2024-09-13T23:57:00.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.758+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/2374042257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71800 0x556ed1f56b00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.758+0000 7f2e8224ef40 1 -- 172.21.15.173:0/2374042257 >> 172.21.15.173:0/2374042257 conn(0x556ed1c71400 msgr2=0x556ed1d71800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.758+0000 7f2e8224ef40 1 -- 172.21.15.173:0/2374042257 shutdown_connections 2024-09-13T23:57:00.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.758+0000 7f2e8224ef40 1 -- 172.21.15.173:0/2374042257 wait complete. 2024-09-13T23:57:00.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.758+0000 7f2e8224ef40 1 Processor -- start 2024-09-13T23:57:00.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.758+0000 7f2e8224ef40 1 -- start start 2024-09-13T23:57:00.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.758+0000 7f2e8224ef40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71800 0x556ed1f56b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.758+0000 7f2e8224ef40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ed1c968c0 con 0x556ed1c71800 2024-09-13T23:57:00.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.762+0000 7f2e80a07700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71800 0x556ed1f56b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.762+0000 7f2e80a07700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71800 0x556ed1f56b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59092/0 (socket says 172.21.15.173:59092) 2024-09-13T23:57:00.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.762+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 learned_addr learned my addr 172.21.15.173:0/4082799014 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.762+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ed1c82ea0 con 0x556ed1c71800 2024-09-13T23:57:00.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.762+0000 7f2e80a07700 1 --2- 172.21.15.173:0/4082799014 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71800 0x556ed1f56b00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x556ed1ff0a50 tx=0x556ed1fccc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.762+0000 7f2e799f9700 1 -- 172.21.15.173:0/4082799014 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556ed1d15600 con 0x556ed1c71800 2024-09-13T23:57:00.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.762+0000 7f2e799f9700 1 -- 172.21.15.173:0/4082799014 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556ed2026000 con 0x556ed1c71800 2024-09-13T23:57:00.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.762+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556ed1c82820 con 0x556ed1c71800 2024-09-13T23:57:00.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.762+0000 7f2e799f9700 1 -- 172.21.15.173:0/4082799014 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556ed1d15a20 con 0x556ed1c71800 2024-09-13T23:57:00.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.762+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556ed1c829c0 con 0x556ed1c71800 2024-09-13T23:57:00.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.762+0000 7f2e799f9700 1 -- 172.21.15.173:0/4082799014 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x556ed1d6adc0 con 0x556ed1c71800 2024-09-13T23:57:00.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.762+0000 7f2e799f9700 1 --2- 172.21.15.173:0/4082799014 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556ed2009000 0x556ed1f57600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.762+0000 7f2e799f9700 1 -- 172.21.15.173:0/4082799014 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x556ed1cd7340 con 0x556ed1c71800 2024-09-13T23:57:00.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.762+0000 7f2e80206700 1 --2- 172.21.15.173:0/4082799014 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556ed2009000 0x556ed1f57600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.762+0000 7f2e8224ef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.762+0000 7f2e80206700 1 --2- 172.21.15.173:0/4082799014 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556ed2009000 0x556ed1f57600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x556ed1f51920 tx=0x556ed1d75800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.762+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/4082799014 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x556ed2009400 0x556ed1f57b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.762+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed2009800 con 0x556ed2009400 2024-09-13T23:57:00.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.766+0000 7f2e81208700 1 --2- 172.21.15.173:0/4082799014 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x556ed2009400 0x556ed1f57b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.766+0000 7f2e81208700 1 --2- 172.21.15.173:0/4082799014 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x556ed2009400 0x556ed1f57b80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.766+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x556ed2098b40 con 0x556ed2009400 2024-09-13T23:57:00.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.766+0000 7f2e8224ef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.766+0000 7f2e8224ef40 20 realm 2024-09-13T23:57:00.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.766+0000 7f2e8224ef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.766+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed2009c00 con 0x556ed2009400 2024-09-13T23:57:00.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.766+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x556ed2098b40 con 0x556ed2009400 2024-09-13T23:57:00.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.766+0000 7f2e8224ef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.766+0000 7f2e8224ef40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:00.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.766+0000 7f2e8224ef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.766+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed2009800 con 0x556ed2009400 2024-09-13T23:57:00.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.766+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x556ed2098b40 con 0x556ed2009400 2024-09-13T23:57:00.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.766+0000 7f2e8224ef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.766+0000 7f2e8224ef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.766+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/4082799014 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x556ed2009c00 0x556ed1f58100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.766+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed2009c00 2024-09-13T23:57:00.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.766+0000 7f2e80a07700 1 --2- 172.21.15.173:0/4082799014 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x556ed2009c00 0x556ed1f58100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.766+0000 7f2e80a07700 1 --2- 172.21.15.173:0/4082799014 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x556ed2009c00 0x556ed1f58100 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.766+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x556ed2099200 con 0x556ed2009c00 2024-09-13T23:57:00.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.770+0000 7f2e8224ef40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:00.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.770+0000 7f2e8224ef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.770+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/4082799014 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x556ed20a2400 0x556ed1f58680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.770+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2800 con 0x556ed20a2400 2024-09-13T23:57:00.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.770+0000 7f2e80206700 1 --2- 172.21.15.173:0/4082799014 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x556ed20a2400 0x556ed1f58680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.770+0000 7f2e80206700 1 --2- 172.21.15.173:0/4082799014 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x556ed20a2400 0x556ed1f58680 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.770+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x556ed2099440 con 0x556ed20a2400 2024-09-13T23:57:00.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.770+0000 7f2e8224ef40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:00.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.770+0000 7f2e8224ef40 20 searching for the correct realm 2024-09-13T23:57:00.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.770+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2c00 con 0x556ed20a2400 2024-09-13T23:57:00.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.770+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x556ed2099440 con 0x556ed20a2400 2024-09-13T23:57:00.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.770+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2800 con 0x556ed2009c00 2024-09-13T23:57:00.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.770+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2099200 con 0x556ed2009c00 2024-09-13T23:57:00.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.770+0000 7f2e80a07700 1 --2- 172.21.15.173:0/4082799014 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x556ed20a2800 0x556ed1f58c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.770+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed20a2800 2024-09-13T23:57:00.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.770+0000 7f2e81208700 1 --2- 172.21.15.173:0/4082799014 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x556ed20a2800 0x556ed1f58c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.770+0000 7f2e81208700 1 --2- 172.21.15.173:0/4082799014 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x556ed20a2800 0x556ed1f58c00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.770+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2098b40 con 0x556ed20a2800 2024-09-13T23:57:00.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.770+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed2009400 2024-09-13T23:57:00.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.774+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x556ed2098b40 con 0x556ed2009400 2024-09-13T23:57:00.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.774+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed2009400 2024-09-13T23:57:00.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.774+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2098b40 con 0x556ed2009400 2024-09-13T23:57:00.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.774+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed20a2400 2024-09-13T23:57:00.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.774+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2099440 con 0x556ed20a2400 2024-09-13T23:57:00.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.774+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed2009400 2024-09-13T23:57:00.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.774+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2098b40 con 0x556ed2009400 2024-09-13T23:57:00.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.774+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed2009c00 2024-09-13T23:57:00.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.774+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2099200 con 0x556ed2009c00 2024-09-13T23:57:00.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.774+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed2009c00 2024-09-13T23:57:00.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.774+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2099200 con 0x556ed2009c00 2024-09-13T23:57:00.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.774+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed2009400 2024-09-13T23:57:00.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.774+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2098b40 con 0x556ed2009400 2024-09-13T23:57:00.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.774+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed20a2800 2024-09-13T23:57:00.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.774+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2098b40 con 0x556ed20a2800 2024-09-13T23:57:00.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.774+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed2009400 2024-09-13T23:57:00.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.778+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2098b40 con 0x556ed2009400 2024-09-13T23:57:00.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.778+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed20a2800 2024-09-13T23:57:00.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.778+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2098b40 con 0x556ed20a2800 2024-09-13T23:57:00.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.778+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed2009c00 2024-09-13T23:57:00.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.778+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2099200 con 0x556ed2009c00 2024-09-13T23:57:00.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.778+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed20a2400 2024-09-13T23:57:00.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.778+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2099440 con 0x556ed20a2400 2024-09-13T23:57:00.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.778+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed2009400 2024-09-13T23:57:00.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.778+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2098b40 con 0x556ed2009400 2024-09-13T23:57:00.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.778+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed2009c00 2024-09-13T23:57:00.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.778+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2099200 con 0x556ed2009c00 2024-09-13T23:57:00.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.778+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed20a2400 2024-09-13T23:57:00.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.778+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2099440 con 0x556ed20a2400 2024-09-13T23:57:00.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.778+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed2009400 2024-09-13T23:57:00.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.782+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2098b40 con 0x556ed2009400 2024-09-13T23:57:00.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.782+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed2009400 2024-09-13T23:57:00.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.782+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2098b40 con 0x556ed2009400 2024-09-13T23:57:00.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.782+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed2009400 2024-09-13T23:57:00.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.782+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2098b40 con 0x556ed2009400 2024-09-13T23:57:00.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.782+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed20a2400 2024-09-13T23:57:00.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.782+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2099440 con 0x556ed20a2400 2024-09-13T23:57:00.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.782+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed20a2800 2024-09-13T23:57:00.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.782+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2098b40 con 0x556ed20a2800 2024-09-13T23:57:00.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.782+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed2009400 2024-09-13T23:57:00.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.782+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2098b40 con 0x556ed2009400 2024-09-13T23:57:00.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.782+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed20a2800 2024-09-13T23:57:00.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.782+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2098b40 con 0x556ed20a2800 2024-09-13T23:57:00.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.782+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed20a2400 2024-09-13T23:57:00.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.786+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2099440 con 0x556ed20a2400 2024-09-13T23:57:00.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.786+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed20a2800 2024-09-13T23:57:00.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.786+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2098b40 con 0x556ed20a2800 2024-09-13T23:57:00.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.786+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed2009c00 2024-09-13T23:57:00.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.786+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2099200 con 0x556ed2009c00 2024-09-13T23:57:00.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.786+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed2009c00 2024-09-13T23:57:00.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.786+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2099200 con 0x556ed2009c00 2024-09-13T23:57:00.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.786+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed20a2400 2024-09-13T23:57:00.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.786+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2099440 con 0x556ed20a2400 2024-09-13T23:57:00.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.786+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed2009c00 2024-09-13T23:57:00.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.786+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x556ed2099200 con 0x556ed2009c00 2024-09-13T23:57:00.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.786+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed2009c00 2024-09-13T23:57:00.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556ed2099200 con 0x556ed2009c00 2024-09-13T23:57:00.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:00.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:00.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:00.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:00.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a3000 con 0x556ed2009400 2024-09-13T23:57:00.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x556ed2098b40 con 0x556ed2009400 2024-09-13T23:57:00.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a3400 con 0x556ed2009c00 2024-09-13T23:57:00.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x556ed2099200 con 0x556ed2009c00 2024-09-13T23:57:00.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:00.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a3800 con 0x556ed2009400 2024-09-13T23:57:00.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x556ed2098b40 con 0x556ed2009400 2024-09-13T23:57:00.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:00.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 20 zone default found 2024-09-13T23:57:00.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 4 Realm: () 2024-09-13T23:57:00.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:00.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:00.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:00.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 20 zonegroup default 2024-09-13T23:57:00.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a3c00 con 0x556ed20a2800 2024-09-13T23:57:00.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x556ed2098b40 con 0x556ed20a2800 2024-09-13T23:57:00.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a3000 con 0x556ed20a2400 2024-09-13T23:57:00.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x556ed2099440 con 0x556ed20a2400 2024-09-13T23:57:00.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.790+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a3800 con 0x556ed20a2400 2024-09-13T23:57:00.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.794+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x556ed2099440 con 0x556ed20a2400 2024-09-13T23:57:00.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.794+0000 7f2e8224ef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.794+0000 7f2e8224ef40 20 started sync module instance, tier type = 2024-09-13T23:57:00.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.794+0000 7f2e8224ef40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:00.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.794+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed2009800 con 0x556ed2009c00 2024-09-13T23:57:00.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.794+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2099200 con 0x556ed2009c00 2024-09-13T23:57:00.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.794+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93934457248512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed2008800 con 0x556ed2009c00 2024-09-13T23:57:00.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.794+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed2009800 con 0x556ed2009400 2024-09-13T23:57:00.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.798+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2098b40 con 0x556ed2009400 2024-09-13T23:57:00.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.798+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93934457249664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2000 con 0x556ed2009400 2024-09-13T23:57:00.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.798+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a3400 con 0x556ed2009c00 2024-09-13T23:57:00.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.798+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93934457248512] v33'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2099200 con 0x556ed2009c00 2024-09-13T23:57:00.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.798+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93934457249664] v33'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2098b40 con 0x556ed2009400 2024-09-13T23:57:00.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.802+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2099200 con 0x556ed2009c00 2024-09-13T23:57:00.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.802+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93934457250816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20ac000 con 0x556ed2009c00 2024-09-13T23:57:00.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.802+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20ac400 con 0x556ed20a2800 2024-09-13T23:57:00.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.802+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2098b40 con 0x556ed20a2800 2024-09-13T23:57:00.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.802+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93934457251968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20ac800 con 0x556ed20a2800 2024-09-13T23:57:00.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.802+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20acc00 con 0x556ed2009c00 2024-09-13T23:57:00.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.802+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93934457250816] v33'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2099200 con 0x556ed2009c00 2024-09-13T23:57:00.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.806+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93934457251968] v33'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2098b40 con 0x556ed20a2800 2024-09-13T23:57:00.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.806+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2099200 con 0x556ed2009c00 2024-09-13T23:57:00.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.806+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93934457253120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20ad000 con 0x556ed2009c00 2024-09-13T23:57:00.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.806+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20ad400 con 0x556ed20a2400 2024-09-13T23:57:00.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.806+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2099440 con 0x556ed20a2400 2024-09-13T23:57:00.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.806+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93934457254272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20ad800 con 0x556ed20a2400 2024-09-13T23:57:00.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.806+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20adc00 con 0x556ed20a2400 2024-09-13T23:57:00.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.806+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93934457253120] v33'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2099200 con 0x556ed2009c00 2024-09-13T23:57:00.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.810+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93934457254272] v33'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2099440 con 0x556ed20a2400 2024-09-13T23:57:00.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.810+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2099440 con 0x556ed20a2400 2024-09-13T23:57:00.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.810+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93934457255424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20ad400 con 0x556ed20a2400 2024-09-13T23:57:00.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.810+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20ac000 con 0x556ed20a2800 2024-09-13T23:57:00.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.810+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93934457255424] v33'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2099440 con 0x556ed20a2400 2024-09-13T23:57:00.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.810+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2098b40 con 0x556ed20a2800 2024-09-13T23:57:00.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.810+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93934457256576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20acc00 con 0x556ed20a2800 2024-09-13T23:57:00.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.810+0000 7f2e8224ef40 20 add_watcher() i=0 2024-09-13T23:57:00.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.810+0000 7f2e8224ef40 20 add_watcher() i=1 2024-09-13T23:57:00.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.810+0000 7f2e8224ef40 20 add_watcher() i=2 2024-09-13T23:57:00.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.810+0000 7f2e8224ef40 20 add_watcher() i=3 2024-09-13T23:57:00.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.810+0000 7f2e8224ef40 20 add_watcher() i=4 2024-09-13T23:57:00.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.810+0000 7f2e8224ef40 20 add_watcher() i=5 2024-09-13T23:57:00.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.810+0000 7f2e8224ef40 20 add_watcher() i=6 2024-09-13T23:57:00.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.814+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93934457256576] v33'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2098b40 con 0x556ed20a2800 2024-09-13T23:57:00.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.814+0000 7f2e8224ef40 20 add_watcher() i=7 2024-09-13T23:57:00.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.814+0000 7f2e8224ef40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:00.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.814+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a2c00 con 0x556ed2009400 2024-09-13T23:57:00.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.814+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x556ed2098b40 con 0x556ed2009400 2024-09-13T23:57:00.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.814+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93934458724352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a3000 con 0x556ed2009400 2024-09-13T23:57:00.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.814+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93934458724352] v33'72 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x556ed2098b40 con 0x556ed2009400 2024-09-13T23:57:00.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.814+0000 7f2e679d5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:00.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.818+0000 7f2e8224ef40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:00.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.818+0000 7f2e8224ef40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:00.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.818+0000 7f2e8224ef40 1 Processor -- start 2024-09-13T23:57:00.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.818+0000 7f2e8224ef40 1 -- start start 2024-09-13T23:57:00.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.818+0000 7f2e8224ef40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed20a3400 0x556ed1f59180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.818+0000 7f2e8224ef40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ed1cfe3c0 con 0x556ed20a3400 2024-09-13T23:57:00.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.818+0000 7f2e80206700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed20a3400 0x556ed1f59180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.818+0000 7f2e80206700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed20a3400 0x556ed1f59180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59094/0 (socket says 172.21.15.173:59094) 2024-09-13T23:57:00.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.818+0000 7f2e80206700 1 -- 172.21.15.173:0/352655498 learned_addr learned my addr 172.21.15.173:0/352655498 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.818+0000 7f2e80206700 1 -- 172.21.15.173:0/352655498 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ed1c82b60 con 0x556ed20a3400 2024-09-13T23:57:00.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.818+0000 7f2e80206700 1 --2- 172.21.15.173:0/352655498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed20a3400 0x556ed1f59180 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x556ed20be000 tx=0x556ed1d759e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c732104232f44e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.818+0000 7f2e671d4700 1 -- 172.21.15.173:0/352655498 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556ed1d15760 con 0x556ed20a3400 2024-09-13T23:57:00.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.818+0000 7f2e671d4700 1 -- 172.21.15.173:0/352655498 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556ed2026a80 con 0x556ed20a3400 2024-09-13T23:57:00.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.818+0000 7f2e671d4700 1 -- 172.21.15.173:0/352655498 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556ed20b4160 con 0x556ed20a3400 2024-09-13T23:57:00.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.818+0000 7f2e8224ef40 1 -- 172.21.15.173:0/352655498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed20a3400 msgr2=0x556ed1f59180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.818+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/352655498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed20a3400 0x556ed1f59180 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x556ed20be000 tx=0x556ed1d759e0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.818+0000 7f2e8224ef40 1 -- 172.21.15.173:0/352655498 shutdown_connections 2024-09-13T23:57:00.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.818+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/352655498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed20a3400 0x556ed1f59180 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.818+0000 7f2e8224ef40 1 -- 172.21.15.173:0/352655498 >> 172.21.15.173:0/352655498 conn(0x556ed20a3800 msgr2=0x556ed1d72000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.818+0000 7f2e8224ef40 1 -- 172.21.15.173:0/352655498 shutdown_connections 2024-09-13T23:57:00.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.818+0000 7f2e8224ef40 1 -- 172.21.15.173:0/352655498 wait complete. 2024-09-13T23:57:00.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.818+0000 7f2e8224ef40 1 Processor -- start 2024-09-13T23:57:00.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.822+0000 7f2e8224ef40 1 -- start start 2024-09-13T23:57:00.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.822+0000 7f2e8224ef40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed20a3400 0x556ed1f59180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.822+0000 7f2e8224ef40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ed1cfe500 con 0x556ed20a3400 2024-09-13T23:57:00.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.822+0000 7f2e80206700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed20a3400 0x556ed1f59180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.822+0000 7f2e80206700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed20a3400 0x556ed1f59180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59096/0 (socket says 172.21.15.173:59096) 2024-09-13T23:57:00.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.822+0000 7f2e80206700 1 -- 172.21.15.173:0/836857198 learned_addr learned my addr 172.21.15.173:0/836857198 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.822+0000 7f2e80206700 1 -- 172.21.15.173:0/836857198 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ed1c82d00 con 0x556ed20a3400 2024-09-13T23:57:00.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.822+0000 7f2e80206700 1 --2- 172.21.15.173:0/836857198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed20a3400 0x556ed1f59180 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x556ed20be210 tx=0x556ed1fcdc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.822+0000 7f2e659d1700 1 -- 172.21.15.173:0/836857198 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556ed20b42c0 con 0x556ed20a3400 2024-09-13T23:57:00.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.822+0000 7f2e659d1700 1 -- 172.21.15.173:0/836857198 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556ed2026780 con 0x556ed20a3400 2024-09-13T23:57:00.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.822+0000 7f2e8224ef40 1 -- 172.21.15.173:0/836857198 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556ed1c82340 con 0x556ed20a3400 2024-09-13T23:57:00.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.822+0000 7f2e659d1700 1 -- 172.21.15.173:0/836857198 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556ed20b4420 con 0x556ed20a3400 2024-09-13T23:57:00.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.822+0000 7f2e8224ef40 1 -- 172.21.15.173:0/836857198 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556ed1c83d40 con 0x556ed20a3400 2024-09-13T23:57:00.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.822+0000 7f2e659d1700 1 -- 172.21.15.173:0/836857198 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x556ed1d6bb80 con 0x556ed20a3400 2024-09-13T23:57:00.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.822+0000 7f2e659d1700 1 --2- 172.21.15.173:0/836857198 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556ed20a2c00 0x556ed214a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.822+0000 7f2e659d1700 1 -- 172.21.15.173:0/836857198 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x556ed1cd76c0 con 0x556ed20a3400 2024-09-13T23:57:00.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.826+0000 7f2e8224ef40 5 note: GC not initialized 2024-09-13T23:57:00.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.826+0000 7f2e81208700 1 --2- 172.21.15.173:0/836857198 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556ed20a2c00 0x556ed214a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.826+0000 7f2e81208700 1 --2- 172.21.15.173:0/836857198 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556ed20a2c00 0x556ed214a000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x556ed203f6e0 tx=0x556ed1fcc9c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.826+0000 7f2e631cc700 20 reqs_thread_entry: start 2024-09-13T23:57:00.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.826+0000 7f2e8224ef40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:00.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.826+0000 7f2e8224ef40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:00.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.826+0000 7f2e611c8700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:31 2024 2024-09-13T23:57:00.832 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:00.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.826+0000 7f2e609a6700 20 reqs_thread_entry: start 2024-09-13T23:57:00.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.826+0000 7f2e8224ef40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:57:00.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.826+0000 7f2e8224ef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.826+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed2008800 con 0x556ed2009400 2024-09-13T23:57:00.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.826+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv6 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x556ed2098b40 con 0x556ed2009400 2024-09-13T23:57:00.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.826+0000 7f2e8224ef40 20 rados_obj.operate() r=0 bl.length=513 2024-09-13T23:57:00.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.826+0000 7f2e8224ef40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:57:00.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.826+0000 7f2e8224ef40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:00.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.826+0000 7f2e8224ef40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:00.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.826+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~513 in=513b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20ac800 con 0x556ed2009400 2024-09-13T23:57:00.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.830+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~513] v33'7 uv7 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x556ed2098b40 con 0x556ed2009400 2024-09-13T23:57:00.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.830+0000 7f2e8224ef40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:57:00.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.830+0000 7f2e8224ef40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:00.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.830+0000 7f2e8224ef40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:57:00.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.830+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93934458726656 in=701b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20ac000 con 0x556ed2009c00 2024-09-13T23:57:00.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.830+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== watch-notify(notify (1) cookie 93934457253120 notify 141733920777 ret 0) v3 ==== 731+0+0 (crc 0 0 0) 0x556ed1c83860 con 0x556ed2009c00 2024-09-13T23:57:00.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.830+0000 7f2e7b1fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920777 cookie 93934457253120 notifier 4392 bl.length()=689 2024-09-13T23:57:00.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.830+0000 7f2e7b1fc700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:57:00.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.830+0000 7f2e7b1fc700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:00.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.830+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(64 notify.4 [notify cookie 93934458726656 out=8b] v0'0 uv57 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x556ed2099200 con 0x556ed2009c00 2024-09-13T23:57:00.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.830+0000 7f2e7b1fc700 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed21b8000 con 0x556ed2009c00 2024-09-13T23:57:00.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.830+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2099200 con 0x556ed2009c00 2024-09-13T23:57:00.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.834+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== watch-notify(notify_complete (2) cookie 93934458726656 notify 141733920777 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556ed1f94000 con 0x556ed2009c00 2024-09-13T23:57:00.838 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:00.838 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "foo", 2024-09-13T23:57:00.838 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Foo", 2024-09-13T23:57:00.838 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "foo@foo.com", 2024-09-13T23:57:00.838 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:57:00.838 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:57:00.838 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [ 2024-09-13T23:57:00.838 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:00.838 INFO:teuthology.orchestra.run.smithi173.stdout: "id": "foo:foo1", 2024-09-13T23:57:00.838 INFO:teuthology.orchestra.run.smithi173.stdout: "permissions": "full-control" 2024-09-13T23:57:00.838 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:00.838 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:00.839 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:57:00.839 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:00.839 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:57:00.839 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-09-13T23:57:00.839 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-09-13T23:57:00.839 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:00.839 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:00.839 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [ 2024-09-13T23:57:00.839 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:00.839 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo:foo1", 2024-09-13T23:57:00.839 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL" 2024-09-13T23:57:00.839 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:00.839 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:00.839 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:57:00.840 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:57:00.840 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:57:00.840 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:57:00.840 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:57:00.840 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:57:00.840 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:00.840 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:00.840 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:00.840 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:00.840 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:00.840 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:00.840 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:57:00.840 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:00.840 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:00.841 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:00.841 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:00.841 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:00.841 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:00.841 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:57:00.841 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:57:00.841 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:57:00.841 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:00.841 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:57:00.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.834+0000 7f2e679d5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:00.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.834+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93934458724352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20acc00 con 0x556ed2009400 2024-09-13T23:57:00.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.834+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93934458724352] v33'73 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x556ed2098b40 con 0x556ed2009400 2024-09-13T23:57:00.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.838+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93934457248512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20ad000 con 0x556ed2009c00 2024-09-13T23:57:00.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.838+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93934457248512] v33'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2099200 con 0x556ed2009c00 2024-09-13T23:57:00.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.838+0000 7f2e8224ef40 20 remove_watcher() i=0 2024-09-13T23:57:00.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.838+0000 7f2e8224ef40 2 removed watcher, disabling cache 2024-09-13T23:57:00.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.838+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93934457249664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20ac400 con 0x556ed2009400 2024-09-13T23:57:00.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.842+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93934457249664] v33'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2098b40 con 0x556ed2009400 2024-09-13T23:57:00.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.842+0000 7f2e8224ef40 20 remove_watcher() i=1 2024-09-13T23:57:00.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.842+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93934457250816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed20a3000 con 0x556ed2009c00 2024-09-13T23:57:00.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.842+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93934457250816] v33'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2099200 con 0x556ed2009c00 2024-09-13T23:57:00.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.842+0000 7f2e8224ef40 20 remove_watcher() i=2 2024-09-13T23:57:00.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.842+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93934457251968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed21b8800 con 0x556ed20a2800 2024-09-13T23:57:00.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.846+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93934457251968] v33'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2098b40 con 0x556ed20a2800 2024-09-13T23:57:00.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.846+0000 7f2e8224ef40 20 remove_watcher() i=3 2024-09-13T23:57:00.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.846+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93934457253120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed21b8c00 con 0x556ed2009c00 2024-09-13T23:57:00.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.846+0000 7f2e80a07700 1 -- 172.21.15.173:0/4082799014 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93934457253120] v33'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2099200 con 0x556ed2009c00 2024-09-13T23:57:00.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.846+0000 7f2e8224ef40 20 remove_watcher() i=4 2024-09-13T23:57:00.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.846+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93934457254272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed21b9000 con 0x556ed20a2400 2024-09-13T23:57:00.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.850+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93934457254272] v33'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2099440 con 0x556ed20a2400 2024-09-13T23:57:00.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.850+0000 7f2e8224ef40 20 remove_watcher() i=5 2024-09-13T23:57:00.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.850+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93934457255424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed21b9400 con 0x556ed20a2400 2024-09-13T23:57:00.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.854+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93934457255424] v33'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2099440 con 0x556ed20a2400 2024-09-13T23:57:00.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.854+0000 7f2e8224ef40 20 remove_watcher() i=6 2024-09-13T23:57:00.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.854+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93934457256576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556ed21b9800 con 0x556ed20a2800 2024-09-13T23:57:00.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.854+0000 7f2e81208700 1 -- 172.21.15.173:0/4082799014 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93934457256576] v33'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556ed2098b40 con 0x556ed20a2800 2024-09-13T23:57:00.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.854+0000 7f2e8224ef40 20 remove_watcher() i=7 2024-09-13T23:57:00.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.854+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x556ed2009c00 msgr2=0x556ed1f58100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.854+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/4082799014 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x556ed2009c00 0x556ed1f58100 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.854+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x556ed2009400 msgr2=0x556ed1f57b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.854+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/4082799014 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x556ed2009400 0x556ed1f57b80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.854+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x556ed20a2800 msgr2=0x556ed1f58c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.854+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/4082799014 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x556ed20a2800 0x556ed1f58c00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.854+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x556ed20a2400 msgr2=0x556ed1f58680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.854+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/4082799014 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x556ed20a2400 0x556ed1f58680 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.854+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556ed2009000 msgr2=0x556ed1f57600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.854+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/4082799014 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556ed2009000 0x556ed1f57600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x556ed1f51920 tx=0x556ed1d75800 comp rx=0 tx=0).stop 2024-09-13T23:57:00.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.854+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71800 msgr2=0x556ed1f56b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.854+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/4082799014 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71800 0x556ed1f56b00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x556ed1ff0a50 tx=0x556ed1fccc00 comp rx=0 tx=0).stop 2024-09-13T23:57:00.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.854+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 reap_dead start 2024-09-13T23:57:00.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.854+0000 7f2e80206700 1 -- 172.21.15.173:0/4082799014 reap_dead start 2024-09-13T23:57:00.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.854+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 shutdown_connections 2024-09-13T23:57:00.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.854+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 >> 172.21.15.173:0/4082799014 conn(0x556ed1c71400 msgr2=0x556ed1d71800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.854+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 shutdown_connections 2024-09-13T23:57:00.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.854+0000 7f2e8224ef40 1 -- 172.21.15.173:0/4082799014 wait complete. 2024-09-13T23:57:00.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.858+0000 7f2e8224ef40 1 -- 172.21.15.173:0/836857198 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556ed20a2c00 msgr2=0x556ed214a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.858+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/836857198 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556ed20a2c00 0x556ed214a000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x556ed203f6e0 tx=0x556ed1fcc9c0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.858+0000 7f2e8224ef40 1 -- 172.21.15.173:0/836857198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed20a3400 msgr2=0x556ed1f59180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.858+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/836857198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed20a3400 0x556ed1f59180 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x556ed20be210 tx=0x556ed1fcdc20 comp rx=0 tx=0).stop 2024-09-13T23:57:00.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.858+0000 7f2e8224ef40 1 -- 172.21.15.173:0/836857198 shutdown_connections 2024-09-13T23:57:00.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.858+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/836857198 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556ed20a2c00 0x556ed214a000 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.858+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/836857198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed20a3400 0x556ed1f59180 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.858+0000 7f2e8224ef40 1 -- 172.21.15.173:0/836857198 >> 172.21.15.173:0/836857198 conn(0x556ed20a3800 msgr2=0x556ed1d72000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.858+0000 7f2e8224ef40 1 -- 172.21.15.173:0/836857198 shutdown_connections 2024-09-13T23:57:00.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.858+0000 7f2e8224ef40 1 -- 172.21.15.173:0/836857198 wait complete. 2024-09-13T23:57:00.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.858+0000 7f2e8224ef40 1 -- 172.21.15.173:0/2077256224 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556ed2008000 msgr2=0x556ed1f57080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.858+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/2077256224 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556ed2008000 0x556ed1f57080 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x556ed2a3be90 tx=0x556ed1fcca20 comp rx=0 tx=0).stop 2024-09-13T23:57:00.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.858+0000 7f2e8224ef40 1 -- 172.21.15.173:0/2077256224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71000 msgr2=0x556ed1f56580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.858+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/2077256224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71000 0x556ed1f56580 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x556ed2a3be60 tx=0x556ed1d75920 comp rx=0 tx=0).stop 2024-09-13T23:57:00.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.858+0000 7f2e8224ef40 1 -- 172.21.15.173:0/2077256224 shutdown_connections 2024-09-13T23:57:00.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.858+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/2077256224 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556ed2008000 0x556ed1f57080 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.858+0000 7f2e8224ef40 1 --2- 172.21.15.173:0/2077256224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556ed1c71000 0x556ed1f56580 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.858+0000 7f2e8224ef40 1 -- 172.21.15.173:0/2077256224 >> 172.21.15.173:0/2077256224 conn(0x556ed1c70c00 msgr2=0x556ed1d71000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.858+0000 7f2e8224ef40 1 -- 172.21.15.173:0/2077256224 shutdown_connections 2024-09-13T23:57:00.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.858+0000 7f2e8224ef40 1 -- 172.21.15.173:0/2077256224 wait complete. 2024-09-13T23:57:00.870 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:57:00.870 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:57:00.870 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:57:00.870 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:57:00.907 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:00.907 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:00.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.902+0000 7fd3ea9e5f40 1 Processor -- start 2024-09-13T23:57:00.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.902+0000 7fd3ea9e5f40 1 -- start start 2024-09-13T23:57:00.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.902+0000 7fd3ea9e5f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x56281925d000 0x562819542580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.902+0000 7fd3ea9e5f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562819321500 con 0x56281925d400 2024-09-13T23:57:00.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.902+0000 7fd3ea9e5f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x5628192eaa00 con 0x56281925d000 2024-09-13T23:57:00.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.902+0000 7fd3e919e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x56281925d000 0x562819542580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.902+0000 7fd3e899d700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x56281925d400 0x56281935c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:57942/0 (socket says 172.21.15.173:57942) 2024-09-13T23:57:00.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.902+0000 7fd3e899d700 1 -- 172.21.15.173:0/966595531 learned_addr learned my addr 172.21.15.173:0/966595531 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:00.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.906+0000 7fd3e919e700 1 -- 172.21.15.173:0/966595531 >> v1:172.21.15.87:6789/0 conn(0x56281925d400 legacy=0x56281935c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.906+0000 7fd3e819c700 1 -- 172.21.15.173:0/966595531 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 135045030 0 0) 0x5628193b8000 con 0x56281925d400 2024-09-13T23:57:00.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.906+0000 7fd3e919e700 1 -- 172.21.15.173:0/966595531 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56281926fd40 con 0x56281925d000 2024-09-13T23:57:00.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.906+0000 7fd3e919e700 1 --2- 172.21.15.173:0/966595531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925d000 0x562819542580 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x56281953da70 tx=0x562819361920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34e2e2cd63e2bb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.906+0000 7fd3e819c700 1 -- 172.21.15.173:0/966595531 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5628193014a0 con 0x56281925d000 2024-09-13T23:57:00.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.906+0000 7fd3e819c700 1 -- 172.21.15.173:0/966595531 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562819321800 con 0x56281925d000 2024-09-13T23:57:00.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.906+0000 7fd3e819c700 1 -- 172.21.15.173:0/966595531 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562819301600 con 0x56281925d000 2024-09-13T23:57:00.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.906+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/966595531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925d000 msgr2=0x562819542580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.906+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/966595531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925d000 0x562819542580 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x56281953da70 tx=0x562819361920 comp rx=0 tx=0).stop 2024-09-13T23:57:00.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.906+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/966595531 shutdown_connections 2024-09-13T23:57:00.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.906+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/966595531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925d000 0x562819542580 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.906+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/966595531 >> 172.21.15.173:0/966595531 conn(0x56281925cc00 msgr2=0x56281935c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.906+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/966595531 shutdown_connections 2024-09-13T23:57:00.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.906+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/966595531 wait complete. 2024-09-13T23:57:00.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.906+0000 7fd3ea9e5f40 1 Processor -- start 2024-09-13T23:57:00.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.906+0000 7fd3ea9e5f40 1 -- start start 2024-09-13T23:57:00.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.906+0000 7fd3ea9e5f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925d400 0x562819542b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.906+0000 7fd3ea9e5f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628192ea500 con 0x56281925d400 2024-09-13T23:57:00.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.906+0000 7fd3e919e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925d400 0x562819542b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.906+0000 7fd3e919e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925d400 0x562819542b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59118/0 (socket says 172.21.15.173:59118) 2024-09-13T23:57:00.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.906+0000 7fd3e919e700 1 -- 172.21.15.173:0/2042071487 learned_addr learned my addr 172.21.15.173:0/2042071487 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.906+0000 7fd3e919e700 1 -- 172.21.15.173:0/2042071487 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56281926fba0 con 0x56281925d400 2024-09-13T23:57:00.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.906+0000 7fd3e919e700 1 --2- 172.21.15.173:0/2042071487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925d400 0x562819542b00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x56281953da70 tx=0x562819361800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168a0082a22745fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.910+0000 7fd3e799b700 1 -- 172.21.15.173:0/2042071487 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562819301760 con 0x56281925d400 2024-09-13T23:57:00.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.910+0000 7fd3e799b700 1 -- 172.21.15.173:0/2042071487 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562819321b00 con 0x56281925d400 2024-09-13T23:57:00.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.910+0000 7fd3e799b700 1 -- 172.21.15.173:0/2042071487 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5628193014a0 con 0x56281925d400 2024-09-13T23:57:00.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.910+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/2042071487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925d400 msgr2=0x562819542b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.910+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/2042071487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925d400 0x562819542b00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x56281953da70 tx=0x562819361800 comp rx=0 tx=0).stop 2024-09-13T23:57:00.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.910+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/2042071487 shutdown_connections 2024-09-13T23:57:00.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.910+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/2042071487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925d400 0x562819542b00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.910+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/2042071487 >> 172.21.15.173:0/2042071487 conn(0x56281925cc00 msgr2=0x56281935d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.910+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/2042071487 shutdown_connections 2024-09-13T23:57:00.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.910+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/2042071487 wait complete. 2024-09-13T23:57:00.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.910+0000 7fd3ea9e5f40 1 Processor -- start 2024-09-13T23:57:00.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.910+0000 7fd3ea9e5f40 1 -- start start 2024-09-13T23:57:00.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.910+0000 7fd3ea9e5f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925d400 0x562819542b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.910+0000 7fd3ea9e5f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628192ea3c0 con 0x56281925d400 2024-09-13T23:57:00.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.910+0000 7fd3e919e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925d400 0x562819542b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.910+0000 7fd3e919e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925d400 0x562819542b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59124/0 (socket says 172.21.15.173:59124) 2024-09-13T23:57:00.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.910+0000 7fd3e919e700 1 -- 172.21.15.173:0/791809358 learned_addr learned my addr 172.21.15.173:0/791809358 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.910+0000 7fd3e919e700 1 -- 172.21.15.173:0/791809358 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56281926fa00 con 0x56281925d400 2024-09-13T23:57:00.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.910+0000 7fd3e919e700 1 --2- 172.21.15.173:0/791809358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925d400 0x562819542b00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x56281a027f50 tx=0x562819361920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.910+0000 7fd3e6198700 1 -- 172.21.15.173:0/791809358 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562819301600 con 0x56281925d400 2024-09-13T23:57:00.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.910+0000 7fd3e6198700 1 -- 172.21.15.173:0/791809358 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562819321c80 con 0x56281925d400 2024-09-13T23:57:00.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.910+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/791809358 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56281926f860 con 0x56281925d400 2024-09-13T23:57:00.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.910+0000 7fd3e6198700 1 -- 172.21.15.173:0/791809358 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5628193018c0 con 0x56281925d400 2024-09-13T23:57:00.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.910+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/791809358 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56281926f6c0 con 0x56281925d400 2024-09-13T23:57:00.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3ea9e5f40 1 Processor -- start 2024-09-13T23:57:00.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3ea9e5f40 1 -- start start 2024-09-13T23:57:00.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3e6198700 1 -- 172.21.15.173:0/791809358 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x562819356b00 con 0x56281925d400 2024-09-13T23:57:00.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3ea9e5f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925dc00 0x562819543080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3ea9e5f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628192ea000 con 0x56281925dc00 2024-09-13T23:57:00.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3e6198700 1 --2- 172.21.15.173:0/791809358 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5628195f2000 0x562819544100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3e999f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925dc00 0x562819543080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3e6198700 1 -- 172.21.15.173:0/791809358 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5628192c3180 con 0x56281925d400 2024-09-13T23:57:00.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3e999f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925dc00 0x562819543080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59134/0 (socket says 172.21.15.173:59134) 2024-09-13T23:57:00.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3e999f700 1 -- 172.21.15.173:0/1673738353 learned_addr learned my addr 172.21.15.173:0/1673738353 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3e919e700 1 --2- 172.21.15.173:0/791809358 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5628195f2000 0x562819544100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3e999f700 1 -- 172.21.15.173:0/1673738353 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56281926e000 con 0x56281925dc00 2024-09-13T23:57:00.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3e919e700 1 --2- 172.21.15.173:0/791809358 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5628195f2000 0x562819544100 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x5628195854a0 tx=0x5628195b68a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3e999f700 1 --2- 172.21.15.173:0/1673738353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925dc00 0x562819543080 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x56281a027fb0 tx=0x5628195b6780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52ce64558d3ee37 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3e3993700 1 -- 172.21.15.173:0/1673738353 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562819301600 con 0x56281925dc00 2024-09-13T23:57:00.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3e3993700 1 -- 172.21.15.173:0/1673738353 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562819600000 con 0x56281925dc00 2024-09-13T23:57:00.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3e3993700 1 -- 172.21.15.173:0/1673738353 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5628193018c0 con 0x56281925dc00 2024-09-13T23:57:00.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/1673738353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925dc00 msgr2=0x562819543080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/1673738353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925dc00 0x562819543080 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x56281a027fb0 tx=0x5628195b6780 comp rx=0 tx=0).stop 2024-09-13T23:57:00.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/1673738353 shutdown_connections 2024-09-13T23:57:00.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/1673738353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925dc00 0x562819543080 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/1673738353 >> 172.21.15.173:0/1673738353 conn(0x56281925d800 msgr2=0x56281935d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/1673738353 shutdown_connections 2024-09-13T23:57:00.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/1673738353 wait complete. 2024-09-13T23:57:00.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.914+0000 7fd3ea9e5f40 1 Processor -- start 2024-09-13T23:57:00.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.918+0000 7fd3ea9e5f40 1 -- start start 2024-09-13T23:57:00.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.918+0000 7fd3ea9e5f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925dc00 0x562819543080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.918+0000 7fd3ea9e5f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x562819282640 con 0x56281925dc00 2024-09-13T23:57:00.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.918+0000 7fd3e999f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925dc00 0x562819543080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.918+0000 7fd3e999f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925dc00 0x562819543080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59150/0 (socket says 172.21.15.173:59150) 2024-09-13T23:57:00.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.918+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 learned_addr learned my addr 172.21.15.173:0/4037918618 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.918+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56281926eea0 con 0x56281925dc00 2024-09-13T23:57:00.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.918+0000 7fd3e999f700 1 --2- 172.21.15.173:0/4037918618 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925dc00 0x562819543080 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x562819584810 tx=0x5628195b65a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.918+0000 7fd3e2190700 1 -- 172.21.15.173:0/4037918618 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562819301760 con 0x56281925dc00 2024-09-13T23:57:00.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.918+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56281926e820 con 0x56281925dc00 2024-09-13T23:57:00.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.918+0000 7fd3e2190700 1 -- 172.21.15.173:0/4037918618 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562819600180 con 0x56281925dc00 2024-09-13T23:57:00.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.918+0000 7fd3e2190700 1 -- 172.21.15.173:0/4037918618 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x562819301600 con 0x56281925dc00 2024-09-13T23:57:00.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.918+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56281926e9c0 con 0x56281925dc00 2024-09-13T23:57:00.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.918+0000 7fd3ea9e5f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.918+0000 7fd3e2190700 1 -- 172.21.15.173:0/4037918618 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x562819356dc0 con 0x56281925dc00 2024-09-13T23:57:00.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.918+0000 7fd3e2190700 1 --2- 172.21.15.173:0/4037918618 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5628195f2c00 0x562819544680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.922+0000 7fd3e2190700 1 -- 172.21.15.173:0/4037918618 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5628192c3340 con 0x56281925dc00 2024-09-13T23:57:00.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.922+0000 7fd3e899d700 1 --2- 172.21.15.173:0/4037918618 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5628195f2c00 0x562819544680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.922+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/4037918618 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5628195f3000 0x562819543600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.922+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3400 con 0x5628195f3000 2024-09-13T23:57:00.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.922+0000 7fd3e999f700 1 --2- 172.21.15.173:0/4037918618 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5628195f3000 0x562819543600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.922+0000 7fd3e899d700 1 --2- 172.21.15.173:0/4037918618 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5628195f2c00 0x562819544680 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x56281a026030 tx=0x5628195b7920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.922+0000 7fd3e999f700 1 --2- 172.21.15.173:0/4037918618 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5628195f3000 0x562819543600 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.922+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56281967cb40 con 0x5628195f3000 2024-09-13T23:57:00.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.922+0000 7fd3ea9e5f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.922+0000 7fd3ea9e5f40 20 realm 2024-09-13T23:57:00.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.922+0000 7fd3ea9e5f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.922+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3000 2024-09-13T23:57:00.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.922+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56281967cb40 con 0x5628195f3000 2024-09-13T23:57:00.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.922+0000 7fd3ea9e5f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.922+0000 7fd3ea9e5f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:00.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.922+0000 7fd3ea9e5f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.922+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3c00 con 0x5628195f3000 2024-09-13T23:57:00.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.922+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56281967cb40 con 0x5628195f3000 2024-09-13T23:57:00.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.922+0000 7fd3ea9e5f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.922+0000 7fd3ea9e5f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.922+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/4037918618 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5628195f3400 0x562819543b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.922+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3400 2024-09-13T23:57:00.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.922+0000 7fd3e919e700 1 --2- 172.21.15.173:0/4037918618 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5628195f3400 0x562819543b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.926+0000 7fd3e919e700 1 --2- 172.21.15.173:0/4037918618 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5628195f3400 0x562819543b80 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.926+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x56281967d200 con 0x5628195f3400 2024-09-13T23:57:00.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.926+0000 7fd3ea9e5f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:00.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.926+0000 7fd3ea9e5f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.926+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/4037918618 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5628195f3c00 0x562819544c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.926+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196ba000 con 0x5628195f3c00 2024-09-13T23:57:00.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.926+0000 7fd3e899d700 1 --2- 172.21.15.173:0/4037918618 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5628195f3c00 0x562819544c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.926+0000 7fd3e899d700 1 --2- 172.21.15.173:0/4037918618 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5628195f3c00 0x562819544c00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.926+0000 7fd3e899d700 1 -- 172.21.15.173:0/4037918618 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x56281967d440 con 0x5628195f3c00 2024-09-13T23:57:00.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.926+0000 7fd3ea9e5f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:00.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.926+0000 7fd3ea9e5f40 20 searching for the correct realm 2024-09-13T23:57:00.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.926+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196ba400 con 0x5628195f3c00 2024-09-13T23:57:00.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.926+0000 7fd3e899d700 1 -- 172.21.15.173:0/4037918618 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x56281967d440 con 0x5628195f3c00 2024-09-13T23:57:00.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.926+0000 7fd3e899d700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196ba000 con 0x5628195f3400 2024-09-13T23:57:00.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.926+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967d200 con 0x5628195f3400 2024-09-13T23:57:00.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.926+0000 7fd3e919e700 1 --2- 172.21.15.173:0/4037918618 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5628196ba000 0x562819542580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.926+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628196ba000 2024-09-13T23:57:00.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.930+0000 7fd3e999f700 1 --2- 172.21.15.173:0/4037918618 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5628196ba000 0x562819542580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.930+0000 7fd3e999f700 1 --2- 172.21.15.173:0/4037918618 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5628196ba000 0x562819542580 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.930+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967cb40 con 0x5628196ba000 2024-09-13T23:57:00.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.930+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3000 2024-09-13T23:57:00.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.930+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x56281967cb40 con 0x5628195f3000 2024-09-13T23:57:00.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.930+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3000 2024-09-13T23:57:00.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.930+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967cb40 con 0x5628195f3000 2024-09-13T23:57:00.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.930+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3c00 2024-09-13T23:57:00.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.930+0000 7fd3e899d700 1 -- 172.21.15.173:0/4037918618 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967d440 con 0x5628195f3c00 2024-09-13T23:57:00.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.930+0000 7fd3e899d700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3000 2024-09-13T23:57:00.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.930+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967cb40 con 0x5628195f3000 2024-09-13T23:57:00.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.930+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3400 2024-09-13T23:57:00.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.934+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967d200 con 0x5628195f3400 2024-09-13T23:57:00.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.934+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3400 2024-09-13T23:57:00.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.934+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967d200 con 0x5628195f3400 2024-09-13T23:57:00.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.934+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3000 2024-09-13T23:57:00.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.934+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967cb40 con 0x5628195f3000 2024-09-13T23:57:00.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.934+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628196ba000 2024-09-13T23:57:00.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.934+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967cb40 con 0x5628196ba000 2024-09-13T23:57:00.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.934+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3000 2024-09-13T23:57:00.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.934+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967cb40 con 0x5628195f3000 2024-09-13T23:57:00.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.934+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628196ba000 2024-09-13T23:57:00.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.934+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967cb40 con 0x5628196ba000 2024-09-13T23:57:00.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.934+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3400 2024-09-13T23:57:00.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.934+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967d200 con 0x5628195f3400 2024-09-13T23:57:00.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.934+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3c00 2024-09-13T23:57:00.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.938+0000 7fd3e899d700 1 -- 172.21.15.173:0/4037918618 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967d440 con 0x5628195f3c00 2024-09-13T23:57:00.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.938+0000 7fd3e899d700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3000 2024-09-13T23:57:00.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.938+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967cb40 con 0x5628195f3000 2024-09-13T23:57:00.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.938+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3400 2024-09-13T23:57:00.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.938+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967d200 con 0x5628195f3400 2024-09-13T23:57:00.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.938+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3c00 2024-09-13T23:57:00.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.938+0000 7fd3e899d700 1 -- 172.21.15.173:0/4037918618 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967d440 con 0x5628195f3c00 2024-09-13T23:57:00.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.938+0000 7fd3e899d700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3000 2024-09-13T23:57:00.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.938+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967cb40 con 0x5628195f3000 2024-09-13T23:57:00.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.938+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3000 2024-09-13T23:57:00.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.938+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967cb40 con 0x5628195f3000 2024-09-13T23:57:00.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.938+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3000 2024-09-13T23:57:00.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.938+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967cb40 con 0x5628195f3000 2024-09-13T23:57:00.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.938+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3c00 2024-09-13T23:57:00.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.942+0000 7fd3e899d700 1 -- 172.21.15.173:0/4037918618 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967d440 con 0x5628195f3c00 2024-09-13T23:57:00.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.942+0000 7fd3e899d700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628196ba000 2024-09-13T23:57:00.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.942+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967cb40 con 0x5628196ba000 2024-09-13T23:57:00.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.942+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3000 2024-09-13T23:57:00.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.942+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967cb40 con 0x5628195f3000 2024-09-13T23:57:00.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.942+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628196ba000 2024-09-13T23:57:00.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.942+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967cb40 con 0x5628196ba000 2024-09-13T23:57:00.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.942+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3c00 2024-09-13T23:57:00.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.942+0000 7fd3e899d700 1 -- 172.21.15.173:0/4037918618 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967d440 con 0x5628195f3c00 2024-09-13T23:57:00.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.942+0000 7fd3e899d700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628196ba000 2024-09-13T23:57:00.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.942+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967cb40 con 0x5628196ba000 2024-09-13T23:57:00.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.942+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3400 2024-09-13T23:57:00.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.942+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967d200 con 0x5628195f3400 2024-09-13T23:57:00.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.942+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3400 2024-09-13T23:57:00.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.946+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967d200 con 0x5628195f3400 2024-09-13T23:57:00.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.946+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3c00 2024-09-13T23:57:00.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.946+0000 7fd3e899d700 1 -- 172.21.15.173:0/4037918618 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967d440 con 0x5628195f3c00 2024-09-13T23:57:00.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.946+0000 7fd3e899d700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3400 2024-09-13T23:57:00.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.946+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x56281967d200 con 0x5628195f3400 2024-09-13T23:57:00.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.946+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3400 2024-09-13T23:57:00.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.946+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56281967d200 con 0x5628195f3400 2024-09-13T23:57:00.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.946+0000 7fd3ea9e5f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:00.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.946+0000 7fd3ea9e5f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:00.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.946+0000 7fd3ea9e5f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:00.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.946+0000 7fd3ea9e5f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:00.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.946+0000 7fd3ea9e5f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.946+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196ba800 con 0x5628195f3000 2024-09-13T23:57:00.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.946+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56281967cb40 con 0x5628195f3000 2024-09-13T23:57:00.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.946+0000 7fd3ea9e5f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.946+0000 7fd3ea9e5f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.946+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196bac00 con 0x5628195f3400 2024-09-13T23:57:00.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x56281967d200 con 0x5628195f3400 2024-09-13T23:57:00.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3ea9e5f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:00.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3ea9e5f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196bb000 con 0x5628195f3000 2024-09-13T23:57:00.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x56281967cb40 con 0x5628195f3000 2024-09-13T23:57:00.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3ea9e5f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:00.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3ea9e5f40 20 zone default found 2024-09-13T23:57:00.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3ea9e5f40 4 Realm: () 2024-09-13T23:57:00.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3ea9e5f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:00.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3ea9e5f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:00.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3ea9e5f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:00.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3ea9e5f40 20 zonegroup default 2024-09-13T23:57:00.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3ea9e5f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196bb400 con 0x5628196ba000 2024-09-13T23:57:00.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x56281967cb40 con 0x5628196ba000 2024-09-13T23:57:00.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3ea9e5f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3ea9e5f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196bb800 con 0x5628195f3c00 2024-09-13T23:57:00.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3e899d700 1 -- 172.21.15.173:0/4037918618 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x56281967d440 con 0x5628195f3c00 2024-09-13T23:57:00.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3ea9e5f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3ea9e5f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196bbc00 con 0x5628195f3c00 2024-09-13T23:57:00.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3e899d700 1 -- 172.21.15.173:0/4037918618 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x56281967d440 con 0x5628195f3c00 2024-09-13T23:57:00.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3ea9e5f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:00.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3ea9e5f40 20 started sync module instance, tier type = 2024-09-13T23:57:00.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3ea9e5f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:00.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.950+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196c0000 con 0x5628195f3400 2024-09-13T23:57:00.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.954+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56281967d200 con 0x5628195f3400 2024-09-13T23:57:00.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.954+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94730223590144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196c0400 con 0x5628195f3400 2024-09-13T23:57:00.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.954+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196c0800 con 0x5628195f3000 2024-09-13T23:57:00.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.958+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94730223590144] v33'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56281967d200 con 0x5628195f3400 2024-09-13T23:57:00.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.958+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56281967cb40 con 0x5628195f3000 2024-09-13T23:57:00.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.958+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94730223591296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196c0c00 con 0x5628195f3000 2024-09-13T23:57:00.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.958+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196c1000 con 0x5628195f3400 2024-09-13T23:57:00.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.958+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94730223591296] v33'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56281967cb40 con 0x5628195f3000 2024-09-13T23:57:00.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.958+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56281967d200 con 0x5628195f3400 2024-09-13T23:57:00.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.958+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94730223592448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196c1400 con 0x5628195f3400 2024-09-13T23:57:00.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.958+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196c1800 con 0x5628196ba000 2024-09-13T23:57:00.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.962+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94730223592448] v33'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56281967d200 con 0x5628195f3400 2024-09-13T23:57:00.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.962+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56281967cb40 con 0x5628196ba000 2024-09-13T23:57:00.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.962+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94730223593600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196c1c00 con 0x5628196ba000 2024-09-13T23:57:00.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.962+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196c0800 con 0x5628195f3400 2024-09-13T23:57:00.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.966+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94730223593600] v33'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56281967cb40 con 0x5628196ba000 2024-09-13T23:57:00.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.966+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56281967d200 con 0x5628195f3400 2024-09-13T23:57:00.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.966+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94730223594752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196c0000 con 0x5628195f3400 2024-09-13T23:57:00.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.966+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196c0400 con 0x5628195f3c00 2024-09-13T23:57:00.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.966+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94730223594752] v33'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56281967d200 con 0x5628195f3400 2024-09-13T23:57:00.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.966+0000 7fd3e899d700 1 -- 172.21.15.173:0/4037918618 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56281967d440 con 0x5628195f3c00 2024-09-13T23:57:00.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.966+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94730223595904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196ba800 con 0x5628195f3c00 2024-09-13T23:57:00.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.966+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196bb000 con 0x5628195f3c00 2024-09-13T23:57:00.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.970+0000 7fd3e899d700 1 -- 172.21.15.173:0/4037918618 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v33'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56281967d440 con 0x5628195f3c00 2024-09-13T23:57:00.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.970+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94730223597056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196bb400 con 0x5628195f3c00 2024-09-13T23:57:00.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.970+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196bac00 con 0x5628196ba000 2024-09-13T23:57:00.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.970+0000 7fd3e899d700 1 -- 172.21.15.173:0/4037918618 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94730223595904] v33'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56281967d440 con 0x5628195f3c00 2024-09-13T23:57:00.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.970+0000 7fd3e899d700 1 -- 172.21.15.173:0/4037918618 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94730223597056] v33'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56281967d440 con 0x5628195f3c00 2024-09-13T23:57:00.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.970+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56281967cb40 con 0x5628196ba000 2024-09-13T23:57:00.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.970+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94730223598208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628196ba000 2024-09-13T23:57:00.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.970+0000 7fd3ea9e5f40 20 add_watcher() i=0 2024-09-13T23:57:00.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.970+0000 7fd3ea9e5f40 20 add_watcher() i=1 2024-09-13T23:57:00.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.970+0000 7fd3ea9e5f40 20 add_watcher() i=2 2024-09-13T23:57:00.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.970+0000 7fd3ea9e5f40 20 add_watcher() i=3 2024-09-13T23:57:00.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.970+0000 7fd3ea9e5f40 20 add_watcher() i=4 2024-09-13T23:57:00.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.970+0000 7fd3ea9e5f40 20 add_watcher() i=5 2024-09-13T23:57:00.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.970+0000 7fd3ea9e5f40 20 add_watcher() i=6 2024-09-13T23:57:00.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.974+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94730223598208] v33'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56281967cb40 con 0x5628196ba000 2024-09-13T23:57:00.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.974+0000 7fd3ea9e5f40 20 add_watcher() i=7 2024-09-13T23:57:00.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.974+0000 7fd3ea9e5f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:00.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.974+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196c0c00 con 0x5628195f3000 2024-09-13T23:57:00.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.974+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x56281967cb40 con 0x5628195f3000 2024-09-13T23:57:00.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.974+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94730225213440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196c1800 con 0x5628195f3000 2024-09-13T23:57:00.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.978+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94730225213440] v33'74 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x56281967cb40 con 0x5628195f3000 2024-09-13T23:57:00.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.978+0000 7fd3d016c700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:00.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.978+0000 7fd3ea9e5f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:00.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.978+0000 7fd3ea9e5f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:00.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.978+0000 7fd3ea9e5f40 1 Processor -- start 2024-09-13T23:57:00.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.978+0000 7fd3ea9e5f40 1 -- start start 2024-09-13T23:57:00.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.978+0000 7fd3ea9e5f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628196c0400 0x562819545180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.978+0000 7fd3ea9e5f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x562819282780 con 0x5628196c0400 2024-09-13T23:57:00.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.978+0000 7fd3e899d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628196c0400 0x562819545180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.978+0000 7fd3e899d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628196c0400 0x562819545180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59160/0 (socket says 172.21.15.173:59160) 2024-09-13T23:57:00.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.978+0000 7fd3e899d700 1 -- 172.21.15.173:0/181241892 learned_addr learned my addr 172.21.15.173:0/181241892 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.978+0000 7fd3e899d700 1 -- 172.21.15.173:0/181241892 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56281926eb60 con 0x5628196c0400 2024-09-13T23:57:00.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.978+0000 7fd3e899d700 1 --2- 172.21.15.173:0/181241892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628196c0400 0x562819545180 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x562819647f80 tx=0x5628195b78c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d563dcbdc8e032f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.978+0000 7fd3cf96b700 1 -- 172.21.15.173:0/181241892 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5628196d8000 con 0x5628196c0400 2024-09-13T23:57:00.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.978+0000 7fd3cf96b700 1 -- 172.21.15.173:0/181241892 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562819600600 con 0x5628196c0400 2024-09-13T23:57:00.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.978+0000 7fd3cf96b700 1 -- 172.21.15.173:0/181241892 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5628196d8160 con 0x5628196c0400 2024-09-13T23:57:00.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.982+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/181241892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628196c0400 msgr2=0x562819545180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:00.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.982+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/181241892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628196c0400 0x562819545180 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x562819647f80 tx=0x5628195b78c0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.982+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/181241892 shutdown_connections 2024-09-13T23:57:00.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.982+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/181241892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628196c0400 0x562819545180 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:00.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.982+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/181241892 >> 172.21.15.173:0/181241892 conn(0x5628196c1c00 msgr2=0x56281935e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:00.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.982+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/181241892 shutdown_connections 2024-09-13T23:57:00.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.982+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/181241892 wait complete. 2024-09-13T23:57:00.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.982+0000 7fd3ea9e5f40 1 Processor -- start 2024-09-13T23:57:00.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.982+0000 7fd3ea9e5f40 1 -- start start 2024-09-13T23:57:00.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.982+0000 7fd3ea9e5f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628196c0400 0x562819545180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.982+0000 7fd3ea9e5f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628192ea000 con 0x5628196c0400 2024-09-13T23:57:00.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.982+0000 7fd3e899d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628196c0400 0x562819545180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.982+0000 7fd3e899d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628196c0400 0x562819545180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59166/0 (socket says 172.21.15.173:59166) 2024-09-13T23:57:00.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.982+0000 7fd3e899d700 1 -- 172.21.15.173:0/3005294955 learned_addr learned my addr 172.21.15.173:0/3005294955 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:00.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.982+0000 7fd3e899d700 1 -- 172.21.15.173:0/3005294955 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56281926ed00 con 0x5628196c0400 2024-09-13T23:57:00.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.982+0000 7fd3e899d700 1 --2- 172.21.15.173:0/3005294955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628196c0400 0x562819545180 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x5628196d5260 tx=0x5628195b7a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.986+0000 7fd3ce168700 1 -- 172.21.15.173:0/3005294955 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5628196d82c0 con 0x5628196c0400 2024-09-13T23:57:00.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.986+0000 7fd3ce168700 1 -- 172.21.15.173:0/3005294955 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562819600300 con 0x5628196c0400 2024-09-13T23:57:00.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.986+0000 7fd3ce168700 1 -- 172.21.15.173:0/3005294955 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5628196d8000 con 0x5628196c0400 2024-09-13T23:57:00.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.986+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/3005294955 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56281926e340 con 0x5628196c0400 2024-09-13T23:57:00.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.986+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/3005294955 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56281926eb60 con 0x5628196c0400 2024-09-13T23:57:00.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.986+0000 7fd3ce168700 1 -- 172.21.15.173:0/3005294955 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x562819357b80 con 0x5628196c0400 2024-09-13T23:57:00.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.986+0000 7fd3ce168700 1 --2- 172.21.15.173:0/3005294955 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x562819758000 0x56281975e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:00.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.986+0000 7fd3ce168700 1 -- 172.21.15.173:0/3005294955 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5628192c3500 con 0x5628196c0400 2024-09-13T23:57:00.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.986+0000 7fd3ea9e5f40 5 note: GC not initialized 2024-09-13T23:57:00.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.986+0000 7fd3e999f700 1 --2- 172.21.15.173:0/3005294955 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x562819758000 0x56281975e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:00.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.986+0000 7fd3e999f700 1 --2- 172.21.15.173:0/3005294955 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x562819758000 0x56281975e000 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x562819647b90 tx=0x562819722660 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:00.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.990+0000 7fd3cb963700 20 reqs_thread_entry: start 2024-09-13T23:57:00.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.990+0000 7fd3ea9e5f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:00.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.990+0000 7fd3ea9e5f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:00.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.990+0000 7fd3c995f700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:31 2024 2024-09-13T23:57:00.995 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:00.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.990+0000 7fd3c913d700 20 reqs_thread_entry: start 2024-09-13T23:57:00.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.990+0000 7fd3ea9e5f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:00.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.990+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196bb800 con 0x5628195f3000 2024-09-13T23:57:00.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.990+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x56281967cb40 con 0x5628195f3000 2024-09-13T23:57:00.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.990+0000 7fd3ea9e5f40 20 rados_obj.operate() r=0 bl.length=513 2024-09-13T23:57:00.996 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:00.996 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "foo", 2024-09-13T23:57:00.996 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Foo", 2024-09-13T23:57:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "foo@foo.com", 2024-09-13T23:57:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:57:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:57:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [ 2024-09-13T23:57:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: "id": "foo:foo1", 2024-09-13T23:57:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: "permissions": "full-control" 2024-09-13T23:57:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:57:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:57:00.997 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-09-13T23:57:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-09-13T23:57:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [ 2024-09-13T23:57:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo:foo1", 2024-09-13T23:57:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL" 2024-09-13T23:57:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:57:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:57:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:57:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:57:00.998 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:57:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:57:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:57:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:00.999 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:57:01.000 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:57:01.000 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:57:01.000 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:01.000 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:57:01.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.994+0000 7fd3d016c700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:01.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.994+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94730225213440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628196bbc00 con 0x5628195f3000 2024-09-13T23:57:01.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.994+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94730225213440] v33'75 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x56281967cb40 con 0x5628195f3000 2024-09-13T23:57:01.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.994+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94730223590144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5628195f3800 con 0x5628195f3400 2024-09-13T23:57:01.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.998+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94730223590144] v33'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56281967d200 con 0x5628195f3400 2024-09-13T23:57:01.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.998+0000 7fd3ea9e5f40 20 remove_watcher() i=0 2024-09-13T23:57:01.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.998+0000 7fd3ea9e5f40 2 removed watcher, disabling cache 2024-09-13T23:57:01.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.998+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94730223591296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562819758400 con 0x5628195f3000 2024-09-13T23:57:01.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.998+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94730223591296] v33'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56281967cb40 con 0x5628195f3000 2024-09-13T23:57:01.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.998+0000 7fd3ea9e5f40 20 remove_watcher() i=1 2024-09-13T23:57:01.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:00.998+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94730223592448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562819758800 con 0x5628195f3400 2024-09-13T23:57:01.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.002+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94730223592448] v33'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56281967d200 con 0x5628195f3400 2024-09-13T23:57:01.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.002+0000 7fd3ea9e5f40 20 remove_watcher() i=2 2024-09-13T23:57:01.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.002+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94730223593600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562819758c00 con 0x5628196ba000 2024-09-13T23:57:01.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.006+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94730223593600] v33'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56281967cb40 con 0x5628196ba000 2024-09-13T23:57:01.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.006+0000 7fd3ea9e5f40 20 remove_watcher() i=3 2024-09-13T23:57:01.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.006+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94730223594752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562819759000 con 0x5628195f3400 2024-09-13T23:57:01.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.006+0000 7fd3e919e700 1 -- 172.21.15.173:0/4037918618 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94730223594752] v33'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56281967d200 con 0x5628195f3400 2024-09-13T23:57:01.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.006+0000 7fd3ea9e5f40 20 remove_watcher() i=4 2024-09-13T23:57:01.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.006+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94730223595904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562819759400 con 0x5628195f3c00 2024-09-13T23:57:01.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.010+0000 7fd3e899d700 1 -- 172.21.15.173:0/4037918618 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94730223595904] v33'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56281967d440 con 0x5628195f3c00 2024-09-13T23:57:01.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.010+0000 7fd3ea9e5f40 20 remove_watcher() i=5 2024-09-13T23:57:01.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.010+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94730223597056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562819759800 con 0x5628195f3c00 2024-09-13T23:57:01.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.014+0000 7fd3e899d700 1 -- 172.21.15.173:0/4037918618 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94730223597056] v33'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56281967d440 con 0x5628195f3c00 2024-09-13T23:57:01.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.014+0000 7fd3ea9e5f40 20 remove_watcher() i=6 2024-09-13T23:57:01.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.014+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94730223598208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562819759c00 con 0x5628196ba000 2024-09-13T23:57:01.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.014+0000 7fd3e999f700 1 -- 172.21.15.173:0/4037918618 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94730223598208] v33'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56281967cb40 con 0x5628196ba000 2024-09-13T23:57:01.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.014+0000 7fd3ea9e5f40 20 remove_watcher() i=7 2024-09-13T23:57:01.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.014+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5628195f3400 msgr2=0x562819543b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.014+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/4037918618 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5628195f3400 0x562819543b80 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.014+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5628195f3000 msgr2=0x562819543600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.014+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/4037918618 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5628195f3000 0x562819543600 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.014+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5628196ba000 msgr2=0x562819542580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.014+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/4037918618 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5628196ba000 0x562819542580 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.014+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5628195f3c00 msgr2=0x562819544c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.014+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/4037918618 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5628195f3c00 0x562819544c00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.014+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5628195f2c00 msgr2=0x562819544680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.014+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/4037918618 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5628195f2c00 0x562819544680 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x56281a026030 tx=0x5628195b7920 comp rx=0 tx=0).stop 2024-09-13T23:57:01.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.014+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925dc00 msgr2=0x562819543080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.014+0000 7fd3e899d700 1 -- 172.21.15.173:0/4037918618 reap_dead start 2024-09-13T23:57:01.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.014+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/4037918618 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925dc00 0x562819543080 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x562819584810 tx=0x5628195b65a0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.014+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 shutdown_connections 2024-09-13T23:57:01.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.014+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/4037918618 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925dc00 0x562819543080 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.014+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 >> 172.21.15.173:0/4037918618 conn(0x56281925d800 msgr2=0x56281935d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.014+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 shutdown_connections 2024-09-13T23:57:01.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.014+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/4037918618 wait complete. 2024-09-13T23:57:01.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.018+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/3005294955 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x562819758000 msgr2=0x56281975e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.018+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/3005294955 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x562819758000 0x56281975e000 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x562819647b90 tx=0x562819722660 comp rx=0 tx=0).stop 2024-09-13T23:57:01.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.018+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/3005294955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628196c0400 msgr2=0x562819545180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.018+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/3005294955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628196c0400 0x562819545180 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x5628196d5260 tx=0x5628195b7a40 comp rx=0 tx=0).stop 2024-09-13T23:57:01.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.018+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/3005294955 shutdown_connections 2024-09-13T23:57:01.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.018+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/3005294955 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x562819758000 0x56281975e000 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.018+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/3005294955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5628196c0400 0x562819545180 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.018+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/3005294955 >> 172.21.15.173:0/3005294955 conn(0x5628196c1c00 msgr2=0x56281935e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.018+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/3005294955 shutdown_connections 2024-09-13T23:57:01.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.018+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/3005294955 wait complete. 2024-09-13T23:57:01.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.018+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/791809358 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5628195f2000 msgr2=0x562819544100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.018+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/791809358 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5628195f2000 0x562819544100 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x5628195854a0 tx=0x5628195b68a0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.018+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/791809358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925d400 msgr2=0x562819542b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.018+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/791809358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925d400 0x562819542b00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x56281a027f50 tx=0x562819361920 comp rx=0 tx=0).stop 2024-09-13T23:57:01.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.018+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/791809358 shutdown_connections 2024-09-13T23:57:01.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.018+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/791809358 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5628195f2000 0x562819544100 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.018+0000 7fd3ea9e5f40 1 --2- 172.21.15.173:0/791809358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56281925d400 0x562819542b00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.018+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/791809358 >> 172.21.15.173:0/791809358 conn(0x56281925cc00 msgr2=0x56281935d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.018+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/791809358 shutdown_connections 2024-09-13T23:57:01.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.018+0000 7fd3ea9e5f40 1 -- 172.21.15.173:0/791809358 wait complete. 2024-09-13T23:57:01.028 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:57:01.028 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:57:01.028 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:57:01.029 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:57:01.069 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:01.069 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:01.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.066+0000 7f01d69f7f40 1 Processor -- start 2024-09-13T23:57:01.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.066+0000 7f01d69f7f40 1 -- start start 2024-09-13T23:57:01.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.066+0000 7f01d69f7f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x56519efdf000 0x56519f2c4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.066+0000 7f01d69f7f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56519f0a3500 con 0x56519efdf400 2024-09-13T23:57:01.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.066+0000 7f01d69f7f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x56519f06ca00 con 0x56519efdf000 2024-09-13T23:57:01.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.066+0000 7f01d51b0700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x56519efdf000 0x56519f2c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.066+0000 7f01d49af700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x56519efdf400 0x56519f0de800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:57946/0 (socket says 172.21.15.173:57946) 2024-09-13T23:57:01.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.066+0000 7f01d49af700 1 -- 172.21.15.173:0/3197902409 learned_addr learned my addr 172.21.15.173:0/3197902409 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:01.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.066+0000 7f01d51b0700 1 -- 172.21.15.173:0/3197902409 >> v1:172.21.15.87:6789/0 conn(0x56519efdf400 legacy=0x56519f0de800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.066+0000 7f01d51b0700 1 -- 172.21.15.173:0/3197902409 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56519eff1d40 con 0x56519efdf000 2024-09-13T23:57:01.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.066+0000 7f01d51b0700 1 --2- 172.21.15.173:0/3197902409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf000 0x56519f2c4580 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x56519f2bfa70 tx=0x56519f0e3920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=febcfb2d572cbb16 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.066+0000 7f01d41ae700 1 -- 172.21.15.173:0/3197902409 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56519f0834a0 con 0x56519efdf000 2024-09-13T23:57:01.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.066+0000 7f01d41ae700 1 -- 172.21.15.173:0/3197902409 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56519f0a3800 con 0x56519efdf000 2024-09-13T23:57:01.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.066+0000 7f01d41ae700 1 -- 172.21.15.173:0/3197902409 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56519f083600 con 0x56519efdf000 2024-09-13T23:57:01.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.066+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3197902409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf000 msgr2=0x56519f2c4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.066+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/3197902409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf000 0x56519f2c4580 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x56519f2bfa70 tx=0x56519f0e3920 comp rx=0 tx=0).stop 2024-09-13T23:57:01.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.066+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3197902409 shutdown_connections 2024-09-13T23:57:01.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.066+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/3197902409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf000 0x56519f2c4580 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.066+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3197902409 >> 172.21.15.173:0/3197902409 conn(0x56519efdec00 msgr2=0x56519f0de000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.066+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3197902409 shutdown_connections 2024-09-13T23:57:01.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.066+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3197902409 wait complete. 2024-09-13T23:57:01.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.070+0000 7f01d69f7f40 1 Processor -- start 2024-09-13T23:57:01.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.070+0000 7f01d69f7f40 1 -- start start 2024-09-13T23:57:01.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.070+0000 7f01d69f7f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf000 0x56519f2c4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.070+0000 7f01d69f7f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56519f06c500 con 0x56519efdf000 2024-09-13T23:57:01.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.070+0000 7f01d51b0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf000 0x56519f2c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.070+0000 7f01d51b0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf000 0x56519f2c4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59190/0 (socket says 172.21.15.173:59190) 2024-09-13T23:57:01.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.070+0000 7f01d51b0700 1 -- 172.21.15.173:0/1265957247 learned_addr learned my addr 172.21.15.173:0/1265957247 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.070+0000 7f01d51b0700 1 -- 172.21.15.173:0/1265957247 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56519eff1ba0 con 0x56519efdf000 2024-09-13T23:57:01.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.070+0000 7f01d51b0700 1 --2- 172.21.15.173:0/1265957247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf000 0x56519f2c4580 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x56519f13bd40 tx=0x56519f0e3800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a086a90a4f6facbd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.070+0000 7f01d39ad700 1 -- 172.21.15.173:0/1265957247 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56519f083760 con 0x56519efdf000 2024-09-13T23:57:01.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.070+0000 7f01d39ad700 1 -- 172.21.15.173:0/1265957247 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56519f0a3b00 con 0x56519efdf000 2024-09-13T23:57:01.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.070+0000 7f01d39ad700 1 -- 172.21.15.173:0/1265957247 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56519f0834a0 con 0x56519efdf000 2024-09-13T23:57:01.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.074+0000 7f01d69f7f40 1 -- 172.21.15.173:0/1265957247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf000 msgr2=0x56519f2c4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.074+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/1265957247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf000 0x56519f2c4580 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x56519f13bd40 tx=0x56519f0e3800 comp rx=0 tx=0).stop 2024-09-13T23:57:01.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.074+0000 7f01d69f7f40 1 -- 172.21.15.173:0/1265957247 shutdown_connections 2024-09-13T23:57:01.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.074+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/1265957247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf000 0x56519f2c4580 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.074+0000 7f01d69f7f40 1 -- 172.21.15.173:0/1265957247 >> 172.21.15.173:0/1265957247 conn(0x56519efdec00 msgr2=0x56519f0df000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.074+0000 7f01d69f7f40 1 -- 172.21.15.173:0/1265957247 shutdown_connections 2024-09-13T23:57:01.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.074+0000 7f01d69f7f40 1 -- 172.21.15.173:0/1265957247 wait complete. 2024-09-13T23:57:01.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.074+0000 7f01d69f7f40 1 Processor -- start 2024-09-13T23:57:01.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.074+0000 7f01d69f7f40 1 -- start start 2024-09-13T23:57:01.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.074+0000 7f01d69f7f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf000 0x56519f2c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.074+0000 7f01d69f7f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56519f06c3c0 con 0x56519efdf000 2024-09-13T23:57:01.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.074+0000 7f01d51b0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf000 0x56519f2c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.074+0000 7f01d51b0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf000 0x56519f2c4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59194/0 (socket says 172.21.15.173:59194) 2024-09-13T23:57:01.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.074+0000 7f01d51b0700 1 -- 172.21.15.173:0/215973892 learned_addr learned my addr 172.21.15.173:0/215973892 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.074+0000 7f01d51b0700 1 -- 172.21.15.173:0/215973892 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56519eff1a00 con 0x56519efdf000 2024-09-13T23:57:01.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.074+0000 7f01d51b0700 1 --2- 172.21.15.173:0/215973892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf000 0x56519f2c4580 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x56519f13b6b0 tx=0x56519f0e3920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.074+0000 7f01d21aa700 1 -- 172.21.15.173:0/215973892 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56519f083600 con 0x56519efdf000 2024-09-13T23:57:01.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.074+0000 7f01d21aa700 1 -- 172.21.15.173:0/215973892 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56519f0a3c80 con 0x56519efdf000 2024-09-13T23:57:01.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.074+0000 7f01d69f7f40 1 -- 172.21.15.173:0/215973892 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56519eff1860 con 0x56519efdf000 2024-09-13T23:57:01.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.074+0000 7f01d21aa700 1 -- 172.21.15.173:0/215973892 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56519f0838c0 con 0x56519efdf000 2024-09-13T23:57:01.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.074+0000 7f01d69f7f40 1 -- 172.21.15.173:0/215973892 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56519eff16c0 con 0x56519efdf000 2024-09-13T23:57:01.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.078+0000 7f01d69f7f40 1 Processor -- start 2024-09-13T23:57:01.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.078+0000 7f01d69f7f40 1 -- start start 2024-09-13T23:57:01.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.078+0000 7f01d21aa700 1 -- 172.21.15.173:0/215973892 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x56519f0d8b00 con 0x56519efdf000 2024-09-13T23:57:01.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.078+0000 7f01d69f7f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf800 0x56519f2c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.078+0000 7f01d69f7f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56519f06c000 con 0x56519efdf800 2024-09-13T23:57:01.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.078+0000 7f01d21aa700 1 --2- 172.21.15.173:0/215973892 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56519f374000 0x56519f2c5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.078+0000 7f01d21aa700 1 -- 172.21.15.173:0/215973892 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x56519f045180 con 0x56519efdf000 2024-09-13T23:57:01.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.078+0000 7f01d51b0700 1 --2- 172.21.15.173:0/215973892 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56519f374000 0x56519f2c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.078+0000 7f01d59b1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf800 0x56519f2c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.078+0000 7f01d59b1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf800 0x56519f2c4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59210/0 (socket says 172.21.15.173:59210) 2024-09-13T23:57:01.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.078+0000 7f01d59b1700 1 -- 172.21.15.173:0/3638528986 learned_addr learned my addr 172.21.15.173:0/3638528986 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.078+0000 7f01d59b1700 1 -- 172.21.15.173:0/3638528986 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56519eff0000 con 0x56519efdf800 2024-09-13T23:57:01.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.078+0000 7f01d51b0700 1 --2- 172.21.15.173:0/215973892 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56519f374000 0x56519f2c5080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x56519f306ea0 tx=0x56519f338780 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.078+0000 7f01d59b1700 1 --2- 172.21.15.173:0/3638528986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf800 0x56519f2c4b00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x56519f306b10 tx=0x56519f338a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7639df1449e3baf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.078+0000 7f01cf9a5700 1 -- 172.21.15.173:0/3638528986 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56519f083600 con 0x56519efdf800 2024-09-13T23:57:01.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.078+0000 7f01cf9a5700 1 -- 172.21.15.173:0/3638528986 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56519f384000 con 0x56519efdf800 2024-09-13T23:57:01.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.078+0000 7f01cf9a5700 1 -- 172.21.15.173:0/3638528986 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56519f0838c0 con 0x56519efdf800 2024-09-13T23:57:01.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.078+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3638528986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf800 msgr2=0x56519f2c4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.078+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/3638528986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf800 0x56519f2c4b00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x56519f306b10 tx=0x56519f338a80 comp rx=0 tx=0).stop 2024-09-13T23:57:01.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.078+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3638528986 shutdown_connections 2024-09-13T23:57:01.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.078+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/3638528986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf800 0x56519f2c4b00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.078+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3638528986 >> 172.21.15.173:0/3638528986 conn(0x56519efdf400 msgr2=0x56519f0df800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.078+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3638528986 shutdown_connections 2024-09-13T23:57:01.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.082+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3638528986 wait complete. 2024-09-13T23:57:01.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.082+0000 7f01d69f7f40 1 Processor -- start 2024-09-13T23:57:01.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.082+0000 7f01d69f7f40 1 -- start start 2024-09-13T23:57:01.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.082+0000 7f01d69f7f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf800 0x56519f2c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.082+0000 7f01d69f7f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56519f004640 con 0x56519efdf800 2024-09-13T23:57:01.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.082+0000 7f01d59b1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf800 0x56519f2c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.082+0000 7f01d59b1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf800 0x56519f2c4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59222/0 (socket says 172.21.15.173:59222) 2024-09-13T23:57:01.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.082+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 learned_addr learned my addr 172.21.15.173:0/3158602704 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.082+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56519eff0ea0 con 0x56519efdf800 2024-09-13T23:57:01.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.082+0000 7f01d59b1700 1 --2- 172.21.15.173:0/3158602704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf800 0x56519f2c4b00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x56519f13bda0 tx=0x56519f338660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.082+0000 7f01ce1a2700 1 -- 172.21.15.173:0/3158602704 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56519f083760 con 0x56519efdf800 2024-09-13T23:57:01.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.082+0000 7f01ce1a2700 1 -- 172.21.15.173:0/3158602704 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56519f384180 con 0x56519efdf800 2024-09-13T23:57:01.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.082+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56519eff0820 con 0x56519efdf800 2024-09-13T23:57:01.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.082+0000 7f01ce1a2700 1 -- 172.21.15.173:0/3158602704 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56519f083600 con 0x56519efdf800 2024-09-13T23:57:01.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.082+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56519eff09c0 con 0x56519efdf800 2024-09-13T23:57:01.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.082+0000 7f01d69f7f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.082+0000 7f01ce1a2700 1 -- 172.21.15.173:0/3158602704 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x56519f0d9080 con 0x56519efdf800 2024-09-13T23:57:01.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.082+0000 7f01ce1a2700 1 --2- 172.21.15.173:0/3158602704 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56519f374c00 0x56519f2c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.086+0000 7f01ce1a2700 1 -- 172.21.15.173:0/3158602704 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x56519f045340 con 0x56519efdf800 2024-09-13T23:57:01.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.086+0000 7f01d49af700 1 --2- 172.21.15.173:0/3158602704 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56519f374c00 0x56519f2c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.086+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/3158602704 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56519f375000 0x56519f2c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.086+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375400 con 0x56519f375000 2024-09-13T23:57:01.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.086+0000 7f01d59b1700 1 --2- 172.21.15.173:0/3158602704 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56519f375000 0x56519f2c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.086+0000 7f01d49af700 1 --2- 172.21.15.173:0/3158602704 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56519f374c00 0x56519f2c5600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x56519f355b30 tx=0x56519f339920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.086+0000 7f01d59b1700 1 --2- 172.21.15.173:0/3158602704 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56519f375000 0x56519f2c5b80 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.086+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56519f41ab40 con 0x56519f375000 2024-09-13T23:57:01.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.086+0000 7f01d69f7f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.086+0000 7f01d69f7f40 20 realm 2024-09-13T23:57:01.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.086+0000 7f01d69f7f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.086+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375000 2024-09-13T23:57:01.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.086+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56519f41ab40 con 0x56519f375000 2024-09-13T23:57:01.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.086+0000 7f01d69f7f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.086+0000 7f01d69f7f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:01.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.086+0000 7f01d69f7f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.086+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375c00 con 0x56519f375000 2024-09-13T23:57:01.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.086+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56519f41ab40 con 0x56519f375000 2024-09-13T23:57:01.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.086+0000 7f01d69f7f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.086+0000 7f01d69f7f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.086+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/3158602704 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56519f375400 0x56519f2c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.086+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375400 2024-09-13T23:57:01.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.086+0000 7f01d51b0700 1 --2- 172.21.15.173:0/3158602704 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56519f375400 0x56519f2c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.086+0000 7f01d51b0700 1 --2- 172.21.15.173:0/3158602704 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56519f375400 0x56519f2c6100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.090+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x56519f41b200 con 0x56519f375400 2024-09-13T23:57:01.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.090+0000 7f01d69f7f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:01.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.090+0000 7f01d69f7f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.090+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/3158602704 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56519f375c00 0x56519f2c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.090+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f43a000 con 0x56519f375c00 2024-09-13T23:57:01.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.090+0000 7f01d49af700 1 --2- 172.21.15.173:0/3158602704 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56519f375c00 0x56519f2c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.090+0000 7f01d49af700 1 --2- 172.21.15.173:0/3158602704 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56519f375c00 0x56519f2c6680 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.090+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x56519f41b440 con 0x56519f375c00 2024-09-13T23:57:01.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.090+0000 7f01d69f7f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:01.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.090+0000 7f01d69f7f40 20 searching for the correct realm 2024-09-13T23:57:01.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.090+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f43a400 con 0x56519f375c00 2024-09-13T23:57:01.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.090+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x56519f41b440 con 0x56519f375c00 2024-09-13T23:57:01.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.090+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f43a000 con 0x56519f375400 2024-09-13T23:57:01.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.090+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41b200 con 0x56519f375400 2024-09-13T23:57:01.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.090+0000 7f01d51b0700 1 --2- 172.21.15.173:0/3158602704 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56519f43a000 0x56519f2c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.090+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f43a000 2024-09-13T23:57:01.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.090+0000 7f01d59b1700 1 --2- 172.21.15.173:0/3158602704 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56519f43a000 0x56519f2c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.090+0000 7f01d59b1700 1 --2- 172.21.15.173:0/3158602704 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56519f43a000 0x56519f2c6c00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.094+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41ab40 con 0x56519f43a000 2024-09-13T23:57:01.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.094+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375000 2024-09-13T23:57:01.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.094+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x56519f41ab40 con 0x56519f375000 2024-09-13T23:57:01.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.094+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375000 2024-09-13T23:57:01.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.094+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41ab40 con 0x56519f375000 2024-09-13T23:57:01.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.094+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375c00 2024-09-13T23:57:01.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.094+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41b440 con 0x56519f375c00 2024-09-13T23:57:01.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.094+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375000 2024-09-13T23:57:01.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.094+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41ab40 con 0x56519f375000 2024-09-13T23:57:01.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.094+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375400 2024-09-13T23:57:01.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.094+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41b200 con 0x56519f375400 2024-09-13T23:57:01.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.094+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375400 2024-09-13T23:57:01.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.094+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41b200 con 0x56519f375400 2024-09-13T23:57:01.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.094+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375000 2024-09-13T23:57:01.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.094+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41ab40 con 0x56519f375000 2024-09-13T23:57:01.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.094+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f43a000 2024-09-13T23:57:01.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.098+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41ab40 con 0x56519f43a000 2024-09-13T23:57:01.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.098+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375000 2024-09-13T23:57:01.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.098+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41ab40 con 0x56519f375000 2024-09-13T23:57:01.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.098+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f43a000 2024-09-13T23:57:01.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.098+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41ab40 con 0x56519f43a000 2024-09-13T23:57:01.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.098+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375400 2024-09-13T23:57:01.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.098+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41b200 con 0x56519f375400 2024-09-13T23:57:01.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.098+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375c00 2024-09-13T23:57:01.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.098+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41b440 con 0x56519f375c00 2024-09-13T23:57:01.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.098+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375000 2024-09-13T23:57:01.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.098+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41ab40 con 0x56519f375000 2024-09-13T23:57:01.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.098+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375400 2024-09-13T23:57:01.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.102+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41b200 con 0x56519f375400 2024-09-13T23:57:01.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.102+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375c00 2024-09-13T23:57:01.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.102+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41b440 con 0x56519f375c00 2024-09-13T23:57:01.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.102+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375000 2024-09-13T23:57:01.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.102+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41ab40 con 0x56519f375000 2024-09-13T23:57:01.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.102+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375000 2024-09-13T23:57:01.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.102+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41ab40 con 0x56519f375000 2024-09-13T23:57:01.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.102+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375000 2024-09-13T23:57:01.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.102+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41ab40 con 0x56519f375000 2024-09-13T23:57:01.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.102+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375c00 2024-09-13T23:57:01.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.102+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41b440 con 0x56519f375c00 2024-09-13T23:57:01.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.102+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f43a000 2024-09-13T23:57:01.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.102+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41ab40 con 0x56519f43a000 2024-09-13T23:57:01.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.102+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375000 2024-09-13T23:57:01.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.102+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41ab40 con 0x56519f375000 2024-09-13T23:57:01.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.102+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f43a000 2024-09-13T23:57:01.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.106+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41ab40 con 0x56519f43a000 2024-09-13T23:57:01.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.106+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375c00 2024-09-13T23:57:01.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.106+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41b440 con 0x56519f375c00 2024-09-13T23:57:01.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.106+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f43a000 2024-09-13T23:57:01.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.106+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41ab40 con 0x56519f43a000 2024-09-13T23:57:01.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.106+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375400 2024-09-13T23:57:01.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.106+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41b200 con 0x56519f375400 2024-09-13T23:57:01.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.106+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375400 2024-09-13T23:57:01.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.106+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41b200 con 0x56519f375400 2024-09-13T23:57:01.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.106+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375c00 2024-09-13T23:57:01.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.106+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41b440 con 0x56519f375c00 2024-09-13T23:57:01.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.106+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375400 2024-09-13T23:57:01.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x56519f41b200 con 0x56519f375400 2024-09-13T23:57:01.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f375400 2024-09-13T23:57:01.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56519f41b200 con 0x56519f375400 2024-09-13T23:57:01.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d69f7f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:01.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d69f7f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:01.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d69f7f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:01.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d69f7f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:01.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d69f7f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f43a800 con 0x56519f375000 2024-09-13T23:57:01.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56519f41ab40 con 0x56519f375000 2024-09-13T23:57:01.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d69f7f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d69f7f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f43ac00 con 0x56519f375400 2024-09-13T23:57:01.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x56519f41b200 con 0x56519f375400 2024-09-13T23:57:01.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d69f7f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:01.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d69f7f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f43b000 con 0x56519f375000 2024-09-13T23:57:01.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x56519f41ab40 con 0x56519f375000 2024-09-13T23:57:01.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d69f7f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:01.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d69f7f40 20 zone default found 2024-09-13T23:57:01.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d69f7f40 4 Realm: () 2024-09-13T23:57:01.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d69f7f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:01.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d69f7f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:01.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d69f7f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:01.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d69f7f40 20 zonegroup default 2024-09-13T23:57:01.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d69f7f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f43b400 con 0x56519f43a000 2024-09-13T23:57:01.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x56519f41ab40 con 0x56519f43a000 2024-09-13T23:57:01.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d69f7f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d69f7f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.110+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f43b800 con 0x56519f375c00 2024-09-13T23:57:01.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.114+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x56519f41b440 con 0x56519f375c00 2024-09-13T23:57:01.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.114+0000 7f01d69f7f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.114+0000 7f01d69f7f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.114+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f43bc00 con 0x56519f375c00 2024-09-13T23:57:01.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.114+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x56519f41b440 con 0x56519f375c00 2024-09-13T23:57:01.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.114+0000 7f01d69f7f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.114+0000 7f01d69f7f40 20 started sync module instance, tier type = 2024-09-13T23:57:01.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.114+0000 7f01d69f7f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:01.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.114+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f440000 con 0x56519f375400 2024-09-13T23:57:01.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.114+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56519f41b200 con 0x56519f375400 2024-09-13T23:57:01.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.114+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94908562782976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f440400 con 0x56519f375400 2024-09-13T23:57:01.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.114+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f440800 con 0x56519f375000 2024-09-13T23:57:01.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.118+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94908562782976] v33'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56519f41b200 con 0x56519f375400 2024-09-13T23:57:01.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.118+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56519f41ab40 con 0x56519f375000 2024-09-13T23:57:01.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.118+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94908562784128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f440c00 con 0x56519f375000 2024-09-13T23:57:01.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.118+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f441000 con 0x56519f375400 2024-09-13T23:57:01.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.122+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94908562784128] v33'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56519f41ab40 con 0x56519f375000 2024-09-13T23:57:01.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.122+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56519f41b200 con 0x56519f375400 2024-09-13T23:57:01.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.122+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94908562785280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f441400 con 0x56519f375400 2024-09-13T23:57:01.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.122+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f441800 con 0x56519f43a000 2024-09-13T23:57:01.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.126+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94908562785280] v33'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56519f41b200 con 0x56519f375400 2024-09-13T23:57:01.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.126+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56519f41ab40 con 0x56519f43a000 2024-09-13T23:57:01.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.126+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94908562786432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f441c00 con 0x56519f43a000 2024-09-13T23:57:01.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.126+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f440800 con 0x56519f375400 2024-09-13T23:57:01.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.126+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94908562786432] v33'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56519f41ab40 con 0x56519f43a000 2024-09-13T23:57:01.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.126+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56519f41b200 con 0x56519f375400 2024-09-13T23:57:01.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.126+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94908562787584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f440000 con 0x56519f375400 2024-09-13T23:57:01.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.126+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f43a800 con 0x56519f375c00 2024-09-13T23:57:01.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.130+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56519f41b440 con 0x56519f375c00 2024-09-13T23:57:01.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.130+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94908562788736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f43b000 con 0x56519f375c00 2024-09-13T23:57:01.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.130+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f43b400 con 0x56519f375c00 2024-09-13T23:57:01.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.130+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94908562787584] v33'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56519f41b200 con 0x56519f375400 2024-09-13T23:57:01.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.130+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94908562788736] v33'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56519f41b440 con 0x56519f375c00 2024-09-13T23:57:01.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.130+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56519f41b440 con 0x56519f375c00 2024-09-13T23:57:01.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.130+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94908562789888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f43ac00 con 0x56519f375c00 2024-09-13T23:57:01.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.130+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f375800 con 0x56519f43a000 2024-09-13T23:57:01.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.134+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56519f41ab40 con 0x56519f43a000 2024-09-13T23:57:01.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.134+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94908562791040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f440400 con 0x56519f43a000 2024-09-13T23:57:01.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.134+0000 7f01d69f7f40 20 add_watcher() i=0 2024-09-13T23:57:01.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.134+0000 7f01d69f7f40 20 add_watcher() i=1 2024-09-13T23:57:01.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.134+0000 7f01d69f7f40 20 add_watcher() i=2 2024-09-13T23:57:01.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.134+0000 7f01d69f7f40 20 add_watcher() i=3 2024-09-13T23:57:01.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.134+0000 7f01d69f7f40 20 add_watcher() i=4 2024-09-13T23:57:01.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.134+0000 7f01d69f7f40 20 add_watcher() i=5 2024-09-13T23:57:01.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.134+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94908562789888] v33'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56519f41b440 con 0x56519f375c00 2024-09-13T23:57:01.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.134+0000 7f01d69f7f40 20 add_watcher() i=6 2024-09-13T23:57:01.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.134+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94908562791040] v33'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56519f41ab40 con 0x56519f43a000 2024-09-13T23:57:01.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.134+0000 7f01d69f7f40 20 add_watcher() i=7 2024-09-13T23:57:01.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.134+0000 7f01d69f7f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:01.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.134+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f441000 con 0x56519f375000 2024-09-13T23:57:01.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.134+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x56519f41ab40 con 0x56519f375000 2024-09-13T23:57:01.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.134+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94908564398080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f441400 con 0x56519f375000 2024-09-13T23:57:01.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.138+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94908564398080] v33'76 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x56519f41ab40 con 0x56519f375000 2024-09-13T23:57:01.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.138+0000 7f01bc17e700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:01.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.138+0000 7f01d69f7f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:01.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.138+0000 7f01d69f7f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:01.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.138+0000 7f01d69f7f40 1 Processor -- start 2024-09-13T23:57:01.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.138+0000 7f01d69f7f40 1 -- start start 2024-09-13T23:57:01.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.138+0000 7f01d69f7f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519f43a400 0x56519f2c7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.138+0000 7f01d69f7f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56519f004780 con 0x56519f43a400 2024-09-13T23:57:01.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.138+0000 7f01d49af700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519f43a400 0x56519f2c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.138+0000 7f01d49af700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519f43a400 0x56519f2c7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59236/0 (socket says 172.21.15.173:59236) 2024-09-13T23:57:01.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.138+0000 7f01d49af700 1 -- 172.21.15.173:0/3859415934 learned_addr learned my addr 172.21.15.173:0/3859415934 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.138+0000 7f01d49af700 1 -- 172.21.15.173:0/3859415934 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56519eff0b60 con 0x56519f43a400 2024-09-13T23:57:01.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.138+0000 7f01d49af700 1 --2- 172.21.15.173:0/3859415934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519f43a400 0x56519f2c7180 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x56519f450090 tx=0x56519f3398c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d7ef484fe0b04c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.142+0000 7f01bb97d700 1 -- 172.21.15.173:0/3859415934 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56519f458000 con 0x56519f43a400 2024-09-13T23:57:01.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.142+0000 7f01bb97d700 1 -- 172.21.15.173:0/3859415934 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56519f384600 con 0x56519f43a400 2024-09-13T23:57:01.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.142+0000 7f01bb97d700 1 -- 172.21.15.173:0/3859415934 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56519f458160 con 0x56519f43a400 2024-09-13T23:57:01.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.142+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3859415934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519f43a400 msgr2=0x56519f2c7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.142+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/3859415934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519f43a400 0x56519f2c7180 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x56519f450090 tx=0x56519f3398c0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.142+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3859415934 shutdown_connections 2024-09-13T23:57:01.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.142+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/3859415934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519f43a400 0x56519f2c7180 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.142+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3859415934 >> 172.21.15.173:0/3859415934 conn(0x56519f440800 msgr2=0x56519f0e0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.142+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3859415934 shutdown_connections 2024-09-13T23:57:01.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.142+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3859415934 wait complete. 2024-09-13T23:57:01.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.142+0000 7f01d69f7f40 1 Processor -- start 2024-09-13T23:57:01.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.142+0000 7f01d69f7f40 1 -- start start 2024-09-13T23:57:01.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.142+0000 7f01d69f7f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519f43a400 0x56519f2c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.142+0000 7f01d69f7f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56519f06c000 con 0x56519f43a400 2024-09-13T23:57:01.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.142+0000 7f01d49af700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519f43a400 0x56519f2c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.142+0000 7f01d49af700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519f43a400 0x56519f2c7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59246/0 (socket says 172.21.15.173:59246) 2024-09-13T23:57:01.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.142+0000 7f01d49af700 1 -- 172.21.15.173:0/2684080798 learned_addr learned my addr 172.21.15.173:0/2684080798 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.142+0000 7f01d49af700 1 -- 172.21.15.173:0/2684080798 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56519eff0d00 con 0x56519f43a400 2024-09-13T23:57:01.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.142+0000 7f01d49af700 1 --2- 172.21.15.173:0/2684080798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519f43a400 0x56519f2c7180 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x56519f4502a0 tx=0x56519f339a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.142+0000 7f01ba17a700 1 -- 172.21.15.173:0/2684080798 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56519f4582c0 con 0x56519f43a400 2024-09-13T23:57:01.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.142+0000 7f01ba17a700 1 -- 172.21.15.173:0/2684080798 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56519f384300 con 0x56519f43a400 2024-09-13T23:57:01.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.142+0000 7f01ba17a700 1 -- 172.21.15.173:0/2684080798 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56519f458000 con 0x56519f43a400 2024-09-13T23:57:01.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.142+0000 7f01d69f7f40 1 -- 172.21.15.173:0/2684080798 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56519eff0340 con 0x56519f43a400 2024-09-13T23:57:01.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.142+0000 7f01d69f7f40 1 -- 172.21.15.173:0/2684080798 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56519eff0b60 con 0x56519f43a400 2024-09-13T23:57:01.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.146+0000 7f01ba17a700 1 -- 172.21.15.173:0/2684080798 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x56519f0d9b80 con 0x56519f43a400 2024-09-13T23:57:01.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.146+0000 7f01ba17a700 1 --2- 172.21.15.173:0/2684080798 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56519f375800 0x56519f4da000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.146+0000 7f01ba17a700 1 -- 172.21.15.173:0/2684080798 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x56519f045500 con 0x56519f43a400 2024-09-13T23:57:01.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.146+0000 7f01d69f7f40 5 note: GC not initialized 2024-09-13T23:57:01.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.146+0000 7f01d59b1700 1 --2- 172.21.15.173:0/2684080798 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56519f375800 0x56519f4da000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.146+0000 7f01d59b1700 1 --2- 172.21.15.173:0/2684080798 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56519f375800 0x56519f4da000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x56519f3e94d0 tx=0x56519f49e660 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.146+0000 7f01b7975700 20 reqs_thread_entry: start 2024-09-13T23:57:01.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.146+0000 7f01d69f7f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:01.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.146+0000 7f01d69f7f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:01.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.146+0000 7f01b5971700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:31 2024 2024-09-13T23:57:01.154 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:01.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.150+0000 7f01d69f7f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.150+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f43a800 con 0x56519f375000 2024-09-13T23:57:01.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.150+0000 7f01b514f700 20 reqs_thread_entry: start 2024-09-13T23:57:01.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.150+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x56519f41ab40 con 0x56519f375000 2024-09-13T23:57:01.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.150+0000 7f01d69f7f40 20 rados_obj.operate() r=0 bl.length=513 2024-09-13T23:57:01.155 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:01.155 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "foo", 2024-09-13T23:57:01.155 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Foo", 2024-09-13T23:57:01.155 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "foo@foo.com", 2024-09-13T23:57:01.155 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:57:01.155 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:57:01.155 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [ 2024-09-13T23:57:01.155 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:01.155 INFO:teuthology.orchestra.run.smithi173.stdout: "id": "foo:foo1", 2024-09-13T23:57:01.155 INFO:teuthology.orchestra.run.smithi173.stdout: "permissions": "full-control" 2024-09-13T23:57:01.155 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:01.155 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:01.156 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:57:01.156 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:01.156 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:57:01.156 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-09-13T23:57:01.156 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-09-13T23:57:01.156 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:01.156 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:01.156 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [ 2024-09-13T23:57:01.156 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:01.156 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo:foo1", 2024-09-13T23:57:01.156 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL" 2024-09-13T23:57:01.156 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:01.156 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:01.157 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:57:01.157 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:57:01.157 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:57:01.157 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:57:01.157 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:57:01.157 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:57:01.157 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:01.157 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:01.157 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:01.157 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:01.157 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:01.158 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:01.158 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:57:01.158 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:01.158 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:01.158 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:01.158 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:01.158 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:01.158 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:01.158 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:57:01.158 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:57:01.158 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:57:01.158 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:01.158 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:57:01.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.150+0000 7f01bc17e700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:01.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.150+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94908564398080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f440c00 con 0x56519f375000 2024-09-13T23:57:01.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.154+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94908564398080] v33'77 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x56519f41ab40 con 0x56519f375000 2024-09-13T23:57:01.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.154+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94908562782976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f441800 con 0x56519f375400 2024-09-13T23:57:01.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.154+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94908562782976] v33'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56519f41b200 con 0x56519f375400 2024-09-13T23:57:01.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.154+0000 7f01d69f7f40 20 remove_watcher() i=0 2024-09-13T23:57:01.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.154+0000 7f01d69f7f40 2 removed watcher, disabling cache 2024-09-13T23:57:01.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.154+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94908562784128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f441c00 con 0x56519f375000 2024-09-13T23:57:01.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.158+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94908562784128] v33'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56519f41ab40 con 0x56519f375000 2024-09-13T23:57:01.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.158+0000 7f01d69f7f40 20 remove_watcher() i=1 2024-09-13T23:57:01.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.158+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94908562785280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f440400 con 0x56519f375400 2024-09-13T23:57:01.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.162+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94908562785280] v33'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56519f41b200 con 0x56519f375400 2024-09-13T23:57:01.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.162+0000 7f01d69f7f40 20 remove_watcher() i=2 2024-09-13T23:57:01.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.162+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94908562786432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f3a0000 con 0x56519f43a000 2024-09-13T23:57:01.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.162+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94908562786432] v33'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56519f41ab40 con 0x56519f43a000 2024-09-13T23:57:01.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.162+0000 7f01d69f7f40 20 remove_watcher() i=3 2024-09-13T23:57:01.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.162+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94908562787584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f3a0400 con 0x56519f375400 2024-09-13T23:57:01.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.166+0000 7f01d51b0700 1 -- 172.21.15.173:0/3158602704 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94908562787584] v33'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56519f41b200 con 0x56519f375400 2024-09-13T23:57:01.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.166+0000 7f01d69f7f40 20 remove_watcher() i=4 2024-09-13T23:57:01.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.166+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94908562788736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f3a0800 con 0x56519f375c00 2024-09-13T23:57:01.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.166+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94908562788736] v33'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56519f41b440 con 0x56519f375c00 2024-09-13T23:57:01.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.166+0000 7f01d69f7f40 20 remove_watcher() i=5 2024-09-13T23:57:01.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.166+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94908562789888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f3a0c00 con 0x56519f375c00 2024-09-13T23:57:01.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.170+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94908562789888] v33'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56519f41b440 con 0x56519f375c00 2024-09-13T23:57:01.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.170+0000 7f01d69f7f40 20 remove_watcher() i=6 2024-09-13T23:57:01.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.170+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94908562791040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56519f3a1000 con 0x56519f43a000 2024-09-13T23:57:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d59b1700 1 -- 172.21.15.173:0/3158602704 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94908562791040] v33'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56519f41ab40 con 0x56519f43a000 2024-09-13T23:57:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 20 remove_watcher() i=7 2024-09-13T23:57:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56519f375400 msgr2=0x56519f2c6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/3158602704 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56519f375400 0x56519f2c6100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56519f375000 msgr2=0x56519f2c5b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/3158602704 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56519f375000 0x56519f2c5b80 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56519f43a000 msgr2=0x56519f2c6c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/3158602704 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56519f43a000 0x56519f2c6c00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56519f375c00 msgr2=0x56519f2c6680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/3158602704 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56519f375c00 0x56519f2c6680 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56519f374c00 msgr2=0x56519f2c5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/3158602704 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56519f374c00 0x56519f2c5600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x56519f355b30 tx=0x56519f339920 comp rx=0 tx=0).stop 2024-09-13T23:57:01.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf800 msgr2=0x56519f2c4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/3158602704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf800 0x56519f2c4b00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x56519f13bda0 tx=0x56519f338660 comp rx=0 tx=0).stop 2024-09-13T23:57:01.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 reap_dead start 2024-09-13T23:57:01.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d49af700 1 -- 172.21.15.173:0/3158602704 reap_dead start 2024-09-13T23:57:01.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 shutdown_connections 2024-09-13T23:57:01.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 >> 172.21.15.173:0/3158602704 conn(0x56519efdf400 msgr2=0x56519f0df800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 shutdown_connections 2024-09-13T23:57:01.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 -- 172.21.15.173:0/3158602704 wait complete. 2024-09-13T23:57:01.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 -- 172.21.15.173:0/2684080798 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56519f375800 msgr2=0x56519f4da000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/2684080798 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56519f375800 0x56519f4da000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x56519f3e94d0 tx=0x56519f49e660 comp rx=0 tx=0).stop 2024-09-13T23:57:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 -- 172.21.15.173:0/2684080798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519f43a400 msgr2=0x56519f2c7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/2684080798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519f43a400 0x56519f2c7180 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x56519f4502a0 tx=0x56519f339a40 comp rx=0 tx=0).stop 2024-09-13T23:57:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 -- 172.21.15.173:0/2684080798 shutdown_connections 2024-09-13T23:57:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/2684080798 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56519f375800 0x56519f4da000 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/2684080798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519f43a400 0x56519f2c7180 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 -- 172.21.15.173:0/2684080798 >> 172.21.15.173:0/2684080798 conn(0x56519f440800 msgr2=0x56519f0e0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 -- 172.21.15.173:0/2684080798 shutdown_connections 2024-09-13T23:57:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 -- 172.21.15.173:0/2684080798 wait complete. 2024-09-13T23:57:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 -- 172.21.15.173:0/215973892 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56519f374000 msgr2=0x56519f2c5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/215973892 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56519f374000 0x56519f2c5080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x56519f306ea0 tx=0x56519f338780 comp rx=0 tx=0).stop 2024-09-13T23:57:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 -- 172.21.15.173:0/215973892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf000 msgr2=0x56519f2c4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/215973892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf000 0x56519f2c4580 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x56519f13b6b0 tx=0x56519f0e3920 comp rx=0 tx=0).stop 2024-09-13T23:57:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 -- 172.21.15.173:0/215973892 shutdown_connections 2024-09-13T23:57:01.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/215973892 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56519f374000 0x56519f2c5080 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 --2- 172.21.15.173:0/215973892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56519efdf000 0x56519f2c4580 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 -- 172.21.15.173:0/215973892 >> 172.21.15.173:0/215973892 conn(0x56519efdec00 msgr2=0x56519f0df000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 -- 172.21.15.173:0/215973892 shutdown_connections 2024-09-13T23:57:01.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.174+0000 7f01d69f7f40 1 -- 172.21.15.173:0/215973892 wait complete. 2024-09-13T23:57:01.186 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:57:01.186 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-13T23:57:01.186 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-13T23:57:01.187 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-13T23:57:01.233 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:01.234 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:01.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.230+0000 7fec5eb98f40 1 Processor -- start 2024-09-13T23:57:01.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.230+0000 7fec5eb98f40 1 -- start start 2024-09-13T23:57:01.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.230+0000 7fec5eb98f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55a9b5e6d000 0x55a9b6152580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.230+0000 7fec5eb98f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a9b5f31500 con 0x55a9b5e6d400 2024-09-13T23:57:01.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.230+0000 7fec5eb98f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a9b5efaa00 con 0x55a9b5e6d000 2024-09-13T23:57:01.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.230+0000 7fec5d351700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55a9b5e6d000 0x55a9b6152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.230+0000 7fec5cb50700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55a9b5e6d400 0x55a9b5f6c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:57950/0 (socket says 172.21.15.173:57950) 2024-09-13T23:57:01.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.230+0000 7fec5cb50700 1 -- 172.21.15.173:0/1661053140 learned_addr learned my addr 172.21.15.173:0/1661053140 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:01.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.230+0000 7fec5d351700 1 -- 172.21.15.173:0/1661053140 >> v1:172.21.15.87:6789/0 conn(0x55a9b5e6d400 legacy=0x55a9b5f6c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.230+0000 7fec5d351700 1 -- 172.21.15.173:0/1661053140 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9b5e7fd40 con 0x55a9b5e6d000 2024-09-13T23:57:01.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.230+0000 7fec5d351700 1 --2- 172.21.15.173:0/1661053140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d000 0x55a9b6152580 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55a9b614da70 tx=0x55a9b5f71920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f1eecdcd22cdd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.230+0000 7fec5c34f700 1 -- 172.21.15.173:0/1661053140 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a9b5f114a0 con 0x55a9b5e6d000 2024-09-13T23:57:01.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.230+0000 7fec5c34f700 1 -- 172.21.15.173:0/1661053140 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a9b5f31800 con 0x55a9b5e6d000 2024-09-13T23:57:01.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.230+0000 7fec5c34f700 1 -- 172.21.15.173:0/1661053140 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a9b5f11600 con 0x55a9b5e6d000 2024-09-13T23:57:01.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.230+0000 7fec5eb98f40 1 -- 172.21.15.173:0/1661053140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d000 msgr2=0x55a9b6152580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.230+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/1661053140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d000 0x55a9b6152580 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55a9b614da70 tx=0x55a9b5f71920 comp rx=0 tx=0).stop 2024-09-13T23:57:01.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.230+0000 7fec5eb98f40 1 -- 172.21.15.173:0/1661053140 shutdown_connections 2024-09-13T23:57:01.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.230+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/1661053140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d000 0x55a9b6152580 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.230+0000 7fec5eb98f40 1 -- 172.21.15.173:0/1661053140 >> 172.21.15.173:0/1661053140 conn(0x55a9b5e6cc00 msgr2=0x55a9b5f6c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.234+0000 7fec5eb98f40 1 -- 172.21.15.173:0/1661053140 shutdown_connections 2024-09-13T23:57:01.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.234+0000 7fec5eb98f40 1 -- 172.21.15.173:0/1661053140 wait complete. 2024-09-13T23:57:01.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.234+0000 7fec5eb98f40 1 Processor -- start 2024-09-13T23:57:01.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.234+0000 7fec5eb98f40 1 -- start start 2024-09-13T23:57:01.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.234+0000 7fec5eb98f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d000 0x55a9b6152580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.234+0000 7fec5eb98f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9b5efa500 con 0x55a9b5e6d000 2024-09-13T23:57:01.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.234+0000 7fec5d351700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d000 0x55a9b6152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.234+0000 7fec5d351700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d000 0x55a9b6152580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59258/0 (socket says 172.21.15.173:59258) 2024-09-13T23:57:01.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.234+0000 7fec5d351700 1 -- 172.21.15.173:0/1596727929 learned_addr learned my addr 172.21.15.173:0/1596727929 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.234+0000 7fec5d351700 1 -- 172.21.15.173:0/1596727929 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9b5e7fba0 con 0x55a9b5e6d000 2024-09-13T23:57:01.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.234+0000 7fec5d351700 1 --2- 172.21.15.173:0/1596727929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d000 0x55a9b6152580 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x55a9b6ccde00 tx=0x55a9b5f71800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec5acaeec82cefc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.234+0000 7fec5bb4e700 1 -- 172.21.15.173:0/1596727929 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a9b5f11760 con 0x55a9b5e6d000 2024-09-13T23:57:01.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.234+0000 7fec5bb4e700 1 -- 172.21.15.173:0/1596727929 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a9b5f31b00 con 0x55a9b5e6d000 2024-09-13T23:57:01.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.234+0000 7fec5bb4e700 1 -- 172.21.15.173:0/1596727929 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a9b5f114a0 con 0x55a9b5e6d000 2024-09-13T23:57:01.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.234+0000 7fec5eb98f40 1 -- 172.21.15.173:0/1596727929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d000 msgr2=0x55a9b6152580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.234+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/1596727929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d000 0x55a9b6152580 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x55a9b6ccde00 tx=0x55a9b5f71800 comp rx=0 tx=0).stop 2024-09-13T23:57:01.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.238+0000 7fec5eb98f40 1 -- 172.21.15.173:0/1596727929 shutdown_connections 2024-09-13T23:57:01.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.238+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/1596727929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d000 0x55a9b6152580 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.238+0000 7fec5eb98f40 1 -- 172.21.15.173:0/1596727929 >> 172.21.15.173:0/1596727929 conn(0x55a9b5e6cc00 msgr2=0x55a9b5f6d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.238+0000 7fec5eb98f40 1 -- 172.21.15.173:0/1596727929 shutdown_connections 2024-09-13T23:57:01.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.238+0000 7fec5eb98f40 1 -- 172.21.15.173:0/1596727929 wait complete. 2024-09-13T23:57:01.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.238+0000 7fec5eb98f40 1 Processor -- start 2024-09-13T23:57:01.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.238+0000 7fec5eb98f40 1 -- start start 2024-09-13T23:57:01.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.238+0000 7fec5eb98f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d000 0x55a9b6152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.238+0000 7fec5eb98f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9b5efa3c0 con 0x55a9b5e6d000 2024-09-13T23:57:01.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.238+0000 7fec5d351700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d000 0x55a9b6152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.238+0000 7fec5d351700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d000 0x55a9b6152580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59274/0 (socket says 172.21.15.173:59274) 2024-09-13T23:57:01.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.238+0000 7fec5d351700 1 -- 172.21.15.173:0/965090403 learned_addr learned my addr 172.21.15.173:0/965090403 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.238+0000 7fec5d351700 1 -- 172.21.15.173:0/965090403 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9b5e7fa00 con 0x55a9b5e6d000 2024-09-13T23:57:01.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.238+0000 7fec5d351700 1 --2- 172.21.15.173:0/965090403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d000 0x55a9b6152580 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55a9b6ccde90 tx=0x55a9b5f71920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.238+0000 7fec5a34b700 1 -- 172.21.15.173:0/965090403 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a9b5f11600 con 0x55a9b5e6d000 2024-09-13T23:57:01.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.238+0000 7fec5a34b700 1 -- 172.21.15.173:0/965090403 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a9b5f31c80 con 0x55a9b5e6d000 2024-09-13T23:57:01.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.238+0000 7fec5eb98f40 1 -- 172.21.15.173:0/965090403 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a9b5e7f860 con 0x55a9b5e6d000 2024-09-13T23:57:01.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.238+0000 7fec5a34b700 1 -- 172.21.15.173:0/965090403 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a9b5f118c0 con 0x55a9b5e6d000 2024-09-13T23:57:01.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.238+0000 7fec5eb98f40 1 -- 172.21.15.173:0/965090403 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a9b5e7f6c0 con 0x55a9b5e6d000 2024-09-13T23:57:01.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.242+0000 7fec5a34b700 1 -- 172.21.15.173:0/965090403 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55a9b5f66b00 con 0x55a9b5e6d000 2024-09-13T23:57:01.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.242+0000 7fec5eb98f40 1 Processor -- start 2024-09-13T23:57:01.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.242+0000 7fec5eb98f40 1 -- start start 2024-09-13T23:57:01.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.242+0000 7fec5a34b700 1 --2- 172.21.15.173:0/965090403 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a9b61fe000 0x55a9b6153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.242+0000 7fec5a34b700 1 -- 172.21.15.173:0/965090403 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55a9b5ed3180 con 0x55a9b5e6d000 2024-09-13T23:57:01.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.242+0000 7fec5eb98f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d800 0x55a9b6152b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.242+0000 7fec5eb98f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9b5e92640 con 0x55a9b5e6d800 2024-09-13T23:57:01.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.242+0000 7fec5db52700 1 --2- 172.21.15.173:0/965090403 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a9b61fe000 0x55a9b6153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.242+0000 7fec5d351700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d800 0x55a9b6152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.242+0000 7fec5d351700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d800 0x55a9b6152b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59288/0 (socket says 172.21.15.173:59288) 2024-09-13T23:57:01.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.242+0000 7fec5d351700 1 -- 172.21.15.173:0/2470774736 learned_addr learned my addr 172.21.15.173:0/2470774736 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.242+0000 7fec5db52700 1 --2- 172.21.15.173:0/965090403 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a9b61fe000 0x55a9b6153080 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55a9b6ccde60 tx=0x55a9b61c8780 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.242+0000 7fec5d351700 1 -- 172.21.15.173:0/2470774736 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9b5e7e000 con 0x55a9b5e6d800 2024-09-13T23:57:01.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.242+0000 7fec5d351700 1 --2- 172.21.15.173:0/2470774736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d800 0x55a9b6152b00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x55a9b6ce0fc0 tx=0x55a9b61c88a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff629b474803095 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.242+0000 7fec57b46700 1 -- 172.21.15.173:0/2470774736 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a9b5f11600 con 0x55a9b5e6d800 2024-09-13T23:57:01.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.242+0000 7fec57b46700 1 -- 172.21.15.173:0/2470774736 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a9b5f31c80 con 0x55a9b5e6d800 2024-09-13T23:57:01.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.242+0000 7fec57b46700 1 -- 172.21.15.173:0/2470774736 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a9b5f118c0 con 0x55a9b5e6d800 2024-09-13T23:57:01.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.246+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2470774736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d800 msgr2=0x55a9b6152b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.246+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/2470774736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d800 0x55a9b6152b00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x55a9b6ce0fc0 tx=0x55a9b61c88a0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.246+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2470774736 shutdown_connections 2024-09-13T23:57:01.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.246+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/2470774736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d800 0x55a9b6152b00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.246+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2470774736 >> 172.21.15.173:0/2470774736 conn(0x55a9b5e6d400 msgr2=0x55a9b5f6d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.246+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2470774736 shutdown_connections 2024-09-13T23:57:01.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.246+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2470774736 wait complete. 2024-09-13T23:57:01.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.246+0000 7fec5eb98f40 1 Processor -- start 2024-09-13T23:57:01.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.246+0000 7fec5eb98f40 1 -- start start 2024-09-13T23:57:01.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.246+0000 7fec5eb98f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d800 0x55a9b6152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.246+0000 7fec5eb98f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9b5e928c0 con 0x55a9b5e6d800 2024-09-13T23:57:01.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.246+0000 7fec5d351700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d800 0x55a9b6152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.246+0000 7fec5d351700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d800 0x55a9b6152b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59290/0 (socket says 172.21.15.173:59290) 2024-09-13T23:57:01.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.246+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 learned_addr learned my addr 172.21.15.173:0/2480278371 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.246+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9b5e7eea0 con 0x55a9b5e6d800 2024-09-13T23:57:01.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.246+0000 7fec5d351700 1 --2- 172.21.15.173:0/2480278371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d800 0x55a9b6152b00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55a9b6ce0300 tx=0x55a9b61c8a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.246+0000 7fec56343700 1 -- 172.21.15.173:0/2480278371 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a9b5f11760 con 0x55a9b5e6d800 2024-09-13T23:57:01.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.250+0000 7fec56343700 1 -- 172.21.15.173:0/2480278371 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a9b6228000 con 0x55a9b5e6d800 2024-09-13T23:57:01.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.250+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a9b5e7e820 con 0x55a9b5e6d800 2024-09-13T23:57:01.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.250+0000 7fec56343700 1 -- 172.21.15.173:0/2480278371 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a9b5f114a0 con 0x55a9b5e6d800 2024-09-13T23:57:01.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.250+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a9b5e7e9c0 con 0x55a9b5e6d800 2024-09-13T23:57:01.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.250+0000 7fec5eb98f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.250+0000 7fec56343700 1 -- 172.21.15.173:0/2480278371 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55a9b5f66dc0 con 0x55a9b5e6d800 2024-09-13T23:57:01.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.250+0000 7fec56343700 1 --2- 172.21.15.173:0/2480278371 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a9b61ff000 0x55a9b6153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.250+0000 7fec56343700 1 -- 172.21.15.173:0/2480278371 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55a9b5ed3340 con 0x55a9b5e6d800 2024-09-13T23:57:01.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.250+0000 7fec5cb50700 1 --2- 172.21.15.173:0/2480278371 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a9b61ff000 0x55a9b6153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.250+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/2480278371 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a9b61ff400 0x55a9b6153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.250+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b61ff800 con 0x55a9b61ff400 2024-09-13T23:57:01.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.250+0000 7fec5db52700 1 --2- 172.21.15.173:0/2480278371 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a9b61ff400 0x55a9b6153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.250+0000 7fec5cb50700 1 --2- 172.21.15.173:0/2480278371 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a9b61ff000 0x55a9b6153600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55a9b6201b90 tx=0x55a9b61c9860 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.250+0000 7fec5db52700 1 --2- 172.21.15.173:0/2480278371 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a9b61ff400 0x55a9b6153b80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.254+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b61ff400 2024-09-13T23:57:01.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.254+0000 7fec5eb98f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.254+0000 7fec5eb98f40 20 realm 2024-09-13T23:57:01.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.254+0000 7fec5eb98f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.254+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b61ffc00 con 0x55a9b61ff400 2024-09-13T23:57:01.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.254+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b61ff400 2024-09-13T23:57:01.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.254+0000 7fec5eb98f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.254+0000 7fec5eb98f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:01.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.254+0000 7fec5eb98f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.254+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b61ff800 con 0x55a9b61ff400 2024-09-13T23:57:01.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.254+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b61ff400 2024-09-13T23:57:01.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.254+0000 7fec5eb98f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.254+0000 7fec5eb98f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.254+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/2480278371 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a9b61ffc00 0x55a9b6154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.254+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b61ffc00 2024-09-13T23:57:01.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.254+0000 7fec5d351700 1 --2- 172.21.15.173:0/2480278371 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a9b61ffc00 0x55a9b6154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.254+0000 7fec5d351700 1 --2- 172.21.15.173:0/2480278371 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a9b61ffc00 0x55a9b6154100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.254+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55a9b6257200 con 0x55a9b61ffc00 2024-09-13T23:57:01.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.254+0000 7fec5eb98f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:01.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.254+0000 7fec5eb98f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.254+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/2480278371 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a9b62a0400 0x55a9b6154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.254+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0800 con 0x55a9b62a0400 2024-09-13T23:57:01.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.254+0000 7fec5cb50700 1 --2- 172.21.15.173:0/2480278371 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a9b62a0400 0x55a9b6154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.254+0000 7fec5cb50700 1 --2- 172.21.15.173:0/2480278371 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a9b62a0400 0x55a9b6154680 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.258+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55a9b6257440 con 0x55a9b62a0400 2024-09-13T23:57:01.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.258+0000 7fec5eb98f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:01.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.258+0000 7fec5eb98f40 20 searching for the correct realm 2024-09-13T23:57:01.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.258+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0c00 con 0x55a9b62a0400 2024-09-13T23:57:01.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.258+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55a9b6257440 con 0x55a9b62a0400 2024-09-13T23:57:01.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.258+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0800 con 0x55a9b61ffc00 2024-09-13T23:57:01.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.258+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6257200 con 0x55a9b61ffc00 2024-09-13T23:57:01.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.258+0000 7fec5d351700 1 --2- 172.21.15.173:0/2480278371 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a9b62a0800 0x55a9b6154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.258+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b62a0800 2024-09-13T23:57:01.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.258+0000 7fec5db52700 1 --2- 172.21.15.173:0/2480278371 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a9b62a0800 0x55a9b6154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.258+0000 7fec5db52700 1 --2- 172.21.15.173:0/2480278371 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a9b62a0800 0x55a9b6154c00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.258+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b62a0800 2024-09-13T23:57:01.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.258+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b61ff400 2024-09-13T23:57:01.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.258+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b61ff400 2024-09-13T23:57:01.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.258+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b61ff400 2024-09-13T23:57:01.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.262+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b61ff400 2024-09-13T23:57:01.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.262+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b62a0400 2024-09-13T23:57:01.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.262+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6257440 con 0x55a9b62a0400 2024-09-13T23:57:01.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.262+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b61ff400 2024-09-13T23:57:01.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.262+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b61ff400 2024-09-13T23:57:01.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.262+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b61ffc00 2024-09-13T23:57:01.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.262+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6257200 con 0x55a9b61ffc00 2024-09-13T23:57:01.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.262+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b61ffc00 2024-09-13T23:57:01.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.262+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6257200 con 0x55a9b61ffc00 2024-09-13T23:57:01.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.262+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b61ff400 2024-09-13T23:57:01.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.262+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b61ff400 2024-09-13T23:57:01.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.262+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b62a0800 2024-09-13T23:57:01.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.262+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b62a0800 2024-09-13T23:57:01.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.262+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b61ff400 2024-09-13T23:57:01.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.266+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b61ff400 2024-09-13T23:57:01.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.266+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b62a0800 2024-09-13T23:57:01.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.266+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b62a0800 2024-09-13T23:57:01.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.266+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b61ffc00 2024-09-13T23:57:01.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.266+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6257200 con 0x55a9b61ffc00 2024-09-13T23:57:01.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.266+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b62a0400 2024-09-13T23:57:01.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.266+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6257440 con 0x55a9b62a0400 2024-09-13T23:57:01.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.266+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b61ff400 2024-09-13T23:57:01.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.266+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b61ff400 2024-09-13T23:57:01.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.266+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b61ffc00 2024-09-13T23:57:01.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.266+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6257200 con 0x55a9b61ffc00 2024-09-13T23:57:01.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.266+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b62a0400 2024-09-13T23:57:01.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.266+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6257440 con 0x55a9b62a0400 2024-09-13T23:57:01.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.266+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b61ff400 2024-09-13T23:57:01.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.270+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b61ff400 2024-09-13T23:57:01.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.270+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b61ff400 2024-09-13T23:57:01.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.270+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b61ff400 2024-09-13T23:57:01.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.270+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b61ff400 2024-09-13T23:57:01.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.270+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b61ff400 2024-09-13T23:57:01.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.270+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b62a0400 2024-09-13T23:57:01.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.270+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6257440 con 0x55a9b62a0400 2024-09-13T23:57:01.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.270+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b62a0800 2024-09-13T23:57:01.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.270+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b62a0800 2024-09-13T23:57:01.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.270+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b61ff400 2024-09-13T23:57:01.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.270+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b61ff400 2024-09-13T23:57:01.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.270+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b62a0800 2024-09-13T23:57:01.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.270+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b62a0800 2024-09-13T23:57:01.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.270+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b62a0400 2024-09-13T23:57:01.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.270+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6257440 con 0x55a9b62a0400 2024-09-13T23:57:01.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.270+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b62a0800 2024-09-13T23:57:01.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.274+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b62a0800 2024-09-13T23:57:01.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.274+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b61ffc00 2024-09-13T23:57:01.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.274+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6257200 con 0x55a9b61ffc00 2024-09-13T23:57:01.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.274+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b61ffc00 2024-09-13T23:57:01.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.274+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6257200 con 0x55a9b61ffc00 2024-09-13T23:57:01.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.274+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b62a0400 2024-09-13T23:57:01.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.274+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6257440 con 0x55a9b62a0400 2024-09-13T23:57:01.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.274+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b61ffc00 2024-09-13T23:57:01.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.274+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55a9b6257200 con 0x55a9b61ffc00 2024-09-13T23:57:01.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.274+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b61ffc00 2024-09-13T23:57:01.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a9b6257200 con 0x55a9b61ffc00 2024-09-13T23:57:01.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:01.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:01.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:01.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:01.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a1000 con 0x55a9b61ff400 2024-09-13T23:57:01.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b61ff400 2024-09-13T23:57:01.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a1400 con 0x55a9b61ffc00 2024-09-13T23:57:01.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55a9b6257200 con 0x55a9b61ffc00 2024-09-13T23:57:01.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:01.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a1800 con 0x55a9b61ff400 2024-09-13T23:57:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b61ff400 2024-09-13T23:57:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 20 zone default found 2024-09-13T23:57:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 4 Realm: () 2024-09-13T23:57:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 20 zonegroup default 2024-09-13T23:57:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a1c00 con 0x55a9b62a0800 2024-09-13T23:57:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b62a0800 2024-09-13T23:57:01.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a1000 con 0x55a9b62a0400 2024-09-13T23:57:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55a9b6257440 con 0x55a9b62a0400 2024-09-13T23:57:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.278+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a1800 con 0x55a9b62a0400 2024-09-13T23:57:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.282+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55a9b6257440 con 0x55a9b62a0400 2024-09-13T23:57:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.282+0000 7fec5eb98f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.282+0000 7fec5eb98f40 20 started sync module instance, tier type = 2024-09-13T23:57:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.282+0000 7fec5eb98f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:01.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.282+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b61ff800 con 0x55a9b61ffc00 2024-09-13T23:57:01.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.282+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6257200 con 0x55a9b61ffc00 2024-09-13T23:57:01.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.282+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94187392637696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b61fe800 con 0x55a9b61ffc00 2024-09-13T23:57:01.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.282+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b61ff800 con 0x55a9b61ff400 2024-09-13T23:57:01.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.286+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b61ff400 2024-09-13T23:57:01.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.286+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94187392638848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0000 con 0x55a9b61ff400 2024-09-13T23:57:01.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.286+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94187392637696] v33'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6257200 con 0x55a9b61ffc00 2024-09-13T23:57:01.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.286+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a1400 con 0x55a9b61ffc00 2024-09-13T23:57:01.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.290+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94187392638848] v33'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b61ff400 2024-09-13T23:57:01.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.290+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6257200 con 0x55a9b61ffc00 2024-09-13T23:57:01.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.290+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94187392640000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a4000 con 0x55a9b61ffc00 2024-09-13T23:57:01.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.290+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a4400 con 0x55a9b62a0800 2024-09-13T23:57:01.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.290+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b62a0800 2024-09-13T23:57:01.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.290+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94187392641152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a4800 con 0x55a9b62a0800 2024-09-13T23:57:01.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.290+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a4c00 con 0x55a9b61ffc00 2024-09-13T23:57:01.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.290+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94187392640000] v33'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6257200 con 0x55a9b61ffc00 2024-09-13T23:57:01.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.294+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94187392641152] v33'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b62a0800 2024-09-13T23:57:01.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.294+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6257200 con 0x55a9b61ffc00 2024-09-13T23:57:01.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.294+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94187392642304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a5000 con 0x55a9b61ffc00 2024-09-13T23:57:01.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.294+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a5400 con 0x55a9b62a0400 2024-09-13T23:57:01.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.298+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6257440 con 0x55a9b62a0400 2024-09-13T23:57:01.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.298+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94187392643456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a5800 con 0x55a9b62a0400 2024-09-13T23:57:01.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.298+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94187392642304] v33'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6257200 con 0x55a9b61ffc00 2024-09-13T23:57:01.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.298+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a5c00 con 0x55a9b62a0400 2024-09-13T23:57:01.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.298+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v33'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6257440 con 0x55a9b62a0400 2024-09-13T23:57:01.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.298+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94187392644608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a5400 con 0x55a9b62a0400 2024-09-13T23:57:01.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.298+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a4000 con 0x55a9b62a0800 2024-09-13T23:57:01.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.298+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94187392643456] v33'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6257440 con 0x55a9b62a0400 2024-09-13T23:57:01.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.302+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94187392644608] v33'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6257440 con 0x55a9b62a0400 2024-09-13T23:57:01.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.302+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b62a0800 2024-09-13T23:57:01.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.302+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94187392645760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a4c00 con 0x55a9b62a0800 2024-09-13T23:57:01.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.302+0000 7fec5eb98f40 20 add_watcher() i=0 2024-09-13T23:57:01.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.302+0000 7fec5eb98f40 20 add_watcher() i=1 2024-09-13T23:57:01.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.302+0000 7fec5eb98f40 20 add_watcher() i=2 2024-09-13T23:57:01.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.302+0000 7fec5eb98f40 20 add_watcher() i=3 2024-09-13T23:57:01.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.302+0000 7fec5eb98f40 20 add_watcher() i=4 2024-09-13T23:57:01.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.302+0000 7fec5eb98f40 20 add_watcher() i=5 2024-09-13T23:57:01.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.302+0000 7fec5eb98f40 20 add_watcher() i=6 2024-09-13T23:57:01.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.302+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94187392645760] v33'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b62a0800 2024-09-13T23:57:01.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.302+0000 7fec5eb98f40 20 add_watcher() i=7 2024-09-13T23:57:01.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.302+0000 7fec5eb98f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:01.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.302+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a0c00 con 0x55a9b61ff400 2024-09-13T23:57:01.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.302+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b61ff400 2024-09-13T23:57:01.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.302+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94187394097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a1000 con 0x55a9b61ff400 2024-09-13T23:57:01.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.306+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94187394097152] v33'78 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b61ff400 2024-09-13T23:57:01.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.306+0000 7fec4431f700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:01.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.306+0000 7fec5eb98f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:01.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.306+0000 7fec5eb98f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:01.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.306+0000 7fec5eb98f40 1 Processor -- start 2024-09-13T23:57:01.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.306+0000 7fec5eb98f40 1 -- start start 2024-09-13T23:57:01.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.306+0000 7fec5eb98f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b62a1400 0x55a9b6155180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.306+0000 7fec5eb98f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9b5efa3c0 con 0x55a9b62a1400 2024-09-13T23:57:01.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.306+0000 7fec5cb50700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b62a1400 0x55a9b6155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.306+0000 7fec5cb50700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b62a1400 0x55a9b6155180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59296/0 (socket says 172.21.15.173:59296) 2024-09-13T23:57:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.306+0000 7fec5cb50700 1 -- 172.21.15.173:0/2976436380 learned_addr learned my addr 172.21.15.173:0/2976436380 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.306+0000 7fec5cb50700 1 -- 172.21.15.173:0/2976436380 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9b5e7eb60 con 0x55a9b62a1400 2024-09-13T23:57:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.306+0000 7fec5cb50700 1 --2- 172.21.15.173:0/2976436380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b62a1400 0x55a9b6155180 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55a9b62b2690 tx=0x55a9b61c9800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3984c66811e9505c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.306+0000 7fec43b1e700 1 -- 172.21.15.173:0/2976436380 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a9b62ac160 con 0x55a9b62a1400 2024-09-13T23:57:01.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.306+0000 7fec43b1e700 1 -- 172.21.15.173:0/2976436380 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a9b6228a80 con 0x55a9b62a1400 2024-09-13T23:57:01.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.306+0000 7fec43b1e700 1 -- 172.21.15.173:0/2976436380 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a9b62ac2c0 con 0x55a9b62a1400 2024-09-13T23:57:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.310+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2976436380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b62a1400 msgr2=0x55a9b6155180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.310+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/2976436380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b62a1400 0x55a9b6155180 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55a9b62b2690 tx=0x55a9b61c9800 comp rx=0 tx=0).stop 2024-09-13T23:57:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.310+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2976436380 shutdown_connections 2024-09-13T23:57:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.310+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/2976436380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b62a1400 0x55a9b6155180 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.310+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2976436380 >> 172.21.15.173:0/2976436380 conn(0x55a9b62a1800 msgr2=0x55a9b5f6e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.310+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2976436380 shutdown_connections 2024-09-13T23:57:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.310+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2976436380 wait complete. 2024-09-13T23:57:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.310+0000 7fec5eb98f40 1 Processor -- start 2024-09-13T23:57:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.310+0000 7fec5eb98f40 1 -- start start 2024-09-13T23:57:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.310+0000 7fec5eb98f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b62a1400 0x55a9b6155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.310+0000 7fec5eb98f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9b5efa500 con 0x55a9b62a1400 2024-09-13T23:57:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.310+0000 7fec5cb50700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b62a1400 0x55a9b6155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.310+0000 7fec5cb50700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b62a1400 0x55a9b6155180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:59298/0 (socket says 172.21.15.173:59298) 2024-09-13T23:57:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.310+0000 7fec5cb50700 1 -- 172.21.15.173:0/2844221507 learned_addr learned my addr 172.21.15.173:0/2844221507 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.310+0000 7fec5cb50700 1 -- 172.21.15.173:0/2844221507 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9b5e7ed00 con 0x55a9b62a1400 2024-09-13T23:57:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.310+0000 7fec5cb50700 1 --2- 172.21.15.173:0/2844221507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b62a1400 0x55a9b6155180 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55a9b62b28d0 tx=0x55a9b61c9980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.310+0000 7fec4231b700 1 -- 172.21.15.173:0/2844221507 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a9b62ac420 con 0x55a9b62a1400 2024-09-13T23:57:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.310+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2844221507 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a9b5e7e340 con 0x55a9b62a1400 2024-09-13T23:57:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.310+0000 7fec4231b700 1 -- 172.21.15.173:0/2844221507 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a9b6228780 con 0x55a9b62a1400 2024-09-13T23:57:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.310+0000 7fec4231b700 1 -- 172.21.15.173:0/2844221507 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a9b62ac160 con 0x55a9b62a1400 2024-09-13T23:57:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.310+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2844221507 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a9b5e7eb60 con 0x55a9b62a1400 2024-09-13T23:57:01.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.314+0000 7fec4231b700 1 -- 172.21.15.173:0/2844221507 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55a9b5f67b80 con 0x55a9b62a1400 2024-09-13T23:57:01.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.314+0000 7fec4231b700 1 --2- 172.21.15.173:0/2844221507 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a9b62a0c00 0x55a9b6346000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.314+0000 7fec4231b700 1 -- 172.21.15.173:0/2844221507 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55a9b5ed36c0 con 0x55a9b62a1400 2024-09-13T23:57:01.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.314+0000 7fec5eb98f40 5 note: GC not initialized 2024-09-13T23:57:01.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.314+0000 7fec5db52700 1 --2- 172.21.15.173:0/2844221507 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a9b62a0c00 0x55a9b6346000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.314+0000 7fec5db52700 1 --2- 172.21.15.173:0/2844221507 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a9b62a0c00 0x55a9b6346000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55a9b623f950 tx=0x55a9b5f71ce0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.314+0000 7fec3fb16700 20 reqs_thread_entry: start 2024-09-13T23:57:01.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.314+0000 7fec5eb98f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:01.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.314+0000 7fec5eb98f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:01.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.314+0000 7fec3db12700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:31 2024 2024-09-13T23:57:01.322 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:01.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.318+0000 7fec3d2f0700 20 reqs_thread_entry: start 2024-09-13T23:57:01.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.318+0000 7fec5eb98f40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:57:01.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.318+0000 7fec5eb98f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.318+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b61fe800 con 0x55a9b61ff400 2024-09-13T23:57:01.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.318+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b61ff400 2024-09-13T23:57:01.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.318+0000 7fec5eb98f40 20 rados_obj.operate() r=0 bl.length=513 2024-09-13T23:57:01.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.318+0000 7fec5eb98f40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:57:01.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.318+0000 7fec5eb98f40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:01.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.318+0000 7fec5eb98f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:01.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.318+0000 7fec5eb98f40 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-13T23:57:01.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.318+0000 7fec5eb98f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.318+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b61ff800 con 0x55a9b62a0800 2024-09-13T23:57:01.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.318+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b62a0800 2024-09-13T23:57:01.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.318+0000 7fec5eb98f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.318+0000 7fec5eb98f40 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-13T23:57:01.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.318+0000 7fec5eb98f40 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-13T23:57:01.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.318+0000 7fec5eb98f40 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-13T23:57:01.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.318+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~621 in=621b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a4000 con 0x55a9b61ff400 2024-09-13T23:57:01.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.322+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~621] v33'8 uv8 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b61ff400 2024-09-13T23:57:01.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.322+0000 7fec5eb98f40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:57:01.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.322+0000 7fec5eb98f40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:01.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.322+0000 7fec5eb98f40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:57:01.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.322+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94187394099456 in=809b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a4c00 con 0x55a9b61ffc00 2024-09-13T23:57:01.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.322+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== watch-notify(notify (1) cookie 94187392642304 notify 141733920778 ret 0) v3 ==== 839+0+0 (crc 0 0 0) 0x55a9b5e7f6c0 con 0x55a9b61ffc00 2024-09-13T23:57:01.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.322+0000 7fec57345700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920778 cookie 94187392642304 notifier 4416 bl.length()=797 2024-09-13T23:57:01.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.322+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(65 notify.4 [notify cookie 94187394099456 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55a9b6257200 con 0x55a9b61ffc00 2024-09-13T23:57:01.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.322+0000 7fec57345700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:57:01.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.322+0000 7fec57345700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:01.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.322+0000 7fec57345700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b63b2000 con 0x55a9b61ffc00 2024-09-13T23:57:01.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.322+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6257200 con 0x55a9b61ffc00 2024-09-13T23:57:01.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.322+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== watch-notify(notify_complete (2) cookie 94187394099456 notify 141733920778 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55a9b5e7fd40 con 0x55a9b61ffc00 2024-09-13T23:57:01.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.322+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a5000 con 0x55a9b62a0800 2024-09-13T23:57:01.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.326+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b62a0800 2024-09-13T23:57:01.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.326+0000 7fec5eb98f40 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-13T23:57:01.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.326+0000 7fec5eb98f40 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-13T23:57:01.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.326+0000 7fec5eb98f40 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-13T23:57:01.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.326+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94187394099456 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a4400 con 0x55a9b61ffc00 2024-09-13T23:57:01.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.326+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== watch-notify(notify (1) cookie 94187392637696 notify 141733920779 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x55a9b5e7fd40 con 0x55a9b61ffc00 2024-09-13T23:57:01.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.326+0000 7fec57345700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920779 cookie 94187392637696 notifier 4416 bl.length()=166 2024-09-13T23:57:01.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.326+0000 7fec57345700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-13T23:57:01.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.326+0000 7fec57345700 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-13T23:57:01.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.326+0000 7fec57345700 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b63b2400 con 0x55a9b61ffc00 2024-09-13T23:57:01.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.326+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(68 notify.0 [notify cookie 94187394099456 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55a9b6257200 con 0x55a9b61ffc00 2024-09-13T23:57:01.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.326+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6257200 con 0x55a9b61ffc00 2024-09-13T23:57:01.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.326+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== watch-notify(notify_complete (2) cookie 94187394099456 notify 141733920779 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55a9b5e7fba0 con 0x55a9b61ffc00 2024-09-13T23:57:01.332 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:01.332 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "foo", 2024-09-13T23:57:01.332 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Foo", 2024-09-13T23:57:01.332 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "foo@foo.com", 2024-09-13T23:57:01.332 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:57:01.332 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:57:01.332 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [ 2024-09-13T23:57:01.332 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:01.333 INFO:teuthology.orchestra.run.smithi173.stdout: "id": "foo:foo1", 2024-09-13T23:57:01.333 INFO:teuthology.orchestra.run.smithi173.stdout: "permissions": "full-control" 2024-09-13T23:57:01.333 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:01.333 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:01.333 INFO:teuthology.orchestra.run.smithi173.stdout: "id": "foo:foo2", 2024-09-13T23:57:01.333 INFO:teuthology.orchestra.run.smithi173.stdout: "permissions": "" 2024-09-13T23:57:01.333 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:01.333 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:01.333 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:57:01.333 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:01.333 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:57:01.333 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-09-13T23:57:01.333 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-09-13T23:57:01.334 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:01.334 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:01.334 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [ 2024-09-13T23:57:01.334 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:01.334 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo:foo1", 2024-09-13T23:57:01.334 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL" 2024-09-13T23:57:01.334 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:01.334 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:01.334 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo:foo2", 2024-09-13T23:57:01.334 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy" 2024-09-13T23:57:01.334 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:01.334 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:01.334 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:57:01.334 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:57:01.334 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:57:01.335 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:57:01.335 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:57:01.335 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:57:01.335 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:01.335 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:01.335 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:01.335 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:01.335 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:01.335 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:01.335 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:57:01.335 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:01.335 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:01.335 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:01.336 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:01.336 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:01.336 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:01.336 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:57:01.336 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:57:01.336 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:57:01.336 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:01.336 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:57:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.326+0000 7fec4431f700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.326+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94187394097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a1000 con 0x55a9b61ff400 2024-09-13T23:57:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.330+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94187394097152] v33'79 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b61ff400 2024-09-13T23:57:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.330+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94187392637696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b63b2800 con 0x55a9b61ffc00 2024-09-13T23:57:01.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.334+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94187392637696] v33'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6257200 con 0x55a9b61ffc00 2024-09-13T23:57:01.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.334+0000 7fec5eb98f40 20 remove_watcher() i=0 2024-09-13T23:57:01.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.334+0000 7fec5eb98f40 2 removed watcher, disabling cache 2024-09-13T23:57:01.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.334+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94187392638848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a4c00 con 0x55a9b61ff400 2024-09-13T23:57:01.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.334+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94187392638848] v33'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b61ff400 2024-09-13T23:57:01.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.334+0000 7fec5eb98f40 20 remove_watcher() i=1 2024-09-13T23:57:01.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.334+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94187392640000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b63b2c00 con 0x55a9b61ffc00 2024-09-13T23:57:01.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.338+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 27 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94187392640000] v33'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6257200 con 0x55a9b61ffc00 2024-09-13T23:57:01.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.338+0000 7fec5eb98f40 20 remove_watcher() i=2 2024-09-13T23:57:01.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.338+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94187392641152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b63b3000 con 0x55a9b62a0800 2024-09-13T23:57:01.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.338+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94187392641152] v33'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b62a0800 2024-09-13T23:57:01.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.338+0000 7fec5eb98f40 20 remove_watcher() i=3 2024-09-13T23:57:01.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.338+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94187392642304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b63b3400 con 0x55a9b61ffc00 2024-09-13T23:57:01.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.342+0000 7fec5d351700 1 -- 172.21.15.173:0/2480278371 <== osd.0 v2:172.21.15.87:6800/3507919120 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94187392642304] v33'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6257200 con 0x55a9b61ffc00 2024-09-13T23:57:01.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.342+0000 7fec5eb98f40 20 remove_watcher() i=4 2024-09-13T23:57:01.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.342+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94187392643456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b63b3800 con 0x55a9b62a0400 2024-09-13T23:57:01.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.346+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94187392643456] v33'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6257440 con 0x55a9b62a0400 2024-09-13T23:57:01.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.346+0000 7fec5eb98f40 20 remove_watcher() i=5 2024-09-13T23:57:01.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.346+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94187392644608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b63b3c00 con 0x55a9b62a0400 2024-09-13T23:57:01.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.346+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94187392644608] v33'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6257440 con 0x55a9b62a0400 2024-09-13T23:57:01.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.346+0000 7fec5eb98f40 20 remove_watcher() i=6 2024-09-13T23:57:01.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.346+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94187392645760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a9b62a1000 con 0x55a9b62a0800 2024-09-13T23:57:01.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5db52700 1 -- 172.21.15.173:0/2480278371 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94187392645760] v33'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a9b6256b40 con 0x55a9b62a0800 2024-09-13T23:57:01.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 20 remove_watcher() i=7 2024-09-13T23:57:01.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a9b61ffc00 msgr2=0x55a9b6154100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/2480278371 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a9b61ffc00 0x55a9b6154100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a9b61ff400 msgr2=0x55a9b6153b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/2480278371 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a9b61ff400 0x55a9b6153b80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a9b62a0800 msgr2=0x55a9b6154c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/2480278371 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a9b62a0800 0x55a9b6154c00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a9b62a0400 msgr2=0x55a9b6154680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/2480278371 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a9b62a0400 0x55a9b6154680 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a9b61ff000 msgr2=0x55a9b6153600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/2480278371 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a9b61ff000 0x55a9b6153600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55a9b6201b90 tx=0x55a9b61c9860 comp rx=0 tx=0).stop 2024-09-13T23:57:01.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d800 msgr2=0x55a9b6152b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/2480278371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d800 0x55a9b6152b00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55a9b6ce0300 tx=0x55a9b61c8a80 comp rx=0 tx=0).stop 2024-09-13T23:57:01.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 reap_dead start 2024-09-13T23:57:01.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5cb50700 1 -- 172.21.15.173:0/2480278371 reap_dead start 2024-09-13T23:57:01.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 shutdown_connections 2024-09-13T23:57:01.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 >> 172.21.15.173:0/2480278371 conn(0x55a9b5e6d400 msgr2=0x55a9b5f6d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 shutdown_connections 2024-09-13T23:57:01.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2480278371 wait complete. 2024-09-13T23:57:01.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2844221507 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a9b62a0c00 msgr2=0x55a9b6346000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/2844221507 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a9b62a0c00 0x55a9b6346000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55a9b623f950 tx=0x55a9b5f71ce0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2844221507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b62a1400 msgr2=0x55a9b6155180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/2844221507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b62a1400 0x55a9b6155180 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55a9b62b28d0 tx=0x55a9b61c9980 comp rx=0 tx=0).stop 2024-09-13T23:57:01.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2844221507 shutdown_connections 2024-09-13T23:57:01.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/2844221507 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a9b62a0c00 0x55a9b6346000 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/2844221507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b62a1400 0x55a9b6155180 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2844221507 >> 172.21.15.173:0/2844221507 conn(0x55a9b62a1800 msgr2=0x55a9b5f6e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2844221507 shutdown_connections 2024-09-13T23:57:01.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 -- 172.21.15.173:0/2844221507 wait complete. 2024-09-13T23:57:01.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 -- 172.21.15.173:0/965090403 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a9b61fe000 msgr2=0x55a9b6153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/965090403 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a9b61fe000 0x55a9b6153080 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55a9b6ccde60 tx=0x55a9b61c8780 comp rx=0 tx=0).stop 2024-09-13T23:57:01.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 -- 172.21.15.173:0/965090403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d000 msgr2=0x55a9b6152580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/965090403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d000 0x55a9b6152580 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55a9b6ccde90 tx=0x55a9b5f71920 comp rx=0 tx=0).stop 2024-09-13T23:57:01.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 -- 172.21.15.173:0/965090403 shutdown_connections 2024-09-13T23:57:01.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/965090403 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a9b61fe000 0x55a9b6153080 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 --2- 172.21.15.173:0/965090403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a9b5e6d000 0x55a9b6152580 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.350+0000 7fec5eb98f40 1 -- 172.21.15.173:0/965090403 >> 172.21.15.173:0/965090403 conn(0x55a9b5e6cc00 msgr2=0x55a9b5f6d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.354+0000 7fec5eb98f40 1 -- 172.21.15.173:0/965090403 shutdown_connections 2024-09-13T23:57:01.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.354+0000 7fec5eb98f40 1 -- 172.21.15.173:0/965090403 wait complete. 2024-09-13T23:57:01.363 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:57:01.363 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:57:01.363 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:57:01.363 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:57:01.399 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:01.400 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:01.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.394+0000 7fb0b256bf40 1 Processor -- start 2024-09-13T23:57:01.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.394+0000 7fb0b256bf40 1 -- start start 2024-09-13T23:57:01.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.394+0000 7fb0b256bf40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55c0da325400 0x55c0da60a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.394+0000 7fb0b256bf40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c0da3e9500 con 0x55c0da325000 2024-09-13T23:57:01.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.394+0000 7fb0b256bf40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c0da3b2a00 con 0x55c0da325400 2024-09-13T23:57:01.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.394+0000 7fb0b0523700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55c0da325400 0x55c0da60a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.394+0000 7fb0b0d24700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55c0da325000 0x55c0da424800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47328/0 (socket says 172.21.15.173:47328) 2024-09-13T23:57:01.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.394+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3716599779 learned_addr learned my addr 172.21.15.173:0/3716599779 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:01.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.398+0000 7fb0b0523700 1 -- 172.21.15.173:0/3716599779 >> v1:172.21.15.87:6789/0 conn(0x55c0da325000 legacy=0x55c0da424800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.398+0000 7fb0afd22700 1 -- 172.21.15.173:0/3716599779 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231938880 0 0) 0x55c0da480000 con 0x55c0da325000 2024-09-13T23:57:01.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.398+0000 7fb0b0523700 1 -- 172.21.15.173:0/3716599779 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0da337d40 con 0x55c0da325400 2024-09-13T23:57:01.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.398+0000 7fb0b0523700 1 --2- 172.21.15.173:0/3716599779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da325400 0x55c0da60a580 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x55c0da605920 tx=0x55c0da429920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d61d62c4ee170a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.398+0000 7fb0afd22700 1 -- 172.21.15.173:0/3716599779 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c0da3c94a0 con 0x55c0da325400 2024-09-13T23:57:01.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.398+0000 7fb0afd22700 1 -- 172.21.15.173:0/3716599779 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c0da3e9800 con 0x55c0da325400 2024-09-13T23:57:01.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.398+0000 7fb0afd22700 1 -- 172.21.15.173:0/3716599779 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c0da3c9600 con 0x55c0da325400 2024-09-13T23:57:01.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.398+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3716599779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da325400 msgr2=0x55c0da60a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.398+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/3716599779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da325400 0x55c0da60a580 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x55c0da605920 tx=0x55c0da429920 comp rx=0 tx=0).stop 2024-09-13T23:57:01.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.398+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3716599779 shutdown_connections 2024-09-13T23:57:01.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.398+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/3716599779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da325400 0x55c0da60a580 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.398+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3716599779 >> 172.21.15.173:0/3716599779 conn(0x55c0da324c00 msgr2=0x55c0da424000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.398+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3716599779 shutdown_connections 2024-09-13T23:57:01.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.398+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3716599779 wait complete. 2024-09-13T23:57:01.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.398+0000 7fb0b256bf40 1 Processor -- start 2024-09-13T23:57:01.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.398+0000 7fb0b256bf40 1 -- start start 2024-09-13T23:57:01.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.398+0000 7fb0b256bf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da325000 0x55c0da60ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.398+0000 7fb0b256bf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0da3b2500 con 0x55c0da325000 2024-09-13T23:57:01.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.398+0000 7fb0b0d24700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da325000 0x55c0da60ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.398+0000 7fb0b0d24700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da325000 0x55c0da60ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49162/0 (socket says 172.21.15.173:49162) 2024-09-13T23:57:01.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.398+0000 7fb0b0d24700 1 -- 172.21.15.173:0/2463602813 learned_addr learned my addr 172.21.15.173:0/2463602813 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0b0d24700 1 -- 172.21.15.173:0/2463602813 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0da337ba0 con 0x55c0da325000 2024-09-13T23:57:01.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0b0d24700 1 --2- 172.21.15.173:0/2463602813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da325000 0x55c0da60ab00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55c0db0efd70 tx=0x55c0da429b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c73fbf35398107 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0af521700 1 -- 172.21.15.173:0/2463602813 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c0da3c94a0 con 0x55c0da325000 2024-09-13T23:57:01.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0af521700 1 -- 172.21.15.173:0/2463602813 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c0da3e9b00 con 0x55c0da325000 2024-09-13T23:57:01.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0af521700 1 -- 172.21.15.173:0/2463602813 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c0da3c9600 con 0x55c0da325000 2024-09-13T23:57:01.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0b256bf40 1 -- 172.21.15.173:0/2463602813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da325000 msgr2=0x55c0da60ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/2463602813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da325000 0x55c0da60ab00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55c0db0efd70 tx=0x55c0da429b60 comp rx=0 tx=0).stop 2024-09-13T23:57:01.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0b256bf40 1 -- 172.21.15.173:0/2463602813 shutdown_connections 2024-09-13T23:57:01.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/2463602813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da325000 0x55c0da60ab00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0b256bf40 1 -- 172.21.15.173:0/2463602813 >> 172.21.15.173:0/2463602813 conn(0x55c0da324c00 msgr2=0x55c0da425000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0b256bf40 1 -- 172.21.15.173:0/2463602813 shutdown_connections 2024-09-13T23:57:01.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0b256bf40 1 -- 172.21.15.173:0/2463602813 wait complete. 2024-09-13T23:57:01.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0b256bf40 1 Processor -- start 2024-09-13T23:57:01.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0b256bf40 1 -- start start 2024-09-13T23:57:01.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0b256bf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da325000 0x55c0da60ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0b256bf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0da3b23c0 con 0x55c0da325000 2024-09-13T23:57:01.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0b0d24700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da325000 0x55c0da60ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0b0d24700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da325000 0x55c0da60ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49168/0 (socket says 172.21.15.173:49168) 2024-09-13T23:57:01.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0b0d24700 1 -- 172.21.15.173:0/499531793 learned_addr learned my addr 172.21.15.173:0/499531793 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0b0d24700 1 -- 172.21.15.173:0/499531793 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0da337a00 con 0x55c0da325000 2024-09-13T23:57:01.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0b0d24700 1 --2- 172.21.15.173:0/499531793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da325000 0x55c0da60ab00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55c0db0efe60 tx=0x55c0da429a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0add1e700 1 -- 172.21.15.173:0/499531793 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c0da3c98c0 con 0x55c0da325000 2024-09-13T23:57:01.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0b256bf40 1 -- 172.21.15.173:0/499531793 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c0da337860 con 0x55c0da325000 2024-09-13T23:57:01.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0add1e700 1 -- 172.21.15.173:0/499531793 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c0da3e9c80 con 0x55c0da325000 2024-09-13T23:57:01.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0b256bf40 1 -- 172.21.15.173:0/499531793 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c0da3376c0 con 0x55c0da325000 2024-09-13T23:57:01.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.402+0000 7fb0add1e700 1 -- 172.21.15.173:0/499531793 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c0da3c94a0 con 0x55c0da325000 2024-09-13T23:57:01.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.406+0000 7fb0b256bf40 1 Processor -- start 2024-09-13T23:57:01.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.406+0000 7fb0b256bf40 1 -- start start 2024-09-13T23:57:01.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.406+0000 7fb0b256bf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da688000 0x55c0da60b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.406+0000 7fb0b256bf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0da3b2000 con 0x55c0da688000 2024-09-13T23:57:01.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.406+0000 7fb0add1e700 1 -- 172.21.15.173:0/499531793 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55c0da41eb00 con 0x55c0da325000 2024-09-13T23:57:01.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.406+0000 7fb0b1525700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da688000 0x55c0da60b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.406+0000 7fb0add1e700 1 --2- 172.21.15.173:0/499531793 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55c0da689000 0x55c0da60c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.406+0000 7fb0b1525700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da688000 0x55c0da60b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49184/0 (socket says 172.21.15.173:49184) 2024-09-13T23:57:01.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.406+0000 7fb0b1525700 1 -- 172.21.15.173:0/1328006110 learned_addr learned my addr 172.21.15.173:0/1328006110 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.406+0000 7fb0add1e700 1 -- 172.21.15.173:0/499531793 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55c0da38b180 con 0x55c0da325000 2024-09-13T23:57:01.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.406+0000 7fb0b0d24700 1 --2- 172.21.15.173:0/499531793 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55c0da689000 0x55c0da60c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.406+0000 7fb0b1525700 1 -- 172.21.15.173:0/1328006110 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0da336000 con 0x55c0da688000 2024-09-13T23:57:01.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.406+0000 7fb0b0d24700 1 --2- 172.21.15.173:0/499531793 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55c0da689000 0x55c0da60c100 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55c0da6574d0 tx=0x55c0da68e240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.406+0000 7fb0b1525700 1 --2- 172.21.15.173:0/1328006110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da688000 0x55c0da60b080 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55c0db0efe90 tx=0x55c0da68ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d389082b44ce088c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.406+0000 7fb0ab519700 1 -- 172.21.15.173:0/1328006110 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c0da3c98c0 con 0x55c0da688000 2024-09-13T23:57:01.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.406+0000 7fb0ab519700 1 -- 172.21.15.173:0/1328006110 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c0da6d4000 con 0x55c0da688000 2024-09-13T23:57:01.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.406+0000 7fb0ab519700 1 -- 172.21.15.173:0/1328006110 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c0da3c94a0 con 0x55c0da688000 2024-09-13T23:57:01.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.410+0000 7fb0b256bf40 1 -- 172.21.15.173:0/1328006110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da688000 msgr2=0x55c0da60b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.410+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/1328006110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da688000 0x55c0da60b080 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55c0db0efe90 tx=0x55c0da68ea20 comp rx=0 tx=0).stop 2024-09-13T23:57:01.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.410+0000 7fb0b256bf40 1 -- 172.21.15.173:0/1328006110 shutdown_connections 2024-09-13T23:57:01.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.410+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/1328006110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da688000 0x55c0da60b080 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.410+0000 7fb0b256bf40 1 -- 172.21.15.173:0/1328006110 >> 172.21.15.173:0/1328006110 conn(0x55c0da325800 msgr2=0x55c0da425800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.410+0000 7fb0b256bf40 1 -- 172.21.15.173:0/1328006110 shutdown_connections 2024-09-13T23:57:01.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.410+0000 7fb0b256bf40 1 -- 172.21.15.173:0/1328006110 wait complete. 2024-09-13T23:57:01.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.410+0000 7fb0b256bf40 1 Processor -- start 2024-09-13T23:57:01.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.410+0000 7fb0b256bf40 1 -- start start 2024-09-13T23:57:01.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.410+0000 7fb0b256bf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da688000 0x55c0da60b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.410+0000 7fb0b256bf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0da34a640 con 0x55c0da688000 2024-09-13T23:57:01.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.410+0000 7fb0b1525700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da688000 0x55c0da60b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.410+0000 7fb0b1525700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da688000 0x55c0da60b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49196/0 (socket says 172.21.15.173:49196) 2024-09-13T23:57:01.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.410+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 learned_addr learned my addr 172.21.15.173:0/3963172756 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.410+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0da336ea0 con 0x55c0da688000 2024-09-13T23:57:01.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.410+0000 7fb0b1525700 1 --2- 172.21.15.173:0/3963172756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da688000 0x55c0da60b080 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55c0da656420 tx=0x55c0da68e840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.410+0000 7fb0a9d16700 1 -- 172.21.15.173:0/3963172756 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c0da3c9b80 con 0x55c0da688000 2024-09-13T23:57:01.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.410+0000 7fb0a9d16700 1 -- 172.21.15.173:0/3963172756 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c0da6d4180 con 0x55c0da688000 2024-09-13T23:57:01.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.410+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c0da336820 con 0x55c0da688000 2024-09-13T23:57:01.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.410+0000 7fb0a9d16700 1 -- 172.21.15.173:0/3963172756 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c0da3c98c0 con 0x55c0da688000 2024-09-13T23:57:01.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.410+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c0da3369c0 con 0x55c0da688000 2024-09-13T23:57:01.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0b256bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0a9d16700 1 -- 172.21.15.173:0/3963172756 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55c0da41edc0 con 0x55c0da688000 2024-09-13T23:57:01.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0a9d16700 1 --2- 172.21.15.173:0/3963172756 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55c0da689c00 0x55c0da60c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0a9d16700 1 -- 172.21.15.173:0/3963172756 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55c0da38b340 con 0x55c0da688000 2024-09-13T23:57:01.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0b0523700 1 --2- 172.21.15.173:0/3963172756 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55c0da689c00 0x55c0da60c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/3963172756 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55c0da688400 0x55c0da60b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da688800 con 0x55c0da688400 2024-09-13T23:57:01.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0b1525700 1 --2- 172.21.15.173:0/3963172756 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55c0da688400 0x55c0da60b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0b0523700 1 --2- 172.21.15.173:0/3963172756 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55c0da689c00 0x55c0da60c680 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55c0da605ad0 tx=0x55c0da429800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0b1525700 1 --2- 172.21.15.173:0/3963172756 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55c0da688400 0x55c0da60b600 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da688400 2024-09-13T23:57:01.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0b256bf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0b256bf40 20 realm 2024-09-13T23:57:01.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0b256bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da688c00 con 0x55c0da688400 2024-09-13T23:57:01.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da688400 2024-09-13T23:57:01.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0b256bf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0b256bf40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:01.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0b256bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a000 con 0x55c0da688400 2024-09-13T23:57:01.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da688400 2024-09-13T23:57:01.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0b256bf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0b256bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/3963172756 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55c0da77a400 0x55c0da60bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.414+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da77a400 2024-09-13T23:57:01.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.418+0000 7fb0b0d24700 1 --2- 172.21.15.173:0/3963172756 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55c0da77a400 0x55c0da60bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.418+0000 7fb0b0d24700 1 --2- 172.21.15.173:0/3963172756 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55c0da77a400 0x55c0da60bb80 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.418+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55c0da72d200 con 0x55c0da77a400 2024-09-13T23:57:01.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.418+0000 7fb0b256bf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:01.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.418+0000 7fb0b256bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.418+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/3963172756 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55c0da77ac00 0x55c0da60cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.418+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77b000 con 0x55c0da77ac00 2024-09-13T23:57:01.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.418+0000 7fb0b0523700 1 --2- 172.21.15.173:0/3963172756 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55c0da77ac00 0x55c0da60cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.418+0000 7fb0b0523700 1 --2- 172.21.15.173:0/3963172756 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55c0da77ac00 0x55c0da60cc00 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.418+0000 7fb0b0523700 1 -- 172.21.15.173:0/3963172756 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55c0da72d440 con 0x55c0da77ac00 2024-09-13T23:57:01.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.418+0000 7fb0b256bf40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:01.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.418+0000 7fb0b256bf40 20 searching for the correct realm 2024-09-13T23:57:01.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.418+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77b000 con 0x55c0da77ac00 2024-09-13T23:57:01.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.418+0000 7fb0b0523700 1 -- 172.21.15.173:0/3963172756 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55c0da72d440 con 0x55c0da77ac00 2024-09-13T23:57:01.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.422+0000 7fb0b0523700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77b000 con 0x55c0da77a400 2024-09-13T23:57:01.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.422+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72d200 con 0x55c0da77a400 2024-09-13T23:57:01.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.422+0000 7fb0b0d24700 1 --2- 172.21.15.173:0/3963172756 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55c0da77b000 0x55c0da66c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.422+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da77b000 2024-09-13T23:57:01.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.422+0000 7fb0b1525700 1 --2- 172.21.15.173:0/3963172756 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55c0da77b000 0x55c0da66c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.422+0000 7fb0b1525700 1 --2- 172.21.15.173:0/3963172756 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55c0da77b000 0x55c0da66c000 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.422+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da77b000 2024-09-13T23:57:01.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.422+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da688400 2024-09-13T23:57:01.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.422+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da688400 2024-09-13T23:57:01.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.422+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da688400 2024-09-13T23:57:01.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.422+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da688400 2024-09-13T23:57:01.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.422+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da77ac00 2024-09-13T23:57:01.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.422+0000 7fb0b0523700 1 -- 172.21.15.173:0/3963172756 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72d440 con 0x55c0da77ac00 2024-09-13T23:57:01.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.422+0000 7fb0b0523700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da688400 2024-09-13T23:57:01.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.426+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da688400 2024-09-13T23:57:01.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.426+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da77a400 2024-09-13T23:57:01.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.426+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72d200 con 0x55c0da77a400 2024-09-13T23:57:01.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.426+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da77a400 2024-09-13T23:57:01.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.426+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72d200 con 0x55c0da77a400 2024-09-13T23:57:01.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.426+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da688400 2024-09-13T23:57:01.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.426+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da688400 2024-09-13T23:57:01.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.426+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da77b000 2024-09-13T23:57:01.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.426+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da77b000 2024-09-13T23:57:01.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.426+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da688400 2024-09-13T23:57:01.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.426+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da688400 2024-09-13T23:57:01.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.426+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da77b000 2024-09-13T23:57:01.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.426+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da77b000 2024-09-13T23:57:01.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.426+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da77a400 2024-09-13T23:57:01.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.430+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72d200 con 0x55c0da77a400 2024-09-13T23:57:01.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.430+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da77ac00 2024-09-13T23:57:01.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.430+0000 7fb0b0523700 1 -- 172.21.15.173:0/3963172756 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72d440 con 0x55c0da77ac00 2024-09-13T23:57:01.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.430+0000 7fb0b0523700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da688400 2024-09-13T23:57:01.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.430+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da688400 2024-09-13T23:57:01.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.430+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da77a400 2024-09-13T23:57:01.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.430+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72d200 con 0x55c0da77a400 2024-09-13T23:57:01.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.430+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da77ac00 2024-09-13T23:57:01.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.430+0000 7fb0b0523700 1 -- 172.21.15.173:0/3963172756 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72d440 con 0x55c0da77ac00 2024-09-13T23:57:01.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.430+0000 7fb0b0523700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da688400 2024-09-13T23:57:01.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.430+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da688400 2024-09-13T23:57:01.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.430+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da688400 2024-09-13T23:57:01.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.430+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da688400 2024-09-13T23:57:01.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.430+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da688400 2024-09-13T23:57:01.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.434+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da688400 2024-09-13T23:57:01.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.434+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da77ac00 2024-09-13T23:57:01.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.434+0000 7fb0b0523700 1 -- 172.21.15.173:0/3963172756 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72d440 con 0x55c0da77ac00 2024-09-13T23:57:01.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.434+0000 7fb0b0523700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da77b000 2024-09-13T23:57:01.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.434+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da77b000 2024-09-13T23:57:01.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.434+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da688400 2024-09-13T23:57:01.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.434+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da688400 2024-09-13T23:57:01.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.434+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da77b000 2024-09-13T23:57:01.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.434+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da77b000 2024-09-13T23:57:01.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.434+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da77ac00 2024-09-13T23:57:01.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.434+0000 7fb0b0523700 1 -- 172.21.15.173:0/3963172756 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72d440 con 0x55c0da77ac00 2024-09-13T23:57:01.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.434+0000 7fb0b0523700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da77b000 2024-09-13T23:57:01.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.434+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da77b000 2024-09-13T23:57:01.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.434+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da77a400 2024-09-13T23:57:01.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.438+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72d200 con 0x55c0da77a400 2024-09-13T23:57:01.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.438+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da77a400 2024-09-13T23:57:01.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.438+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72d200 con 0x55c0da77a400 2024-09-13T23:57:01.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.438+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da77ac00 2024-09-13T23:57:01.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.438+0000 7fb0b0523700 1 -- 172.21.15.173:0/3963172756 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72d440 con 0x55c0da77ac00 2024-09-13T23:57:01.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.438+0000 7fb0b0523700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da77a400 2024-09-13T23:57:01.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.438+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55c0da72d200 con 0x55c0da77a400 2024-09-13T23:57:01.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.438+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da77a400 2024-09-13T23:57:01.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.438+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c0da72d200 con 0x55c0da77a400 2024-09-13T23:57:01.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.438+0000 7fb0b256bf40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:01.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.438+0000 7fb0b256bf40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:01.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.438+0000 7fb0b256bf40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:01.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.438+0000 7fb0b256bf40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:01.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.438+0000 7fb0b256bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.438+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a000 con 0x55c0da688400 2024-09-13T23:57:01.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da688400 2024-09-13T23:57:01.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77b400 con 0x55c0da77a400 2024-09-13T23:57:01.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55c0da72d200 con 0x55c0da77a400 2024-09-13T23:57:01.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:01.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da688800 con 0x55c0da688400 2024-09-13T23:57:01.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da688400 2024-09-13T23:57:01.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:01.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 20 zone default found 2024-09-13T23:57:01.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 4 Realm: () 2024-09-13T23:57:01.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:01.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:01.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:01.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 20 zonegroup default 2024-09-13T23:57:01.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da688c00 con 0x55c0da77b000 2024-09-13T23:57:01.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da77b000 2024-09-13T23:57:01.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da325400 con 0x55c0da77ac00 2024-09-13T23:57:01.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b0523700 1 -- 172.21.15.173:0/3963172756 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55c0da72d440 con 0x55c0da77ac00 2024-09-13T23:57:01.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77b800 con 0x55c0da77ac00 2024-09-13T23:57:01.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b0523700 1 -- 172.21.15.173:0/3963172756 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55c0da72d440 con 0x55c0da77ac00 2024-09-13T23:57:01.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 20 started sync module instance, tier type = 2024-09-13T23:57:01.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:01.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.442+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77bc00 con 0x55c0da77a400 2024-09-13T23:57:01.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.446+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c0da72d200 con 0x55c0da77a400 2024-09-13T23:57:01.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.446+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94286785813248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a800 con 0x55c0da77a400 2024-09-13T23:57:01.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.446+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77b400 con 0x55c0da688400 2024-09-13T23:57:01.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.450+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da688400 2024-09-13T23:57:01.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.450+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94286785814400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77bc00 con 0x55c0da688400 2024-09-13T23:57:01.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.450+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a000 con 0x55c0da77a400 2024-09-13T23:57:01.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.450+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94286785813248] v33'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c0da72d200 con 0x55c0da77a400 2024-09-13T23:57:01.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.454+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94286785814400] v33'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da688400 2024-09-13T23:57:01.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.454+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c0da72d200 con 0x55c0da77a400 2024-09-13T23:57:01.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.454+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94286785815552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77b400 con 0x55c0da77a400 2024-09-13T23:57:01.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.454+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da688800 con 0x55c0da77b000 2024-09-13T23:57:01.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.454+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da77b000 2024-09-13T23:57:01.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.454+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94286785816704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da688c00 con 0x55c0da77b000 2024-09-13T23:57:01.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.454+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da794000 con 0x55c0da77a400 2024-09-13T23:57:01.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.458+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94286785815552] v33'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c0da72d200 con 0x55c0da77a400 2024-09-13T23:57:01.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.458+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c0da72d200 con 0x55c0da77a400 2024-09-13T23:57:01.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.458+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94286785817856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da794400 con 0x55c0da77a400 2024-09-13T23:57:01.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.458+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da794800 con 0x55c0da77ac00 2024-09-13T23:57:01.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.458+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94286785816704] v33'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da77b000 2024-09-13T23:57:01.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.462+0000 7fb0b0523700 1 -- 172.21.15.173:0/3963172756 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c0da72d440 con 0x55c0da77ac00 2024-09-13T23:57:01.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.462+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94286785819008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da794c00 con 0x55c0da77ac00 2024-09-13T23:57:01.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.462+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da795000 con 0x55c0da77ac00 2024-09-13T23:57:01.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.462+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94286785817856] v33'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c0da72d200 con 0x55c0da77a400 2024-09-13T23:57:01.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.462+0000 7fb0b0523700 1 -- 172.21.15.173:0/3963172756 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94286785819008] v33'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c0da72d440 con 0x55c0da77ac00 2024-09-13T23:57:01.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.462+0000 7fb0b0523700 1 -- 172.21.15.173:0/3963172756 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c0da72d440 con 0x55c0da77ac00 2024-09-13T23:57:01.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.462+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94286785820160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da795400 con 0x55c0da77ac00 2024-09-13T23:57:01.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.462+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da795800 con 0x55c0da77b000 2024-09-13T23:57:01.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.466+0000 7fb0b0523700 1 -- 172.21.15.173:0/3963172756 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94286785820160] v33'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c0da72d440 con 0x55c0da77ac00 2024-09-13T23:57:01.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.466+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da77b000 2024-09-13T23:57:01.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.466+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94286785821312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da795c00 con 0x55c0da77b000 2024-09-13T23:57:01.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.466+0000 7fb0b256bf40 20 add_watcher() i=0 2024-09-13T23:57:01.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.466+0000 7fb0b256bf40 20 add_watcher() i=1 2024-09-13T23:57:01.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.466+0000 7fb0b256bf40 20 add_watcher() i=2 2024-09-13T23:57:01.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.466+0000 7fb0b256bf40 20 add_watcher() i=3 2024-09-13T23:57:01.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.466+0000 7fb0b256bf40 20 add_watcher() i=4 2024-09-13T23:57:01.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.466+0000 7fb0b256bf40 20 add_watcher() i=5 2024-09-13T23:57:01.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.466+0000 7fb0b256bf40 20 add_watcher() i=6 2024-09-13T23:57:01.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.466+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94286785821312] v33'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da77b000 2024-09-13T23:57:01.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.466+0000 7fb0b256bf40 20 add_watcher() i=7 2024-09-13T23:57:01.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.466+0000 7fb0b256bf40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:01.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.466+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da795800 con 0x55c0da688400 2024-09-13T23:57:01.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.466+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da688400 2024-09-13T23:57:01.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.466+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94286787485696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da795c00 con 0x55c0da688400 2024-09-13T23:57:01.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.470+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94286787485696] v33'80 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da688400 2024-09-13T23:57:01.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.470+0000 7fb097cf2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:01.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.470+0000 7fb0b256bf40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:01.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.470+0000 7fb0b256bf40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:01.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.470+0000 7fb0b256bf40 1 Processor -- start 2024-09-13T23:57:01.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.470+0000 7fb0b256bf40 1 -- start start 2024-09-13T23:57:01.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.470+0000 7fb0b256bf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da77bc00 0x55c0da60d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.470+0000 7fb0b256bf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0da34a780 con 0x55c0da77bc00 2024-09-13T23:57:01.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.470+0000 7fb0b0523700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da77bc00 0x55c0da60d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.470+0000 7fb0b0523700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da77bc00 0x55c0da60d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49208/0 (socket says 172.21.15.173:49208) 2024-09-13T23:57:01.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.470+0000 7fb0b0523700 1 -- 172.21.15.173:0/407026581 learned_addr learned my addr 172.21.15.173:0/407026581 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.470+0000 7fb0b0523700 1 -- 172.21.15.173:0/407026581 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0da336b60 con 0x55c0da77bc00 2024-09-13T23:57:01.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.470+0000 7fb0b0523700 1 --2- 172.21.15.173:0/407026581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da77bc00 0x55c0da60d180 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55c0da7a2000 tx=0x55c0da429980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5153c2e3def25bed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.474+0000 7fb0974f1700 1 -- 172.21.15.173:0/407026581 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c0da3c9760 con 0x55c0da77bc00 2024-09-13T23:57:01.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.474+0000 7fb0974f1700 1 -- 172.21.15.173:0/407026581 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c0da6d4600 con 0x55c0da77bc00 2024-09-13T23:57:01.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.474+0000 7fb0974f1700 1 -- 172.21.15.173:0/407026581 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c0da7aa000 con 0x55c0da77bc00 2024-09-13T23:57:01.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.474+0000 7fb0b256bf40 1 -- 172.21.15.173:0/407026581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da77bc00 msgr2=0x55c0da60d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.474+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/407026581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da77bc00 0x55c0da60d180 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55c0da7a2000 tx=0x55c0da429980 comp rx=0 tx=0).stop 2024-09-13T23:57:01.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.474+0000 7fb0b256bf40 1 -- 172.21.15.173:0/407026581 shutdown_connections 2024-09-13T23:57:01.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.474+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/407026581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da77bc00 0x55c0da60d180 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.474+0000 7fb0b256bf40 1 -- 172.21.15.173:0/407026581 >> 172.21.15.173:0/407026581 conn(0x55c0da794800 msgr2=0x55c0da426000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.474+0000 7fb0b256bf40 1 -- 172.21.15.173:0/407026581 shutdown_connections 2024-09-13T23:57:01.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.474+0000 7fb0b256bf40 1 -- 172.21.15.173:0/407026581 wait complete. 2024-09-13T23:57:01.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.474+0000 7fb0b256bf40 1 Processor -- start 2024-09-13T23:57:01.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.474+0000 7fb0b256bf40 1 -- start start 2024-09-13T23:57:01.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.474+0000 7fb0b256bf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da77bc00 0x55c0da60d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.474+0000 7fb0b256bf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0da3b2000 con 0x55c0da77bc00 2024-09-13T23:57:01.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.474+0000 7fb0b0523700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da77bc00 0x55c0da60d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.474+0000 7fb0b0523700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da77bc00 0x55c0da60d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49216/0 (socket says 172.21.15.173:49216) 2024-09-13T23:57:01.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.474+0000 7fb0b0523700 1 -- 172.21.15.173:0/2266837799 learned_addr learned my addr 172.21.15.173:0/2266837799 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.474+0000 7fb0b0523700 1 -- 172.21.15.173:0/2266837799 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0da336d00 con 0x55c0da77bc00 2024-09-13T23:57:01.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.474+0000 7fb0b0523700 1 --2- 172.21.15.173:0/2266837799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da77bc00 0x55c0da60d180 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55c0da7a2210 tx=0x55c0da68fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.474+0000 7fb095cee700 1 -- 172.21.15.173:0/2266837799 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c0da7aa160 con 0x55c0da77bc00 2024-09-13T23:57:01.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.474+0000 7fb095cee700 1 -- 172.21.15.173:0/2266837799 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c0da6d4300 con 0x55c0da77bc00 2024-09-13T23:57:01.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.474+0000 7fb0b256bf40 1 -- 172.21.15.173:0/2266837799 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c0da336340 con 0x55c0da77bc00 2024-09-13T23:57:01.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.474+0000 7fb095cee700 1 -- 172.21.15.173:0/2266837799 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55c0da7aa2c0 con 0x55c0da77bc00 2024-09-13T23:57:01.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.474+0000 7fb0b256bf40 1 -- 172.21.15.173:0/2266837799 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c0da337d40 con 0x55c0da77bc00 2024-09-13T23:57:01.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.478+0000 7fb095cee700 1 -- 172.21.15.173:0/2266837799 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55c0da41fb80 con 0x55c0da77bc00 2024-09-13T23:57:01.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.478+0000 7fb095cee700 1 --2- 172.21.15.173:0/2266837799 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55c0da794000 0x55c0da66c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.478+0000 7fb095cee700 1 -- 172.21.15.173:0/2266837799 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55c0da38b500 con 0x55c0da77bc00 2024-09-13T23:57:01.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.478+0000 7fb0b256bf40 5 note: GC not initialized 2024-09-13T23:57:01.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.478+0000 7fb0b1525700 1 --2- 172.21.15.173:0/2266837799 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55c0da794000 0x55c0da66c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.478+0000 7fb0b1525700 1 --2- 172.21.15.173:0/2266837799 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55c0da794000 0x55c0da66c580 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55c0da70e150 tx=0x55c0da7eaae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.478+0000 7fb0934e9700 20 reqs_thread_entry: start 2024-09-13T23:57:01.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.478+0000 7fb0b256bf40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:01.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.478+0000 7fb0b256bf40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:01.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.478+0000 7fb0914e5700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:31 2024 2024-09-13T23:57:01.485 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:01.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.478+0000 7fb0b256bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.478+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77a000 con 0x55c0da688400 2024-09-13T23:57:01.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.478+0000 7fb090cc3700 20 reqs_thread_entry: start 2024-09-13T23:57:01.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.482+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~621 out=621b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+744 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da688400 2024-09-13T23:57:01.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.482+0000 7fb0b256bf40 20 rados_obj.operate() r=0 bl.length=621 2024-09-13T23:57:01.486 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:01.486 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "foo", 2024-09-13T23:57:01.486 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Foo", 2024-09-13T23:57:01.486 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "foo@foo.com", 2024-09-13T23:57:01.486 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:57:01.486 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:57:01.486 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [ 2024-09-13T23:57:01.486 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:01.486 INFO:teuthology.orchestra.run.smithi173.stdout: "id": "foo:foo1", 2024-09-13T23:57:01.486 INFO:teuthology.orchestra.run.smithi173.stdout: "permissions": "full-control" 2024-09-13T23:57:01.486 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:01.487 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:01.487 INFO:teuthology.orchestra.run.smithi173.stdout: "id": "foo:foo2", 2024-09-13T23:57:01.487 INFO:teuthology.orchestra.run.smithi173.stdout: "permissions": "" 2024-09-13T23:57:01.487 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:01.487 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:01.487 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:57:01.487 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:01.487 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:57:01.487 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-09-13T23:57:01.487 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-09-13T23:57:01.487 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:01.487 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:01.487 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [ 2024-09-13T23:57:01.487 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:01.487 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo:foo1", 2024-09-13T23:57:01.488 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL" 2024-09-13T23:57:01.488 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:01.488 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:01.488 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo:foo2", 2024-09-13T23:57:01.488 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy" 2024-09-13T23:57:01.488 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:01.488 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:01.488 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:57:01.488 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:57:01.488 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:57:01.488 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:57:01.488 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:57:01.488 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:57:01.489 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:01.489 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:01.489 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:01.489 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:01.489 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:01.489 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:01.489 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:57:01.489 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:01.489 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:01.489 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:01.489 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:01.489 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:01.489 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:01.489 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:57:01.490 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:57:01.490 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:57:01.490 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:01.490 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:57:01.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.482+0000 7fb097cf2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:01.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.482+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94286787485696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da77b400 con 0x55c0da688400 2024-09-13T23:57:01.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.482+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94286787485696] v33'81 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da688400 2024-09-13T23:57:01.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.482+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94286785813248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da325400 con 0x55c0da77a400 2024-09-13T23:57:01.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.486+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94286785813248] v33'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c0da72d200 con 0x55c0da77a400 2024-09-13T23:57:01.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.486+0000 7fb0b256bf40 20 remove_watcher() i=0 2024-09-13T23:57:01.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.486+0000 7fb0b256bf40 2 removed watcher, disabling cache 2024-09-13T23:57:01.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.486+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94286785814400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da688800 con 0x55c0da688400 2024-09-13T23:57:01.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.490+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94286785814400] v33'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da688400 2024-09-13T23:57:01.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.490+0000 7fb0b256bf40 20 remove_watcher() i=1 2024-09-13T23:57:01.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.490+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94286785815552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da688c00 con 0x55c0da77a400 2024-09-13T23:57:01.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.490+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94286785815552] v33'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c0da72d200 con 0x55c0da77a400 2024-09-13T23:57:01.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.490+0000 7fb0b256bf40 20 remove_watcher() i=2 2024-09-13T23:57:01.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.490+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94286785816704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da6f0000 con 0x55c0da77b000 2024-09-13T23:57:01.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.494+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94286785816704] v33'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da77b000 2024-09-13T23:57:01.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.494+0000 7fb0b256bf40 20 remove_watcher() i=3 2024-09-13T23:57:01.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.494+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94286785817856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da6f0400 con 0x55c0da77a400 2024-09-13T23:57:01.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.494+0000 7fb0b0d24700 1 -- 172.21.15.173:0/3963172756 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94286785817856] v33'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c0da72d200 con 0x55c0da77a400 2024-09-13T23:57:01.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.494+0000 7fb0b256bf40 20 remove_watcher() i=4 2024-09-13T23:57:01.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.494+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94286785819008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da6f0800 con 0x55c0da77ac00 2024-09-13T23:57:01.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.498+0000 7fb0b0523700 1 -- 172.21.15.173:0/3963172756 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94286785819008] v33'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c0da72d440 con 0x55c0da77ac00 2024-09-13T23:57:01.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.498+0000 7fb0b256bf40 20 remove_watcher() i=5 2024-09-13T23:57:01.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.498+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94286785820160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da6f0c00 con 0x55c0da77ac00 2024-09-13T23:57:01.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.502+0000 7fb0b0523700 1 -- 172.21.15.173:0/3963172756 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94286785820160] v33'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c0da72d440 con 0x55c0da77ac00 2024-09-13T23:57:01.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.502+0000 7fb0b256bf40 20 remove_watcher() i=6 2024-09-13T23:57:01.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.502+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94286785821312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55c0da6f1000 con 0x55c0da77b000 2024-09-13T23:57:01.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.502+0000 7fb0b1525700 1 -- 172.21.15.173:0/3963172756 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94286785821312] v33'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55c0da72cb40 con 0x55c0da77b000 2024-09-13T23:57:01.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.502+0000 7fb0b256bf40 20 remove_watcher() i=7 2024-09-13T23:57:01.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.502+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55c0da77a400 msgr2=0x55c0da60bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.502+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/3963172756 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55c0da77a400 0x55c0da60bb80 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.502+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55c0da688400 msgr2=0x55c0da60b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.502+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/3963172756 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55c0da688400 0x55c0da60b600 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.502+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55c0da77b000 msgr2=0x55c0da66c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.502+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/3963172756 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55c0da77b000 0x55c0da66c000 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.502+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55c0da77ac00 msgr2=0x55c0da60cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.502+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/3963172756 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55c0da77ac00 0x55c0da60cc00 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.502+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55c0da689c00 msgr2=0x55c0da60c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.502+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/3963172756 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55c0da689c00 0x55c0da60c680 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55c0da605ad0 tx=0x55c0da429800 comp rx=0 tx=0).stop 2024-09-13T23:57:01.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.502+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da688000 msgr2=0x55c0da60b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.502+0000 7fb0b0523700 1 -- 172.21.15.173:0/3963172756 reap_dead start 2024-09-13T23:57:01.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.502+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/3963172756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da688000 0x55c0da60b080 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55c0da656420 tx=0x55c0da68e840 comp rx=0 tx=0).stop 2024-09-13T23:57:01.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.502+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 shutdown_connections 2024-09-13T23:57:01.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.502+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/3963172756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da688000 0x55c0da60b080 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.502+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 >> 172.21.15.173:0/3963172756 conn(0x55c0da325800 msgr2=0x55c0da425800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.502+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 shutdown_connections 2024-09-13T23:57:01.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.502+0000 7fb0b256bf40 1 -- 172.21.15.173:0/3963172756 wait complete. 2024-09-13T23:57:01.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.506+0000 7fb0b256bf40 1 -- 172.21.15.173:0/2266837799 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55c0da794000 msgr2=0x55c0da66c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.506+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/2266837799 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55c0da794000 0x55c0da66c580 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55c0da70e150 tx=0x55c0da7eaae0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.506+0000 7fb0b256bf40 1 -- 172.21.15.173:0/2266837799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da77bc00 msgr2=0x55c0da60d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.506+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/2266837799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da77bc00 0x55c0da60d180 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55c0da7a2210 tx=0x55c0da68fc20 comp rx=0 tx=0).stop 2024-09-13T23:57:01.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.506+0000 7fb0b256bf40 1 -- 172.21.15.173:0/2266837799 shutdown_connections 2024-09-13T23:57:01.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.506+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/2266837799 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55c0da794000 0x55c0da66c580 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.506+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/2266837799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da77bc00 0x55c0da60d180 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.506+0000 7fb0b256bf40 1 -- 172.21.15.173:0/2266837799 >> 172.21.15.173:0/2266837799 conn(0x55c0da794800 msgr2=0x55c0da426000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.506+0000 7fb0b256bf40 1 -- 172.21.15.173:0/2266837799 shutdown_connections 2024-09-13T23:57:01.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.506+0000 7fb0b256bf40 1 -- 172.21.15.173:0/2266837799 wait complete. 2024-09-13T23:57:01.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.506+0000 7fb0b256bf40 1 -- 172.21.15.173:0/499531793 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55c0da689000 msgr2=0x55c0da60c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.506+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/499531793 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55c0da689000 0x55c0da60c100 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55c0da6574d0 tx=0x55c0da68e240 comp rx=0 tx=0).stop 2024-09-13T23:57:01.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.506+0000 7fb0b256bf40 1 -- 172.21.15.173:0/499531793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da325000 msgr2=0x55c0da60ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.506+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/499531793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da325000 0x55c0da60ab00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55c0db0efe60 tx=0x55c0da429a40 comp rx=0 tx=0).stop 2024-09-13T23:57:01.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.506+0000 7fb0b256bf40 1 -- 172.21.15.173:0/499531793 shutdown_connections 2024-09-13T23:57:01.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.506+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/499531793 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55c0da689000 0x55c0da60c100 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.506+0000 7fb0b256bf40 1 --2- 172.21.15.173:0/499531793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c0da325000 0x55c0da60ab00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.506+0000 7fb0b256bf40 1 -- 172.21.15.173:0/499531793 >> 172.21.15.173:0/499531793 conn(0x55c0da324c00 msgr2=0x55c0da425000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.506+0000 7fb0b256bf40 1 -- 172.21.15.173:0/499531793 shutdown_connections 2024-09-13T23:57:01.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.506+0000 7fb0b256bf40 1 -- 172.21.15.173:0/499531793 wait complete. 2024-09-13T23:57:01.516 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:57:01.516 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-13T23:57:01.516 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-13T23:57:01.516 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-13T23:57:01.556 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:01.556 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:01.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.550+0000 7f9e8eca7f40 1 Processor -- start 2024-09-13T23:57:01.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.550+0000 7f9e8eca7f40 1 -- start start 2024-09-13T23:57:01.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.550+0000 7f9e8eca7f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55e09fc81400 0x55e09ff66580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.550+0000 7f9e8eca7f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e09fd45500 con 0x55e09fc81000 2024-09-13T23:57:01.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.550+0000 7f9e8eca7f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e09fd0ea00 con 0x55e09fc81400 2024-09-13T23:57:01.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.554+0000 7f9e8cc5f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55e09fc81400 0x55e09ff66580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.554+0000 7f9e8d460700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55e09fc81000 0x55e09fd80800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47336/0 (socket says 172.21.15.173:47336) 2024-09-13T23:57:01.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.554+0000 7f9e8d460700 1 -- 172.21.15.173:0/1276885574 learned_addr learned my addr 172.21.15.173:0/1276885574 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:01.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.554+0000 7f9e8c45e700 1 -- 172.21.15.173:0/1276885574 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214580571 0 0) 0x55e09fddc000 con 0x55e09fc81000 2024-09-13T23:57:01.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.554+0000 7f9e8c45e700 1 -- 172.21.15.173:0/1276885574 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x55e09fd45680 con 0x55e09fc81000 2024-09-13T23:57:01.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.554+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/1276885574 >> v1:172.21.15.87:6789/0 conn(0x55e09fc81000 legacy=0x55e09fd80800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.554+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/1276885574 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e09fc93d40 con 0x55e09fc81400 2024-09-13T23:57:01.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.554+0000 7f9e8cc5f700 1 --2- 172.21.15.173:0/1276885574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81400 0x55e09ff66580 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x55e09ff61920 tx=0x55e09fd85980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa47d9d3fd4f98b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.554+0000 7f9e8c45e700 1 -- 172.21.15.173:0/1276885574 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e09fd254a0 con 0x55e09fc81400 2024-09-13T23:57:01.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.554+0000 7f9e8c45e700 1 -- 172.21.15.173:0/1276885574 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e09fd45680 con 0x55e09fc81400 2024-09-13T23:57:01.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.554+0000 7f9e8c45e700 1 -- 172.21.15.173:0/1276885574 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e09fd25600 con 0x55e09fc81400 2024-09-13T23:57:01.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.554+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/1276885574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81400 msgr2=0x55e09ff66580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.554+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/1276885574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81400 0x55e09ff66580 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x55e09ff61920 tx=0x55e09fd85980 comp rx=0 tx=0).stop 2024-09-13T23:57:01.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.554+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/1276885574 shutdown_connections 2024-09-13T23:57:01.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.554+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/1276885574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81400 0x55e09ff66580 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.554+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/1276885574 >> 172.21.15.173:0/1276885574 conn(0x55e09fc80c00 msgr2=0x55e09fd80000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.554+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/1276885574 shutdown_connections 2024-09-13T23:57:01.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.554+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/1276885574 wait complete. 2024-09-13T23:57:01.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.554+0000 7f9e8eca7f40 1 Processor -- start 2024-09-13T23:57:01.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.554+0000 7f9e8eca7f40 1 -- start start 2024-09-13T23:57:01.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.554+0000 7f9e8eca7f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81000 0x55e09ff66580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.554+0000 7f9e8eca7f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e09fd0e500 con 0x55e09fc81000 2024-09-13T23:57:01.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.554+0000 7f9e8d460700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81000 0x55e09ff66580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.554+0000 7f9e8d460700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81000 0x55e09ff66580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49244/0 (socket says 172.21.15.173:49244) 2024-09-13T23:57:01.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.558+0000 7f9e8d460700 1 -- 172.21.15.173:0/2179326564 learned_addr learned my addr 172.21.15.173:0/2179326564 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.558+0000 7f9e8d460700 1 -- 172.21.15.173:0/2179326564 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e09fc93ba0 con 0x55e09fc81000 2024-09-13T23:57:01.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.558+0000 7f9e8d460700 1 --2- 172.21.15.173:0/2179326564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81000 0x55e09ff66580 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x55e0a0a4bd70 tx=0x55e09fd85b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae96933184ed52e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.558+0000 7f9e8bc5d700 1 -- 172.21.15.173:0/2179326564 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e09fd254a0 con 0x55e09fc81000 2024-09-13T23:57:01.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.558+0000 7f9e8bc5d700 1 -- 172.21.15.173:0/2179326564 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e09fd45b00 con 0x55e09fc81000 2024-09-13T23:57:01.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.558+0000 7f9e8bc5d700 1 -- 172.21.15.173:0/2179326564 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e09fd25600 con 0x55e09fc81000 2024-09-13T23:57:01.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.558+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/2179326564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81000 msgr2=0x55e09ff66580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.558+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/2179326564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81000 0x55e09ff66580 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x55e0a0a4bd70 tx=0x55e09fd85b60 comp rx=0 tx=0).stop 2024-09-13T23:57:01.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.558+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/2179326564 shutdown_connections 2024-09-13T23:57:01.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.558+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/2179326564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81000 0x55e09ff66580 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.558+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/2179326564 >> 172.21.15.173:0/2179326564 conn(0x55e09fc80c00 msgr2=0x55e09fd81000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.558+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/2179326564 shutdown_connections 2024-09-13T23:57:01.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.558+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/2179326564 wait complete. 2024-09-13T23:57:01.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.558+0000 7f9e8eca7f40 1 Processor -- start 2024-09-13T23:57:01.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.558+0000 7f9e8eca7f40 1 -- start start 2024-09-13T23:57:01.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.558+0000 7f9e8eca7f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81000 0x55e09ff66580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.558+0000 7f9e8eca7f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e09fd0e3c0 con 0x55e09fc81000 2024-09-13T23:57:01.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.558+0000 7f9e8d460700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81000 0x55e09ff66580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.562+0000 7f9e8d460700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81000 0x55e09ff66580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49246/0 (socket says 172.21.15.173:49246) 2024-09-13T23:57:01.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.562+0000 7f9e8d460700 1 -- 172.21.15.173:0/7218723 learned_addr learned my addr 172.21.15.173:0/7218723 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.562+0000 7f9e8d460700 1 -- 172.21.15.173:0/7218723 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e09fc93a00 con 0x55e09fc81000 2024-09-13T23:57:01.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.562+0000 7f9e8d460700 1 --2- 172.21.15.173:0/7218723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81000 0x55e09ff66580 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55e0a0a4be00 tx=0x55e09fd85920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.562+0000 7f9e8a45a700 1 -- 172.21.15.173:0/7218723 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e09fd258c0 con 0x55e09fc81000 2024-09-13T23:57:01.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.562+0000 7f9e8a45a700 1 -- 172.21.15.173:0/7218723 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e09fd45c80 con 0x55e09fc81000 2024-09-13T23:57:01.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.562+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/7218723 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e09fc93860 con 0x55e09fc81000 2024-09-13T23:57:01.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.562+0000 7f9e8a45a700 1 -- 172.21.15.173:0/7218723 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e09fd254a0 con 0x55e09fc81000 2024-09-13T23:57:01.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.562+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/7218723 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e09fc936c0 con 0x55e09fc81000 2024-09-13T23:57:01.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.562+0000 7f9e8eca7f40 1 Processor -- start 2024-09-13T23:57:01.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.562+0000 7f9e8eca7f40 1 -- start start 2024-09-13T23:57:01.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.562+0000 7f9e8eca7f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81800 0x55e09ff66b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.562+0000 7f9e8eca7f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e09fca6640 con 0x55e09fc81800 2024-09-13T23:57:01.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.562+0000 7f9e8dc61700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81800 0x55e09ff66b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.562+0000 7f9e8a45a700 1 -- 172.21.15.173:0/7218723 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55e09fd7ab00 con 0x55e09fc81000 2024-09-13T23:57:01.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.562+0000 7f9e8dc61700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81800 0x55e09ff66b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49252/0 (socket says 172.21.15.173:49252) 2024-09-13T23:57:01.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.562+0000 7f9e8dc61700 1 -- 172.21.15.173:0/96248538 learned_addr learned my addr 172.21.15.173:0/96248538 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.562+0000 7f9e8a45a700 1 --2- 172.21.15.173:0/7218723 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e0a0024000 0x55e09ff67080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e8a45a700 1 -- 172.21.15.173:0/7218723 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55e09fce7180 con 0x55e09fc81000 2024-09-13T23:57:01.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e8dc61700 1 -- 172.21.15.173:0/96248538 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e09fc92000 con 0x55e09fc81800 2024-09-13T23:57:01.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e8d460700 1 --2- 172.21.15.173:0/7218723 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e0a0024000 0x55e09ff67080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e8dc61700 1 --2- 172.21.15.173:0/96248538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81800 0x55e09ff66b00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55e09ffb3620 tx=0x55e09fd85f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c691a1fbec58de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e87c55700 1 -- 172.21.15.173:0/96248538 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e09fd258c0 con 0x55e09fc81800 2024-09-13T23:57:01.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e87c55700 1 -- 172.21.15.173:0/96248538 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e09ffd4000 con 0x55e09fc81800 2024-09-13T23:57:01.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e87c55700 1 -- 172.21.15.173:0/96248538 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e09fd254a0 con 0x55e09fc81800 2024-09-13T23:57:01.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e8d460700 1 --2- 172.21.15.173:0/7218723 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e0a0024000 0x55e09ff67080 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55e09ffb3560 tx=0x55e09ffe4240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/96248538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81800 msgr2=0x55e09ff66b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/96248538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81800 0x55e09ff66b00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55e09ffb3620 tx=0x55e09fd85f20 comp rx=0 tx=0).stop 2024-09-13T23:57:01.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/96248538 shutdown_connections 2024-09-13T23:57:01.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/96248538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81800 0x55e09ff66b00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/96248538 >> 172.21.15.173:0/96248538 conn(0x55e09fc81400 msgr2=0x55e09fd81800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/96248538 shutdown_connections 2024-09-13T23:57:01.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/96248538 wait complete. 2024-09-13T23:57:01.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e8eca7f40 1 Processor -- start 2024-09-13T23:57:01.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e8eca7f40 1 -- start start 2024-09-13T23:57:01.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e8eca7f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81800 0x55e09ff66b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e8eca7f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e09fca68c0 con 0x55e09fc81800 2024-09-13T23:57:01.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e8dc61700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81800 0x55e09ff66b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e8dc61700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81800 0x55e09ff66b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49266/0 (socket says 172.21.15.173:49266) 2024-09-13T23:57:01.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 learned_addr learned my addr 172.21.15.173:0/902542094 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e09fc92ea0 con 0x55e09fc81800 2024-09-13T23:57:01.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e8dc61700 1 --2- 172.21.15.173:0/902542094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81800 0x55e09ff66b00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55e09ff61f80 tx=0x55e09fd85e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e86452700 1 -- 172.21.15.173:0/902542094 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e09fd25b80 con 0x55e09fc81800 2024-09-13T23:57:01.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e86452700 1 -- 172.21.15.173:0/902542094 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e09ffd4180 con 0x55e09fc81800 2024-09-13T23:57:01.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e09fc92820 con 0x55e09fc81800 2024-09-13T23:57:01.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e86452700 1 -- 172.21.15.173:0/902542094 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e09fd258c0 con 0x55e09fc81800 2024-09-13T23:57:01.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.566+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e09fc929c0 con 0x55e09fc81800 2024-09-13T23:57:01.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.570+0000 7f9e86452700 1 -- 172.21.15.173:0/902542094 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55e09fd7b080 con 0x55e09fc81800 2024-09-13T23:57:01.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.570+0000 7f9e86452700 1 --2- 172.21.15.173:0/902542094 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e0a0024c00 0x55e09ff67600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.570+0000 7f9e86452700 1 -- 172.21.15.173:0/902542094 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55e09fce7340 con 0x55e09fc81800 2024-09-13T23:57:01.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.570+0000 7f9e8eca7f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.570+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/902542094 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55e0a0025000 0x55e09ff67b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.570+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025400 con 0x55e0a0025000 2024-09-13T23:57:01.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.570+0000 7f9e8cc5f700 1 --2- 172.21.15.173:0/902542094 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e0a0024c00 0x55e09ff67600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.570+0000 7f9e8dc61700 1 --2- 172.21.15.173:0/902542094 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55e0a0025000 0x55e09ff67b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.570+0000 7f9e8dc61700 1 --2- 172.21.15.173:0/902542094 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55e0a0025000 0x55e09ff67b80 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.570+0000 7f9e8cc5f700 1 --2- 172.21.15.173:0/902542094 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e0a0024c00 0x55e09ff67600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55e09ff61920 tx=0x55e09fd85800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.570+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a0025000 2024-09-13T23:57:01.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.570+0000 7f9e8eca7f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.570+0000 7f9e8eca7f40 20 realm 2024-09-13T23:57:01.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.570+0000 7f9e8eca7f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.570+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025000 2024-09-13T23:57:01.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.570+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a0025000 2024-09-13T23:57:01.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.570+0000 7f9e8eca7f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.570+0000 7f9e8eca7f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:01.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.570+0000 7f9e8eca7f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.570+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025c00 con 0x55e0a0025000 2024-09-13T23:57:01.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.574+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a0025000 2024-09-13T23:57:01.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.574+0000 7f9e8eca7f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.574+0000 7f9e8eca7f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.574+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/902542094 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55e0a0025400 0x55e09ff68100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.574+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025400 2024-09-13T23:57:01.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.574+0000 7f9e8d460700 1 --2- 172.21.15.173:0/902542094 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55e0a0025400 0x55e09ff68100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.574+0000 7f9e8d460700 1 --2- 172.21.15.173:0/902542094 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55e0a0025400 0x55e09ff68100 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.574+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55e0a00d1200 con 0x55e0a0025400 2024-09-13T23:57:01.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.574+0000 7f9e8eca7f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:01.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.574+0000 7f9e8eca7f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.574+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/902542094 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55e0a0025c00 0x55e09ff68680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.574+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e0000 con 0x55e0a0025c00 2024-09-13T23:57:01.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.574+0000 7f9e8cc5f700 1 --2- 172.21.15.173:0/902542094 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55e0a0025c00 0x55e09ff68680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.574+0000 7f9e8cc5f700 1 --2- 172.21.15.173:0/902542094 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55e0a0025c00 0x55e09ff68680 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.574+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55e0a00d1440 con 0x55e0a0025c00 2024-09-13T23:57:01.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.574+0000 7f9e8eca7f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:01.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.574+0000 7f9e8eca7f40 20 searching for the correct realm 2024-09-13T23:57:01.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.574+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e0400 con 0x55e0a0025c00 2024-09-13T23:57:01.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.578+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55e0a00d1440 con 0x55e0a0025c00 2024-09-13T23:57:01.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.578+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e0000 con 0x55e0a0025400 2024-09-13T23:57:01.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.578+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d1200 con 0x55e0a0025400 2024-09-13T23:57:01.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.578+0000 7f9e8d460700 1 --2- 172.21.15.173:0/902542094 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55e0a00e0000 0x55e09ff68c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.578+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a00e0000 2024-09-13T23:57:01.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.578+0000 7f9e8dc61700 1 --2- 172.21.15.173:0/902542094 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55e0a00e0000 0x55e09ff68c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.578+0000 7f9e8dc61700 1 --2- 172.21.15.173:0/902542094 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55e0a00e0000 0x55e09ff68c00 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.578+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a00e0000 2024-09-13T23:57:01.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.578+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025000 2024-09-13T23:57:01.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.578+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a0025000 2024-09-13T23:57:01.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.578+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025000 2024-09-13T23:57:01.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.578+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a0025000 2024-09-13T23:57:01.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.578+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025c00 2024-09-13T23:57:01.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.578+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d1440 con 0x55e0a0025c00 2024-09-13T23:57:01.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.578+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025000 2024-09-13T23:57:01.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.582+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a0025000 2024-09-13T23:57:01.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.582+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025400 2024-09-13T23:57:01.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.582+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d1200 con 0x55e0a0025400 2024-09-13T23:57:01.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.582+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025400 2024-09-13T23:57:01.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.582+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d1200 con 0x55e0a0025400 2024-09-13T23:57:01.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.582+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025000 2024-09-13T23:57:01.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.582+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a0025000 2024-09-13T23:57:01.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.582+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a00e0000 2024-09-13T23:57:01.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.582+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a00e0000 2024-09-13T23:57:01.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.582+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025000 2024-09-13T23:57:01.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.582+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a0025000 2024-09-13T23:57:01.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.582+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a00e0000 2024-09-13T23:57:01.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.582+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a00e0000 2024-09-13T23:57:01.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.582+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025400 2024-09-13T23:57:01.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.586+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d1200 con 0x55e0a0025400 2024-09-13T23:57:01.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.586+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025c00 2024-09-13T23:57:01.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.586+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d1440 con 0x55e0a0025c00 2024-09-13T23:57:01.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.586+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025000 2024-09-13T23:57:01.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.586+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a0025000 2024-09-13T23:57:01.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.586+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025400 2024-09-13T23:57:01.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.586+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d1200 con 0x55e0a0025400 2024-09-13T23:57:01.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.586+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025c00 2024-09-13T23:57:01.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.586+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d1440 con 0x55e0a0025c00 2024-09-13T23:57:01.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.586+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025000 2024-09-13T23:57:01.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.586+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a0025000 2024-09-13T23:57:01.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.586+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025000 2024-09-13T23:57:01.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.586+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a0025000 2024-09-13T23:57:01.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.586+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025000 2024-09-13T23:57:01.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.590+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a0025000 2024-09-13T23:57:01.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.590+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025c00 2024-09-13T23:57:01.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.590+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d1440 con 0x55e0a0025c00 2024-09-13T23:57:01.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.590+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a00e0000 2024-09-13T23:57:01.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.590+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a00e0000 2024-09-13T23:57:01.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.590+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025000 2024-09-13T23:57:01.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.590+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a0025000 2024-09-13T23:57:01.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.590+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a00e0000 2024-09-13T23:57:01.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.590+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a00e0000 2024-09-13T23:57:01.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.590+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025c00 2024-09-13T23:57:01.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.590+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d1440 con 0x55e0a0025c00 2024-09-13T23:57:01.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.590+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a00e0000 2024-09-13T23:57:01.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.590+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a00e0000 2024-09-13T23:57:01.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.590+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025400 2024-09-13T23:57:01.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.594+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d1200 con 0x55e0a0025400 2024-09-13T23:57:01.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.594+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025400 2024-09-13T23:57:01.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.594+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d1200 con 0x55e0a0025400 2024-09-13T23:57:01.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.594+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025c00 2024-09-13T23:57:01.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.594+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d1440 con 0x55e0a0025c00 2024-09-13T23:57:01.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.594+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025400 2024-09-13T23:57:01.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.594+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55e0a00d1200 con 0x55e0a0025400 2024-09-13T23:57:01.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.594+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a0025400 2024-09-13T23:57:01.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.594+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e0a00d1200 con 0x55e0a0025400 2024-09-13T23:57:01.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.594+0000 7f9e8eca7f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:01.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.594+0000 7f9e8eca7f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:01.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.594+0000 7f9e8eca7f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:01.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.594+0000 7f9e8eca7f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:01.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.594+0000 7f9e8eca7f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.594+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e0800 con 0x55e0a0025000 2024-09-13T23:57:01.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.594+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a0025000 2024-09-13T23:57:01.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.594+0000 7f9e8eca7f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.594+0000 7f9e8eca7f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.594+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e0c00 con 0x55e0a0025400 2024-09-13T23:57:01.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55e0a00d1200 con 0x55e0a0025400 2024-09-13T23:57:01.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8eca7f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:01.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8eca7f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e1000 con 0x55e0a0025000 2024-09-13T23:57:01.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a0025000 2024-09-13T23:57:01.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8eca7f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:01.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8eca7f40 20 zone default found 2024-09-13T23:57:01.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8eca7f40 4 Realm: () 2024-09-13T23:57:01.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8eca7f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:01.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8eca7f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:01.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8eca7f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:01.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8eca7f40 20 zonegroup default 2024-09-13T23:57:01.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8eca7f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e1400 con 0x55e0a00e0000 2024-09-13T23:57:01.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a00e0000 2024-09-13T23:57:01.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8eca7f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8eca7f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e1800 con 0x55e0a0025c00 2024-09-13T23:57:01.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55e0a00d1440 con 0x55e0a0025c00 2024-09-13T23:57:01.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8eca7f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8eca7f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e1c00 con 0x55e0a0025c00 2024-09-13T23:57:01.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55e0a00d1440 con 0x55e0a0025c00 2024-09-13T23:57:01.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8eca7f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8eca7f40 20 started sync module instance, tier type = 2024-09-13T23:57:01.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8eca7f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:01.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.598+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e2000 con 0x55e0a0025400 2024-09-13T23:57:01.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.602+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d1200 con 0x55e0a0025400 2024-09-13T23:57:01.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.602+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94423244724992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e2400 con 0x55e0a0025400 2024-09-13T23:57:01.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.602+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e2800 con 0x55e0a0025000 2024-09-13T23:57:01.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.606+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a0025000 2024-09-13T23:57:01.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.606+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94423244724992] v33'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d1200 con 0x55e0a0025400 2024-09-13T23:57:01.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.606+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94423244726144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e2c00 con 0x55e0a0025000 2024-09-13T23:57:01.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.606+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e3000 con 0x55e0a0025400 2024-09-13T23:57:01.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.610+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94423244726144] v33'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a0025000 2024-09-13T23:57:01.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.610+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d1200 con 0x55e0a0025400 2024-09-13T23:57:01.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.610+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94423244727296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e3400 con 0x55e0a0025400 2024-09-13T23:57:01.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.610+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e3800 con 0x55e0a00e0000 2024-09-13T23:57:01.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.610+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a00e0000 2024-09-13T23:57:01.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.610+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94423244728448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e3c00 con 0x55e0a00e0000 2024-09-13T23:57:01.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.610+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e2800 con 0x55e0a0025400 2024-09-13T23:57:01.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.610+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94423244727296] v33'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d1200 con 0x55e0a0025400 2024-09-13T23:57:01.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.614+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94423244728448] v33'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a00e0000 2024-09-13T23:57:01.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.614+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d1200 con 0x55e0a0025400 2024-09-13T23:57:01.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.614+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94423244729600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e2000 con 0x55e0a0025400 2024-09-13T23:57:01.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.614+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e0800 con 0x55e0a0025c00 2024-09-13T23:57:01.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.614+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d1440 con 0x55e0a0025c00 2024-09-13T23:57:01.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.614+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94423244730752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e1000 con 0x55e0a0025c00 2024-09-13T23:57:01.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.614+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e1400 con 0x55e0a0025c00 2024-09-13T23:57:01.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.618+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94423244729600] v33'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d1200 con 0x55e0a0025400 2024-09-13T23:57:01.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.618+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94423244730752] v33'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d1440 con 0x55e0a0025c00 2024-09-13T23:57:01.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.618+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d1440 con 0x55e0a0025c00 2024-09-13T23:57:01.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.618+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94423244731904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e0c00 con 0x55e0a0025c00 2024-09-13T23:57:01.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.618+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a0025800 con 0x55e0a00e0000 2024-09-13T23:57:01.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.618+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a00e0000 2024-09-13T23:57:01.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.618+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94423244733056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e2400 con 0x55e0a00e0000 2024-09-13T23:57:01.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.618+0000 7f9e8eca7f40 20 add_watcher() i=0 2024-09-13T23:57:01.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.618+0000 7f9e8eca7f40 20 add_watcher() i=1 2024-09-13T23:57:01.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.618+0000 7f9e8eca7f40 20 add_watcher() i=2 2024-09-13T23:57:01.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.618+0000 7f9e8eca7f40 20 add_watcher() i=3 2024-09-13T23:57:01.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.618+0000 7f9e8eca7f40 20 add_watcher() i=4 2024-09-13T23:57:01.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.618+0000 7f9e8eca7f40 20 add_watcher() i=5 2024-09-13T23:57:01.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.622+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94423244731904] v33'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d1440 con 0x55e0a0025c00 2024-09-13T23:57:01.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.622+0000 7f9e8eca7f40 20 add_watcher() i=6 2024-09-13T23:57:01.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.622+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94423244733056] v33'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a00e0000 2024-09-13T23:57:01.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.622+0000 7f9e8eca7f40 20 add_watcher() i=7 2024-09-13T23:57:01.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.622+0000 7f9e8eca7f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:01.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.622+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e3000 con 0x55e0a0025000 2024-09-13T23:57:01.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.622+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a0025000 2024-09-13T23:57:01.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.622+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94423246340096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e3400 con 0x55e0a0025000 2024-09-13T23:57:01.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.626+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94423246340096] v33'82 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a0025000 2024-09-13T23:57:01.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.626+0000 7f9e7442e700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:01.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.626+0000 7f9e8eca7f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:01.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.626+0000 7f9e8eca7f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:01.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.626+0000 7f9e8eca7f40 1 Processor -- start 2024-09-13T23:57:01.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.626+0000 7f9e8eca7f40 1 -- start start 2024-09-13T23:57:01.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.626+0000 7f9e8eca7f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0a00e0400 0x55e09ff69180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.626+0000 7f9e8eca7f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e09fd0e3c0 con 0x55e0a00e0400 2024-09-13T23:57:01.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.626+0000 7f9e8cc5f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0a00e0400 0x55e09ff69180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.626+0000 7f9e8cc5f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0a00e0400 0x55e09ff69180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49270/0 (socket says 172.21.15.173:49270) 2024-09-13T23:57:01.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.626+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/2475995948 learned_addr learned my addr 172.21.15.173:0/2475995948 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.626+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/2475995948 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e09fc92b60 con 0x55e0a00e0400 2024-09-13T23:57:01.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.626+0000 7f9e8cc5f700 1 --2- 172.21.15.173:0/2475995948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0a00e0400 0x55e09ff69180 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55e0a00f0000 tx=0x55e09fd859e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98d84f72df633a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.626+0000 7f9e73c2d700 1 -- 172.21.15.173:0/2475995948 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e09fd25760 con 0x55e0a00e0400 2024-09-13T23:57:01.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.626+0000 7f9e73c2d700 1 -- 172.21.15.173:0/2475995948 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e09ffd4600 con 0x55e0a00e0400 2024-09-13T23:57:01.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.626+0000 7f9e73c2d700 1 -- 172.21.15.173:0/2475995948 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e0a00fc000 con 0x55e0a00e0400 2024-09-13T23:57:01.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.630+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/2475995948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0a00e0400 msgr2=0x55e09ff69180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.630+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/2475995948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0a00e0400 0x55e09ff69180 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55e0a00f0000 tx=0x55e09fd859e0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.630+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/2475995948 shutdown_connections 2024-09-13T23:57:01.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.630+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/2475995948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0a00e0400 0x55e09ff69180 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.630+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/2475995948 >> 172.21.15.173:0/2475995948 conn(0x55e0a00e2800 msgr2=0x55e09fd82000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.630+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/2475995948 shutdown_connections 2024-09-13T23:57:01.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.630+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/2475995948 wait complete. 2024-09-13T23:57:01.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.630+0000 7f9e8eca7f40 1 Processor -- start 2024-09-13T23:57:01.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.630+0000 7f9e8eca7f40 1 -- start start 2024-09-13T23:57:01.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.630+0000 7f9e8eca7f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0a00e0400 0x55e09ff69180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.630+0000 7f9e8eca7f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e09fd0e500 con 0x55e0a00e0400 2024-09-13T23:57:01.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.630+0000 7f9e8cc5f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0a00e0400 0x55e09ff69180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.630+0000 7f9e8cc5f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0a00e0400 0x55e09ff69180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49278/0 (socket says 172.21.15.173:49278) 2024-09-13T23:57:01.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.630+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/995707049 learned_addr learned my addr 172.21.15.173:0/995707049 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.630+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/995707049 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e09fc92d00 con 0x55e0a00e0400 2024-09-13T23:57:01.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.630+0000 7f9e8cc5f700 1 --2- 172.21.15.173:0/995707049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0a00e0400 0x55e09ff69180 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55e0a00f0210 tx=0x55e09ffe5c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.630+0000 7f9e7242a700 1 -- 172.21.15.173:0/995707049 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e0a00fc160 con 0x55e0a00e0400 2024-09-13T23:57:01.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.630+0000 7f9e7242a700 1 -- 172.21.15.173:0/995707049 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e09ffd4300 con 0x55e0a00e0400 2024-09-13T23:57:01.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.630+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/995707049 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e09fc92340 con 0x55e0a00e0400 2024-09-13T23:57:01.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.630+0000 7f9e7242a700 1 -- 172.21.15.173:0/995707049 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e0a00fc2c0 con 0x55e0a00e0400 2024-09-13T23:57:01.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.630+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/995707049 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e09fc93d40 con 0x55e0a00e0400 2024-09-13T23:57:01.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.634+0000 7f9e7242a700 1 -- 172.21.15.173:0/995707049 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55e09fd7bb80 con 0x55e0a00e0400 2024-09-13T23:57:01.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.634+0000 7f9e7242a700 1 --2- 172.21.15.173:0/995707049 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e0a0025800 0x55e0a0178000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.634+0000 7f9e7242a700 1 -- 172.21.15.173:0/995707049 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55e09fce7500 con 0x55e0a00e0400 2024-09-13T23:57:01.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.634+0000 7f9e8eca7f40 5 note: GC not initialized 2024-09-13T23:57:01.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.634+0000 7f9e8dc61700 1 --2- 172.21.15.173:0/995707049 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e0a0025800 0x55e0a0178000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.634+0000 7f9e8dc61700 1 --2- 172.21.15.173:0/995707049 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e0a0025800 0x55e0a0178000 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55e0a007f4d0 tx=0x55e0a013eae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.634+0000 7f9e6fc25700 20 reqs_thread_entry: start 2024-09-13T23:57:01.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.634+0000 7f9e8eca7f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:01.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.634+0000 7f9e8eca7f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:01.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.638+0000 7f9e6d420700 20 reqs_thread_entry: start 2024-09-13T23:57:01.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.638+0000 7f9e6dc21700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:31 2024 2024-09-13T23:57:01.642 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:01.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.638+0000 7f9e8eca7f40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:57:01.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.638+0000 7f9e8eca7f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.638+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e0800 con 0x55e0a0025000 2024-09-13T23:57:01.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.638+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~621 out=621b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+744 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a0025000 2024-09-13T23:57:01.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.638+0000 7f9e8eca7f40 20 rados_obj.operate() r=0 bl.length=621 2024-09-13T23:57:01.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.638+0000 7f9e8eca7f40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:57:01.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.638+0000 7f9e8eca7f40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:01.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.638+0000 7f9e8eca7f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:01.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.638+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~539 in=539b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e3800 con 0x55e0a0025000 2024-09-13T23:57:01.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.638+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~539] v33'9 uv9 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a0025000 2024-09-13T23:57:01.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.638+0000 7f9e8eca7f40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:57:01.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.638+0000 7f9e8eca7f40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:01.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.638+0000 7f9e8eca7f40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:57:01.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.638+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94423246342400 in=727b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e3c00 con 0x55e0a0025400 2024-09-13T23:57:01.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.642+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== watch-notify(notify (1) cookie 94423244729600 notify 141733920780 ret 0) v3 ==== 757+0+0 (crc 0 0 0) 0x55e09ffe2820 con 0x55e0a0025400 2024-09-13T23:57:01.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.642+0000 7f9e87c55700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920780 cookie 94423244729600 notifier 4432 bl.length()=715 2024-09-13T23:57:01.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.642+0000 7f9e87c55700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:57:01.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.642+0000 7f9e87c55700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:01.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.642+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(64 notify.4 [notify cookie 94423246342400 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55e0a00d1200 con 0x55e0a0025400 2024-09-13T23:57:01.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.642+0000 7f9e87c55700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a01ee000 con 0x55e0a0025400 2024-09-13T23:57:01.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.642+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d1200 con 0x55e0a0025400 2024-09-13T23:57:01.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.642+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== watch-notify(notify_complete (2) cookie 94423246342400 notify 141733920780 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55e09ffe29c0 con 0x55e0a0025400 2024-09-13T23:57:01.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.642+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e2400 con 0x55e0a0025000 2024-09-13T23:57:01.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.642+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(66 foo:foo1 [delete] v33'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a0025000 2024-09-13T23:57:01.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.642+0000 7f9e8eca7f40 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-13T23:57:01.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.642+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94423246342400 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a01ee800 con 0x55e0a0025400 2024-09-13T23:57:01.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.646+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== watch-notify(notify (1) cookie 94423244724992 notify 141733920781 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x55e09ffe29c0 con 0x55e0a0025400 2024-09-13T23:57:01.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.646+0000 7f9e87454700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920781 cookie 94423244724992 notifier 4432 bl.length()=159 2024-09-13T23:57:01.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.646+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(67 notify.0 [notify cookie 94423246342400 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55e0a00d1200 con 0x55e0a0025400 2024-09-13T23:57:01.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.646+0000 7f9e87454700 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a01f4000 con 0x55e0a0025400 2024-09-13T23:57:01.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.646+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== watch-notify(notify_complete (2) cookie 94423246342400 notify 141733920781 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55e09ffe2b60 con 0x55e0a0025400 2024-09-13T23:57:01.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.646+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d1200 con 0x55e0a0025400 2024-09-13T23:57:01.651 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:01.651 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "foo", 2024-09-13T23:57:01.651 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Foo", 2024-09-13T23:57:01.652 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "foo@foo.com", 2024-09-13T23:57:01.652 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:57:01.652 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:57:01.652 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [ 2024-09-13T23:57:01.652 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:01.652 INFO:teuthology.orchestra.run.smithi173.stdout: "id": "foo:foo1", 2024-09-13T23:57:01.652 INFO:teuthology.orchestra.run.smithi173.stdout: "permissions": "full-control" 2024-09-13T23:57:01.652 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:01.652 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:01.652 INFO:teuthology.orchestra.run.smithi173.stdout: "id": "foo:foo2", 2024-09-13T23:57:01.652 INFO:teuthology.orchestra.run.smithi173.stdout: "permissions": "" 2024-09-13T23:57:01.652 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:01.652 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:01.652 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:57:01.653 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:01.653 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:57:01.653 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-09-13T23:57:01.653 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-09-13T23:57:01.653 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:01.653 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:01.653 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [ 2024-09-13T23:57:01.653 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:01.653 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo:foo2", 2024-09-13T23:57:01.653 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy" 2024-09-13T23:57:01.653 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:01.653 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:01.653 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:57:01.653 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:57:01.654 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:57:01.654 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:57:01.654 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:57:01.654 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:57:01.654 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:01.654 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:01.654 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:01.654 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:01.654 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:01.654 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:01.654 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:57:01.654 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:01.654 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:01.654 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:01.654 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:01.654 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:01.655 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:01.655 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:57:01.655 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:57:01.655 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:57:01.655 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:01.655 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:57:01.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.646+0000 7f9e7442e700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:01.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.646+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94423246340096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a01eec00 con 0x55e0a0025000 2024-09-13T23:57:01.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.650+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94423246340096] v33'83 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a0025000 2024-09-13T23:57:01.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.650+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94423244724992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a01ef000 con 0x55e0a0025400 2024-09-13T23:57:01.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.654+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94423244724992] v33'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d1200 con 0x55e0a0025400 2024-09-13T23:57:01.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.654+0000 7f9e8eca7f40 20 remove_watcher() i=0 2024-09-13T23:57:01.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.654+0000 7f9e8eca7f40 2 removed watcher, disabling cache 2024-09-13T23:57:01.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.654+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94423244726144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a01ef400 con 0x55e0a0025000 2024-09-13T23:57:01.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.654+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.1 v2:172.21.15.173:6808/3256211813 24 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94423244726144] v33'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a0025000 2024-09-13T23:57:01.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.654+0000 7f9e8eca7f40 20 remove_watcher() i=1 2024-09-13T23:57:01.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.654+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94423244727296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a01ef800 con 0x55e0a0025400 2024-09-13T23:57:01.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.658+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 27 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94423244727296] v33'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d1200 con 0x55e0a0025400 2024-09-13T23:57:01.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.658+0000 7f9e8eca7f40 20 remove_watcher() i=2 2024-09-13T23:57:01.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.658+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94423244728448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a01efc00 con 0x55e0a00e0000 2024-09-13T23:57:01.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.662+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94423244728448] v33'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a00e0000 2024-09-13T23:57:01.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.662+0000 7f9e8eca7f40 20 remove_watcher() i=3 2024-09-13T23:57:01.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.662+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94423244729600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e3000 con 0x55e0a0025400 2024-09-13T23:57:01.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.662+0000 7f9e8d460700 1 -- 172.21.15.173:0/902542094 <== osd.0 v2:172.21.15.87:6800/3507919120 28 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94423244729600] v33'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d1200 con 0x55e0a0025400 2024-09-13T23:57:01.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.662+0000 7f9e8eca7f40 20 remove_watcher() i=4 2024-09-13T23:57:01.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.662+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94423244730752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e3400 con 0x55e0a0025c00 2024-09-13T23:57:01.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.666+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94423244730752] v33'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d1440 con 0x55e0a0025c00 2024-09-13T23:57:01.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.666+0000 7f9e8eca7f40 20 remove_watcher() i=5 2024-09-13T23:57:01.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.666+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94423244731904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e3800 con 0x55e0a0025c00 2024-09-13T23:57:01.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.670+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94423244731904] v33'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d1440 con 0x55e0a0025c00 2024-09-13T23:57:01.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.670+0000 7f9e8eca7f40 20 remove_watcher() i=6 2024-09-13T23:57:01.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.670+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94423244733056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a00e2c00 con 0x55e0a00e0000 2024-09-13T23:57:01.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.670+0000 7f9e8dc61700 1 -- 172.21.15.173:0/902542094 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94423244733056] v33'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e0a00d0b40 con 0x55e0a00e0000 2024-09-13T23:57:01.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.670+0000 7f9e8eca7f40 20 remove_watcher() i=7 2024-09-13T23:57:01.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.670+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55e0a0025400 msgr2=0x55e09ff68100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.670+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/902542094 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55e0a0025400 0x55e09ff68100 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.670+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55e0a0025000 msgr2=0x55e09ff67b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.670+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/902542094 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55e0a0025000 0x55e09ff67b80 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.670+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55e0a00e0000 msgr2=0x55e09ff68c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.670+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/902542094 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55e0a00e0000 0x55e09ff68c00 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.670+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55e0a0025c00 msgr2=0x55e09ff68680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.670+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/902542094 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55e0a0025c00 0x55e09ff68680 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e0a0024c00 msgr2=0x55e09ff67600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/902542094 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e0a0024c00 0x55e09ff67600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55e09ff61920 tx=0x55e09fd85800 comp rx=0 tx=0).stop 2024-09-13T23:57:01.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81800 msgr2=0x55e09ff66b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/902542094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81800 0x55e09ff66b00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55e09ff61f80 tx=0x55e09fd85e00 comp rx=0 tx=0).stop 2024-09-13T23:57:01.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 reap_dead start 2024-09-13T23:57:01.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8cc5f700 1 -- 172.21.15.173:0/902542094 reap_dead start 2024-09-13T23:57:01.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 shutdown_connections 2024-09-13T23:57:01.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 >> 172.21.15.173:0/902542094 conn(0x55e09fc81400 msgr2=0x55e09fd81800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 shutdown_connections 2024-09-13T23:57:01.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/902542094 wait complete. 2024-09-13T23:57:01.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/995707049 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e0a0025800 msgr2=0x55e0a0178000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/995707049 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e0a0025800 0x55e0a0178000 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55e0a007f4d0 tx=0x55e0a013eae0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/995707049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0a00e0400 msgr2=0x55e09ff69180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/995707049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0a00e0400 0x55e09ff69180 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55e0a00f0210 tx=0x55e09ffe5c20 comp rx=0 tx=0).stop 2024-09-13T23:57:01.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/995707049 shutdown_connections 2024-09-13T23:57:01.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/995707049 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e0a0025800 0x55e0a0178000 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/995707049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0a00e0400 0x55e09ff69180 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/995707049 >> 172.21.15.173:0/995707049 conn(0x55e0a00e2800 msgr2=0x55e09fd82000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/995707049 shutdown_connections 2024-09-13T23:57:01.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/995707049 wait complete. 2024-09-13T23:57:01.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/7218723 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e0a0024000 msgr2=0x55e09ff67080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/7218723 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e0a0024000 0x55e09ff67080 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55e09ffb3560 tx=0x55e09ffe4240 comp rx=0 tx=0).stop 2024-09-13T23:57:01.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/7218723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81000 msgr2=0x55e09ff66580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/7218723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81000 0x55e09ff66580 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55e0a0a4be00 tx=0x55e09fd85920 comp rx=0 tx=0).stop 2024-09-13T23:57:01.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/7218723 shutdown_connections 2024-09-13T23:57:01.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/7218723 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e0a0024000 0x55e09ff67080 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 --2- 172.21.15.173:0/7218723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e09fc81000 0x55e09ff66580 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/7218723 >> 172.21.15.173:0/7218723 conn(0x55e09fc80c00 msgr2=0x55e09fd81000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/7218723 shutdown_connections 2024-09-13T23:57:01.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.674+0000 7f9e8eca7f40 1 -- 172.21.15.173:0/7218723 wait complete. 2024-09-13T23:57:01.685 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:57:01.685 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-13T23:57:01.686 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-13T23:57:01.686 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-13T23:57:01.772 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:01.773 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:01.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f4931785f40 1 Processor -- start 2024-09-13T23:57:01.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f4931785f40 1 -- start start 2024-09-13T23:57:01.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f4931785f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x56372287b400 0x563722b60580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f4931785f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56372293f500 con 0x56372287b000 2024-09-13T23:57:01.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f4931785f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x563722908a00 con 0x56372287b400 2024-09-13T23:57:01.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f492f73d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x56372287b400 0x563722b60580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f492f73d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x56372287b400 0x563722b60580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49288/0 (socket says 172.21.15.173:49288) 2024-09-13T23:57:01.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f492f73d700 1 -- 172.21.15.173:0/3365835186 learned_addr learned my addr 172.21.15.173:0/3365835186 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f492ff3e700 1 --1- 172.21.15.173:0/3365835186 >> v1:172.21.15.87:6789/0 conn(0x56372287b000 0x56372297a800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47348/0 (socket says 172.21.15.173:47348) 2024-09-13T23:57:01.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f492f73d700 1 -- 172.21.15.173:0/3365835186 >> v1:172.21.15.87:6789/0 conn(0x56372287b000 legacy=0x56372297a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f492f73d700 1 -- 172.21.15.173:0/3365835186 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56372288dd40 con 0x56372287b400 2024-09-13T23:57:01.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f492f73d700 1 --2- 172.21.15.173:0/3365835186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b400 0x563722b60580 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x563722b5b920 tx=0x56372297f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9473067e4594ffe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f492ef3c700 1 -- 172.21.15.173:0/3365835186 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56372291f4a0 con 0x56372287b400 2024-09-13T23:57:01.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f492ef3c700 1 -- 172.21.15.173:0/3365835186 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56372293f800 con 0x56372287b400 2024-09-13T23:57:01.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f492ef3c700 1 -- 172.21.15.173:0/3365835186 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56372291f600 con 0x56372287b400 2024-09-13T23:57:01.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f4931785f40 1 -- 172.21.15.173:0/3365835186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b400 msgr2=0x563722b60580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f4931785f40 1 --2- 172.21.15.173:0/3365835186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b400 0x563722b60580 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x563722b5b920 tx=0x56372297f920 comp rx=0 tx=0).stop 2024-09-13T23:57:01.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f4931785f40 1 -- 172.21.15.173:0/3365835186 shutdown_connections 2024-09-13T23:57:01.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f4931785f40 1 --2- 172.21.15.173:0/3365835186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b400 0x563722b60580 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f4931785f40 1 -- 172.21.15.173:0/3365835186 >> 172.21.15.173:0/3365835186 conn(0x56372287ac00 msgr2=0x56372297a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f4931785f40 1 -- 172.21.15.173:0/3365835186 shutdown_connections 2024-09-13T23:57:01.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f4931785f40 1 -- 172.21.15.173:0/3365835186 wait complete. 2024-09-13T23:57:01.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f4931785f40 1 Processor -- start 2024-09-13T23:57:01.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f4931785f40 1 -- start start 2024-09-13T23:57:01.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f4931785f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b000 0x563722b60580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.770+0000 7f4931785f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563722908500 con 0x56372287b000 2024-09-13T23:57:01.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.774+0000 7f492ff3e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b000 0x563722b60580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.774+0000 7f492ff3e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b000 0x563722b60580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49302/0 (socket says 172.21.15.173:49302) 2024-09-13T23:57:01.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.774+0000 7f492ff3e700 1 -- 172.21.15.173:0/2422505474 learned_addr learned my addr 172.21.15.173:0/2422505474 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.774+0000 7f492ff3e700 1 -- 172.21.15.173:0/2422505474 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56372288dba0 con 0x56372287b000 2024-09-13T23:57:01.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.774+0000 7f492ff3e700 1 --2- 172.21.15.173:0/2422505474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b000 0x563722b60580 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x5637229d7e90 tx=0x56372297fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0609e19ccd87829 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.774+0000 7f492e73b700 1 -- 172.21.15.173:0/2422505474 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56372291f1e0 con 0x56372287b000 2024-09-13T23:57:01.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.774+0000 7f492e73b700 1 -- 172.21.15.173:0/2422505474 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56372293fb00 con 0x56372287b000 2024-09-13T23:57:01.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.774+0000 7f492e73b700 1 -- 172.21.15.173:0/2422505474 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56372291f4a0 con 0x56372287b000 2024-09-13T23:57:01.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.774+0000 7f4931785f40 1 -- 172.21.15.173:0/2422505474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b000 msgr2=0x563722b60580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.774+0000 7f4931785f40 1 --2- 172.21.15.173:0/2422505474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b000 0x563722b60580 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x5637229d7e90 tx=0x56372297fb60 comp rx=0 tx=0).stop 2024-09-13T23:57:01.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.774+0000 7f4931785f40 1 -- 172.21.15.173:0/2422505474 shutdown_connections 2024-09-13T23:57:01.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.774+0000 7f4931785f40 1 --2- 172.21.15.173:0/2422505474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b000 0x563722b60580 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.774+0000 7f4931785f40 1 -- 172.21.15.173:0/2422505474 >> 172.21.15.173:0/2422505474 conn(0x56372287ac00 msgr2=0x56372297b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.774+0000 7f4931785f40 1 -- 172.21.15.173:0/2422505474 shutdown_connections 2024-09-13T23:57:01.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.774+0000 7f4931785f40 1 -- 172.21.15.173:0/2422505474 wait complete. 2024-09-13T23:57:01.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.774+0000 7f4931785f40 1 Processor -- start 2024-09-13T23:57:01.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.774+0000 7f4931785f40 1 -- start start 2024-09-13T23:57:01.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.774+0000 7f4931785f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b000 0x563722b60580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.774+0000 7f4931785f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637229083c0 con 0x56372287b000 2024-09-13T23:57:01.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.774+0000 7f492ff3e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b000 0x563722b60580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.774+0000 7f492ff3e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b000 0x563722b60580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49306/0 (socket says 172.21.15.173:49306) 2024-09-13T23:57:01.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.774+0000 7f492ff3e700 1 -- 172.21.15.173:0/4057333512 learned_addr learned my addr 172.21.15.173:0/4057333512 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.778+0000 7f492ff3e700 1 -- 172.21.15.173:0/4057333512 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56372288da00 con 0x56372287b000 2024-09-13T23:57:01.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.778+0000 7f492ff3e700 1 --2- 172.21.15.173:0/4057333512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b000 0x563722b60580 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x5637236ee0f0 tx=0x56372297fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.778+0000 7f492cf38700 1 -- 172.21.15.173:0/4057333512 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56372291f600 con 0x56372287b000 2024-09-13T23:57:01.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.778+0000 7f492cf38700 1 -- 172.21.15.173:0/4057333512 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56372293fc80 con 0x56372287b000 2024-09-13T23:57:01.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.778+0000 7f4931785f40 1 -- 172.21.15.173:0/4057333512 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56372288d860 con 0x56372287b000 2024-09-13T23:57:01.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.778+0000 7f492cf38700 1 -- 172.21.15.173:0/4057333512 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56372291f1e0 con 0x56372287b000 2024-09-13T23:57:01.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.778+0000 7f4931785f40 1 -- 172.21.15.173:0/4057333512 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56372288d6c0 con 0x56372287b000 2024-09-13T23:57:01.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.778+0000 7f4931785f40 1 Processor -- start 2024-09-13T23:57:01.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.778+0000 7f4931785f40 1 -- start start 2024-09-13T23:57:01.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.778+0000 7f492cf38700 1 -- 172.21.15.173:0/4057333512 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x563722974b00 con 0x56372287b000 2024-09-13T23:57:01.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.778+0000 7f4931785f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b800 0x563722b60b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.778+0000 7f4931785f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637228a0640 con 0x56372287b800 2024-09-13T23:57:01.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.778+0000 7f493073f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b800 0x563722b60b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.778+0000 7f492cf38700 1 --2- 172.21.15.173:0/4057333512 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563722c22000 0x563722b61080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.778+0000 7f493073f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b800 0x563722b60b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49310/0 (socket says 172.21.15.173:49310) 2024-09-13T23:57:01.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.778+0000 7f493073f700 1 -- 172.21.15.173:0/115607162 learned_addr learned my addr 172.21.15.173:0/115607162 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.778+0000 7f492cf38700 1 -- 172.21.15.173:0/4057333512 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5637228e1180 con 0x56372287b000 2024-09-13T23:57:01.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.778+0000 7f492ff3e700 1 --2- 172.21.15.173:0/4057333512 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563722c22000 0x563722b61080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.778+0000 7f493073f700 1 -- 172.21.15.173:0/115607162 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56372288c000 con 0x56372287b800 2024-09-13T23:57:01.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.782+0000 7f493073f700 1 --2- 172.21.15.173:0/115607162 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b800 0x563722b60b00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x5637229d7ef0 tx=0x563722be4a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71fc1ec7f6a2fafa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.782+0000 7f492ff3e700 1 --2- 172.21.15.173:0/4057333512 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563722c22000 0x563722b61080 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x5637236ef620 tx=0x563722be4240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.782+0000 7f492a733700 1 -- 172.21.15.173:0/115607162 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56372291f600 con 0x56372287b800 2024-09-13T23:57:01.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.782+0000 7f492a733700 1 -- 172.21.15.173:0/115607162 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563722c3e000 con 0x56372287b800 2024-09-13T23:57:01.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.782+0000 7f492a733700 1 -- 172.21.15.173:0/115607162 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56372291f1e0 con 0x56372287b800 2024-09-13T23:57:01.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.782+0000 7f4931785f40 1 -- 172.21.15.173:0/115607162 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b800 msgr2=0x563722b60b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.782+0000 7f4931785f40 1 --2- 172.21.15.173:0/115607162 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b800 0x563722b60b00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x5637229d7ef0 tx=0x563722be4a20 comp rx=0 tx=0).stop 2024-09-13T23:57:01.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.782+0000 7f4931785f40 1 -- 172.21.15.173:0/115607162 shutdown_connections 2024-09-13T23:57:01.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.782+0000 7f4931785f40 1 --2- 172.21.15.173:0/115607162 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b800 0x563722b60b00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.782+0000 7f4931785f40 1 -- 172.21.15.173:0/115607162 >> 172.21.15.173:0/115607162 conn(0x56372287b400 msgr2=0x56372297b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.782+0000 7f4931785f40 1 -- 172.21.15.173:0/115607162 shutdown_connections 2024-09-13T23:57:01.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.782+0000 7f4931785f40 1 -- 172.21.15.173:0/115607162 wait complete. 2024-09-13T23:57:01.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.782+0000 7f4931785f40 1 Processor -- start 2024-09-13T23:57:01.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.782+0000 7f4931785f40 1 -- start start 2024-09-13T23:57:01.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.782+0000 7f4931785f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b800 0x563722b60b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.782+0000 7f4931785f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637228a08c0 con 0x56372287b800 2024-09-13T23:57:01.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.782+0000 7f493073f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b800 0x563722b60b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.782+0000 7f493073f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b800 0x563722b60b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49312/0 (socket says 172.21.15.173:49312) 2024-09-13T23:57:01.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.782+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 learned_addr learned my addr 172.21.15.173:0/2438377661 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.782+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56372288cea0 con 0x56372287b800 2024-09-13T23:57:01.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.786+0000 7f493073f700 1 --2- 172.21.15.173:0/2438377661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b800 0x563722b60b00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x5637229d7770 tx=0x563722be4840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.786+0000 7f4928f30700 1 -- 172.21.15.173:0/2438377661 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56372291fa20 con 0x56372287b800 2024-09-13T23:57:01.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.786+0000 7f4928f30700 1 -- 172.21.15.173:0/2438377661 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563722c3e180 con 0x56372287b800 2024-09-13T23:57:01.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.786+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56372288c820 con 0x56372287b800 2024-09-13T23:57:01.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.786+0000 7f4928f30700 1 -- 172.21.15.173:0/2438377661 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56372291f600 con 0x56372287b800 2024-09-13T23:57:01.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.786+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56372288c9c0 con 0x56372287b800 2024-09-13T23:57:01.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.786+0000 7f4931785f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.786+0000 7f4928f30700 1 -- 172.21.15.173:0/2438377661 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x563722974dc0 con 0x56372287b800 2024-09-13T23:57:01.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.786+0000 7f4928f30700 1 --2- 172.21.15.173:0/2438377661 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563722c22c00 0x563722b61600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.786+0000 7f4928f30700 1 -- 172.21.15.173:0/2438377661 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5637228e1340 con 0x56372287b800 2024-09-13T23:57:01.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.786+0000 7f4931785f40 1 --2- 172.21.15.173:0/2438377661 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563722c23000 0x563722b61b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.786+0000 7f492f73d700 1 --2- 172.21.15.173:0/2438377661 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563722c22c00 0x563722b61600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.786+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23400 con 0x563722c23000 2024-09-13T23:57:01.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.786+0000 7f493073f700 1 --2- 172.21.15.173:0/2438377661 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563722c23000 0x563722b61b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.786+0000 7f492f73d700 1 --2- 172.21.15.173:0/2438377661 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563722c22c00 0x563722b61600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x563722b5b920 tx=0x56372297f800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.786+0000 7f493073f700 1 --2- 172.21.15.173:0/2438377661 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563722c23000 0x563722b61b80 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.790+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563722cccb40 con 0x563722c23000 2024-09-13T23:57:01.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.790+0000 7f4931785f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.790+0000 7f4931785f40 20 realm 2024-09-13T23:57:01.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.790+0000 7f4931785f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.790+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23000 2024-09-13T23:57:01.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.790+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563722cccb40 con 0x563722c23000 2024-09-13T23:57:01.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.790+0000 7f4931785f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.790+0000 7f4931785f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:01.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.790+0000 7f4931785f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.790+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23c00 con 0x563722c23000 2024-09-13T23:57:01.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.790+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563722cccb40 con 0x563722c23000 2024-09-13T23:57:01.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.790+0000 7f4931785f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.790+0000 7f4931785f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.790+0000 7f4931785f40 1 --2- 172.21.15.173:0/2438377661 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563722c23400 0x563722b62100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.790+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23400 2024-09-13T23:57:01.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.790+0000 7f492ff3e700 1 --2- 172.21.15.173:0/2438377661 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563722c23400 0x563722b62100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.790+0000 7f492ff3e700 1 --2- 172.21.15.173:0/2438377661 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563722c23400 0x563722b62100 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.790+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x563722ccd200 con 0x563722c23400 2024-09-13T23:57:01.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.790+0000 7f4931785f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:01.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.790+0000 7f4931785f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.790+0000 7f4931785f40 1 --2- 172.21.15.173:0/2438377661 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563722c23c00 0x563722b62680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.790+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722ce6000 con 0x563722c23c00 2024-09-13T23:57:01.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.790+0000 7f492f73d700 1 --2- 172.21.15.173:0/2438377661 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563722c23c00 0x563722b62680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.790+0000 7f492f73d700 1 --2- 172.21.15.173:0/2438377661 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563722c23c00 0x563722b62680 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.794+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x563722ccd440 con 0x563722c23c00 2024-09-13T23:57:01.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.794+0000 7f4931785f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:01.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.794+0000 7f4931785f40 20 searching for the correct realm 2024-09-13T23:57:01.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.794+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722ce6400 con 0x563722c23c00 2024-09-13T23:57:01.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.794+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x563722ccd440 con 0x563722c23c00 2024-09-13T23:57:01.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.794+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722ce6000 con 0x563722c23400 2024-09-13T23:57:01.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.794+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722ccd200 con 0x563722c23400 2024-09-13T23:57:01.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.794+0000 7f492ff3e700 1 --2- 172.21.15.173:0/2438377661 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563722ce6000 0x563722b62c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.794+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722ce6000 2024-09-13T23:57:01.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.794+0000 7f493073f700 1 --2- 172.21.15.173:0/2438377661 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563722ce6000 0x563722b62c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.794+0000 7f493073f700 1 --2- 172.21.15.173:0/2438377661 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563722ce6000 0x563722b62c00 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.794+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722cccb40 con 0x563722ce6000 2024-09-13T23:57:01.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.794+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23000 2024-09-13T23:57:01.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.794+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x563722cccb40 con 0x563722c23000 2024-09-13T23:57:01.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.794+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23000 2024-09-13T23:57:01.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.798+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722cccb40 con 0x563722c23000 2024-09-13T23:57:01.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.798+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23c00 2024-09-13T23:57:01.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.798+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722ccd440 con 0x563722c23c00 2024-09-13T23:57:01.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.798+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23000 2024-09-13T23:57:01.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.798+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722cccb40 con 0x563722c23000 2024-09-13T23:57:01.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.798+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23400 2024-09-13T23:57:01.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.798+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722ccd200 con 0x563722c23400 2024-09-13T23:57:01.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.798+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23400 2024-09-13T23:57:01.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.798+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722ccd200 con 0x563722c23400 2024-09-13T23:57:01.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.798+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23000 2024-09-13T23:57:01.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.798+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722cccb40 con 0x563722c23000 2024-09-13T23:57:01.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.798+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722ce6000 2024-09-13T23:57:01.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.798+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722cccb40 con 0x563722ce6000 2024-09-13T23:57:01.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.798+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23000 2024-09-13T23:57:01.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.802+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722cccb40 con 0x563722c23000 2024-09-13T23:57:01.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.802+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722ce6000 2024-09-13T23:57:01.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.802+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722cccb40 con 0x563722ce6000 2024-09-13T23:57:01.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.802+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23400 2024-09-13T23:57:01.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.802+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722ccd200 con 0x563722c23400 2024-09-13T23:57:01.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.802+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23c00 2024-09-13T23:57:01.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.802+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722ccd440 con 0x563722c23c00 2024-09-13T23:57:01.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.802+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23000 2024-09-13T23:57:01.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.802+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722cccb40 con 0x563722c23000 2024-09-13T23:57:01.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.802+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23400 2024-09-13T23:57:01.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.802+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722ccd200 con 0x563722c23400 2024-09-13T23:57:01.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.802+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23c00 2024-09-13T23:57:01.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.806+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722ccd440 con 0x563722c23c00 2024-09-13T23:57:01.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.806+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23000 2024-09-13T23:57:01.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.806+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722cccb40 con 0x563722c23000 2024-09-13T23:57:01.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.806+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23000 2024-09-13T23:57:01.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.806+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722cccb40 con 0x563722c23000 2024-09-13T23:57:01.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.806+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23000 2024-09-13T23:57:01.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.806+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722cccb40 con 0x563722c23000 2024-09-13T23:57:01.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.806+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23c00 2024-09-13T23:57:01.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.806+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722ccd440 con 0x563722c23c00 2024-09-13T23:57:01.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.806+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722ce6000 2024-09-13T23:57:01.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.806+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722cccb40 con 0x563722ce6000 2024-09-13T23:57:01.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.806+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23000 2024-09-13T23:57:01.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.806+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722cccb40 con 0x563722c23000 2024-09-13T23:57:01.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.806+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722ce6000 2024-09-13T23:57:01.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.806+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722cccb40 con 0x563722ce6000 2024-09-13T23:57:01.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.806+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23c00 2024-09-13T23:57:01.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.810+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722ccd440 con 0x563722c23c00 2024-09-13T23:57:01.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.810+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722ce6000 2024-09-13T23:57:01.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.810+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722cccb40 con 0x563722ce6000 2024-09-13T23:57:01.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.810+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23400 2024-09-13T23:57:01.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.810+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722ccd200 con 0x563722c23400 2024-09-13T23:57:01.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.810+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23400 2024-09-13T23:57:01.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.810+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722ccd200 con 0x563722c23400 2024-09-13T23:57:01.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.810+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23c00 2024-09-13T23:57:01.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.810+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722ccd440 con 0x563722c23c00 2024-09-13T23:57:01.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.810+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23400 2024-09-13T23:57:01.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x563722ccd200 con 0x563722c23400 2024-09-13T23:57:01.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722c23400 2024-09-13T23:57:01.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563722ccd200 con 0x563722c23400 2024-09-13T23:57:01.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f4931785f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:01.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f4931785f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:01.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f4931785f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:01.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f4931785f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:01.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f4931785f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722ce6800 con 0x563722c23000 2024-09-13T23:57:01.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563722cccb40 con 0x563722c23000 2024-09-13T23:57:01.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f4931785f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f4931785f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722ce6c00 con 0x563722c23400 2024-09-13T23:57:01.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x563722ccd200 con 0x563722c23400 2024-09-13T23:57:01.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f4931785f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:01.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f4931785f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722ce7000 con 0x563722c23000 2024-09-13T23:57:01.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x563722cccb40 con 0x563722c23000 2024-09-13T23:57:01.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f4931785f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:01.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f4931785f40 20 zone default found 2024-09-13T23:57:01.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f4931785f40 4 Realm: () 2024-09-13T23:57:01.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f4931785f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:01.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f4931785f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:01.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f4931785f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:01.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f4931785f40 20 zonegroup default 2024-09-13T23:57:01.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f4931785f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722ce7400 con 0x563722ce6000 2024-09-13T23:57:01.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x563722cccb40 con 0x563722ce6000 2024-09-13T23:57:01.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f4931785f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f4931785f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.814+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722ce7800 con 0x563722c23c00 2024-09-13T23:57:01.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.818+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x563722ccd440 con 0x563722c23c00 2024-09-13T23:57:01.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.818+0000 7f4931785f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.818+0000 7f4931785f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.818+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722ce7c00 con 0x563722c23c00 2024-09-13T23:57:01.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.818+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x563722ccd440 con 0x563722c23c00 2024-09-13T23:57:01.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.818+0000 7f4931785f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.818+0000 7f4931785f40 20 started sync module instance, tier type = 2024-09-13T23:57:01.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.818+0000 7f4931785f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:01.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.818+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722bce000 con 0x563722c23400 2024-09-13T23:57:01.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.822+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722ccd200 con 0x563722c23400 2024-09-13T23:57:01.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.822+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94794805508864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722bce400 con 0x563722c23400 2024-09-13T23:57:01.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.822+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722bce800 con 0x563722c23000 2024-09-13T23:57:01.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.822+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722cccb40 con 0x563722c23000 2024-09-13T23:57:01.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.822+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94794805510016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722bcec00 con 0x563722c23000 2024-09-13T23:57:01.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.822+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94794805508864] v33'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722ccd200 con 0x563722c23400 2024-09-13T23:57:01.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.826+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722bcf000 con 0x563722c23400 2024-09-13T23:57:01.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.826+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94794805510016] v33'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722cccb40 con 0x563722c23000 2024-09-13T23:57:01.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.826+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722ccd200 con 0x563722c23400 2024-09-13T23:57:01.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.826+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94794805511168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722bcf400 con 0x563722c23400 2024-09-13T23:57:01.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.826+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722bcf800 con 0x563722ce6000 2024-09-13T23:57:01.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.830+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722cccb40 con 0x563722ce6000 2024-09-13T23:57:01.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.830+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94794805512320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722bcfc00 con 0x563722ce6000 2024-09-13T23:57:01.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.830+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722bce800 con 0x563722c23400 2024-09-13T23:57:01.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.830+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94794805511168] v33'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722ccd200 con 0x563722c23400 2024-09-13T23:57:01.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.830+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94794805512320] v33'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722cccb40 con 0x563722ce6000 2024-09-13T23:57:01.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.830+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722ccd200 con 0x563722c23400 2024-09-13T23:57:01.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.830+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94794805513472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722bce000 con 0x563722c23400 2024-09-13T23:57:01.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.830+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722ce6800 con 0x563722c23c00 2024-09-13T23:57:01.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.834+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722ccd440 con 0x563722c23c00 2024-09-13T23:57:01.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.834+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94794805514624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722ce7000 con 0x563722c23c00 2024-09-13T23:57:01.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.834+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722ce7400 con 0x563722c23c00 2024-09-13T23:57:01.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.834+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94794805513472] v33'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722ccd200 con 0x563722c23400 2024-09-13T23:57:01.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.834+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94794805514624] v33'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722ccd440 con 0x563722c23c00 2024-09-13T23:57:01.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.838+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722ccd440 con 0x563722c23c00 2024-09-13T23:57:01.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.838+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94794805515776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722ce6c00 con 0x563722c23c00 2024-09-13T23:57:01.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.838+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722c23800 con 0x563722ce6000 2024-09-13T23:57:01.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.838+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94794805515776] v33'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722ccd440 con 0x563722c23c00 2024-09-13T23:57:01.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.838+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722cccb40 con 0x563722ce6000 2024-09-13T23:57:01.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.838+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94794805516928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722bce400 con 0x563722ce6000 2024-09-13T23:57:01.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.838+0000 7f4931785f40 20 add_watcher() i=0 2024-09-13T23:57:01.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.838+0000 7f4931785f40 20 add_watcher() i=1 2024-09-13T23:57:01.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.838+0000 7f4931785f40 20 add_watcher() i=2 2024-09-13T23:57:01.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.838+0000 7f4931785f40 20 add_watcher() i=3 2024-09-13T23:57:01.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.838+0000 7f4931785f40 20 add_watcher() i=4 2024-09-13T23:57:01.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.838+0000 7f4931785f40 20 add_watcher() i=5 2024-09-13T23:57:01.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.838+0000 7f4931785f40 20 add_watcher() i=6 2024-09-13T23:57:01.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.842+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94794805516928] v33'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722cccb40 con 0x563722ce6000 2024-09-13T23:57:01.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.842+0000 7f4931785f40 20 add_watcher() i=7 2024-09-13T23:57:01.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.842+0000 7f4931785f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:01.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.842+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722bcf000 con 0x563722c23000 2024-09-13T23:57:01.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.842+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x563722cccb40 con 0x563722c23000 2024-09-13T23:57:01.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.842+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94794807214080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722bcf400 con 0x563722c23000 2024-09-13T23:57:01.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.842+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94794807214080] v33'84 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x563722cccb40 con 0x563722c23000 2024-09-13T23:57:01.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.842+0000 7f4916f0c700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:01.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.842+0000 7f4931785f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:01.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.842+0000 7f4931785f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:01.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.842+0000 7f4931785f40 1 Processor -- start 2024-09-13T23:57:01.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.842+0000 7f4931785f40 1 -- start start 2024-09-13T23:57:01.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.842+0000 7f4931785f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563722ce6400 0x563722b63180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.842+0000 7f4931785f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637229083c0 con 0x563722ce6400 2024-09-13T23:57:01.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.846+0000 7f492f73d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563722ce6400 0x563722b63180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.846+0000 7f492f73d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563722ce6400 0x563722b63180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49316/0 (socket says 172.21.15.173:49316) 2024-09-13T23:57:01.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.846+0000 7f492f73d700 1 -- 172.21.15.173:0/4093663348 learned_addr learned my addr 172.21.15.173:0/4093663348 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.846+0000 7f492f73d700 1 -- 172.21.15.173:0/4093663348 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56372288cb60 con 0x563722ce6400 2024-09-13T23:57:01.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.846+0000 7f492f73d700 1 --2- 172.21.15.173:0/4093663348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563722ce6400 0x563722b63180 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x563722d020f0 tx=0x56372297f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386bf0bb0b64043a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.846+0000 7f491670b700 1 -- 172.21.15.173:0/4093663348 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56372291f760 con 0x563722ce6400 2024-09-13T23:57:01.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.846+0000 7f491670b700 1 -- 172.21.15.173:0/4093663348 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563722c3e600 con 0x563722ce6400 2024-09-13T23:57:01.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.846+0000 7f491670b700 1 -- 172.21.15.173:0/4093663348 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563722d0a000 con 0x563722ce6400 2024-09-13T23:57:01.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.846+0000 7f4931785f40 1 -- 172.21.15.173:0/4093663348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563722ce6400 msgr2=0x563722b63180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.846+0000 7f4931785f40 1 --2- 172.21.15.173:0/4093663348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563722ce6400 0x563722b63180 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x563722d020f0 tx=0x56372297f980 comp rx=0 tx=0).stop 2024-09-13T23:57:01.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.846+0000 7f4931785f40 1 -- 172.21.15.173:0/4093663348 shutdown_connections 2024-09-13T23:57:01.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.846+0000 7f4931785f40 1 --2- 172.21.15.173:0/4093663348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563722ce6400 0x563722b63180 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.846+0000 7f4931785f40 1 -- 172.21.15.173:0/4093663348 >> 172.21.15.173:0/4093663348 conn(0x563722bce800 msgr2=0x56372297c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.846+0000 7f4931785f40 1 -- 172.21.15.173:0/4093663348 shutdown_connections 2024-09-13T23:57:01.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.846+0000 7f4931785f40 1 -- 172.21.15.173:0/4093663348 wait complete. 2024-09-13T23:57:01.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.846+0000 7f4931785f40 1 Processor -- start 2024-09-13T23:57:01.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.846+0000 7f4931785f40 1 -- start start 2024-09-13T23:57:01.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.846+0000 7f4931785f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563722ce6400 0x563722b63180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.846+0000 7f4931785f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563722908500 con 0x563722ce6400 2024-09-13T23:57:01.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.846+0000 7f492f73d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563722ce6400 0x563722b63180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.846+0000 7f492f73d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563722ce6400 0x563722b63180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49332/0 (socket says 172.21.15.173:49332) 2024-09-13T23:57:01.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.846+0000 7f492f73d700 1 -- 172.21.15.173:0/4201067641 learned_addr learned my addr 172.21.15.173:0/4201067641 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.850+0000 7f492f73d700 1 -- 172.21.15.173:0/4201067641 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56372288cd00 con 0x563722ce6400 2024-09-13T23:57:01.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.850+0000 7f492f73d700 1 --2- 172.21.15.173:0/4201067641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563722ce6400 0x563722b63180 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x563722d02390 tx=0x563722be5c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.850+0000 7f4914f08700 1 -- 172.21.15.173:0/4201067641 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563722d0a160 con 0x563722ce6400 2024-09-13T23:57:01.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.850+0000 7f4914f08700 1 -- 172.21.15.173:0/4201067641 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563722c3e300 con 0x563722ce6400 2024-09-13T23:57:01.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.850+0000 7f4931785f40 1 -- 172.21.15.173:0/4201067641 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56372288c340 con 0x563722ce6400 2024-09-13T23:57:01.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.850+0000 7f4914f08700 1 -- 172.21.15.173:0/4201067641 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563722d0a2c0 con 0x563722ce6400 2024-09-13T23:57:01.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.850+0000 7f4931785f40 1 -- 172.21.15.173:0/4201067641 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56372288dd40 con 0x563722ce6400 2024-09-13T23:57:01.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.850+0000 7f4914f08700 1 -- 172.21.15.173:0/4201067641 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x563722975b80 con 0x563722ce6400 2024-09-13T23:57:01.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.850+0000 7f4914f08700 1 --2- 172.21.15.173:0/4201067641 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563722c23800 0x563722d80000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.850+0000 7f4914f08700 1 -- 172.21.15.173:0/4201067641 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5637228e1500 con 0x563722ce6400 2024-09-13T23:57:01.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.850+0000 7f4931785f40 5 note: GC not initialized 2024-09-13T23:57:01.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.850+0000 7f493073f700 1 --2- 172.21.15.173:0/4201067641 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563722c23800 0x563722d80000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.850+0000 7f493073f700 1 --2- 172.21.15.173:0/4201067641 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563722c23800 0x563722d80000 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x563722c7b6e0 tx=0x563722d48ae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.854+0000 7f4912703700 20 reqs_thread_entry: start 2024-09-13T23:57:01.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.854+0000 7f4931785f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:01.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.854+0000 7f4931785f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:01.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.854+0000 7f490fefe700 20 reqs_thread_entry: start 2024-09-13T23:57:01.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.854+0000 7f4931785f40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:57:01.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.854+0000 7f4931785f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.854+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722ce6800 con 0x563722c23000 2024-09-13T23:57:01.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.854+0000 7f49106ff700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:32 2024 2024-09-13T23:57:01.859 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:01.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.854+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~539 out=539b,getxattrs out=75b] v0'0 uv9 ondisk = 0) v8 ==== 231+0+662 (crc 0 0 0) 0x563722cccb40 con 0x563722c23000 2024-09-13T23:57:01.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.854+0000 7f4931785f40 20 rados_obj.operate() r=0 bl.length=539 2024-09-13T23:57:01.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.854+0000 7f4931785f40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:57:01.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.854+0000 7f4931785f40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:01.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.854+0000 7f4931785f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:01.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.854+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~513 in=513b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722bcf800 con 0x563722c23000 2024-09-13T23:57:01.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.858+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~513] v33'10 uv10 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x563722cccb40 con 0x563722c23000 2024-09-13T23:57:01.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.858+0000 7f4931785f40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:57:01.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.858+0000 7f4931785f40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:01.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.858+0000 7f4931785f40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:57:01.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.858+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94794807216384 in=701b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722bcfc00 con 0x563722c23400 2024-09-13T23:57:01.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.858+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== watch-notify(notify (1) cookie 94794805513472 notify 141733920782 ret 0) v3 ==== 731+0+0 (crc 0 0 0) 0x563722be2820 con 0x563722c23400 2024-09-13T23:57:01.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.858+0000 7f492a733700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920782 cookie 94794805513472 notifier 4440 bl.length()=689 2024-09-13T23:57:01.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.858+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(64 notify.4 [notify cookie 94794807216384 out=8b] v0'0 uv75 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x563722ccd200 con 0x563722c23400 2024-09-13T23:57:01.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.858+0000 7f492a733700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:57:01.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.858+0000 7f492a733700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:01.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.858+0000 7f492a733700 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722df2000 con 0x563722c23400 2024-09-13T23:57:01.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.858+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722ccd200 con 0x563722c23400 2024-09-13T23:57:01.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.858+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== watch-notify(notify_complete (2) cookie 94794807216384 notify 141733920782 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x563722be29c0 con 0x563722c23400 2024-09-13T23:57:01.864 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:01.864 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "foo", 2024-09-13T23:57:01.864 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Foo", 2024-09-13T23:57:01.864 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "foo@foo.com", 2024-09-13T23:57:01.864 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:57:01.864 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:57:01.864 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [ 2024-09-13T23:57:01.864 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:01.864 INFO:teuthology.orchestra.run.smithi173.stdout: "id": "foo:foo2", 2024-09-13T23:57:01.864 INFO:teuthology.orchestra.run.smithi173.stdout: "permissions": "" 2024-09-13T23:57:01.865 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:01.865 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:01.865 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:57:01.865 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:01.865 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:57:01.865 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-09-13T23:57:01.865 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-09-13T23:57:01.865 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:01.865 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:01.865 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [ 2024-09-13T23:57:01.865 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:01.865 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo:foo2", 2024-09-13T23:57:01.865 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy" 2024-09-13T23:57:01.865 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:01.866 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:01.866 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:57:01.866 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:57:01.866 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:57:01.866 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:57:01.866 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:57:01.866 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:57:01.866 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:01.866 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:01.866 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:01.866 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:01.866 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:01.866 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:01.866 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:57:01.867 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:01.867 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:01.867 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:01.867 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:01.867 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:01.867 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:01.867 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:57:01.867 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:57:01.867 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:57:01.867 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:01.867 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:57:01.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.858+0000 7f4916f0c700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:01.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.858+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94794807214080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722bce400 con 0x563722c23000 2024-09-13T23:57:01.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.862+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94794807214080] v33'85 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x563722cccb40 con 0x563722c23000 2024-09-13T23:57:01.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.862+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94794805508864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722df2800 con 0x563722c23400 2024-09-13T23:57:01.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.866+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94794805508864] v33'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722ccd200 con 0x563722c23400 2024-09-13T23:57:01.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.866+0000 7f4931785f40 20 remove_watcher() i=0 2024-09-13T23:57:01.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.866+0000 7f4931785f40 2 removed watcher, disabling cache 2024-09-13T23:57:01.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.866+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94794805510016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722df2c00 con 0x563722c23000 2024-09-13T23:57:01.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.866+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94794805510016] v33'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722cccb40 con 0x563722c23000 2024-09-13T23:57:01.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.866+0000 7f4931785f40 20 remove_watcher() i=1 2024-09-13T23:57:01.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.866+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94794805511168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722df3000 con 0x563722c23400 2024-09-13T23:57:01.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.870+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94794805511168] v33'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722ccd200 con 0x563722c23400 2024-09-13T23:57:01.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.870+0000 7f4931785f40 20 remove_watcher() i=2 2024-09-13T23:57:01.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.870+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94794805512320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722df3400 con 0x563722ce6000 2024-09-13T23:57:01.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.870+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94794805512320] v33'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722cccb40 con 0x563722ce6000 2024-09-13T23:57:01.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.870+0000 7f4931785f40 20 remove_watcher() i=3 2024-09-13T23:57:01.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.870+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94794805513472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722df3800 con 0x563722c23400 2024-09-13T23:57:01.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.874+0000 7f492ff3e700 1 -- 172.21.15.173:0/2438377661 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94794805513472] v33'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722ccd200 con 0x563722c23400 2024-09-13T23:57:01.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.874+0000 7f4931785f40 20 remove_watcher() i=4 2024-09-13T23:57:01.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.874+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94794805514624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722df3c00 con 0x563722c23c00 2024-09-13T23:57:01.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.878+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94794805514624] v33'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722ccd440 con 0x563722c23c00 2024-09-13T23:57:01.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.878+0000 7f4931785f40 20 remove_watcher() i=5 2024-09-13T23:57:01.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.878+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94794805515776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722bcf000 con 0x563722c23c00 2024-09-13T23:57:01.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.878+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94794805515776] v33'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722ccd440 con 0x563722c23c00 2024-09-13T23:57:01.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.878+0000 7f4931785f40 20 remove_watcher() i=6 2024-09-13T23:57:01.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.878+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94794805516928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563722bcf400 con 0x563722ce6000 2024-09-13T23:57:01.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f493073f700 1 -- 172.21.15.173:0/2438377661 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94794805516928] v33'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563722cccb40 con 0x563722ce6000 2024-09-13T23:57:01.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 20 remove_watcher() i=7 2024-09-13T23:57:01.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563722c23400 msgr2=0x563722b62100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 --2- 172.21.15.173:0/2438377661 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563722c23400 0x563722b62100 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563722c23000 msgr2=0x563722b61b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 --2- 172.21.15.173:0/2438377661 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563722c23000 0x563722b61b80 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563722ce6000 msgr2=0x563722b62c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 --2- 172.21.15.173:0/2438377661 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563722ce6000 0x563722b62c00 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563722c23c00 msgr2=0x563722b62680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 --2- 172.21.15.173:0/2438377661 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563722c23c00 0x563722b62680 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563722c22c00 msgr2=0x563722b61600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 --2- 172.21.15.173:0/2438377661 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563722c22c00 0x563722b61600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x563722b5b920 tx=0x56372297f800 comp rx=0 tx=0).stop 2024-09-13T23:57:01.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b800 msgr2=0x563722b60b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 --2- 172.21.15.173:0/2438377661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b800 0x563722b60b00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x5637229d7770 tx=0x563722be4840 comp rx=0 tx=0).stop 2024-09-13T23:57:01.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 reap_dead start 2024-09-13T23:57:01.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 shutdown_connections 2024-09-13T23:57:01.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 >> 172.21.15.173:0/2438377661 conn(0x56372287b400 msgr2=0x56372297b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f492f73d700 1 -- 172.21.15.173:0/2438377661 reap_dead start 2024-09-13T23:57:01.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 shutdown_connections 2024-09-13T23:57:01.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 -- 172.21.15.173:0/2438377661 wait complete. 2024-09-13T23:57:01.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 -- 172.21.15.173:0/4201067641 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563722c23800 msgr2=0x563722d80000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 --2- 172.21.15.173:0/4201067641 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563722c23800 0x563722d80000 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x563722c7b6e0 tx=0x563722d48ae0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 -- 172.21.15.173:0/4201067641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563722ce6400 msgr2=0x563722b63180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 --2- 172.21.15.173:0/4201067641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563722ce6400 0x563722b63180 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x563722d02390 tx=0x563722be5c20 comp rx=0 tx=0).stop 2024-09-13T23:57:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 -- 172.21.15.173:0/4201067641 shutdown_connections 2024-09-13T23:57:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 --2- 172.21.15.173:0/4201067641 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563722c23800 0x563722d80000 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 --2- 172.21.15.173:0/4201067641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563722ce6400 0x563722b63180 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 -- 172.21.15.173:0/4201067641 >> 172.21.15.173:0/4201067641 conn(0x563722bce800 msgr2=0x56372297c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 -- 172.21.15.173:0/4201067641 shutdown_connections 2024-09-13T23:57:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.882+0000 7f4931785f40 1 -- 172.21.15.173:0/4201067641 wait complete. 2024-09-13T23:57:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.886+0000 7f4931785f40 1 -- 172.21.15.173:0/4057333512 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563722c22000 msgr2=0x563722b61080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.886+0000 7f4931785f40 1 --2- 172.21.15.173:0/4057333512 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563722c22000 0x563722b61080 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x5637236ef620 tx=0x563722be4240 comp rx=0 tx=0).stop 2024-09-13T23:57:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.886+0000 7f4931785f40 1 -- 172.21.15.173:0/4057333512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b000 msgr2=0x563722b60580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.886+0000 7f4931785f40 1 --2- 172.21.15.173:0/4057333512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b000 0x563722b60580 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x5637236ee0f0 tx=0x56372297fa40 comp rx=0 tx=0).stop 2024-09-13T23:57:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.886+0000 7f4931785f40 1 -- 172.21.15.173:0/4057333512 shutdown_connections 2024-09-13T23:57:01.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.886+0000 7f4931785f40 1 --2- 172.21.15.173:0/4057333512 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563722c22000 0x563722b61080 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.886+0000 7f4931785f40 1 --2- 172.21.15.173:0/4057333512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56372287b000 0x563722b60580 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.886+0000 7f4931785f40 1 -- 172.21.15.173:0/4057333512 >> 172.21.15.173:0/4057333512 conn(0x56372287ac00 msgr2=0x56372297b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.886+0000 7f4931785f40 1 -- 172.21.15.173:0/4057333512 shutdown_connections 2024-09-13T23:57:01.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.886+0000 7f4931785f40 1 -- 172.21.15.173:0/4057333512 wait complete. 2024-09-13T23:57:01.895 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:57:01.895 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-13T23:57:01.896 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-13T23:57:01.896 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-13T23:57:01.939 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:01.940 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:01.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.934+0000 7f091c33df40 1 Processor -- start 2024-09-13T23:57:01.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.934+0000 7f091c33df40 1 -- start start 2024-09-13T23:57:01.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.934+0000 7f091c33df40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x564d50f21400 0x564d51206580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.934+0000 7f091c33df40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564d50fe5500 con 0x564d50f21000 2024-09-13T23:57:01.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.934+0000 7f091c33df40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x564d50faea00 con 0x564d50f21400 2024-09-13T23:57:01.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.934+0000 7f091a2f5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x564d50f21400 0x564d51206580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.934+0000 7f091aaf6700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x564d50f21000 0x564d51020800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47360/0 (socket says 172.21.15.173:47360) 2024-09-13T23:57:01.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.934+0000 7f091a2f5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x564d50f21400 0x564d51206580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49344/0 (socket says 172.21.15.173:49344) 2024-09-13T23:57:01.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.934+0000 7f091aaf6700 1 -- 172.21.15.173:0/2699695159 learned_addr learned my addr 172.21.15.173:0/2699695159 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:01.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.938+0000 7f091a2f5700 1 -- 172.21.15.173:0/2699695159 >> v1:172.21.15.87:6789/0 conn(0x564d50f21000 legacy=0x564d51020800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.938+0000 7f091a2f5700 1 -- 172.21.15.173:0/2699695159 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d50f33d40 con 0x564d50f21400 2024-09-13T23:57:01.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.938+0000 7f091a2f5700 1 --2- 172.21.15.173:0/2699695159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21400 0x564d51206580 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x564d51201920 tx=0x564d51025920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4df307c7e5b5f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.938+0000 7f0919af4700 1 -- 172.21.15.173:0/2699695159 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d50fc54a0 con 0x564d50f21400 2024-09-13T23:57:01.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.938+0000 7f0919af4700 1 -- 172.21.15.173:0/2699695159 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564d50fe5800 con 0x564d50f21400 2024-09-13T23:57:01.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.938+0000 7f0919af4700 1 -- 172.21.15.173:0/2699695159 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d50fc5600 con 0x564d50f21400 2024-09-13T23:57:01.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.938+0000 7f091c33df40 1 -- 172.21.15.173:0/2699695159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21400 msgr2=0x564d51206580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.938+0000 7f091c33df40 1 --2- 172.21.15.173:0/2699695159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21400 0x564d51206580 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x564d51201920 tx=0x564d51025920 comp rx=0 tx=0).stop 2024-09-13T23:57:01.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.938+0000 7f091c33df40 1 -- 172.21.15.173:0/2699695159 shutdown_connections 2024-09-13T23:57:01.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.938+0000 7f091c33df40 1 --2- 172.21.15.173:0/2699695159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21400 0x564d51206580 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.938+0000 7f091c33df40 1 -- 172.21.15.173:0/2699695159 >> 172.21.15.173:0/2699695159 conn(0x564d50f20c00 msgr2=0x564d51020000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.938+0000 7f091c33df40 1 -- 172.21.15.173:0/2699695159 shutdown_connections 2024-09-13T23:57:01.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.938+0000 7f091c33df40 1 -- 172.21.15.173:0/2699695159 wait complete. 2024-09-13T23:57:01.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.938+0000 7f091c33df40 1 Processor -- start 2024-09-13T23:57:01.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.938+0000 7f091c33df40 1 -- start start 2024-09-13T23:57:01.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.938+0000 7f091c33df40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21000 0x564d51206580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.938+0000 7f091c33df40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d50fae500 con 0x564d50f21000 2024-09-13T23:57:01.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.938+0000 7f091aaf6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21000 0x564d51206580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.938+0000 7f091aaf6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21000 0x564d51206580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49346/0 (socket says 172.21.15.173:49346) 2024-09-13T23:57:01.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.938+0000 7f091aaf6700 1 -- 172.21.15.173:0/285417579 learned_addr learned my addr 172.21.15.173:0/285417579 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.942+0000 7f091aaf6700 1 -- 172.21.15.173:0/285417579 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d50f33ba0 con 0x564d50f21000 2024-09-13T23:57:01.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.942+0000 7f091aaf6700 1 --2- 172.21.15.173:0/285417579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21000 0x564d51206580 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x564d51d858c0 tx=0x564d51025b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=859623f5f1cf9bae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.942+0000 7f09192f3700 1 -- 172.21.15.173:0/285417579 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d50fc54a0 con 0x564d50f21000 2024-09-13T23:57:01.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.942+0000 7f09192f3700 1 -- 172.21.15.173:0/285417579 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564d50fe5b00 con 0x564d50f21000 2024-09-13T23:57:01.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.942+0000 7f09192f3700 1 -- 172.21.15.173:0/285417579 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d50fc5600 con 0x564d50f21000 2024-09-13T23:57:01.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.942+0000 7f091c33df40 1 -- 172.21.15.173:0/285417579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21000 msgr2=0x564d51206580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.942+0000 7f091c33df40 1 --2- 172.21.15.173:0/285417579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21000 0x564d51206580 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x564d51d858c0 tx=0x564d51025b60 comp rx=0 tx=0).stop 2024-09-13T23:57:01.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.942+0000 7f091c33df40 1 -- 172.21.15.173:0/285417579 shutdown_connections 2024-09-13T23:57:01.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.942+0000 7f091c33df40 1 --2- 172.21.15.173:0/285417579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21000 0x564d51206580 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.942+0000 7f091c33df40 1 -- 172.21.15.173:0/285417579 >> 172.21.15.173:0/285417579 conn(0x564d50f20c00 msgr2=0x564d51021000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.942+0000 7f091c33df40 1 -- 172.21.15.173:0/285417579 shutdown_connections 2024-09-13T23:57:01.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.942+0000 7f091c33df40 1 -- 172.21.15.173:0/285417579 wait complete. 2024-09-13T23:57:01.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.942+0000 7f091c33df40 1 Processor -- start 2024-09-13T23:57:01.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.942+0000 7f091c33df40 1 -- start start 2024-09-13T23:57:01.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.942+0000 7f091c33df40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21000 0x564d51206580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.942+0000 7f091c33df40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d50fae3c0 con 0x564d50f21000 2024-09-13T23:57:01.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.946+0000 7f091aaf6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21000 0x564d51206580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.946+0000 7f091aaf6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21000 0x564d51206580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49350/0 (socket says 172.21.15.173:49350) 2024-09-13T23:57:01.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.946+0000 7f091aaf6700 1 -- 172.21.15.173:0/4166061274 learned_addr learned my addr 172.21.15.173:0/4166061274 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.946+0000 7f091aaf6700 1 -- 172.21.15.173:0/4166061274 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d50f33a00 con 0x564d50f21000 2024-09-13T23:57:01.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.946+0000 7f091aaf6700 1 --2- 172.21.15.173:0/4166061274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21000 0x564d51206580 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x564d51d85ad0 tx=0x564d51025a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.946+0000 7f0917af0700 1 -- 172.21.15.173:0/4166061274 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d50fc58c0 con 0x564d50f21000 2024-09-13T23:57:01.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.946+0000 7f0917af0700 1 -- 172.21.15.173:0/4166061274 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564d50fe5c80 con 0x564d50f21000 2024-09-13T23:57:01.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.946+0000 7f091c33df40 1 -- 172.21.15.173:0/4166061274 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564d50f33860 con 0x564d50f21000 2024-09-13T23:57:01.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.946+0000 7f0917af0700 1 -- 172.21.15.173:0/4166061274 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d50fc54a0 con 0x564d50f21000 2024-09-13T23:57:01.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.946+0000 7f091c33df40 1 -- 172.21.15.173:0/4166061274 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d50f336c0 con 0x564d50f21000 2024-09-13T23:57:01.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.946+0000 7f091c33df40 1 Processor -- start 2024-09-13T23:57:01.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.946+0000 7f091c33df40 1 -- start start 2024-09-13T23:57:01.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.946+0000 7f091c33df40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21800 0x564d51206b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.946+0000 7f091c33df40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d50f46640 con 0x564d50f21800 2024-09-13T23:57:01.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.946+0000 7f0917af0700 1 -- 172.21.15.173:0/4166061274 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x564d5101ab00 con 0x564d50f21000 2024-09-13T23:57:01.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.946+0000 7f091b2f7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21800 0x564d51206b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.946+0000 7f091b2f7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21800 0x564d51206b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49356/0 (socket says 172.21.15.173:49356) 2024-09-13T23:57:01.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.946+0000 7f091b2f7700 1 -- 172.21.15.173:0/4060764392 learned_addr learned my addr 172.21.15.173:0/4060764392 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.946+0000 7f0917af0700 1 --2- 172.21.15.173:0/4166061274 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d512c4000 0x564d51207080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.946+0000 7f0917af0700 1 -- 172.21.15.173:0/4166061274 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x564d50f87180 con 0x564d50f21000 2024-09-13T23:57:01.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.946+0000 7f091aaf6700 1 --2- 172.21.15.173:0/4166061274 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d512c4000 0x564d51207080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f091b2f7700 1 -- 172.21.15.173:0/4060764392 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d50f32000 con 0x564d50f21800 2024-09-13T23:57:01.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f091b2f7700 1 --2- 172.21.15.173:0/4060764392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21800 0x564d51206b00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x564d512a0510 tx=0x564d51288a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb662ecc159559e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f091aaf6700 1 --2- 172.21.15.173:0/4166061274 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d512c4000 0x564d51207080 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x564d51d995f0 tx=0x564d51288240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f09152eb700 1 -- 172.21.15.173:0/4060764392 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d50fc58c0 con 0x564d50f21800 2024-09-13T23:57:01.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f09152eb700 1 -- 172.21.15.173:0/4060764392 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564d512cc000 con 0x564d50f21800 2024-09-13T23:57:01.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f09152eb700 1 -- 172.21.15.173:0/4060764392 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d50fc54a0 con 0x564d50f21800 2024-09-13T23:57:01.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f091c33df40 1 -- 172.21.15.173:0/4060764392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21800 msgr2=0x564d51206b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:01.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f091c33df40 1 --2- 172.21.15.173:0/4060764392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21800 0x564d51206b00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x564d512a0510 tx=0x564d51288a20 comp rx=0 tx=0).stop 2024-09-13T23:57:01.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f091c33df40 1 -- 172.21.15.173:0/4060764392 shutdown_connections 2024-09-13T23:57:01.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f091c33df40 1 --2- 172.21.15.173:0/4060764392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21800 0x564d51206b00 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:01.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f091c33df40 1 -- 172.21.15.173:0/4060764392 >> 172.21.15.173:0/4060764392 conn(0x564d50f21400 msgr2=0x564d51021800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:01.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f091c33df40 1 -- 172.21.15.173:0/4060764392 shutdown_connections 2024-09-13T23:57:01.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f091c33df40 1 -- 172.21.15.173:0/4060764392 wait complete. 2024-09-13T23:57:01.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f091c33df40 1 Processor -- start 2024-09-13T23:57:01.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f091c33df40 1 -- start start 2024-09-13T23:57:01.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f091c33df40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21800 0x564d51206b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f091c33df40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d50f468c0 con 0x564d50f21800 2024-09-13T23:57:01.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f091b2f7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21800 0x564d51206b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f091b2f7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21800 0x564d51206b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49372/0 (socket says 172.21.15.173:49372) 2024-09-13T23:57:01.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 learned_addr learned my addr 172.21.15.173:0/995615653 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:01.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d50f32ea0 con 0x564d50f21800 2024-09-13T23:57:01.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f091b2f7700 1 --2- 172.21.15.173:0/995615653 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21800 0x564d51206b00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x564d51d98360 tx=0x564d51288840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f0913ae8700 1 -- 172.21.15.173:0/995615653 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d50fc5b80 con 0x564d50f21800 2024-09-13T23:57:01.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f0913ae8700 1 -- 172.21.15.173:0/995615653 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564d512cc180 con 0x564d50f21800 2024-09-13T23:57:01.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564d50f32820 con 0x564d50f21800 2024-09-13T23:57:01.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f0913ae8700 1 -- 172.21.15.173:0/995615653 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d50fc58c0 con 0x564d50f21800 2024-09-13T23:57:01.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.950+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d50f329c0 con 0x564d50f21800 2024-09-13T23:57:01.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f091c33df40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f0913ae8700 1 -- 172.21.15.173:0/995615653 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x564d5101adc0 con 0x564d50f21800 2024-09-13T23:57:01.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f0913ae8700 1 --2- 172.21.15.173:0/995615653 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d512c4c00 0x564d51207600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f0913ae8700 1 -- 172.21.15.173:0/995615653 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x564d50f87340 con 0x564d50f21800 2024-09-13T23:57:01.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f091a2f5700 1 --2- 172.21.15.173:0/995615653 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d512c4c00 0x564d51207600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f091c33df40 1 --2- 172.21.15.173:0/995615653 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564d512c5000 0x564d51207b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5400 con 0x564d512c5000 2024-09-13T23:57:01.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f091b2f7700 1 --2- 172.21.15.173:0/995615653 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564d512c5000 0x564d51207b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f091a2f5700 1 --2- 172.21.15.173:0/995615653 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d512c4c00 0x564d51207600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x564d51201920 tx=0x564d51025800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f091b2f7700 1 --2- 172.21.15.173:0/995615653 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564d512c5000 0x564d51207b80 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564d5134eb40 con 0x564d512c5000 2024-09-13T23:57:01.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f091c33df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f091c33df40 20 realm 2024-09-13T23:57:01.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f091c33df40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5000 2024-09-13T23:57:01.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564d5134eb40 con 0x564d512c5000 2024-09-13T23:57:01.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f091c33df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f091c33df40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:01.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f091c33df40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5c00 con 0x564d512c5000 2024-09-13T23:57:01.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564d5134eb40 con 0x564d512c5000 2024-09-13T23:57:01.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f091c33df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f091c33df40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f091c33df40 1 --2- 172.21.15.173:0/995615653 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564d512c5400 0x564d51208100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.954+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5400 2024-09-13T23:57:01.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.958+0000 7f091aaf6700 1 --2- 172.21.15.173:0/995615653 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564d512c5400 0x564d51208100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.958+0000 7f091aaf6700 1 --2- 172.21.15.173:0/995615653 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564d512c5400 0x564d51208100 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.958+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x564d5134f200 con 0x564d512c5400 2024-09-13T23:57:01.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.958+0000 7f091c33df40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:01.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.958+0000 7f091c33df40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.958+0000 7f091c33df40 1 --2- 172.21.15.173:0/995615653 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564d512c5c00 0x564d51208680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.958+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d5137e000 con 0x564d512c5c00 2024-09-13T23:57:01.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.958+0000 7f091a2f5700 1 --2- 172.21.15.173:0/995615653 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564d512c5c00 0x564d51208680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.958+0000 7f091a2f5700 1 --2- 172.21.15.173:0/995615653 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564d512c5c00 0x564d51208680 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.958+0000 7f091a2f5700 1 -- 172.21.15.173:0/995615653 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x564d5134f440 con 0x564d512c5c00 2024-09-13T23:57:01.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.958+0000 7f091c33df40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:01.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.958+0000 7f091c33df40 20 searching for the correct realm 2024-09-13T23:57:01.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.958+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d5137e400 con 0x564d512c5c00 2024-09-13T23:57:01.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.958+0000 7f091a2f5700 1 -- 172.21.15.173:0/995615653 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x564d5134f440 con 0x564d512c5c00 2024-09-13T23:57:01.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.958+0000 7f091a2f5700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d5137e000 con 0x564d512c5400 2024-09-13T23:57:01.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.962+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134f200 con 0x564d512c5400 2024-09-13T23:57:01.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.962+0000 7f091aaf6700 1 --2- 172.21.15.173:0/995615653 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564d5137e000 0x564d51208c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:01.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.962+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d5137e000 2024-09-13T23:57:01.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.962+0000 7f091b2f7700 1 --2- 172.21.15.173:0/995615653 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564d5137e000 0x564d51208c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:01.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.962+0000 7f091b2f7700 1 --2- 172.21.15.173:0/995615653 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564d5137e000 0x564d51208c00 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:01.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.962+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134eb40 con 0x564d5137e000 2024-09-13T23:57:01.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.962+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5000 2024-09-13T23:57:01.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.962+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x564d5134eb40 con 0x564d512c5000 2024-09-13T23:57:01.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.962+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5000 2024-09-13T23:57:01.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.962+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134eb40 con 0x564d512c5000 2024-09-13T23:57:01.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.962+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5c00 2024-09-13T23:57:01.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.962+0000 7f091a2f5700 1 -- 172.21.15.173:0/995615653 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134f440 con 0x564d512c5c00 2024-09-13T23:57:01.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.962+0000 7f091a2f5700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5000 2024-09-13T23:57:01.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.962+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134eb40 con 0x564d512c5000 2024-09-13T23:57:01.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.962+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5400 2024-09-13T23:57:01.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.966+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134f200 con 0x564d512c5400 2024-09-13T23:57:01.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.966+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5400 2024-09-13T23:57:01.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.966+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134f200 con 0x564d512c5400 2024-09-13T23:57:01.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.966+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5000 2024-09-13T23:57:01.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.966+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134eb40 con 0x564d512c5000 2024-09-13T23:57:01.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.966+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d5137e000 2024-09-13T23:57:01.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.966+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134eb40 con 0x564d5137e000 2024-09-13T23:57:01.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.966+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5000 2024-09-13T23:57:01.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.966+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134eb40 con 0x564d512c5000 2024-09-13T23:57:01.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.966+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d5137e000 2024-09-13T23:57:01.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.966+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134eb40 con 0x564d5137e000 2024-09-13T23:57:01.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.966+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5400 2024-09-13T23:57:01.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.966+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134f200 con 0x564d512c5400 2024-09-13T23:57:01.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.970+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5c00 2024-09-13T23:57:01.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.970+0000 7f091a2f5700 1 -- 172.21.15.173:0/995615653 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134f440 con 0x564d512c5c00 2024-09-13T23:57:01.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.970+0000 7f091a2f5700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5000 2024-09-13T23:57:01.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.970+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134eb40 con 0x564d512c5000 2024-09-13T23:57:01.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.970+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5400 2024-09-13T23:57:01.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.970+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134f200 con 0x564d512c5400 2024-09-13T23:57:01.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.970+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5c00 2024-09-13T23:57:01.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.970+0000 7f091a2f5700 1 -- 172.21.15.173:0/995615653 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134f440 con 0x564d512c5c00 2024-09-13T23:57:01.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.970+0000 7f091a2f5700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5000 2024-09-13T23:57:01.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.970+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134eb40 con 0x564d512c5000 2024-09-13T23:57:01.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.970+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5000 2024-09-13T23:57:01.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.970+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134eb40 con 0x564d512c5000 2024-09-13T23:57:01.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.970+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5000 2024-09-13T23:57:01.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.970+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134eb40 con 0x564d512c5000 2024-09-13T23:57:01.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.970+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5c00 2024-09-13T23:57:01.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.974+0000 7f091a2f5700 1 -- 172.21.15.173:0/995615653 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134f440 con 0x564d512c5c00 2024-09-13T23:57:01.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.974+0000 7f091a2f5700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d5137e000 2024-09-13T23:57:01.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.974+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134eb40 con 0x564d5137e000 2024-09-13T23:57:01.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.974+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5000 2024-09-13T23:57:01.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.974+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134eb40 con 0x564d512c5000 2024-09-13T23:57:01.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.974+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d5137e000 2024-09-13T23:57:01.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.974+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134eb40 con 0x564d5137e000 2024-09-13T23:57:01.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.974+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5c00 2024-09-13T23:57:01.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.974+0000 7f091a2f5700 1 -- 172.21.15.173:0/995615653 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134f440 con 0x564d512c5c00 2024-09-13T23:57:01.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.974+0000 7f091a2f5700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d5137e000 2024-09-13T23:57:01.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.974+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134eb40 con 0x564d5137e000 2024-09-13T23:57:01.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.974+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5400 2024-09-13T23:57:01.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.974+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134f200 con 0x564d512c5400 2024-09-13T23:57:01.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.974+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5400 2024-09-13T23:57:01.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.978+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134f200 con 0x564d512c5400 2024-09-13T23:57:01.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.978+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5c00 2024-09-13T23:57:01.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.978+0000 7f091a2f5700 1 -- 172.21.15.173:0/995615653 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134f440 con 0x564d512c5c00 2024-09-13T23:57:01.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.978+0000 7f091a2f5700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5400 2024-09-13T23:57:01.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.978+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x564d5134f200 con 0x564d512c5400 2024-09-13T23:57:01.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.978+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d512c5400 2024-09-13T23:57:01.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.978+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d5134f200 con 0x564d512c5400 2024-09-13T23:57:01.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.978+0000 7f091c33df40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:01.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.978+0000 7f091c33df40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:01.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.978+0000 7f091c33df40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:01.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.978+0000 7f091c33df40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:01.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.978+0000 7f091c33df40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.978+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d5137e800 con 0x564d512c5000 2024-09-13T23:57:01.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.978+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564d5134eb40 con 0x564d512c5000 2024-09-13T23:57:01.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.978+0000 7f091c33df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.978+0000 7f091c33df40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.978+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d5137ec00 con 0x564d512c5400 2024-09-13T23:57:01.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.978+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x564d5134f200 con 0x564d512c5400 2024-09-13T23:57:01.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.978+0000 7f091c33df40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:01.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.978+0000 7f091c33df40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.978+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d5137f000 con 0x564d512c5000 2024-09-13T23:57:01.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.982+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x564d5134eb40 con 0x564d512c5000 2024-09-13T23:57:01.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.982+0000 7f091c33df40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:01.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.982+0000 7f091c33df40 20 zone default found 2024-09-13T23:57:01.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.982+0000 7f091c33df40 4 Realm: () 2024-09-13T23:57:01.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.982+0000 7f091c33df40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:01.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.982+0000 7f091c33df40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:01.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.982+0000 7f091c33df40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:01.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.982+0000 7f091c33df40 20 zonegroup default 2024-09-13T23:57:01.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.982+0000 7f091c33df40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.982+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d5137f400 con 0x564d5137e000 2024-09-13T23:57:01.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.982+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x564d5134eb40 con 0x564d5137e000 2024-09-13T23:57:01.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.982+0000 7f091c33df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.982+0000 7f091c33df40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.982+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d5137f800 con 0x564d512c5c00 2024-09-13T23:57:01.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.982+0000 7f091a2f5700 1 -- 172.21.15.173:0/995615653 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x564d5134f440 con 0x564d512c5c00 2024-09-13T23:57:01.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.982+0000 7f091c33df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.982+0000 7f091c33df40 20 rados->read ofs=0 len=0 2024-09-13T23:57:01.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.982+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d5137fc00 con 0x564d512c5c00 2024-09-13T23:57:01.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.982+0000 7f091a2f5700 1 -- 172.21.15.173:0/995615653 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x564d5134f440 con 0x564d512c5c00 2024-09-13T23:57:01.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.982+0000 7f091c33df40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:01.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.982+0000 7f091c33df40 20 started sync module instance, tier type = 2024-09-13T23:57:01.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.982+0000 7f091c33df40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:01.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.982+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d51246000 con 0x564d512c5400 2024-09-13T23:57:01.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.986+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134f200 con 0x564d512c5400 2024-09-13T23:57:01.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.986+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94890073512704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d51246400 con 0x564d512c5400 2024-09-13T23:57:01.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.986+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d51246800 con 0x564d512c5000 2024-09-13T23:57:01.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.986+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94890073512704] v33'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134f200 con 0x564d512c5400 2024-09-13T23:57:01.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.986+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134eb40 con 0x564d512c5000 2024-09-13T23:57:01.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.986+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94890073513856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d51246c00 con 0x564d512c5000 2024-09-13T23:57:01.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.986+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d51247000 con 0x564d512c5400 2024-09-13T23:57:01.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.990+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134f200 con 0x564d512c5400 2024-09-13T23:57:01.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.990+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94890073515008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d51247400 con 0x564d512c5400 2024-09-13T23:57:01.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.990+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d51247800 con 0x564d5137e000 2024-09-13T23:57:01.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.990+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94890073513856] v33'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134eb40 con 0x564d512c5000 2024-09-13T23:57:01.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.994+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134eb40 con 0x564d5137e000 2024-09-13T23:57:01.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.994+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94890073516160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d51247c00 con 0x564d5137e000 2024-09-13T23:57:01.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.994+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d51246800 con 0x564d512c5400 2024-09-13T23:57:01.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.994+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94890073515008] v33'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134f200 con 0x564d512c5400 2024-09-13T23:57:02.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.994+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134f200 con 0x564d512c5400 2024-09-13T23:57:02.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.994+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94890073517312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d51246000 con 0x564d512c5400 2024-09-13T23:57:02.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.994+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d5137e800 con 0x564d512c5c00 2024-09-13T23:57:02.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.998+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94890073516160] v33'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134eb40 con 0x564d5137e000 2024-09-13T23:57:02.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.998+0000 7f091a2f5700 1 -- 172.21.15.173:0/995615653 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134f440 con 0x564d512c5c00 2024-09-13T23:57:02.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.998+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94890073518464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d5137f000 con 0x564d512c5c00 2024-09-13T23:57:02.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.998+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d5137f400 con 0x564d512c5c00 2024-09-13T23:57:02.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.998+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94890073517312] v33'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134f200 con 0x564d512c5400 2024-09-13T23:57:02.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.998+0000 7f091a2f5700 1 -- 172.21.15.173:0/995615653 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94890073518464] v33'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134f440 con 0x564d512c5c00 2024-09-13T23:57:02.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.998+0000 7f091a2f5700 1 -- 172.21.15.173:0/995615653 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134f440 con 0x564d512c5c00 2024-09-13T23:57:02.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.998+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94890073519616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d5137ec00 con 0x564d512c5c00 2024-09-13T23:57:02.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:01.998+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d512c5800 con 0x564d5137e000 2024-09-13T23:57:02.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.002+0000 7f091a2f5700 1 -- 172.21.15.173:0/995615653 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94890073519616] v33'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134f440 con 0x564d512c5c00 2024-09-13T23:57:02.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.002+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134eb40 con 0x564d5137e000 2024-09-13T23:57:02.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.002+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94890073520768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d51246400 con 0x564d5137e000 2024-09-13T23:57:02.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.002+0000 7f091c33df40 20 add_watcher() i=0 2024-09-13T23:57:02.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.002+0000 7f091c33df40 20 add_watcher() i=1 2024-09-13T23:57:02.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.002+0000 7f091c33df40 20 add_watcher() i=2 2024-09-13T23:57:02.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.002+0000 7f091c33df40 20 add_watcher() i=3 2024-09-13T23:57:02.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.002+0000 7f091c33df40 20 add_watcher() i=4 2024-09-13T23:57:02.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.002+0000 7f091c33df40 20 add_watcher() i=5 2024-09-13T23:57:02.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.002+0000 7f091c33df40 20 add_watcher() i=6 2024-09-13T23:57:02.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.002+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94890073520768] v33'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134eb40 con 0x564d5137e000 2024-09-13T23:57:02.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.002+0000 7f091c33df40 20 add_watcher() i=7 2024-09-13T23:57:02.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.002+0000 7f091c33df40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:02.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.002+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d51247000 con 0x564d512c5000 2024-09-13T23:57:02.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.002+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x564d5134eb40 con 0x564d512c5000 2024-09-13T23:57:02.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.002+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94890075160576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d51247400 con 0x564d512c5000 2024-09-13T23:57:02.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.006+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94890075160576] v33'86 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x564d5134eb40 con 0x564d512c5000 2024-09-13T23:57:02.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.006+0000 7f0901ac4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:02.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.006+0000 7f091c33df40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:02.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.006+0000 7f091c33df40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:02.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.006+0000 7f091c33df40 1 Processor -- start 2024-09-13T23:57:02.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.006+0000 7f091c33df40 1 -- start start 2024-09-13T23:57:02.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.006+0000 7f091c33df40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5137e400 0x564d51209180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.006+0000 7f091c33df40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d50fae3c0 con 0x564d5137e400 2024-09-13T23:57:02.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.006+0000 7f091a2f5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5137e400 0x564d51209180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.006+0000 7f091a2f5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5137e400 0x564d51209180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49386/0 (socket says 172.21.15.173:49386) 2024-09-13T23:57:02.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.006+0000 7f091a2f5700 1 -- 172.21.15.173:0/1575934035 learned_addr learned my addr 172.21.15.173:0/1575934035 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.010+0000 7f091a2f5700 1 -- 172.21.15.173:0/1575934035 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d50f32b60 con 0x564d5137e400 2024-09-13T23:57:02.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.010+0000 7f091a2f5700 1 --2- 172.21.15.173:0/1575934035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5137e400 0x564d51209180 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x564d5139a0f0 tx=0x564d51025980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc089f1a03ebbdb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.010+0000 7f09012c3700 1 -- 172.21.15.173:0/1575934035 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d50fc5760 con 0x564d5137e400 2024-09-13T23:57:02.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.010+0000 7f09012c3700 1 -- 172.21.15.173:0/1575934035 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564d512cc600 con 0x564d5137e400 2024-09-13T23:57:02.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.010+0000 7f09012c3700 1 -- 172.21.15.173:0/1575934035 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d513a2000 con 0x564d5137e400 2024-09-13T23:57:02.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.010+0000 7f091c33df40 1 -- 172.21.15.173:0/1575934035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5137e400 msgr2=0x564d51209180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.010+0000 7f091c33df40 1 --2- 172.21.15.173:0/1575934035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5137e400 0x564d51209180 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x564d5139a0f0 tx=0x564d51025980 comp rx=0 tx=0).stop 2024-09-13T23:57:02.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.010+0000 7f091c33df40 1 -- 172.21.15.173:0/1575934035 shutdown_connections 2024-09-13T23:57:02.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.010+0000 7f091c33df40 1 --2- 172.21.15.173:0/1575934035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5137e400 0x564d51209180 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.010+0000 7f091c33df40 1 -- 172.21.15.173:0/1575934035 >> 172.21.15.173:0/1575934035 conn(0x564d51246800 msgr2=0x564d51022000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.010+0000 7f091c33df40 1 -- 172.21.15.173:0/1575934035 shutdown_connections 2024-09-13T23:57:02.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.010+0000 7f091c33df40 1 -- 172.21.15.173:0/1575934035 wait complete. 2024-09-13T23:57:02.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.010+0000 7f091c33df40 1 Processor -- start 2024-09-13T23:57:02.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.010+0000 7f091c33df40 1 -- start start 2024-09-13T23:57:02.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.010+0000 7f091c33df40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5137e400 0x564d51209180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.010+0000 7f091c33df40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d50fae500 con 0x564d5137e400 2024-09-13T23:57:02.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.010+0000 7f091a2f5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5137e400 0x564d51209180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.010+0000 7f091a2f5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5137e400 0x564d51209180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49400/0 (socket says 172.21.15.173:49400) 2024-09-13T23:57:02.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.010+0000 7f091a2f5700 1 -- 172.21.15.173:0/2067243409 learned_addr learned my addr 172.21.15.173:0/2067243409 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.014+0000 7f091a2f5700 1 -- 172.21.15.173:0/2067243409 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d50f32d00 con 0x564d5137e400 2024-09-13T23:57:02.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.014+0000 7f091a2f5700 1 --2- 172.21.15.173:0/2067243409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5137e400 0x564d51209180 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x564d5139a300 tx=0x564d51289c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.014+0000 7f08ffac0700 1 -- 172.21.15.173:0/2067243409 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d513a2160 con 0x564d5137e400 2024-09-13T23:57:02.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.014+0000 7f08ffac0700 1 -- 172.21.15.173:0/2067243409 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564d512cc300 con 0x564d5137e400 2024-09-13T23:57:02.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.014+0000 7f08ffac0700 1 -- 172.21.15.173:0/2067243409 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d513a22c0 con 0x564d5137e400 2024-09-13T23:57:02.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.014+0000 7f091c33df40 1 -- 172.21.15.173:0/2067243409 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564d50f32340 con 0x564d5137e400 2024-09-13T23:57:02.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.014+0000 7f091c33df40 1 -- 172.21.15.173:0/2067243409 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d50f33d40 con 0x564d5137e400 2024-09-13T23:57:02.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.014+0000 7f08ffac0700 1 -- 172.21.15.173:0/2067243409 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x564d5101bb80 con 0x564d5137e400 2024-09-13T23:57:02.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.014+0000 7f08ffac0700 1 --2- 172.21.15.173:0/2067243409 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d512c5800 0x564d5141a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.014+0000 7f08ffac0700 1 -- 172.21.15.173:0/2067243409 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x564d50f87500 con 0x564d5137e400 2024-09-13T23:57:02.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.014+0000 7f091b2f7700 1 --2- 172.21.15.173:0/2067243409 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d512c5800 0x564d5141a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.014+0000 7f091c33df40 5 note: GC not initialized 2024-09-13T23:57:02.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.014+0000 7f091b2f7700 1 --2- 172.21.15.173:0/2067243409 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d512c5800 0x564d5141a000 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x564d51323c50 tx=0x564d513e0ae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.018+0000 7f08fd2bb700 20 reqs_thread_entry: start 2024-09-13T23:57:02.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.018+0000 7f091c33df40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:02.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.018+0000 7f091c33df40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:02.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.018+0000 7f08fb2b7700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:32 2024 2024-09-13T23:57:02.023 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:02.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.018+0000 7f08faa95700 20 reqs_thread_entry: start 2024-09-13T23:57:02.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.018+0000 7f091c33df40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:57:02.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.018+0000 7f091c33df40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.018+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d5137e800 con 0x564d512c5000 2024-09-13T23:57:02.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.018+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv10 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x564d5134eb40 con 0x564d512c5000 2024-09-13T23:57:02.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.018+0000 7f091c33df40 20 rados_obj.operate() r=0 bl.length=513 2024-09-13T23:57:02.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.018+0000 7f091c33df40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:57:02.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.018+0000 7f091c33df40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:02.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.018+0000 7f091c33df40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:02.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.018+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d51247800 con 0x564d512c5000 2024-09-13T23:57:02.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.022+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~357] v33'11 uv11 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x564d5134eb40 con 0x564d512c5000 2024-09-13T23:57:02.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.022+0000 7f091c33df40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:57:02.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.022+0000 7f091c33df40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:02.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.022+0000 7f091c33df40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:57:02.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.022+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94890075162880 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d51247c00 con 0x564d512c5400 2024-09-13T23:57:02.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.022+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== watch-notify(notify (1) cookie 94890073517312 notify 141733920783 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x564d51282820 con 0x564d512c5400 2024-09-13T23:57:02.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.022+0000 7f09152eb700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920783 cookie 94890073517312 notifier 4448 bl.length()=533 2024-09-13T23:57:02.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.022+0000 7f09152eb700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:57:02.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.022+0000 7f09152eb700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:02.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.022+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(64 notify.4 [notify cookie 94890075162880 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x564d5134f200 con 0x564d512c5400 2024-09-13T23:57:02.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.022+0000 7f09152eb700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d5148c000 con 0x564d512c5400 2024-09-13T23:57:02.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.022+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== watch-notify(notify_complete (2) cookie 94890075162880 notify 141733920783 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x564d512829c0 con 0x564d512c5400 2024-09-13T23:57:02.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.022+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134f200 con 0x564d512c5400 2024-09-13T23:57:02.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.022+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d51246400 con 0x564d5137e000 2024-09-13T23:57:02.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.026+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(66 foo:foo2 [delete] v33'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134eb40 con 0x564d5137e000 2024-09-13T23:57:02.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.026+0000 7f091c33df40 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-13T23:57:02.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.026+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94890075162880 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d5148c800 con 0x564d512c5400 2024-09-13T23:57:02.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.026+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== watch-notify(notify (1) cookie 94890073512704 notify 141733920784 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x564d512829c0 con 0x564d512c5400 2024-09-13T23:57:02.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.026+0000 7f09152eb700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920784 cookie 94890073512704 notifier 4448 bl.length()=159 2024-09-13T23:57:02.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.026+0000 7f09152eb700 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d5148c400 con 0x564d512c5400 2024-09-13T23:57:02.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.026+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(67 notify.0 [notify cookie 94890075162880 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x564d5134f200 con 0x564d512c5400 2024-09-13T23:57:02.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.026+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134f200 con 0x564d512c5400 2024-09-13T23:57:02.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.026+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== watch-notify(notify_complete (2) cookie 94890075162880 notify 141733920784 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x564d51282b60 con 0x564d512c5400 2024-09-13T23:57:02.032 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:02.033 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "foo", 2024-09-13T23:57:02.033 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Foo", 2024-09-13T23:57:02.033 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "foo@foo.com", 2024-09-13T23:57:02.033 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:57:02.033 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:57:02.033 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [], 2024-09-13T23:57:02.033 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:57:02.033 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:02.033 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:57:02.033 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-09-13T23:57:02.033 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-09-13T23:57:02.033 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:02.034 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:02.034 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [], 2024-09-13T23:57:02.034 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:57:02.034 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:57:02.034 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:57:02.034 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:57:02.034 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:57:02.034 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:57:02.034 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:02.034 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:02.034 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:02.034 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:02.034 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:02.034 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:02.034 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:57:02.035 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:02.035 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:02.035 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:02.035 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:02.035 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:02.035 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:02.035 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:57:02.035 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:57:02.035 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:57:02.035 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:02.035 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:57:02.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.030+0000 7f0901ac4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:02.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.030+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94890075160576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d5148cc00 con 0x564d512c5000 2024-09-13T23:57:02.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.030+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94890075160576] v33'87 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x564d5134eb40 con 0x564d512c5000 2024-09-13T23:57:02.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.030+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94890073512704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d5148d000 con 0x564d512c5400 2024-09-13T23:57:02.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.034+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94890073512704] v33'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134f200 con 0x564d512c5400 2024-09-13T23:57:02.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.034+0000 7f091c33df40 20 remove_watcher() i=0 2024-09-13T23:57:02.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.034+0000 7f091c33df40 2 removed watcher, disabling cache 2024-09-13T23:57:02.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.034+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94890073513856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d5148d400 con 0x564d512c5000 2024-09-13T23:57:02.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.038+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94890073513856] v33'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134eb40 con 0x564d512c5000 2024-09-13T23:57:02.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.038+0000 7f091c33df40 20 remove_watcher() i=1 2024-09-13T23:57:02.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.038+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94890073515008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d5148d800 con 0x564d512c5400 2024-09-13T23:57:02.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.038+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 27 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94890073515008] v33'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134f200 con 0x564d512c5400 2024-09-13T23:57:02.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.038+0000 7f091c33df40 20 remove_watcher() i=2 2024-09-13T23:57:02.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.038+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94890073516160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d5148dc00 con 0x564d5137e000 2024-09-13T23:57:02.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.042+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94890073516160] v33'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134eb40 con 0x564d5137e000 2024-09-13T23:57:02.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.042+0000 7f091c33df40 20 remove_watcher() i=3 2024-09-13T23:57:02.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.042+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94890073517312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d51247000 con 0x564d512c5400 2024-09-13T23:57:02.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.046+0000 7f091aaf6700 1 -- 172.21.15.173:0/995615653 <== osd.0 v2:172.21.15.87:6800/3507919120 28 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94890073517312] v33'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134f200 con 0x564d512c5400 2024-09-13T23:57:02.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.046+0000 7f091c33df40 20 remove_watcher() i=4 2024-09-13T23:57:02.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.046+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94890073518464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d51247400 con 0x564d512c5c00 2024-09-13T23:57:02.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.046+0000 7f091a2f5700 1 -- 172.21.15.173:0/995615653 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94890073518464] v33'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134f440 con 0x564d512c5c00 2024-09-13T23:57:02.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.046+0000 7f091c33df40 20 remove_watcher() i=5 2024-09-13T23:57:02.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.046+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94890073519616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d51247800 con 0x564d512c5c00 2024-09-13T23:57:02.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.050+0000 7f091a2f5700 1 -- 172.21.15.173:0/995615653 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94890073519616] v33'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134f440 con 0x564d512c5c00 2024-09-13T23:57:02.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.050+0000 7f091c33df40 20 remove_watcher() i=6 2024-09-13T23:57:02.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.050+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94890073520768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564d51246c00 con 0x564d5137e000 2024-09-13T23:57:02.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.050+0000 7f091b2f7700 1 -- 172.21.15.173:0/995615653 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94890073520768] v33'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d5134eb40 con 0x564d5137e000 2024-09-13T23:57:02.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.050+0000 7f091c33df40 20 remove_watcher() i=7 2024-09-13T23:57:02.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.050+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564d512c5400 msgr2=0x564d51208100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.050+0000 7f091c33df40 1 --2- 172.21.15.173:0/995615653 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564d512c5400 0x564d51208100 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.050+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564d512c5000 msgr2=0x564d51207b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.050+0000 7f091c33df40 1 --2- 172.21.15.173:0/995615653 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564d512c5000 0x564d51207b80 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.050+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564d5137e000 msgr2=0x564d51208c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.050+0000 7f091c33df40 1 --2- 172.21.15.173:0/995615653 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564d5137e000 0x564d51208c00 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.050+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564d512c5c00 msgr2=0x564d51208680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.050+0000 7f091c33df40 1 --2- 172.21.15.173:0/995615653 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564d512c5c00 0x564d51208680 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.050+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d512c4c00 msgr2=0x564d51207600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.050+0000 7f091c33df40 1 --2- 172.21.15.173:0/995615653 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d512c4c00 0x564d51207600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x564d51201920 tx=0x564d51025800 comp rx=0 tx=0).stop 2024-09-13T23:57:02.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.050+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21800 msgr2=0x564d51206b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.050+0000 7f091a2f5700 1 -- 172.21.15.173:0/995615653 reap_dead start 2024-09-13T23:57:02.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.050+0000 7f091c33df40 1 --2- 172.21.15.173:0/995615653 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21800 0x564d51206b00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x564d51d98360 tx=0x564d51288840 comp rx=0 tx=0).stop 2024-09-13T23:57:02.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.050+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 shutdown_connections 2024-09-13T23:57:02.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.050+0000 7f091c33df40 1 --2- 172.21.15.173:0/995615653 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21800 0x564d51206b00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.050+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 >> 172.21.15.173:0/995615653 conn(0x564d50f21400 msgr2=0x564d51021800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.050+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 shutdown_connections 2024-09-13T23:57:02.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.054+0000 7f091c33df40 1 -- 172.21.15.173:0/995615653 wait complete. 2024-09-13T23:57:02.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.054+0000 7f091c33df40 1 -- 172.21.15.173:0/2067243409 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d512c5800 msgr2=0x564d5141a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.054+0000 7f091c33df40 1 --2- 172.21.15.173:0/2067243409 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d512c5800 0x564d5141a000 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x564d51323c50 tx=0x564d513e0ae0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.054+0000 7f091c33df40 1 -- 172.21.15.173:0/2067243409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5137e400 msgr2=0x564d51209180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.054+0000 7f091c33df40 1 --2- 172.21.15.173:0/2067243409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5137e400 0x564d51209180 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x564d5139a300 tx=0x564d51289c20 comp rx=0 tx=0).stop 2024-09-13T23:57:02.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.054+0000 7f091c33df40 1 -- 172.21.15.173:0/2067243409 shutdown_connections 2024-09-13T23:57:02.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.054+0000 7f091c33df40 1 --2- 172.21.15.173:0/2067243409 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d512c5800 0x564d5141a000 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.054+0000 7f091c33df40 1 --2- 172.21.15.173:0/2067243409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5137e400 0x564d51209180 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.054+0000 7f091c33df40 1 -- 172.21.15.173:0/2067243409 >> 172.21.15.173:0/2067243409 conn(0x564d51246800 msgr2=0x564d51022000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.054+0000 7f091c33df40 1 -- 172.21.15.173:0/2067243409 shutdown_connections 2024-09-13T23:57:02.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.054+0000 7f091c33df40 1 -- 172.21.15.173:0/2067243409 wait complete. 2024-09-13T23:57:02.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.054+0000 7f091c33df40 1 -- 172.21.15.173:0/4166061274 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d512c4000 msgr2=0x564d51207080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.054+0000 7f091c33df40 1 --2- 172.21.15.173:0/4166061274 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d512c4000 0x564d51207080 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x564d51d995f0 tx=0x564d51288240 comp rx=0 tx=0).stop 2024-09-13T23:57:02.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.054+0000 7f091c33df40 1 -- 172.21.15.173:0/4166061274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21000 msgr2=0x564d51206580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.054+0000 7f091c33df40 1 --2- 172.21.15.173:0/4166061274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21000 0x564d51206580 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x564d51d85ad0 tx=0x564d51025a40 comp rx=0 tx=0).stop 2024-09-13T23:57:02.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.054+0000 7f091c33df40 1 -- 172.21.15.173:0/4166061274 shutdown_connections 2024-09-13T23:57:02.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.054+0000 7f091c33df40 1 --2- 172.21.15.173:0/4166061274 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d512c4000 0x564d51207080 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.054+0000 7f091c33df40 1 --2- 172.21.15.173:0/4166061274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d50f21000 0x564d51206580 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.054+0000 7f091c33df40 1 -- 172.21.15.173:0/4166061274 >> 172.21.15.173:0/4166061274 conn(0x564d50f20c00 msgr2=0x564d51021000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.054+0000 7f091c33df40 1 -- 172.21.15.173:0/4166061274 shutdown_connections 2024-09-13T23:57:02.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.054+0000 7f091c33df40 1 -- 172.21.15.173:0/4166061274 wait complete. 2024-09-13T23:57:02.066 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:57:02.066 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-13T23:57:02.066 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-13T23:57:02.066 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-13T23:57:02.109 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:02.109 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:02.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.106+0000 7fc5840e5f40 1 Processor -- start 2024-09-13T23:57:02.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.106+0000 7fc5840e5f40 1 -- start start 2024-09-13T23:57:02.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.106+0000 7fc5840e5f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55f780f6f000 0x55f781254580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.106+0000 7fc5840e5f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f781033500 con 0x55f780f6f400 2024-09-13T23:57:02.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.106+0000 7fc5840e5f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f780ffca00 con 0x55f780f6f000 2024-09-13T23:57:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.106+0000 7fc58289e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55f780f6f000 0x55f781254580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.106+0000 7fc58209d700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55f780f6f400 0x55f78106e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47362/0 (socket says 172.21.15.173:47362) 2024-09-13T23:57:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.106+0000 7fc58209d700 1 -- 172.21.15.173:0/1162063821 learned_addr learned my addr 172.21.15.173:0/1162063821 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.106+0000 7fc58289e700 1 -- 172.21.15.173:0/1162063821 >> v1:172.21.15.87:6789/0 conn(0x55f780f6f400 legacy=0x55f78106e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.106+0000 7fc58289e700 1 -- 172.21.15.173:0/1162063821 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f780f81d40 con 0x55f780f6f000 2024-09-13T23:57:02.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.106+0000 7fc58289e700 1 --2- 172.21.15.173:0/1162063821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f000 0x55f781254580 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x55f78124fa70 tx=0x55f781073920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971dc2486907a902 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.106+0000 7fc58189c700 1 -- 172.21.15.173:0/1162063821 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f7810134a0 con 0x55f780f6f000 2024-09-13T23:57:02.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.106+0000 7fc58189c700 1 -- 172.21.15.173:0/1162063821 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f781033800 con 0x55f780f6f000 2024-09-13T23:57:02.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.106+0000 7fc58189c700 1 -- 172.21.15.173:0/1162063821 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f781013600 con 0x55f780f6f000 2024-09-13T23:57:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.106+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1162063821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f000 msgr2=0x55f781254580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.106+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/1162063821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f000 0x55f781254580 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x55f78124fa70 tx=0x55f781073920 comp rx=0 tx=0).stop 2024-09-13T23:57:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.106+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1162063821 shutdown_connections 2024-09-13T23:57:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.106+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/1162063821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f000 0x55f781254580 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.106+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1162063821 >> 172.21.15.173:0/1162063821 conn(0x55f780f6ec00 msgr2=0x55f78106e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.106+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1162063821 shutdown_connections 2024-09-13T23:57:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.106+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1162063821 wait complete. 2024-09-13T23:57:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.106+0000 7fc5840e5f40 1 Processor -- start 2024-09-13T23:57:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc5840e5f40 1 -- start start 2024-09-13T23:57:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc5840e5f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f000 0x55f781254580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc5840e5f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f780ffc500 con 0x55f780f6f000 2024-09-13T23:57:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc58289e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f000 0x55f781254580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc58289e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f000 0x55f781254580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49430/0 (socket says 172.21.15.173:49430) 2024-09-13T23:57:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc58289e700 1 -- 172.21.15.173:0/3363470240 learned_addr learned my addr 172.21.15.173:0/3363470240 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc58289e700 1 -- 172.21.15.173:0/3363470240 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f780f81ba0 con 0x55f780f6f000 2024-09-13T23:57:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc58289e700 1 --2- 172.21.15.173:0/3363470240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f000 0x55f781254580 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x55f7810ca0c0 tx=0x55f781073800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7edd8f7e0ca698b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc58109b700 1 -- 172.21.15.173:0/3363470240 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f781013760 con 0x55f780f6f000 2024-09-13T23:57:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc58109b700 1 -- 172.21.15.173:0/3363470240 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f781033b00 con 0x55f780f6f000 2024-09-13T23:57:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc58109b700 1 -- 172.21.15.173:0/3363470240 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f7810134a0 con 0x55f780f6f000 2024-09-13T23:57:02.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc5840e5f40 1 -- 172.21.15.173:0/3363470240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f000 msgr2=0x55f781254580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/3363470240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f000 0x55f781254580 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x55f7810ca0c0 tx=0x55f781073800 comp rx=0 tx=0).stop 2024-09-13T23:57:02.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc5840e5f40 1 -- 172.21.15.173:0/3363470240 shutdown_connections 2024-09-13T23:57:02.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/3363470240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f000 0x55f781254580 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc5840e5f40 1 -- 172.21.15.173:0/3363470240 >> 172.21.15.173:0/3363470240 conn(0x55f780f6ec00 msgr2=0x55f78106f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc5840e5f40 1 -- 172.21.15.173:0/3363470240 shutdown_connections 2024-09-13T23:57:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc5840e5f40 1 -- 172.21.15.173:0/3363470240 wait complete. 2024-09-13T23:57:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc5840e5f40 1 Processor -- start 2024-09-13T23:57:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc5840e5f40 1 -- start start 2024-09-13T23:57:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc5840e5f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f000 0x55f781254580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc5840e5f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f780ffc3c0 con 0x55f780f6f000 2024-09-13T23:57:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc58289e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f000 0x55f781254580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc58289e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f000 0x55f781254580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49436/0 (socket says 172.21.15.173:49436) 2024-09-13T23:57:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.110+0000 7fc58289e700 1 -- 172.21.15.173:0/2917506836 learned_addr learned my addr 172.21.15.173:0/2917506836 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.114+0000 7fc58289e700 1 -- 172.21.15.173:0/2917506836 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f780f81a00 con 0x55f780f6f000 2024-09-13T23:57:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.114+0000 7fc58289e700 1 --2- 172.21.15.173:0/2917506836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f000 0x55f781254580 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x55f7810cbf50 tx=0x55f781073920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.114+0000 7fc57f898700 1 -- 172.21.15.173:0/2917506836 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f781013600 con 0x55f780f6f000 2024-09-13T23:57:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.114+0000 7fc5840e5f40 1 -- 172.21.15.173:0/2917506836 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f780f81860 con 0x55f780f6f000 2024-09-13T23:57:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.114+0000 7fc57f898700 1 -- 172.21.15.173:0/2917506836 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f781033c80 con 0x55f780f6f000 2024-09-13T23:57:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.114+0000 7fc57f898700 1 -- 172.21.15.173:0/2917506836 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f7810138c0 con 0x55f780f6f000 2024-09-13T23:57:02.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.114+0000 7fc5840e5f40 1 -- 172.21.15.173:0/2917506836 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f780f816c0 con 0x55f780f6f000 2024-09-13T23:57:02.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.114+0000 7fc5840e5f40 1 Processor -- start 2024-09-13T23:57:02.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.114+0000 7fc5840e5f40 1 -- start start 2024-09-13T23:57:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.114+0000 7fc5840e5f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f800 0x55f781254b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.114+0000 7fc5840e5f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f780ffc000 con 0x55f780f6f800 2024-09-13T23:57:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.114+0000 7fc58309f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f800 0x55f781254b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.114+0000 7fc58309f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f800 0x55f781254b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49452/0 (socket says 172.21.15.173:49452) 2024-09-13T23:57:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.114+0000 7fc58309f700 1 -- 172.21.15.173:0/174599394 learned_addr learned my addr 172.21.15.173:0/174599394 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.114+0000 7fc57f898700 1 -- 172.21.15.173:0/2917506836 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55f781068b00 con 0x55f780f6f000 2024-09-13T23:57:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.114+0000 7fc58309f700 1 -- 172.21.15.173:0/174599394 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f780f80000 con 0x55f780f6f800 2024-09-13T23:57:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.114+0000 7fc57f898700 1 --2- 172.21.15.173:0/2917506836 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f781312000 0x55f781255080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.114+0000 7fc57f898700 1 -- 172.21.15.173:0/2917506836 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55f780fd5180 con 0x55f780f6f000 2024-09-13T23:57:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.114+0000 7fc58289e700 1 --2- 172.21.15.173:0/2917506836 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f781312000 0x55f781255080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.114+0000 7fc58309f700 1 --2- 172.21.15.173:0/174599394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f800 0x55f781254b00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x55f781de6c90 tx=0x55f7812d28a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8be59444eb7ac96 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.114+0000 7fc57d093700 1 -- 172.21.15.173:0/174599394 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f781013600 con 0x55f780f6f800 2024-09-13T23:57:02.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.114+0000 7fc57d093700 1 -- 172.21.15.173:0/174599394 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f7812d6000 con 0x55f780f6f800 2024-09-13T23:57:02.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.114+0000 7fc57d093700 1 -- 172.21.15.173:0/174599394 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f7810138c0 con 0x55f780f6f800 2024-09-13T23:57:02.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.118+0000 7fc58289e700 1 --2- 172.21.15.173:0/2917506836 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f781312000 0x55f781255080 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55f781314030 tx=0x55f7812d2120 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.118+0000 7fc5840e5f40 1 -- 172.21.15.173:0/174599394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f800 msgr2=0x55f781254b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.118+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/174599394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f800 0x55f781254b00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x55f781de6c90 tx=0x55f7812d28a0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.118+0000 7fc5840e5f40 1 -- 172.21.15.173:0/174599394 shutdown_connections 2024-09-13T23:57:02.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.118+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/174599394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f800 0x55f781254b00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.118+0000 7fc5840e5f40 1 -- 172.21.15.173:0/174599394 >> 172.21.15.173:0/174599394 conn(0x55f780f6f400 msgr2=0x55f78106f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.118+0000 7fc5840e5f40 1 -- 172.21.15.173:0/174599394 shutdown_connections 2024-09-13T23:57:02.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.118+0000 7fc5840e5f40 1 -- 172.21.15.173:0/174599394 wait complete. 2024-09-13T23:57:02.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.118+0000 7fc5840e5f40 1 Processor -- start 2024-09-13T23:57:02.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.118+0000 7fc5840e5f40 1 -- start start 2024-09-13T23:57:02.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.118+0000 7fc5840e5f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f800 0x55f781254b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.118+0000 7fc5840e5f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f780f94640 con 0x55f780f6f800 2024-09-13T23:57:02.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.118+0000 7fc58309f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f800 0x55f781254b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.118+0000 7fc58309f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f800 0x55f781254b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49464/0 (socket says 172.21.15.173:49464) 2024-09-13T23:57:02.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.118+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 learned_addr learned my addr 172.21.15.173:0/1771235105 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.118+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f780f80ea0 con 0x55f780f6f800 2024-09-13T23:57:02.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.118+0000 7fc58309f700 1 --2- 172.21.15.173:0/1771235105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f800 0x55f781254b00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x55f7813148d0 tx=0x55f781073e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.122+0000 7fc57b890700 1 -- 172.21.15.173:0/1771235105 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f781013760 con 0x55f780f6f800 2024-09-13T23:57:02.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.122+0000 7fc57b890700 1 -- 172.21.15.173:0/1771235105 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f7812d6180 con 0x55f780f6f800 2024-09-13T23:57:02.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.122+0000 7fc57b890700 1 -- 172.21.15.173:0/1771235105 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f781013600 con 0x55f780f6f800 2024-09-13T23:57:02.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.122+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f780f80820 con 0x55f780f6f800 2024-09-13T23:57:02.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.122+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f780f809c0 con 0x55f780f6f800 2024-09-13T23:57:02.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.122+0000 7fc5840e5f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.122+0000 7fc57b890700 1 -- 172.21.15.173:0/1771235105 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55f781068dc0 con 0x55f780f6f800 2024-09-13T23:57:02.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.122+0000 7fc57b890700 1 --2- 172.21.15.173:0/1771235105 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f781312c00 0x55f781255600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.122+0000 7fc57b890700 1 -- 172.21.15.173:0/1771235105 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55f780fd5340 con 0x55f780f6f800 2024-09-13T23:57:02.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.122+0000 7fc58209d700 1 --2- 172.21.15.173:0/1771235105 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f781312c00 0x55f781255600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.122+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/1771235105 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f781313000 0x55f781255b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.122+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313400 con 0x55f781313000 2024-09-13T23:57:02.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.122+0000 7fc58309f700 1 --2- 172.21.15.173:0/1771235105 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f781313000 0x55f781255b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.122+0000 7fc58209d700 1 --2- 172.21.15.173:0/1771235105 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f781312c00 0x55f781255600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55f781315bf0 tx=0x55f7812d3800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.122+0000 7fc58309f700 1 --2- 172.21.15.173:0/1771235105 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f781313000 0x55f781255b80 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.126+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55f781398b40 con 0x55f781313000 2024-09-13T23:57:02.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.126+0000 7fc5840e5f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.126+0000 7fc5840e5f40 20 realm 2024-09-13T23:57:02.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.126+0000 7fc5840e5f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.126+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313000 2024-09-13T23:57:02.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.126+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55f781398b40 con 0x55f781313000 2024-09-13T23:57:02.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.126+0000 7fc5840e5f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.126+0000 7fc5840e5f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:02.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.126+0000 7fc5840e5f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.126+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313c00 con 0x55f781313000 2024-09-13T23:57:02.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.126+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55f781398b40 con 0x55f781313000 2024-09-13T23:57:02.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.126+0000 7fc5840e5f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.126+0000 7fc5840e5f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.126+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/1771235105 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f781313400 0x55f781256100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.126+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313400 2024-09-13T23:57:02.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.126+0000 7fc58289e700 1 --2- 172.21.15.173:0/1771235105 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f781313400 0x55f781256100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.126+0000 7fc58289e700 1 --2- 172.21.15.173:0/1771235105 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f781313400 0x55f781256100 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.126+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55f781399200 con 0x55f781313400 2024-09-13T23:57:02.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.126+0000 7fc5840e5f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:02.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.126+0000 7fc5840e5f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.126+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/1771235105 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f781313c00 0x55f781256680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.126+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d0000 con 0x55f781313c00 2024-09-13T23:57:02.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.126+0000 7fc58209d700 1 --2- 172.21.15.173:0/1771235105 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f781313c00 0x55f781256680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.126+0000 7fc58209d700 1 --2- 172.21.15.173:0/1771235105 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f781313c00 0x55f781256680 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.130+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55f781399440 con 0x55f781313c00 2024-09-13T23:57:02.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.130+0000 7fc5840e5f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:02.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.130+0000 7fc5840e5f40 20 searching for the correct realm 2024-09-13T23:57:02.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.130+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d0400 con 0x55f781313c00 2024-09-13T23:57:02.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.130+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55f781399440 con 0x55f781313c00 2024-09-13T23:57:02.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.130+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d0000 con 0x55f781313400 2024-09-13T23:57:02.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.130+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781399200 con 0x55f781313400 2024-09-13T23:57:02.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.130+0000 7fc58289e700 1 --2- 172.21.15.173:0/1771235105 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f7813d0000 0x55f781256c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.130+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f7813d0000 2024-09-13T23:57:02.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.130+0000 7fc58309f700 1 --2- 172.21.15.173:0/1771235105 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f7813d0000 0x55f781256c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.130+0000 7fc58309f700 1 --2- 172.21.15.173:0/1771235105 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f7813d0000 0x55f781256c00 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.130+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781398b40 con 0x55f7813d0000 2024-09-13T23:57:02.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.130+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313000 2024-09-13T23:57:02.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.130+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55f781398b40 con 0x55f781313000 2024-09-13T23:57:02.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.130+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313000 2024-09-13T23:57:02.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.134+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781398b40 con 0x55f781313000 2024-09-13T23:57:02.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.134+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313c00 2024-09-13T23:57:02.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.134+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781399440 con 0x55f781313c00 2024-09-13T23:57:02.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.134+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313000 2024-09-13T23:57:02.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.134+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781398b40 con 0x55f781313000 2024-09-13T23:57:02.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.134+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313400 2024-09-13T23:57:02.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.134+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781399200 con 0x55f781313400 2024-09-13T23:57:02.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.134+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313400 2024-09-13T23:57:02.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.134+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781399200 con 0x55f781313400 2024-09-13T23:57:02.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.134+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313000 2024-09-13T23:57:02.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.134+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781398b40 con 0x55f781313000 2024-09-13T23:57:02.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.134+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f7813d0000 2024-09-13T23:57:02.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.134+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781398b40 con 0x55f7813d0000 2024-09-13T23:57:02.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.134+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313000 2024-09-13T23:57:02.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.138+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781398b40 con 0x55f781313000 2024-09-13T23:57:02.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.138+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f7813d0000 2024-09-13T23:57:02.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.138+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781398b40 con 0x55f7813d0000 2024-09-13T23:57:02.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.138+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313400 2024-09-13T23:57:02.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.138+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781399200 con 0x55f781313400 2024-09-13T23:57:02.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.138+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313c00 2024-09-13T23:57:02.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.138+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781399440 con 0x55f781313c00 2024-09-13T23:57:02.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.138+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313000 2024-09-13T23:57:02.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.138+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781398b40 con 0x55f781313000 2024-09-13T23:57:02.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.138+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313400 2024-09-13T23:57:02.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.138+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781399200 con 0x55f781313400 2024-09-13T23:57:02.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.138+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313c00 2024-09-13T23:57:02.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.142+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781399440 con 0x55f781313c00 2024-09-13T23:57:02.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.142+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313000 2024-09-13T23:57:02.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.142+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781398b40 con 0x55f781313000 2024-09-13T23:57:02.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.142+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313000 2024-09-13T23:57:02.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.142+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781398b40 con 0x55f781313000 2024-09-13T23:57:02.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.142+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313000 2024-09-13T23:57:02.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.142+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781398b40 con 0x55f781313000 2024-09-13T23:57:02.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.142+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313c00 2024-09-13T23:57:02.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.142+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781399440 con 0x55f781313c00 2024-09-13T23:57:02.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.142+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f7813d0000 2024-09-13T23:57:02.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.142+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781398b40 con 0x55f7813d0000 2024-09-13T23:57:02.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.142+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313000 2024-09-13T23:57:02.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.142+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781398b40 con 0x55f781313000 2024-09-13T23:57:02.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.142+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f7813d0000 2024-09-13T23:57:02.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.146+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781398b40 con 0x55f7813d0000 2024-09-13T23:57:02.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.146+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313c00 2024-09-13T23:57:02.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.146+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781399440 con 0x55f781313c00 2024-09-13T23:57:02.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.146+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f7813d0000 2024-09-13T23:57:02.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.146+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781398b40 con 0x55f7813d0000 2024-09-13T23:57:02.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.146+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313400 2024-09-13T23:57:02.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.146+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781399200 con 0x55f781313400 2024-09-13T23:57:02.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.146+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313400 2024-09-13T23:57:02.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.146+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781399200 con 0x55f781313400 2024-09-13T23:57:02.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.146+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313c00 2024-09-13T23:57:02.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.146+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781399440 con 0x55f781313c00 2024-09-13T23:57:02.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.146+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313400 2024-09-13T23:57:02.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.150+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55f781399200 con 0x55f781313400 2024-09-13T23:57:02.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.150+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f781313400 2024-09-13T23:57:02.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.150+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f781399200 con 0x55f781313400 2024-09-13T23:57:02.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.150+0000 7fc5840e5f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:02.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.150+0000 7fc5840e5f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:02.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.150+0000 7fc5840e5f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:02.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.150+0000 7fc5840e5f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:02.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.150+0000 7fc5840e5f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.150+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d0800 con 0x55f781313000 2024-09-13T23:57:02.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.150+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55f781398b40 con 0x55f781313000 2024-09-13T23:57:02.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.150+0000 7fc5840e5f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.150+0000 7fc5840e5f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.150+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d0c00 con 0x55f781313400 2024-09-13T23:57:02.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.150+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55f781399200 con 0x55f781313400 2024-09-13T23:57:02.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.150+0000 7fc5840e5f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:02.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.150+0000 7fc5840e5f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.150+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d1000 con 0x55f781313000 2024-09-13T23:57:02.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.154+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55f781398b40 con 0x55f781313000 2024-09-13T23:57:02.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.154+0000 7fc5840e5f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:02.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.154+0000 7fc5840e5f40 20 zone default found 2024-09-13T23:57:02.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.154+0000 7fc5840e5f40 4 Realm: () 2024-09-13T23:57:02.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.154+0000 7fc5840e5f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:02.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.154+0000 7fc5840e5f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:02.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.154+0000 7fc5840e5f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:02.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.154+0000 7fc5840e5f40 20 zonegroup default 2024-09-13T23:57:02.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.154+0000 7fc5840e5f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.154+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d1400 con 0x55f7813d0000 2024-09-13T23:57:02.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.154+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55f781398b40 con 0x55f7813d0000 2024-09-13T23:57:02.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.154+0000 7fc5840e5f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.154+0000 7fc5840e5f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.154+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d1800 con 0x55f781313c00 2024-09-13T23:57:02.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.154+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55f781399440 con 0x55f781313c00 2024-09-13T23:57:02.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.154+0000 7fc5840e5f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.154+0000 7fc5840e5f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.154+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d1c00 con 0x55f781313c00 2024-09-13T23:57:02.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.154+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55f781399440 con 0x55f781313c00 2024-09-13T23:57:02.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.154+0000 7fc5840e5f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.154+0000 7fc5840e5f40 20 started sync module instance, tier type = 2024-09-13T23:57:02.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.154+0000 7fc5840e5f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:02.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.154+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d2000 con 0x55f781313400 2024-09-13T23:57:02.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.158+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f781399200 con 0x55f781313400 2024-09-13T23:57:02.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.158+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94521511951104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d2400 con 0x55f781313400 2024-09-13T23:57:02.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.158+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d2800 con 0x55f781313000 2024-09-13T23:57:02.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.158+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94521511951104] v33'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f781399200 con 0x55f781313400 2024-09-13T23:57:02.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.162+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f781398b40 con 0x55f781313000 2024-09-13T23:57:02.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.162+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94521511952256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d2c00 con 0x55f781313000 2024-09-13T23:57:02.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.162+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d3000 con 0x55f781313400 2024-09-13T23:57:02.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.162+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94521511952256] v33'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f781398b40 con 0x55f781313000 2024-09-13T23:57:02.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.162+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f781399200 con 0x55f781313400 2024-09-13T23:57:02.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.162+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94521511953408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d3400 con 0x55f781313400 2024-09-13T23:57:02.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.162+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d3800 con 0x55f7813d0000 2024-09-13T23:57:02.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.166+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f781398b40 con 0x55f7813d0000 2024-09-13T23:57:02.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.166+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94521511954560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d3c00 con 0x55f7813d0000 2024-09-13T23:57:02.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.166+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d2800 con 0x55f781313400 2024-09-13T23:57:02.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.166+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94521511953408] v33'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f781399200 con 0x55f781313400 2024-09-13T23:57:02.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.170+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94521511954560] v33'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f781398b40 con 0x55f7813d0000 2024-09-13T23:57:02.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.170+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f781399200 con 0x55f781313400 2024-09-13T23:57:02.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.170+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94521511955712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d2000 con 0x55f781313400 2024-09-13T23:57:02.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.170+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d0800 con 0x55f781313c00 2024-09-13T23:57:02.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.170+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f781399440 con 0x55f781313c00 2024-09-13T23:57:02.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.170+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94521511956864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d1000 con 0x55f781313c00 2024-09-13T23:57:02.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.170+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d1400 con 0x55f781313c00 2024-09-13T23:57:02.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.170+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94521511955712] v33'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f781399200 con 0x55f781313400 2024-09-13T23:57:02.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.174+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94521511956864] v33'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f781399440 con 0x55f781313c00 2024-09-13T23:57:02.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.174+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f781399440 con 0x55f781313c00 2024-09-13T23:57:02.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.174+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94521511958016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d0c00 con 0x55f781313c00 2024-09-13T23:57:02.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.174+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f781313800 con 0x55f7813d0000 2024-09-13T23:57:02.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.174+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f781398b40 con 0x55f7813d0000 2024-09-13T23:57:02.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.174+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94521511959168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d2400 con 0x55f7813d0000 2024-09-13T23:57:02.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.174+0000 7fc5840e5f40 20 add_watcher() i=0 2024-09-13T23:57:02.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.174+0000 7fc5840e5f40 20 add_watcher() i=1 2024-09-13T23:57:02.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.174+0000 7fc5840e5f40 20 add_watcher() i=2 2024-09-13T23:57:02.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.174+0000 7fc5840e5f40 20 add_watcher() i=3 2024-09-13T23:57:02.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.174+0000 7fc5840e5f40 20 add_watcher() i=4 2024-09-13T23:57:02.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.174+0000 7fc5840e5f40 20 add_watcher() i=5 2024-09-13T23:57:02.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.174+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94521511958016] v33'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f781399440 con 0x55f781313c00 2024-09-13T23:57:02.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.178+0000 7fc5840e5f40 20 add_watcher() i=6 2024-09-13T23:57:02.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.178+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94521511959168] v33'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f781398b40 con 0x55f7813d0000 2024-09-13T23:57:02.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.178+0000 7fc5840e5f40 20 add_watcher() i=7 2024-09-13T23:57:02.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.178+0000 7fc5840e5f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:02.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.178+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d3000 con 0x55f781313000 2024-09-13T23:57:02.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.178+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55f781398b40 con 0x55f781313000 2024-09-13T23:57:02.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.178+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94521513574400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d3400 con 0x55f781313000 2024-09-13T23:57:02.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.182+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94521513574400] v33'88 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55f781398b40 con 0x55f781313000 2024-09-13T23:57:02.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.182+0000 7fc56986c700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:02.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.182+0000 7fc5840e5f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:02.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.182+0000 7fc5840e5f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:02.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.182+0000 7fc5840e5f40 1 Processor -- start 2024-09-13T23:57:02.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.182+0000 7fc5840e5f40 1 -- start start 2024-09-13T23:57:02.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.182+0000 7fc5840e5f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f7813d0400 0x55f781257180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.182+0000 7fc5840e5f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f780f94780 con 0x55f7813d0400 2024-09-13T23:57:02.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.182+0000 7fc58209d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f7813d0400 0x55f781257180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.182+0000 7fc58209d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f7813d0400 0x55f781257180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49470/0 (socket says 172.21.15.173:49470) 2024-09-13T23:57:02.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.182+0000 7fc58209d700 1 -- 172.21.15.173:0/4144348262 learned_addr learned my addr 172.21.15.173:0/4144348262 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.182+0000 7fc58209d700 1 -- 172.21.15.173:0/4144348262 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f780f80b60 con 0x55f7813d0400 2024-09-13T23:57:02.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.182+0000 7fc58209d700 1 --2- 172.21.15.173:0/4144348262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f7813d0400 0x55f781257180 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x55f7813e2090 tx=0x55f7812d37a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a7a0b2d1b17fb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.182+0000 7fc56906b700 1 -- 172.21.15.173:0/4144348262 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f7813ea000 con 0x55f7813d0400 2024-09-13T23:57:02.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.182+0000 7fc56906b700 1 -- 172.21.15.173:0/4144348262 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f7812d6600 con 0x55f7813d0400 2024-09-13T23:57:02.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.182+0000 7fc56906b700 1 -- 172.21.15.173:0/4144348262 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f7813ea160 con 0x55f7813d0400 2024-09-13T23:57:02.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.182+0000 7fc5840e5f40 1 -- 172.21.15.173:0/4144348262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f7813d0400 msgr2=0x55f781257180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.182+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/4144348262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f7813d0400 0x55f781257180 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x55f7813e2090 tx=0x55f7812d37a0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.182+0000 7fc5840e5f40 1 -- 172.21.15.173:0/4144348262 shutdown_connections 2024-09-13T23:57:02.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.182+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/4144348262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f7813d0400 0x55f781257180 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.182+0000 7fc5840e5f40 1 -- 172.21.15.173:0/4144348262 >> 172.21.15.173:0/4144348262 conn(0x55f7813d2800 msgr2=0x55f781070000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.186+0000 7fc5840e5f40 1 -- 172.21.15.173:0/4144348262 shutdown_connections 2024-09-13T23:57:02.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.186+0000 7fc5840e5f40 1 -- 172.21.15.173:0/4144348262 wait complete. 2024-09-13T23:57:02.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.186+0000 7fc5840e5f40 1 Processor -- start 2024-09-13T23:57:02.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.186+0000 7fc5840e5f40 1 -- start start 2024-09-13T23:57:02.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.186+0000 7fc5840e5f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f7813d0400 0x55f781257180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.186+0000 7fc5840e5f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f780ffc000 con 0x55f7813d0400 2024-09-13T23:57:02.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.186+0000 7fc58209d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f7813d0400 0x55f781257180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.186+0000 7fc58209d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f7813d0400 0x55f781257180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49478/0 (socket says 172.21.15.173:49478) 2024-09-13T23:57:02.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.186+0000 7fc58209d700 1 -- 172.21.15.173:0/1566958934 learned_addr learned my addr 172.21.15.173:0/1566958934 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.186+0000 7fc58209d700 1 -- 172.21.15.173:0/1566958934 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f780f80d00 con 0x55f7813d0400 2024-09-13T23:57:02.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.186+0000 7fc58209d700 1 --2- 172.21.15.173:0/1566958934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f7813d0400 0x55f781257180 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x55f7813e22a0 tx=0x55f7812d3920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.186+0000 7fc567868700 1 -- 172.21.15.173:0/1566958934 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f7813ea2c0 con 0x55f7813d0400 2024-09-13T23:57:02.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.186+0000 7fc567868700 1 -- 172.21.15.173:0/1566958934 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f7812d6300 con 0x55f7813d0400 2024-09-13T23:57:02.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.186+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1566958934 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f780f80340 con 0x55f7813d0400 2024-09-13T23:57:02.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.186+0000 7fc567868700 1 -- 172.21.15.173:0/1566958934 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f7813ea000 con 0x55f7813d0400 2024-09-13T23:57:02.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.186+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1566958934 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f780f80b60 con 0x55f7813d0400 2024-09-13T23:57:02.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.186+0000 7fc567868700 1 -- 172.21.15.173:0/1566958934 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55f7810698c0 con 0x55f7813d0400 2024-09-13T23:57:02.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.190+0000 7fc567868700 1 --2- 172.21.15.173:0/1566958934 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f781313800 0x55f781468000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.190+0000 7fc567868700 1 -- 172.21.15.173:0/1566958934 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55f780fd5500 con 0x55f7813d0400 2024-09-13T23:57:02.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.190+0000 7fc5840e5f40 5 note: GC not initialized 2024-09-13T23:57:02.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.190+0000 7fc58309f700 1 --2- 172.21.15.173:0/1566958934 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f781313800 0x55f781468000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.190+0000 7fc58309f700 1 --2- 172.21.15.173:0/1566958934 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f781313800 0x55f781468000 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x55f781314210 tx=0x55f781430660 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.190+0000 7fc565063700 20 reqs_thread_entry: start 2024-09-13T23:57:02.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.190+0000 7fc5840e5f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:02.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.190+0000 7fc5840e5f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:02.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.190+0000 7fc5840e5f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.190+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d0800 con 0x55f781313000 2024-09-13T23:57:02.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.190+0000 7fc56285e700 20 reqs_thread_entry: start 2024-09-13T23:57:02.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.190+0000 7fc56305f700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:32 2024 2024-09-13T23:57:02.197 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:02.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.194+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55f781398b40 con 0x55f781313000 2024-09-13T23:57:02.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.194+0000 7fc5840e5f40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:57:02.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.194+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d2c00 con 0x55f7813d0000 2024-09-13T23:57:02.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.194+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x55f781398b40 con 0x55f7813d0000 2024-09-13T23:57:02.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.194+0000 7fc56986c700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:02.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.194+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94521513574400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d3800 con 0x55f781313000 2024-09-13T23:57:02.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.198+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94521513574400] v33'89 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55f781398b40 con 0x55f781313000 2024-09-13T23:57:02.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.198+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94521511951104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d3c00 con 0x55f781313400 2024-09-13T23:57:02.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.198+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94521511951104] v33'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f781399200 con 0x55f781313400 2024-09-13T23:57:02.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.198+0000 7fc5840e5f40 20 remove_watcher() i=0 2024-09-13T23:57:02.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.198+0000 7fc5840e5f40 2 removed watcher, disabling cache 2024-09-13T23:57:02.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.198+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94521511952256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d2400 con 0x55f781313000 2024-09-13T23:57:02.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.202+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94521511952256] v33'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f781398b40 con 0x55f781313000 2024-09-13T23:57:02.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.202+0000 7fc5840e5f40 20 remove_watcher() i=1 2024-09-13T23:57:02.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.202+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94521511953408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d3000 con 0x55f781313400 2024-09-13T23:57:02.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.202+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94521511953408] v33'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f781399200 con 0x55f781313400 2024-09-13T23:57:02.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.202+0000 7fc5840e5f40 20 remove_watcher() i=2 2024-09-13T23:57:02.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.202+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94521511954560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d3400 con 0x55f7813d0000 2024-09-13T23:57:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.206+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94521511954560] v33'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f781398b40 con 0x55f7813d0000 2024-09-13T23:57:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.206+0000 7fc5840e5f40 20 remove_watcher() i=3 2024-09-13T23:57:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.206+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94521511955712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d2c00 con 0x55f781313400 2024-09-13T23:57:02.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.210+0000 7fc58289e700 1 -- 172.21.15.173:0/1771235105 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94521511955712] v33'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f781399200 con 0x55f781313400 2024-09-13T23:57:02.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.210+0000 7fc5840e5f40 20 remove_watcher() i=4 2024-09-13T23:57:02.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.210+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94521511956864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d3800 con 0x55f781313c00 2024-09-13T23:57:02.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.210+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94521511956864] v33'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f781399440 con 0x55f781313c00 2024-09-13T23:57:02.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.210+0000 7fc5840e5f40 20 remove_watcher() i=5 2024-09-13T23:57:02.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.210+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94521511958016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d2400 con 0x55f781313c00 2024-09-13T23:57:02.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.214+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94521511958016] v33'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f781399440 con 0x55f781313c00 2024-09-13T23:57:02.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.214+0000 7fc5840e5f40 20 remove_watcher() i=6 2024-09-13T23:57:02.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.214+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94521511959168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f7813d0800 con 0x55f7813d0000 2024-09-13T23:57:02.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.214+0000 7fc58309f700 1 -- 172.21.15.173:0/1771235105 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94521511959168] v33'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f781398b40 con 0x55f7813d0000 2024-09-13T23:57:02.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 20 remove_watcher() i=7 2024-09-13T23:57:02.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f781313400 msgr2=0x55f781256100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/1771235105 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f781313400 0x55f781256100 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f781313000 msgr2=0x55f781255b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/1771235105 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f781313000 0x55f781255b80 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f7813d0000 msgr2=0x55f781256c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/1771235105 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f7813d0000 0x55f781256c00 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f781313c00 msgr2=0x55f781256680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/1771235105 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f781313c00 0x55f781256680 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f781312c00 msgr2=0x55f781255600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/1771235105 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f781312c00 0x55f781255600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55f781315bf0 tx=0x55f7812d3800 comp rx=0 tx=0).stop 2024-09-13T23:57:02.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f800 msgr2=0x55f781254b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/1771235105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f800 0x55f781254b00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x55f7813148d0 tx=0x55f781073e60 comp rx=0 tx=0).stop 2024-09-13T23:57:02.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 reap_dead start 2024-09-13T23:57:02.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc58209d700 1 -- 172.21.15.173:0/1771235105 reap_dead start 2024-09-13T23:57:02.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 shutdown_connections 2024-09-13T23:57:02.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 >> 172.21.15.173:0/1771235105 conn(0x55f780f6f400 msgr2=0x55f78106f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 shutdown_connections 2024-09-13T23:57:02.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1771235105 wait complete. 2024-09-13T23:57:02.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1566958934 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f781313800 msgr2=0x55f781468000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/1566958934 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f781313800 0x55f781468000 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x55f781314210 tx=0x55f781430660 comp rx=0 tx=0).stop 2024-09-13T23:57:02.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1566958934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f7813d0400 msgr2=0x55f781257180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/1566958934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f7813d0400 0x55f781257180 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x55f7813e22a0 tx=0x55f7812d3920 comp rx=0 tx=0).stop 2024-09-13T23:57:02.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1566958934 shutdown_connections 2024-09-13T23:57:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/1566958934 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f781313800 0x55f781468000 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/1566958934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f7813d0400 0x55f781257180 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1566958934 >> 172.21.15.173:0/1566958934 conn(0x55f7813d2800 msgr2=0x55f781070000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1566958934 shutdown_connections 2024-09-13T23:57:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 -- 172.21.15.173:0/1566958934 wait complete. 2024-09-13T23:57:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 -- 172.21.15.173:0/2917506836 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f781312000 msgr2=0x55f781255080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/2917506836 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f781312000 0x55f781255080 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55f781314030 tx=0x55f7812d2120 comp rx=0 tx=0).stop 2024-09-13T23:57:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 -- 172.21.15.173:0/2917506836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f000 msgr2=0x55f781254580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/2917506836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f000 0x55f781254580 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x55f7810cbf50 tx=0x55f781073920 comp rx=0 tx=0).stop 2024-09-13T23:57:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 -- 172.21.15.173:0/2917506836 shutdown_connections 2024-09-13T23:57:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/2917506836 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f781312000 0x55f781255080 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 --2- 172.21.15.173:0/2917506836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f780f6f000 0x55f781254580 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 -- 172.21.15.173:0/2917506836 >> 172.21.15.173:0/2917506836 conn(0x55f780f6ec00 msgr2=0x55f78106f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 -- 172.21.15.173:0/2917506836 shutdown_connections 2024-09-13T23:57:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.218+0000 7fc5840e5f40 1 -- 172.21.15.173:0/2917506836 wait complete. 2024-09-13T23:57:02.227 INFO:teuthology.orchestra.run.smithi173.stdout:[] 2024-09-13T23:57:02.229 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T23:57:02.229 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-13T23:57:02.230 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-13T23:57:02.230 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-13T23:57:02.271 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:02.272 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:02.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.266+0000 7f7ac577ff40 1 Processor -- start 2024-09-13T23:57:02.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.266+0000 7f7ac577ff40 1 -- start start 2024-09-13T23:57:02.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.266+0000 7f7ac577ff40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x5629ab571000 0x5629ab856580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.266+0000 7f7ac577ff40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5629ab635500 con 0x5629ab571400 2024-09-13T23:57:02.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.266+0000 7f7ac577ff40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x5629ab5fea00 con 0x5629ab571000 2024-09-13T23:57:02.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.266+0000 7f7ac3737700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x5629ab571400 0x5629ab670800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47370/0 (socket says 172.21.15.173:47370) 2024-09-13T23:57:02.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.266+0000 7f7ac3737700 1 -- 172.21.15.173:0/2321546638 learned_addr learned my addr 172.21.15.173:0/2321546638 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:02.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.266+0000 7f7ac3f38700 1 --2- 172.21.15.173:0/2321546638 >> v2:172.21.15.87:3300/0 conn(0x5629ab571000 0x5629ab856580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.270+0000 7f7ac2f36700 1 -- 172.21.15.173:0/2321546638 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186455823 0 0) 0x5629ab6cc000 con 0x5629ab571400 2024-09-13T23:57:02.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.270+0000 7f7ac2f36700 1 -- 172.21.15.173:0/2321546638 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x5629ab635680 con 0x5629ab571400 2024-09-13T23:57:02.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.270+0000 7f7ac3f38700 1 -- 172.21.15.173:0/2321546638 >> v1:172.21.15.87:6789/0 conn(0x5629ab571400 legacy=0x5629ab670800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.270+0000 7f7ac3f38700 1 -- 172.21.15.173:0/2321546638 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629ab583d40 con 0x5629ab571000 2024-09-13T23:57:02.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.270+0000 7f7ac3f38700 1 --2- 172.21.15.173:0/2321546638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571000 0x5629ab856580 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x5629ab851a70 tx=0x5629ab675980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dbe47c0b7ba4a04 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.270+0000 7f7ac2f36700 1 -- 172.21.15.173:0/2321546638 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5629ab6154a0 con 0x5629ab571000 2024-09-13T23:57:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.270+0000 7f7ac2f36700 1 -- 172.21.15.173:0/2321546638 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5629ab635680 con 0x5629ab571000 2024-09-13T23:57:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.270+0000 7f7ac2f36700 1 -- 172.21.15.173:0/2321546638 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5629ab615600 con 0x5629ab571000 2024-09-13T23:57:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.270+0000 7f7ac577ff40 1 -- 172.21.15.173:0/2321546638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571000 msgr2=0x5629ab856580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.270+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/2321546638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571000 0x5629ab856580 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x5629ab851a70 tx=0x5629ab675980 comp rx=0 tx=0).stop 2024-09-13T23:57:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.270+0000 7f7ac577ff40 1 -- 172.21.15.173:0/2321546638 shutdown_connections 2024-09-13T23:57:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.270+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/2321546638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571000 0x5629ab856580 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.270+0000 7f7ac577ff40 1 -- 172.21.15.173:0/2321546638 >> 172.21.15.173:0/2321546638 conn(0x5629ab570c00 msgr2=0x5629ab670000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.270+0000 7f7ac577ff40 1 -- 172.21.15.173:0/2321546638 shutdown_connections 2024-09-13T23:57:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.270+0000 7f7ac577ff40 1 -- 172.21.15.173:0/2321546638 wait complete. 2024-09-13T23:57:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.270+0000 7f7ac577ff40 1 Processor -- start 2024-09-13T23:57:02.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.270+0000 7f7ac577ff40 1 -- start start 2024-09-13T23:57:02.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.270+0000 7f7ac577ff40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571000 0x5629ab856580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.270+0000 7f7ac577ff40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629ab5fe500 con 0x5629ab571000 2024-09-13T23:57:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.270+0000 7f7ac3f38700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571000 0x5629ab856580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.270+0000 7f7ac3f38700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571000 0x5629ab856580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49496/0 (socket says 172.21.15.173:49496) 2024-09-13T23:57:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.270+0000 7f7ac3f38700 1 -- 172.21.15.173:0/230959546 learned_addr learned my addr 172.21.15.173:0/230959546 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.274+0000 7f7ac3f38700 1 -- 172.21.15.173:0/230959546 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629ab583ba0 con 0x5629ab571000 2024-09-13T23:57:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.274+0000 7f7ac3f38700 1 --2- 172.21.15.173:0/230959546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571000 0x5629ab856580 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x5629ac345e00 tx=0x5629ab675800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e1e74384a62112 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.274+0000 7f7ac2735700 1 -- 172.21.15.173:0/230959546 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5629ab615760 con 0x5629ab571000 2024-09-13T23:57:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.274+0000 7f7ac2735700 1 -- 172.21.15.173:0/230959546 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5629ab635980 con 0x5629ab571000 2024-09-13T23:57:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.274+0000 7f7ac2735700 1 -- 172.21.15.173:0/230959546 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5629ab6151e0 con 0x5629ab571000 2024-09-13T23:57:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.274+0000 7f7ac577ff40 1 -- 172.21.15.173:0/230959546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571000 msgr2=0x5629ab856580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.274+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/230959546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571000 0x5629ab856580 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x5629ac345e00 tx=0x5629ab675800 comp rx=0 tx=0).stop 2024-09-13T23:57:02.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.274+0000 7f7ac577ff40 1 -- 172.21.15.173:0/230959546 shutdown_connections 2024-09-13T23:57:02.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.274+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/230959546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571000 0x5629ab856580 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.274+0000 7f7ac577ff40 1 -- 172.21.15.173:0/230959546 >> 172.21.15.173:0/230959546 conn(0x5629ab570c00 msgr2=0x5629ab671000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.274+0000 7f7ac577ff40 1 -- 172.21.15.173:0/230959546 shutdown_connections 2024-09-13T23:57:02.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.274+0000 7f7ac577ff40 1 -- 172.21.15.173:0/230959546 wait complete. 2024-09-13T23:57:02.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.274+0000 7f7ac577ff40 1 Processor -- start 2024-09-13T23:57:02.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.274+0000 7f7ac577ff40 1 -- start start 2024-09-13T23:57:02.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.274+0000 7f7ac577ff40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571400 0x5629ab856b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.274+0000 7f7ac577ff40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629ab5fe3c0 con 0x5629ab571400 2024-09-13T23:57:02.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.274+0000 7f7ac3f38700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571400 0x5629ab856b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.274+0000 7f7ac3f38700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571400 0x5629ab856b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49504/0 (socket says 172.21.15.173:49504) 2024-09-13T23:57:02.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.274+0000 7f7ac3f38700 1 -- 172.21.15.173:0/2891542522 learned_addr learned my addr 172.21.15.173:0/2891542522 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.274+0000 7f7ac3f38700 1 -- 172.21.15.173:0/2891542522 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629ab583a00 con 0x5629ab571400 2024-09-13T23:57:02.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.274+0000 7f7ac3f38700 1 --2- 172.21.15.173:0/2891542522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571400 0x5629ab856b00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x5629ac345e90 tx=0x5629ab675980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.278+0000 7f7ac0f32700 1 -- 172.21.15.173:0/2891542522 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5629ab6154a0 con 0x5629ab571400 2024-09-13T23:57:02.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.278+0000 7f7ac0f32700 1 -- 172.21.15.173:0/2891542522 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5629ab635b00 con 0x5629ab571400 2024-09-13T23:57:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.278+0000 7f7ac577ff40 1 -- 172.21.15.173:0/2891542522 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5629ab583860 con 0x5629ab571400 2024-09-13T23:57:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.278+0000 7f7ac0f32700 1 -- 172.21.15.173:0/2891542522 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5629ab615600 con 0x5629ab571400 2024-09-13T23:57:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.278+0000 7f7ac577ff40 1 -- 172.21.15.173:0/2891542522 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629ab5836c0 con 0x5629ab571400 2024-09-13T23:57:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.278+0000 7f7ac577ff40 1 Processor -- start 2024-09-13T23:57:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.278+0000 7f7ac577ff40 1 -- start start 2024-09-13T23:57:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.278+0000 7f7ac577ff40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571c00 0x5629ab857080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.278+0000 7f7ac577ff40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629ab5fe000 con 0x5629ab571c00 2024-09-13T23:57:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.278+0000 7f7ac0f32700 1 -- 172.21.15.173:0/2891542522 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x5629ab66ab00 con 0x5629ab571400 2024-09-13T23:57:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.278+0000 7f7ac4739700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571c00 0x5629ab857080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.278+0000 7f7ac4739700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571c00 0x5629ab857080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49512/0 (socket says 172.21.15.173:49512) 2024-09-13T23:57:02.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.278+0000 7f7ac4739700 1 -- 172.21.15.173:0/902792961 learned_addr learned my addr 172.21.15.173:0/902792961 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.278+0000 7f7ac0f32700 1 --2- 172.21.15.173:0/2891542522 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5629ab914000 0x5629ab858100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.278+0000 7f7ac0f32700 1 -- 172.21.15.173:0/2891542522 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5629ab5d7180 con 0x5629ab571400 2024-09-13T23:57:02.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.278+0000 7f7ac3f38700 1 --2- 172.21.15.173:0/2891542522 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5629ab914000 0x5629ab858100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.278+0000 7f7ac4739700 1 -- 172.21.15.173:0/902792961 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629ab582000 con 0x5629ab571c00 2024-09-13T23:57:02.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.278+0000 7f7ac3f38700 1 --2- 172.21.15.173:0/2891542522 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5629ab914000 0x5629ab858100 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x5629ab8a3650 tx=0x5629ab8d88a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.278+0000 7f7ac4739700 1 --2- 172.21.15.173:0/902792961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571c00 0x5629ab857080 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x5629ab8ee720 tx=0x5629ab8d8780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe9b9e993b44718 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.278+0000 7f7abe72d700 1 -- 172.21.15.173:0/902792961 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5629ab6154a0 con 0x5629ab571c00 2024-09-13T23:57:02.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.278+0000 7f7abe72d700 1 -- 172.21.15.173:0/902792961 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5629ab635b00 con 0x5629ab571c00 2024-09-13T23:57:02.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.278+0000 7f7abe72d700 1 -- 172.21.15.173:0/902792961 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5629ab615600 con 0x5629ab571c00 2024-09-13T23:57:02.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.282+0000 7f7ac577ff40 1 -- 172.21.15.173:0/902792961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571c00 msgr2=0x5629ab857080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.282+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/902792961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571c00 0x5629ab857080 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x5629ab8ee720 tx=0x5629ab8d8780 comp rx=0 tx=0).stop 2024-09-13T23:57:02.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.282+0000 7f7ac577ff40 1 -- 172.21.15.173:0/902792961 shutdown_connections 2024-09-13T23:57:02.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.282+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/902792961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571c00 0x5629ab857080 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.282+0000 7f7ac577ff40 1 -- 172.21.15.173:0/902792961 >> 172.21.15.173:0/902792961 conn(0x5629ab571800 msgr2=0x5629ab671800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.282+0000 7f7ac577ff40 1 -- 172.21.15.173:0/902792961 shutdown_connections 2024-09-13T23:57:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.282+0000 7f7ac577ff40 1 -- 172.21.15.173:0/902792961 wait complete. 2024-09-13T23:57:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.282+0000 7f7ac577ff40 1 Processor -- start 2024-09-13T23:57:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.282+0000 7f7ac577ff40 1 -- start start 2024-09-13T23:57:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.282+0000 7f7ac577ff40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571c00 0x5629ab857080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.282+0000 7f7ac577ff40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629ab596640 con 0x5629ab571c00 2024-09-13T23:57:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.282+0000 7f7ac4739700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571c00 0x5629ab857080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.282+0000 7f7ac4739700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571c00 0x5629ab857080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49524/0 (socket says 172.21.15.173:49524) 2024-09-13T23:57:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.282+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 learned_addr learned my addr 172.21.15.173:0/1549597906 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.282+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629ab582ea0 con 0x5629ab571c00 2024-09-13T23:57:02.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.282+0000 7f7ac4739700 1 --2- 172.21.15.173:0/1549597906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571c00 0x5629ab857080 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x5629ab8a2150 tx=0x5629ab8d85a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.282+0000 7f7abcf2a700 1 -- 172.21.15.173:0/1549597906 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5629ab615760 con 0x5629ab571c00 2024-09-13T23:57:02.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.282+0000 7f7abcf2a700 1 -- 172.21.15.173:0/1549597906 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5629ab92a000 con 0x5629ab571c00 2024-09-13T23:57:02.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.282+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5629ab582820 con 0x5629ab571c00 2024-09-13T23:57:02.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.282+0000 7f7abcf2a700 1 -- 172.21.15.173:0/1549597906 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5629ab6154a0 con 0x5629ab571c00 2024-09-13T23:57:02.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.282+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629ab5829c0 con 0x5629ab571c00 2024-09-13T23:57:02.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.286+0000 7f7abcf2a700 1 -- 172.21.15.173:0/1549597906 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x5629ab66adc0 con 0x5629ab571c00 2024-09-13T23:57:02.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.286+0000 7f7ac577ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.286+0000 7f7abcf2a700 1 --2- 172.21.15.173:0/1549597906 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5629ab914c00 0x5629ab858680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.286+0000 7f7abcf2a700 1 -- 172.21.15.173:0/1549597906 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5629ab5d7340 con 0x5629ab571c00 2024-09-13T23:57:02.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.286+0000 7f7ac3737700 1 --2- 172.21.15.173:0/1549597906 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5629ab914c00 0x5629ab858680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.286+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/1549597906 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5629ab915000 0x5629ab857600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.286+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915400 con 0x5629ab915000 2024-09-13T23:57:02.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.286+0000 7f7ac4739700 1 --2- 172.21.15.173:0/1549597906 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5629ab915000 0x5629ab857600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.286+0000 7f7ac3737700 1 --2- 172.21.15.173:0/1549597906 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5629ab914c00 0x5629ab858680 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x5629ac344030 tx=0x5629ab8d9920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.286+0000 7f7ac4739700 1 --2- 172.21.15.173:0/1549597906 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5629ab915000 0x5629ab857600 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.286+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab915000 2024-09-13T23:57:02.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.286+0000 7f7ac577ff40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.286+0000 7f7ac577ff40 20 realm 2024-09-13T23:57:02.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.286+0000 7f7ac577ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.286+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915000 2024-09-13T23:57:02.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.290+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab915000 2024-09-13T23:57:02.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.290+0000 7f7ac577ff40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.290+0000 7f7ac577ff40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:02.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.290+0000 7f7ac577ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.290+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915c00 con 0x5629ab915000 2024-09-13T23:57:02.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.290+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab915000 2024-09-13T23:57:02.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.290+0000 7f7ac577ff40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.290+0000 7f7ac577ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.290+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/1549597906 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5629ab915400 0x5629ab857b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.290+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915400 2024-09-13T23:57:02.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.290+0000 7f7ac3f38700 1 --2- 172.21.15.173:0/1549597906 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5629ab915400 0x5629ab857b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.290+0000 7f7ac3f38700 1 --2- 172.21.15.173:0/1549597906 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5629ab915400 0x5629ab857b80 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.290+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5629ab9bf200 con 0x5629ab915400 2024-09-13T23:57:02.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.290+0000 7f7ac577ff40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:02.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.290+0000 7f7ac577ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.290+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/1549597906 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5629ab915c00 0x5629ab858c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.290+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e0000 con 0x5629ab915c00 2024-09-13T23:57:02.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.290+0000 7f7ac3737700 1 --2- 172.21.15.173:0/1549597906 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5629ab915c00 0x5629ab858c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.290+0000 7f7ac3737700 1 --2- 172.21.15.173:0/1549597906 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5629ab915c00 0x5629ab858c00 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.290+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5629ab9bf440 con 0x5629ab915c00 2024-09-13T23:57:02.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.290+0000 7f7ac577ff40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:02.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.290+0000 7f7ac577ff40 20 searching for the correct realm 2024-09-13T23:57:02.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.290+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e0400 con 0x5629ab915c00 2024-09-13T23:57:02.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.294+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5629ab9bf440 con 0x5629ab915c00 2024-09-13T23:57:02.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.294+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e0000 con 0x5629ab915400 2024-09-13T23:57:02.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.294+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9bf200 con 0x5629ab915400 2024-09-13T23:57:02.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.294+0000 7f7ac3f38700 1 --2- 172.21.15.173:0/1549597906 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5629ab9e0000 0x5629ab856580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.294+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab9e0000 2024-09-13T23:57:02.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.294+0000 7f7ac4739700 1 --2- 172.21.15.173:0/1549597906 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5629ab9e0000 0x5629ab856580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.294+0000 7f7ac4739700 1 --2- 172.21.15.173:0/1549597906 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5629ab9e0000 0x5629ab856580 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.294+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab9e0000 2024-09-13T23:57:02.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.294+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915000 2024-09-13T23:57:02.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.294+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab915000 2024-09-13T23:57:02.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.294+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915000 2024-09-13T23:57:02.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.294+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab915000 2024-09-13T23:57:02.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.294+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915c00 2024-09-13T23:57:02.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.294+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9bf440 con 0x5629ab915c00 2024-09-13T23:57:02.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.294+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915000 2024-09-13T23:57:02.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.298+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab915000 2024-09-13T23:57:02.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.298+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915400 2024-09-13T23:57:02.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.298+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9bf200 con 0x5629ab915400 2024-09-13T23:57:02.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.298+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915400 2024-09-13T23:57:02.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.298+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9bf200 con 0x5629ab915400 2024-09-13T23:57:02.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.298+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915000 2024-09-13T23:57:02.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.298+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab915000 2024-09-13T23:57:02.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.298+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab9e0000 2024-09-13T23:57:02.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.298+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab9e0000 2024-09-13T23:57:02.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.298+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915000 2024-09-13T23:57:02.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.298+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab915000 2024-09-13T23:57:02.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.298+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab9e0000 2024-09-13T23:57:02.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.298+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab9e0000 2024-09-13T23:57:02.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.298+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915400 2024-09-13T23:57:02.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.302+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9bf200 con 0x5629ab915400 2024-09-13T23:57:02.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.302+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915c00 2024-09-13T23:57:02.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.302+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9bf440 con 0x5629ab915c00 2024-09-13T23:57:02.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.302+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915000 2024-09-13T23:57:02.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.302+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab915000 2024-09-13T23:57:02.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.302+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915400 2024-09-13T23:57:02.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.302+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9bf200 con 0x5629ab915400 2024-09-13T23:57:02.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.302+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915c00 2024-09-13T23:57:02.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.302+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9bf440 con 0x5629ab915c00 2024-09-13T23:57:02.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.302+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915000 2024-09-13T23:57:02.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.302+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab915000 2024-09-13T23:57:02.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.302+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915000 2024-09-13T23:57:02.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.306+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab915000 2024-09-13T23:57:02.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.306+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915000 2024-09-13T23:57:02.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.306+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab915000 2024-09-13T23:57:02.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.306+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915c00 2024-09-13T23:57:02.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.306+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9bf440 con 0x5629ab915c00 2024-09-13T23:57:02.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.306+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab9e0000 2024-09-13T23:57:02.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.306+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab9e0000 2024-09-13T23:57:02.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.306+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915000 2024-09-13T23:57:02.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.306+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab915000 2024-09-13T23:57:02.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.306+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab9e0000 2024-09-13T23:57:02.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.306+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab9e0000 2024-09-13T23:57:02.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.306+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915c00 2024-09-13T23:57:02.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.306+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9bf440 con 0x5629ab915c00 2024-09-13T23:57:02.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.306+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab9e0000 2024-09-13T23:57:02.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.306+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab9e0000 2024-09-13T23:57:02.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.306+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915400 2024-09-13T23:57:02.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.310+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9bf200 con 0x5629ab915400 2024-09-13T23:57:02.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.310+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915400 2024-09-13T23:57:02.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.310+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9bf200 con 0x5629ab915400 2024-09-13T23:57:02.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.310+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915c00 2024-09-13T23:57:02.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.310+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9bf440 con 0x5629ab915c00 2024-09-13T23:57:02.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.310+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915400 2024-09-13T23:57:02.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.310+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5629ab9bf200 con 0x5629ab915400 2024-09-13T23:57:02.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.310+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915400 2024-09-13T23:57:02.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.310+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5629ab9bf200 con 0x5629ab915400 2024-09-13T23:57:02.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.310+0000 7f7ac577ff40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:02.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.310+0000 7f7ac577ff40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:02.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.310+0000 7f7ac577ff40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:02.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.310+0000 7f7ac577ff40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:02.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.310+0000 7f7ac577ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.310+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e0800 con 0x5629ab915000 2024-09-13T23:57:02.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab915000 2024-09-13T23:57:02.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e0c00 con 0x5629ab915400 2024-09-13T23:57:02.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5629ab9bf200 con 0x5629ab915400 2024-09-13T23:57:02.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:02.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e1000 con 0x5629ab915000 2024-09-13T23:57:02.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab915000 2024-09-13T23:57:02.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:02.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 20 zone default found 2024-09-13T23:57:02.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 4 Realm: () 2024-09-13T23:57:02.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:02.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:02.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:02.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 20 zonegroup default 2024-09-13T23:57:02.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e1400 con 0x5629ab9e0000 2024-09-13T23:57:02.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab9e0000 2024-09-13T23:57:02.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e1800 con 0x5629ab915c00 2024-09-13T23:57:02.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5629ab9bf440 con 0x5629ab915c00 2024-09-13T23:57:02.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e1c00 con 0x5629ab915c00 2024-09-13T23:57:02.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5629ab9bf440 con 0x5629ab915c00 2024-09-13T23:57:02.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 20 started sync module instance, tier type = 2024-09-13T23:57:02.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:02.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.314+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e6000 con 0x5629ab915400 2024-09-13T23:57:02.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.318+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629ab9bf200 con 0x5629ab915400 2024-09-13T23:57:02.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.318+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94736971258624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e6400 con 0x5629ab915400 2024-09-13T23:57:02.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.318+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e6800 con 0x5629ab915000 2024-09-13T23:57:02.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.322+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94736971258624] v33'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629ab9bf200 con 0x5629ab915400 2024-09-13T23:57:02.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.322+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab915000 2024-09-13T23:57:02.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.322+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94736971259776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e6c00 con 0x5629ab915000 2024-09-13T23:57:02.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.322+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e7000 con 0x5629ab915400 2024-09-13T23:57:02.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.322+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94736971259776] v33'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab915000 2024-09-13T23:57:02.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.326+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629ab9bf200 con 0x5629ab915400 2024-09-13T23:57:02.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.326+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94736971260928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e7400 con 0x5629ab915400 2024-09-13T23:57:02.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.326+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e7800 con 0x5629ab9e0000 2024-09-13T23:57:02.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.326+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab9e0000 2024-09-13T23:57:02.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.326+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94736971262080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e7c00 con 0x5629ab9e0000 2024-09-13T23:57:02.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.326+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94736971260928] v33'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629ab9bf200 con 0x5629ab915400 2024-09-13T23:57:02.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.326+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e6800 con 0x5629ab915400 2024-09-13T23:57:02.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.330+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94736971262080] v33'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab9e0000 2024-09-13T23:57:02.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.330+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629ab9bf200 con 0x5629ab915400 2024-09-13T23:57:02.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.330+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94736971263232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e6000 con 0x5629ab915400 2024-09-13T23:57:02.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.330+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e6400 con 0x5629ab915c00 2024-09-13T23:57:02.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.334+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629ab9bf440 con 0x5629ab915c00 2024-09-13T23:57:02.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.334+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94736971264384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e0800 con 0x5629ab915c00 2024-09-13T23:57:02.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.334+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e1000 con 0x5629ab915c00 2024-09-13T23:57:02.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.334+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94736971263232] v33'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629ab9bf200 con 0x5629ab915400 2024-09-13T23:57:02.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.334+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94736971264384] v33'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629ab9bf440 con 0x5629ab915c00 2024-09-13T23:57:02.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.334+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629ab9bf440 con 0x5629ab915c00 2024-09-13T23:57:02.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.334+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94736971265536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e1400 con 0x5629ab915c00 2024-09-13T23:57:02.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.334+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e0c00 con 0x5629ab9e0000 2024-09-13T23:57:02.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.338+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94736971265536] v33'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629ab9bf440 con 0x5629ab915c00 2024-09-13T23:57:02.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.338+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab9e0000 2024-09-13T23:57:02.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.338+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94736971266688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab9e0000 2024-09-13T23:57:02.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.338+0000 7f7ac577ff40 20 add_watcher() i=0 2024-09-13T23:57:02.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.338+0000 7f7ac577ff40 20 add_watcher() i=1 2024-09-13T23:57:02.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.338+0000 7f7ac577ff40 20 add_watcher() i=2 2024-09-13T23:57:02.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.338+0000 7f7ac577ff40 20 add_watcher() i=3 2024-09-13T23:57:02.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.338+0000 7f7ac577ff40 20 add_watcher() i=4 2024-09-13T23:57:02.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.338+0000 7f7ac577ff40 20 add_watcher() i=5 2024-09-13T23:57:02.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.338+0000 7f7ac577ff40 20 add_watcher() i=6 2024-09-13T23:57:02.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.338+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94736971266688] v33'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab9e0000 2024-09-13T23:57:02.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.338+0000 7f7ac577ff40 20 add_watcher() i=7 2024-09-13T23:57:02.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.338+0000 7f7ac577ff40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:02.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.338+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e6c00 con 0x5629ab915000 2024-09-13T23:57:02.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.338+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab915000 2024-09-13T23:57:02.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.342+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94736972955648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e7800 con 0x5629ab915000 2024-09-13T23:57:02.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.342+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94736972955648] v33'90 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab915000 2024-09-13T23:57:02.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.342+0000 7f7aaaf06700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:02.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.342+0000 7f7ac577ff40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:02.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.342+0000 7f7ac577ff40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:02.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.342+0000 7f7ac577ff40 1 Processor -- start 2024-09-13T23:57:02.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.342+0000 7f7ac577ff40 1 -- start start 2024-09-13T23:57:02.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.342+0000 7f7ac577ff40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab9e6400 0x5629ab859180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.342+0000 7f7ac577ff40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629ab596780 con 0x5629ab9e6400 2024-09-13T23:57:02.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.342+0000 7f7ac3737700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab9e6400 0x5629ab859180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.342+0000 7f7ac3737700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab9e6400 0x5629ab859180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49534/0 (socket says 172.21.15.173:49534) 2024-09-13T23:57:02.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.342+0000 7f7ac3737700 1 -- 172.21.15.173:0/3226050615 learned_addr learned my addr 172.21.15.173:0/3226050615 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.346+0000 7f7ac3737700 1 -- 172.21.15.173:0/3226050615 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629ab582b60 con 0x5629ab9e6400 2024-09-13T23:57:02.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.346+0000 7f7ac3737700 1 --2- 172.21.15.173:0/3226050615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab9e6400 0x5629ab859180 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x5629ab979ec0 tx=0x5629ab8d98c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c16a62915cf110 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.346+0000 7f7aaa705700 1 -- 172.21.15.173:0/3226050615 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5629ab9fc000 con 0x5629ab9e6400 2024-09-13T23:57:02.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.346+0000 7f7aaa705700 1 -- 172.21.15.173:0/3226050615 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5629ab92a480 con 0x5629ab9e6400 2024-09-13T23:57:02.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.346+0000 7f7aaa705700 1 -- 172.21.15.173:0/3226050615 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5629ab9fc160 con 0x5629ab9e6400 2024-09-13T23:57:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.346+0000 7f7ac577ff40 1 -- 172.21.15.173:0/3226050615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab9e6400 msgr2=0x5629ab859180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.346+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/3226050615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab9e6400 0x5629ab859180 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x5629ab979ec0 tx=0x5629ab8d98c0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.346+0000 7f7ac577ff40 1 -- 172.21.15.173:0/3226050615 shutdown_connections 2024-09-13T23:57:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.346+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/3226050615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab9e6400 0x5629ab859180 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.346+0000 7f7ac577ff40 1 -- 172.21.15.173:0/3226050615 >> 172.21.15.173:0/3226050615 conn(0x5629ab9e7c00 msgr2=0x5629ab672000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.346+0000 7f7ac577ff40 1 -- 172.21.15.173:0/3226050615 shutdown_connections 2024-09-13T23:57:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.346+0000 7f7ac577ff40 1 -- 172.21.15.173:0/3226050615 wait complete. 2024-09-13T23:57:02.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.346+0000 7f7ac577ff40 1 Processor -- start 2024-09-13T23:57:02.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.346+0000 7f7ac577ff40 1 -- start start 2024-09-13T23:57:02.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.346+0000 7f7ac577ff40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab9e6400 0x5629ab859180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.346+0000 7f7ac577ff40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629ab5fe000 con 0x5629ab9e6400 2024-09-13T23:57:02.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.346+0000 7f7ac3737700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab9e6400 0x5629ab859180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.346+0000 7f7ac3737700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab9e6400 0x5629ab859180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49550/0 (socket says 172.21.15.173:49550) 2024-09-13T23:57:02.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.346+0000 7f7ac3737700 1 -- 172.21.15.173:0/2834071797 learned_addr learned my addr 172.21.15.173:0/2834071797 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.350+0000 7f7ac3737700 1 -- 172.21.15.173:0/2834071797 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629ab582d00 con 0x5629ab9e6400 2024-09-13T23:57:02.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.350+0000 7f7ac3737700 1 --2- 172.21.15.173:0/2834071797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab9e6400 0x5629ab859180 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x5629aba040f0 tx=0x5629ab8d9a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.350+0000 7f7aa8f02700 1 -- 172.21.15.173:0/2834071797 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5629ab9fc2c0 con 0x5629ab9e6400 2024-09-13T23:57:02.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.350+0000 7f7aa8f02700 1 -- 172.21.15.173:0/2834071797 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5629ab92a600 con 0x5629ab9e6400 2024-09-13T23:57:02.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.350+0000 7f7ac577ff40 1 -- 172.21.15.173:0/2834071797 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5629ab582340 con 0x5629ab9e6400 2024-09-13T23:57:02.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.350+0000 7f7aa8f02700 1 -- 172.21.15.173:0/2834071797 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5629ab9fc000 con 0x5629ab9e6400 2024-09-13T23:57:02.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.350+0000 7f7ac577ff40 1 -- 172.21.15.173:0/2834071797 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629ab582b60 con 0x5629ab9e6400 2024-09-13T23:57:02.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.350+0000 7f7aa8f02700 1 -- 172.21.15.173:0/2834071797 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x5629ab66bb80 con 0x5629ab9e6400 2024-09-13T23:57:02.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.350+0000 7f7aa8f02700 1 --2- 172.21.15.173:0/2834071797 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5629aba7a000 0x5629aba80000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.350+0000 7f7aa8f02700 1 -- 172.21.15.173:0/2834071797 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5629ab5d7500 con 0x5629ab9e6400 2024-09-13T23:57:02.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.350+0000 7f7ac4739700 1 --2- 172.21.15.173:0/2834071797 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5629aba7a000 0x5629aba80000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.350+0000 7f7ac577ff40 5 note: GC not initialized 2024-09-13T23:57:02.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.354+0000 7f7ac4739700 1 --2- 172.21.15.173:0/2834071797 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5629aba7a000 0x5629aba80000 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x5629ab9794a0 tx=0x5629aba44660 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.354+0000 7f7aa66fd700 20 reqs_thread_entry: start 2024-09-13T23:57:02.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.354+0000 7f7ac577ff40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:02.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.354+0000 7f7ac577ff40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:02.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.354+0000 7f7aa3ef8700 20 reqs_thread_entry: start 2024-09-13T23:57:02.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.354+0000 7f7ac577ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.354+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e1800 con 0x5629ab915000 2024-09-13T23:57:02.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.354+0000 7f7aa46f9700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:32 2024 2024-09-13T23:57:02.360 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:02.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.354+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab915000 2024-09-13T23:57:02.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.354+0000 7f7ac577ff40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:57:02.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.354+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab9e1c00 con 0x5629ab9e0000 2024-09-13T23:57:02.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.358+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab9e0000 2024-09-13T23:57:02.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.358+0000 7f7aaaf06700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:02.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.358+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94736972955648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ab915800 con 0x5629ab915000 2024-09-13T23:57:02.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.362+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94736972955648] v33'91 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab915000 2024-09-13T23:57:02.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.362+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94736971258624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629aba7a400 con 0x5629ab915400 2024-09-13T23:57:02.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.362+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94736971258624] v33'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629ab9bf200 con 0x5629ab915400 2024-09-13T23:57:02.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.362+0000 7f7ac577ff40 20 remove_watcher() i=0 2024-09-13T23:57:02.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.362+0000 7f7ac577ff40 2 removed watcher, disabling cache 2024-09-13T23:57:02.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.362+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94736971259776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629aba7a800 con 0x5629ab915000 2024-09-13T23:57:02.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.366+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94736971259776] v33'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab915000 2024-09-13T23:57:02.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.366+0000 7f7ac577ff40 20 remove_watcher() i=1 2024-09-13T23:57:02.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.366+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94736971260928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629aba7ac00 con 0x5629ab915400 2024-09-13T23:57:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.366+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94736971260928] v33'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629ab9bf200 con 0x5629ab915400 2024-09-13T23:57:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.366+0000 7f7ac577ff40 20 remove_watcher() i=2 2024-09-13T23:57:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.366+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94736971262080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629aba7b000 con 0x5629ab9e0000 2024-09-13T23:57:02.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.370+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94736971262080] v33'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab9e0000 2024-09-13T23:57:02.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.370+0000 7f7ac577ff40 20 remove_watcher() i=3 2024-09-13T23:57:02.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.370+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94736971263232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629aba7b400 con 0x5629ab915400 2024-09-13T23:57:02.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.374+0000 7f7ac3f38700 1 -- 172.21.15.173:0/1549597906 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94736971263232] v33'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629ab9bf200 con 0x5629ab915400 2024-09-13T23:57:02.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.374+0000 7f7ac577ff40 20 remove_watcher() i=4 2024-09-13T23:57:02.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.374+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94736971264384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629aba7b800 con 0x5629ab915c00 2024-09-13T23:57:02.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.374+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94736971264384] v33'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629ab9bf440 con 0x5629ab915c00 2024-09-13T23:57:02.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.374+0000 7f7ac577ff40 20 remove_watcher() i=5 2024-09-13T23:57:02.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.374+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94736971265536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629aba7bc00 con 0x5629ab915c00 2024-09-13T23:57:02.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.378+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94736971265536] v33'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629ab9bf440 con 0x5629ab915c00 2024-09-13T23:57:02.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.378+0000 7f7ac577ff40 20 remove_watcher() i=6 2024-09-13T23:57:02.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.378+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94736971266688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629aba7a800 con 0x5629ab9e0000 2024-09-13T23:57:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.378+0000 7f7ac4739700 1 -- 172.21.15.173:0/1549597906 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94736971266688] v33'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5629ab9beb40 con 0x5629ab9e0000 2024-09-13T23:57:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.378+0000 7f7ac577ff40 20 remove_watcher() i=7 2024-09-13T23:57:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.378+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5629ab915400 msgr2=0x5629ab857b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.378+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/1549597906 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5629ab915400 0x5629ab857b80 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.378+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5629ab915000 msgr2=0x5629ab857600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.378+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/1549597906 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5629ab915000 0x5629ab857600 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.378+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5629ab9e0000 msgr2=0x5629ab856580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.378+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/1549597906 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5629ab9e0000 0x5629ab856580 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.378+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5629ab915c00 msgr2=0x5629ab858c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.378+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/1549597906 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5629ab915c00 0x5629ab858c00 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.378+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5629ab914c00 msgr2=0x5629ab858680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.378+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/1549597906 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5629ab914c00 0x5629ab858680 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x5629ac344030 tx=0x5629ab8d9920 comp rx=0 tx=0).stop 2024-09-13T23:57:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.378+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571c00 msgr2=0x5629ab857080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.378+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/1549597906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571c00 0x5629ab857080 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x5629ab8a2150 tx=0x5629ab8d85a0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.378+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 reap_dead start 2024-09-13T23:57:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac3737700 1 -- 172.21.15.173:0/1549597906 reap_dead start 2024-09-13T23:57:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 shutdown_connections 2024-09-13T23:57:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 >> 172.21.15.173:0/1549597906 conn(0x5629ab571800 msgr2=0x5629ab671800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 shutdown_connections 2024-09-13T23:57:02.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac577ff40 1 -- 172.21.15.173:0/1549597906 wait complete. 2024-09-13T23:57:02.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac577ff40 1 -- 172.21.15.173:0/2834071797 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5629aba7a000 msgr2=0x5629aba80000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/2834071797 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5629aba7a000 0x5629aba80000 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x5629ab9794a0 tx=0x5629aba44660 comp rx=0 tx=0).stop 2024-09-13T23:57:02.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac577ff40 1 -- 172.21.15.173:0/2834071797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab9e6400 msgr2=0x5629ab859180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/2834071797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab9e6400 0x5629ab859180 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x5629aba040f0 tx=0x5629ab8d9a40 comp rx=0 tx=0).stop 2024-09-13T23:57:02.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac577ff40 1 -- 172.21.15.173:0/2834071797 shutdown_connections 2024-09-13T23:57:02.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/2834071797 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5629aba7a000 0x5629aba80000 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/2834071797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab9e6400 0x5629ab859180 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac577ff40 1 -- 172.21.15.173:0/2834071797 >> 172.21.15.173:0/2834071797 conn(0x5629ab9e7c00 msgr2=0x5629ab672000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac577ff40 1 -- 172.21.15.173:0/2834071797 shutdown_connections 2024-09-13T23:57:02.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac577ff40 1 -- 172.21.15.173:0/2834071797 wait complete. 2024-09-13T23:57:02.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac577ff40 1 -- 172.21.15.173:0/2891542522 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5629ab914000 msgr2=0x5629ab858100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/2891542522 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5629ab914000 0x5629ab858100 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x5629ab8a3650 tx=0x5629ab8d88a0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac577ff40 1 -- 172.21.15.173:0/2891542522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571400 msgr2=0x5629ab856b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/2891542522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571400 0x5629ab856b00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x5629ac345e90 tx=0x5629ab675980 comp rx=0 tx=0).stop 2024-09-13T23:57:02.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac577ff40 1 -- 172.21.15.173:0/2891542522 shutdown_connections 2024-09-13T23:57:02.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/2891542522 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5629ab914000 0x5629ab858100 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac577ff40 1 --2- 172.21.15.173:0/2891542522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5629ab571400 0x5629ab856b00 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac577ff40 1 -- 172.21.15.173:0/2891542522 >> 172.21.15.173:0/2891542522 conn(0x5629ab570c00 msgr2=0x5629ab671000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac577ff40 1 -- 172.21.15.173:0/2891542522 shutdown_connections 2024-09-13T23:57:02.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.382+0000 7f7ac577ff40 1 -- 172.21.15.173:0/2891542522 wait complete. 2024-09-13T23:57:02.391 INFO:teuthology.orchestra.run.smithi173.stdout:[] 2024-09-13T23:57:02.394 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T23:57:02.429 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:57:02.430 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-13T23:57:02.430 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-13T23:57:02.430 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-13T23:57:02.475 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:02.475 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:02.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.470+0000 7fde98571f40 1 Processor -- start 2024-09-13T23:57:02.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.470+0000 7fde98571f40 1 -- start start 2024-09-13T23:57:02.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.470+0000 7fde98571f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x559aadf93400 0x559aae278580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.470+0000 7fde98571f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559aae057500 con 0x559aadf93000 2024-09-13T23:57:02.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.470+0000 7fde98571f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x559aae020a00 con 0x559aadf93400 2024-09-13T23:57:02.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.470+0000 7fde96529700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x559aadf93400 0x559aae278580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.470+0000 7fde96d2a700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x559aadf93000 0x559aae092800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47376/0 (socket says 172.21.15.173:47376) 2024-09-13T23:57:02.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.470+0000 7fde96d2a700 1 -- 172.21.15.173:0/731331036 learned_addr learned my addr 172.21.15.173:0/731331036 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:02.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.474+0000 7fde96529700 1 -- 172.21.15.173:0/731331036 >> v1:172.21.15.87:6789/0 conn(0x559aadf93000 legacy=0x559aae092800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.474+0000 7fde96529700 1 -- 172.21.15.173:0/731331036 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559aadfa5d40 con 0x559aadf93400 2024-09-13T23:57:02.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.474+0000 7fde96529700 1 --2- 172.21.15.173:0/731331036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93400 0x559aae278580 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x559aae273920 tx=0x559aae097920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e92825d0f2cc20 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.474+0000 7fde95d28700 1 -- 172.21.15.173:0/731331036 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559aae0374a0 con 0x559aadf93400 2024-09-13T23:57:02.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.474+0000 7fde95d28700 1 -- 172.21.15.173:0/731331036 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559aae057800 con 0x559aadf93400 2024-09-13T23:57:02.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.474+0000 7fde95d28700 1 -- 172.21.15.173:0/731331036 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559aae037600 con 0x559aadf93400 2024-09-13T23:57:02.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.474+0000 7fde98571f40 1 -- 172.21.15.173:0/731331036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93400 msgr2=0x559aae278580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.474+0000 7fde98571f40 1 --2- 172.21.15.173:0/731331036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93400 0x559aae278580 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x559aae273920 tx=0x559aae097920 comp rx=0 tx=0).stop 2024-09-13T23:57:02.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.474+0000 7fde98571f40 1 -- 172.21.15.173:0/731331036 shutdown_connections 2024-09-13T23:57:02.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.474+0000 7fde98571f40 1 --2- 172.21.15.173:0/731331036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93400 0x559aae278580 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.474+0000 7fde98571f40 1 -- 172.21.15.173:0/731331036 >> 172.21.15.173:0/731331036 conn(0x559aadf92c00 msgr2=0x559aae092000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.474+0000 7fde98571f40 1 -- 172.21.15.173:0/731331036 shutdown_connections 2024-09-13T23:57:02.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.474+0000 7fde98571f40 1 -- 172.21.15.173:0/731331036 wait complete. 2024-09-13T23:57:02.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.474+0000 7fde98571f40 1 Processor -- start 2024-09-13T23:57:02.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.474+0000 7fde98571f40 1 -- start start 2024-09-13T23:57:02.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.474+0000 7fde98571f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93000 0x559aae278580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.474+0000 7fde98571f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aae020500 con 0x559aadf93000 2024-09-13T23:57:02.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.474+0000 7fde96d2a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93000 0x559aae278580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.474+0000 7fde96d2a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93000 0x559aae278580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49560/0 (socket says 172.21.15.173:49560) 2024-09-13T23:57:02.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.474+0000 7fde96d2a700 1 -- 172.21.15.173:0/1619047222 learned_addr learned my addr 172.21.15.173:0/1619047222 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.474+0000 7fde96d2a700 1 -- 172.21.15.173:0/1619047222 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559aadfa5ba0 con 0x559aadf93000 2024-09-13T23:57:02.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.474+0000 7fde96d2a700 1 --2- 172.21.15.173:0/1619047222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93000 0x559aae278580 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x559aae0efe60 tx=0x559aae097b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ede68385b9fbd35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.478+0000 7fde95527700 1 -- 172.21.15.173:0/1619047222 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559aae0374a0 con 0x559aadf93000 2024-09-13T23:57:02.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.478+0000 7fde95527700 1 -- 172.21.15.173:0/1619047222 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559aae057b00 con 0x559aadf93000 2024-09-13T23:57:02.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.478+0000 7fde95527700 1 -- 172.21.15.173:0/1619047222 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559aae037600 con 0x559aadf93000 2024-09-13T23:57:02.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.478+0000 7fde98571f40 1 -- 172.21.15.173:0/1619047222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93000 msgr2=0x559aae278580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.478+0000 7fde98571f40 1 --2- 172.21.15.173:0/1619047222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93000 0x559aae278580 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x559aae0efe60 tx=0x559aae097b60 comp rx=0 tx=0).stop 2024-09-13T23:57:02.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.478+0000 7fde98571f40 1 -- 172.21.15.173:0/1619047222 shutdown_connections 2024-09-13T23:57:02.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.478+0000 7fde98571f40 1 --2- 172.21.15.173:0/1619047222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93000 0x559aae278580 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.478+0000 7fde98571f40 1 -- 172.21.15.173:0/1619047222 >> 172.21.15.173:0/1619047222 conn(0x559aadf92c00 msgr2=0x559aae093000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.478+0000 7fde98571f40 1 -- 172.21.15.173:0/1619047222 shutdown_connections 2024-09-13T23:57:02.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.478+0000 7fde98571f40 1 -- 172.21.15.173:0/1619047222 wait complete. 2024-09-13T23:57:02.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.478+0000 7fde98571f40 1 Processor -- start 2024-09-13T23:57:02.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.478+0000 7fde98571f40 1 -- start start 2024-09-13T23:57:02.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.478+0000 7fde98571f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93000 0x559aae278580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.478+0000 7fde98571f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aae0203c0 con 0x559aadf93000 2024-09-13T23:57:02.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.478+0000 7fde96d2a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93000 0x559aae278580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.478+0000 7fde96d2a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93000 0x559aae278580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49562/0 (socket says 172.21.15.173:49562) 2024-09-13T23:57:02.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.478+0000 7fde96d2a700 1 -- 172.21.15.173:0/1091316026 learned_addr learned my addr 172.21.15.173:0/1091316026 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.478+0000 7fde96d2a700 1 -- 172.21.15.173:0/1091316026 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559aadfa5a00 con 0x559aadf93000 2024-09-13T23:57:02.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.478+0000 7fde96d2a700 1 --2- 172.21.15.173:0/1091316026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93000 0x559aae278580 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x559aaedfc0c0 tx=0x559aae097a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.478+0000 7fde93d24700 1 -- 172.21.15.173:0/1091316026 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559aae0378c0 con 0x559aadf93000 2024-09-13T23:57:02.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.478+0000 7fde93d24700 1 -- 172.21.15.173:0/1091316026 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559aae057c80 con 0x559aadf93000 2024-09-13T23:57:02.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.478+0000 7fde98571f40 1 -- 172.21.15.173:0/1091316026 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559aadfa5860 con 0x559aadf93000 2024-09-13T23:57:02.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.478+0000 7fde93d24700 1 -- 172.21.15.173:0/1091316026 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559aae0374a0 con 0x559aadf93000 2024-09-13T23:57:02.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.478+0000 7fde98571f40 1 -- 172.21.15.173:0/1091316026 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559aadfa56c0 con 0x559aadf93000 2024-09-13T23:57:02.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.482+0000 7fde93d24700 1 -- 172.21.15.173:0/1091316026 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x559aae08cb00 con 0x559aadf93000 2024-09-13T23:57:02.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.482+0000 7fde98571f40 1 Processor -- start 2024-09-13T23:57:02.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.482+0000 7fde98571f40 1 -- start start 2024-09-13T23:57:02.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.482+0000 7fde93d24700 1 --2- 172.21.15.173:0/1091316026 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559aae326000 0x559aae279080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.482+0000 7fde98571f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93800 0x559aae278b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.482+0000 7fde98571f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aae020000 con 0x559aadf93800 2024-09-13T23:57:02.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.482+0000 7fde93d24700 1 -- 172.21.15.173:0/1091316026 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x559aadff9180 con 0x559aadf93000 2024-09-13T23:57:02.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.482+0000 7fde9752b700 1 --2- 172.21.15.173:0/1091316026 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559aae326000 0x559aae279080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.482+0000 7fde96d2a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93800 0x559aae278b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.482+0000 7fde96d2a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93800 0x559aae278b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49576/0 (socket says 172.21.15.173:49576) 2024-09-13T23:57:02.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.482+0000 7fde96d2a700 1 -- 172.21.15.173:0/4050755539 learned_addr learned my addr 172.21.15.173:0/4050755539 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.482+0000 7fde9752b700 1 --2- 172.21.15.173:0/1091316026 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559aae326000 0x559aae279080 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x559aae32e030 tx=0x559aae2eea20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.482+0000 7fde96d2a700 1 -- 172.21.15.173:0/4050755539 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559aadfa4000 con 0x559aadf93800 2024-09-13T23:57:02.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.482+0000 7fde96d2a700 1 --2- 172.21.15.173:0/4050755539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93800 0x559aae278b00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x559aaedfd080 tx=0x559aae2ee240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57cacd212798d0d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.482+0000 7fde9151f700 1 -- 172.21.15.173:0/4050755539 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559aae037600 con 0x559aadf93800 2024-09-13T23:57:02.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.482+0000 7fde9151f700 1 -- 172.21.15.173:0/4050755539 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559aae057c80 con 0x559aadf93800 2024-09-13T23:57:02.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.482+0000 7fde9151f700 1 -- 172.21.15.173:0/4050755539 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559aae037a20 con 0x559aadf93800 2024-09-13T23:57:02.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.482+0000 7fde98571f40 1 -- 172.21.15.173:0/4050755539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93800 msgr2=0x559aae278b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.482+0000 7fde98571f40 1 --2- 172.21.15.173:0/4050755539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93800 0x559aae278b00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x559aaedfd080 tx=0x559aae2ee240 comp rx=0 tx=0).stop 2024-09-13T23:57:02.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.482+0000 7fde98571f40 1 -- 172.21.15.173:0/4050755539 shutdown_connections 2024-09-13T23:57:02.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.482+0000 7fde98571f40 1 --2- 172.21.15.173:0/4050755539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93800 0x559aae278b00 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.482+0000 7fde98571f40 1 -- 172.21.15.173:0/4050755539 >> 172.21.15.173:0/4050755539 conn(0x559aadf93400 msgr2=0x559aae093800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.482+0000 7fde98571f40 1 -- 172.21.15.173:0/4050755539 shutdown_connections 2024-09-13T23:57:02.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.482+0000 7fde98571f40 1 -- 172.21.15.173:0/4050755539 wait complete. 2024-09-13T23:57:02.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.486+0000 7fde98571f40 1 Processor -- start 2024-09-13T23:57:02.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.486+0000 7fde98571f40 1 -- start start 2024-09-13T23:57:02.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.486+0000 7fde98571f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93800 0x559aae278b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.486+0000 7fde98571f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aadfb8640 con 0x559aadf93800 2024-09-13T23:57:02.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.486+0000 7fde96d2a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93800 0x559aae278b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.486+0000 7fde96d2a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93800 0x559aae278b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49580/0 (socket says 172.21.15.173:49580) 2024-09-13T23:57:02.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.486+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 learned_addr learned my addr 172.21.15.173:0/4059116104 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.486+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559aadfa4ea0 con 0x559aadf93800 2024-09-13T23:57:02.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.486+0000 7fde96d2a700 1 --2- 172.21.15.173:0/4059116104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93800 0x559aae278b00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x559aae32e660 tx=0x559aae2eec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.486+0000 7fde8fd1c700 1 -- 172.21.15.173:0/4059116104 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559aae037600 con 0x559aadf93800 2024-09-13T23:57:02.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.486+0000 7fde8fd1c700 1 -- 172.21.15.173:0/4059116104 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559aae356000 con 0x559aadf93800 2024-09-13T23:57:02.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.486+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559aadfa4820 con 0x559aadf93800 2024-09-13T23:57:02.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.486+0000 7fde8fd1c700 1 -- 172.21.15.173:0/4059116104 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559aae037a20 con 0x559aadf93800 2024-09-13T23:57:02.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.486+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559aadfa49c0 con 0x559aadf93800 2024-09-13T23:57:02.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.486+0000 7fde8fd1c700 1 -- 172.21.15.173:0/4059116104 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x559aae08cdc0 con 0x559aadf93800 2024-09-13T23:57:02.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.486+0000 7fde8fd1c700 1 --2- 172.21.15.173:0/4059116104 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559aae327000 0x559aae279600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.490+0000 7fde8fd1c700 1 -- 172.21.15.173:0/4059116104 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x559aadff9340 con 0x559aadf93800 2024-09-13T23:57:02.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.490+0000 7fde96529700 1 --2- 172.21.15.173:0/4059116104 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559aae327000 0x559aae279600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.490+0000 7fde98571f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.490+0000 7fde98571f40 1 --2- 172.21.15.173:0/4059116104 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559aae327400 0x559aae279b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.490+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae327800 con 0x559aae327400 2024-09-13T23:57:02.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.490+0000 7fde9752b700 1 --2- 172.21.15.173:0/4059116104 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559aae327400 0x559aae279b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.490+0000 7fde96529700 1 --2- 172.21.15.173:0/4059116104 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559aae327000 0x559aae279600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x559aae273920 tx=0x559aae097800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.490+0000 7fde9752b700 1 --2- 172.21.15.173:0/4059116104 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559aae327400 0x559aae279b80 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.490+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae327400 2024-09-13T23:57:02.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.490+0000 7fde98571f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.490+0000 7fde98571f40 20 realm 2024-09-13T23:57:02.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.490+0000 7fde98571f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.490+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae327c00 con 0x559aae327400 2024-09-13T23:57:02.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.490+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae327400 2024-09-13T23:57:02.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.490+0000 7fde98571f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.490+0000 7fde98571f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:02.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.490+0000 7fde98571f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.490+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae327800 con 0x559aae327400 2024-09-13T23:57:02.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.490+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae327400 2024-09-13T23:57:02.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.490+0000 7fde98571f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.490+0000 7fde98571f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.490+0000 7fde98571f40 1 --2- 172.21.15.173:0/4059116104 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559aae327c00 0x559aae27a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.490+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae327c00 2024-09-13T23:57:02.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.490+0000 7fde96d2a700 1 --2- 172.21.15.173:0/4059116104 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559aae327c00 0x559aae27a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.494+0000 7fde96d2a700 1 --2- 172.21.15.173:0/4059116104 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559aae327c00 0x559aae27a100 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.494+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x559aae3b9200 con 0x559aae327c00 2024-09-13T23:57:02.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.494+0000 7fde98571f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:02.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.494+0000 7fde98571f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.494+0000 7fde98571f40 1 --2- 172.21.15.173:0/4059116104 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559aae3be400 0x559aae27a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.494+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be800 con 0x559aae3be400 2024-09-13T23:57:02.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.494+0000 7fde96529700 1 --2- 172.21.15.173:0/4059116104 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559aae3be400 0x559aae27a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.494+0000 7fde96529700 1 --2- 172.21.15.173:0/4059116104 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559aae3be400 0x559aae27a680 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.494+0000 7fde96529700 1 -- 172.21.15.173:0/4059116104 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x559aae3b9440 con 0x559aae3be400 2024-09-13T23:57:02.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.494+0000 7fde98571f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:02.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.494+0000 7fde98571f40 20 searching for the correct realm 2024-09-13T23:57:02.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.494+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3bec00 con 0x559aae3be400 2024-09-13T23:57:02.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.494+0000 7fde96529700 1 -- 172.21.15.173:0/4059116104 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x559aae3b9440 con 0x559aae3be400 2024-09-13T23:57:02.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.494+0000 7fde96529700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be800 con 0x559aae327c00 2024-09-13T23:57:02.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.494+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b9200 con 0x559aae327c00 2024-09-13T23:57:02.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.494+0000 7fde96d2a700 1 --2- 172.21.15.173:0/4059116104 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559aae3be800 0x559aae27ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.494+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae3be800 2024-09-13T23:57:02.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.498+0000 7fde9752b700 1 --2- 172.21.15.173:0/4059116104 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559aae3be800 0x559aae27ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.498+0000 7fde9752b700 1 --2- 172.21.15.173:0/4059116104 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559aae3be800 0x559aae27ac00 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.498+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae3be800 2024-09-13T23:57:02.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.498+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae327400 2024-09-13T23:57:02.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.498+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae327400 2024-09-13T23:57:02.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.498+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae327400 2024-09-13T23:57:02.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.498+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae327400 2024-09-13T23:57:02.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.498+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae3be400 2024-09-13T23:57:02.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.498+0000 7fde96529700 1 -- 172.21.15.173:0/4059116104 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b9440 con 0x559aae3be400 2024-09-13T23:57:02.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.498+0000 7fde96529700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae327400 2024-09-13T23:57:02.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.498+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae327400 2024-09-13T23:57:02.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.498+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae327c00 2024-09-13T23:57:02.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.498+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b9200 con 0x559aae327c00 2024-09-13T23:57:02.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.498+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae327c00 2024-09-13T23:57:02.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.502+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b9200 con 0x559aae327c00 2024-09-13T23:57:02.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.502+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae327400 2024-09-13T23:57:02.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.502+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae327400 2024-09-13T23:57:02.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.502+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae3be800 2024-09-13T23:57:02.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.502+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae3be800 2024-09-13T23:57:02.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.502+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae327400 2024-09-13T23:57:02.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.502+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae327400 2024-09-13T23:57:02.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.502+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae3be800 2024-09-13T23:57:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.502+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae3be800 2024-09-13T23:57:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.502+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae327c00 2024-09-13T23:57:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.502+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b9200 con 0x559aae327c00 2024-09-13T23:57:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.502+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae3be400 2024-09-13T23:57:02.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.502+0000 7fde96529700 1 -- 172.21.15.173:0/4059116104 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b9440 con 0x559aae3be400 2024-09-13T23:57:02.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.502+0000 7fde96529700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae327400 2024-09-13T23:57:02.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.506+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae327400 2024-09-13T23:57:02.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.506+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae327c00 2024-09-13T23:57:02.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.506+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b9200 con 0x559aae327c00 2024-09-13T23:57:02.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.506+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae3be400 2024-09-13T23:57:02.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.506+0000 7fde96529700 1 -- 172.21.15.173:0/4059116104 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b9440 con 0x559aae3be400 2024-09-13T23:57:02.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.506+0000 7fde96529700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae327400 2024-09-13T23:57:02.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.506+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae327400 2024-09-13T23:57:02.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.506+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae327400 2024-09-13T23:57:02.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.506+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae327400 2024-09-13T23:57:02.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.506+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae327400 2024-09-13T23:57:02.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.506+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae327400 2024-09-13T23:57:02.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.506+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae3be400 2024-09-13T23:57:02.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.506+0000 7fde96529700 1 -- 172.21.15.173:0/4059116104 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b9440 con 0x559aae3be400 2024-09-13T23:57:02.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.506+0000 7fde96529700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae3be800 2024-09-13T23:57:02.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.510+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae3be800 2024-09-13T23:57:02.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.510+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae327400 2024-09-13T23:57:02.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.510+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae327400 2024-09-13T23:57:02.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.510+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae3be800 2024-09-13T23:57:02.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.510+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae3be800 2024-09-13T23:57:02.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.510+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae3be400 2024-09-13T23:57:02.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.510+0000 7fde96529700 1 -- 172.21.15.173:0/4059116104 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b9440 con 0x559aae3be400 2024-09-13T23:57:02.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.510+0000 7fde96529700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae3be800 2024-09-13T23:57:02.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.510+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae3be800 2024-09-13T23:57:02.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.510+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae327c00 2024-09-13T23:57:02.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.510+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b9200 con 0x559aae327c00 2024-09-13T23:57:02.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.510+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae327c00 2024-09-13T23:57:02.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.510+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b9200 con 0x559aae327c00 2024-09-13T23:57:02.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.510+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae3be400 2024-09-13T23:57:02.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.514+0000 7fde96529700 1 -- 172.21.15.173:0/4059116104 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b9440 con 0x559aae3be400 2024-09-13T23:57:02.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.514+0000 7fde96529700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae327c00 2024-09-13T23:57:02.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.514+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x559aae3b9200 con 0x559aae327c00 2024-09-13T23:57:02.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.514+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae327c00 2024-09-13T23:57:02.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.514+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559aae3b9200 con 0x559aae327c00 2024-09-13T23:57:02.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.514+0000 7fde98571f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:02.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.514+0000 7fde98571f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:02.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.514+0000 7fde98571f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:02.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.514+0000 7fde98571f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:02.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.514+0000 7fde98571f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.514+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3bf000 con 0x559aae327400 2024-09-13T23:57:02.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.514+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae327400 2024-09-13T23:57:02.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.514+0000 7fde98571f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.514+0000 7fde98571f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.514+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3bf400 con 0x559aae327c00 2024-09-13T23:57:02.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.514+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x559aae3b9200 con 0x559aae327c00 2024-09-13T23:57:02.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.514+0000 7fde98571f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:02.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.514+0000 7fde98571f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.514+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3bf800 con 0x559aae327400 2024-09-13T23:57:02.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.518+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae327400 2024-09-13T23:57:02.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.518+0000 7fde98571f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:02.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.518+0000 7fde98571f40 20 zone default found 2024-09-13T23:57:02.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.518+0000 7fde98571f40 4 Realm: () 2024-09-13T23:57:02.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.518+0000 7fde98571f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:02.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.518+0000 7fde98571f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:02.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.518+0000 7fde98571f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:02.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.518+0000 7fde98571f40 20 zonegroup default 2024-09-13T23:57:02.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.518+0000 7fde98571f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.518+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3bfc00 con 0x559aae3be800 2024-09-13T23:57:02.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.518+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae3be800 2024-09-13T23:57:02.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.518+0000 7fde98571f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.518+0000 7fde98571f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.518+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3bf000 con 0x559aae3be400 2024-09-13T23:57:02.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.518+0000 7fde96529700 1 -- 172.21.15.173:0/4059116104 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x559aae3b9440 con 0x559aae3be400 2024-09-13T23:57:02.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.518+0000 7fde98571f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.518+0000 7fde98571f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.518+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3bf800 con 0x559aae3be400 2024-09-13T23:57:02.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.518+0000 7fde96529700 1 -- 172.21.15.173:0/4059116104 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x559aae3b9440 con 0x559aae3be400 2024-09-13T23:57:02.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.518+0000 7fde98571f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.518+0000 7fde98571f40 20 started sync module instance, tier type = 2024-09-13T23:57:02.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.518+0000 7fde98571f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:02.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.518+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae327800 con 0x559aae327c00 2024-09-13T23:57:02.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.522+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559aae3b9200 con 0x559aae327c00 2024-09-13T23:57:02.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.522+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94122835114752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae326800 con 0x559aae327c00 2024-09-13T23:57:02.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.522+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae327800 con 0x559aae327400 2024-09-13T23:57:02.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.522+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae327400 2024-09-13T23:57:02.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.522+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94122835115904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3be000 con 0x559aae327400 2024-09-13T23:57:02.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.522+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94122835114752] v33'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559aae3b9200 con 0x559aae327c00 2024-09-13T23:57:02.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.522+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3bf400 con 0x559aae327c00 2024-09-13T23:57:02.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.526+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94122835115904] v33'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae327400 2024-09-13T23:57:02.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.526+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559aae3b9200 con 0x559aae327c00 2024-09-13T23:57:02.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.526+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94122835117056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3d0000 con 0x559aae327c00 2024-09-13T23:57:02.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.526+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3d0400 con 0x559aae3be800 2024-09-13T23:57:02.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.530+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae3be800 2024-09-13T23:57:02.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.530+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94122835118208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3d0800 con 0x559aae3be800 2024-09-13T23:57:02.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.530+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3d0c00 con 0x559aae327c00 2024-09-13T23:57:02.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.530+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94122835117056] v33'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559aae3b9200 con 0x559aae327c00 2024-09-13T23:57:02.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.530+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94122835118208] v33'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae3be800 2024-09-13T23:57:02.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.534+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559aae3b9200 con 0x559aae327c00 2024-09-13T23:57:02.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.534+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94122835119360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3d1000 con 0x559aae327c00 2024-09-13T23:57:02.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.534+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3d1400 con 0x559aae3be400 2024-09-13T23:57:02.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.534+0000 7fde96529700 1 -- 172.21.15.173:0/4059116104 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559aae3b9440 con 0x559aae3be400 2024-09-13T23:57:02.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.534+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94122835120512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3d1800 con 0x559aae3be400 2024-09-13T23:57:02.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.534+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3d1c00 con 0x559aae3be400 2024-09-13T23:57:02.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.534+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94122835119360] v33'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559aae3b9200 con 0x559aae327c00 2024-09-13T23:57:02.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.538+0000 7fde96529700 1 -- 172.21.15.173:0/4059116104 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94122835120512] v33'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559aae3b9440 con 0x559aae3be400 2024-09-13T23:57:02.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.538+0000 7fde96529700 1 -- 172.21.15.173:0/4059116104 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559aae3b9440 con 0x559aae3be400 2024-09-13T23:57:02.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.538+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94122835121664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3d1400 con 0x559aae3be400 2024-09-13T23:57:02.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.538+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3d0000 con 0x559aae3be800 2024-09-13T23:57:02.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.538+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae3be800 2024-09-13T23:57:02.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.538+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94122835122816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3d0c00 con 0x559aae3be800 2024-09-13T23:57:02.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.538+0000 7fde98571f40 20 add_watcher() i=0 2024-09-13T23:57:02.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.538+0000 7fde98571f40 20 add_watcher() i=1 2024-09-13T23:57:02.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.538+0000 7fde98571f40 20 add_watcher() i=2 2024-09-13T23:57:02.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.538+0000 7fde98571f40 20 add_watcher() i=3 2024-09-13T23:57:02.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.538+0000 7fde98571f40 20 add_watcher() i=4 2024-09-13T23:57:02.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.538+0000 7fde98571f40 20 add_watcher() i=5 2024-09-13T23:57:02.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.538+0000 7fde96529700 1 -- 172.21.15.173:0/4059116104 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94122835121664] v33'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559aae3b9440 con 0x559aae3be400 2024-09-13T23:57:02.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.538+0000 7fde98571f40 20 add_watcher() i=6 2024-09-13T23:57:02.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.542+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94122835122816] v33'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae3be800 2024-09-13T23:57:02.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.542+0000 7fde98571f40 20 add_watcher() i=7 2024-09-13T23:57:02.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.542+0000 7fde98571f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:02.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.542+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3bec00 con 0x559aae327400 2024-09-13T23:57:02.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.542+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae327400 2024-09-13T23:57:02.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.542+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94122836574208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3bf000 con 0x559aae327400 2024-09-13T23:57:02.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.542+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94122836574208] v33'92 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae327400 2024-09-13T23:57:02.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.542+0000 7fde7dcf8700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:02.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.542+0000 7fde98571f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:02.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.542+0000 7fde98571f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:02.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.546+0000 7fde98571f40 1 Processor -- start 2024-09-13T23:57:02.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.546+0000 7fde98571f40 1 -- start start 2024-09-13T23:57:02.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.546+0000 7fde98571f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aae3bf400 0x559aae27b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.546+0000 7fde98571f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aadfb8780 con 0x559aae3bf400 2024-09-13T23:57:02.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.546+0000 7fde96529700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aae3bf400 0x559aae27b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.546+0000 7fde96529700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aae3bf400 0x559aae27b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49590/0 (socket says 172.21.15.173:49590) 2024-09-13T23:57:02.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.546+0000 7fde96529700 1 -- 172.21.15.173:0/645814368 learned_addr learned my addr 172.21.15.173:0/645814368 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.546+0000 7fde96529700 1 -- 172.21.15.173:0/645814368 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559aadfa4b60 con 0x559aae3bf400 2024-09-13T23:57:02.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.546+0000 7fde96529700 1 --2- 172.21.15.173:0/645814368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aae3bf400 0x559aae27b180 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x559aae32fda0 tx=0x559aae097980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a9d3d4b27f51ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.546+0000 7fde7d4f7700 1 -- 172.21.15.173:0/645814368 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559aae037760 con 0x559aae3bf400 2024-09-13T23:57:02.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.546+0000 7fde7d4f7700 1 -- 172.21.15.173:0/645814368 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559aae356900 con 0x559aae3bf400 2024-09-13T23:57:02.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.546+0000 7fde7d4f7700 1 -- 172.21.15.173:0/645814368 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559aae3ca160 con 0x559aae3bf400 2024-09-13T23:57:02.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.546+0000 7fde98571f40 1 -- 172.21.15.173:0/645814368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aae3bf400 msgr2=0x559aae27b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.546+0000 7fde98571f40 1 --2- 172.21.15.173:0/645814368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aae3bf400 0x559aae27b180 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x559aae32fda0 tx=0x559aae097980 comp rx=0 tx=0).stop 2024-09-13T23:57:02.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.546+0000 7fde98571f40 1 -- 172.21.15.173:0/645814368 shutdown_connections 2024-09-13T23:57:02.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.546+0000 7fde98571f40 1 --2- 172.21.15.173:0/645814368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aae3bf400 0x559aae27b180 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.546+0000 7fde98571f40 1 -- 172.21.15.173:0/645814368 >> 172.21.15.173:0/645814368 conn(0x559aae3bf800 msgr2=0x559aae094000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.546+0000 7fde98571f40 1 -- 172.21.15.173:0/645814368 shutdown_connections 2024-09-13T23:57:02.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.546+0000 7fde98571f40 1 -- 172.21.15.173:0/645814368 wait complete. 2024-09-13T23:57:02.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.546+0000 7fde98571f40 1 Processor -- start 2024-09-13T23:57:02.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.546+0000 7fde98571f40 1 -- start start 2024-09-13T23:57:02.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.550+0000 7fde98571f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aae3bf400 0x559aae27b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.550+0000 7fde98571f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aae020000 con 0x559aae3bf400 2024-09-13T23:57:02.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.550+0000 7fde96529700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aae3bf400 0x559aae27b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.550+0000 7fde96529700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aae3bf400 0x559aae27b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49598/0 (socket says 172.21.15.173:49598) 2024-09-13T23:57:02.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.550+0000 7fde96529700 1 -- 172.21.15.173:0/1740264612 learned_addr learned my addr 172.21.15.173:0/1740264612 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.550+0000 7fde96529700 1 -- 172.21.15.173:0/1740264612 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559aadfa4d00 con 0x559aae3bf400 2024-09-13T23:57:02.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.550+0000 7fde96529700 1 --2- 172.21.15.173:0/1740264612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aae3bf400 0x559aae27b180 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x559aae3e0c30 tx=0x559aae2efc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.550+0000 7fde7bcf4700 1 -- 172.21.15.173:0/1740264612 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559aae3ca2c0 con 0x559aae3bf400 2024-09-13T23:57:02.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.550+0000 7fde7bcf4700 1 -- 172.21.15.173:0/1740264612 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559aae356600 con 0x559aae3bf400 2024-09-13T23:57:02.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.550+0000 7fde98571f40 1 -- 172.21.15.173:0/1740264612 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559aadfa4340 con 0x559aae3bf400 2024-09-13T23:57:02.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.550+0000 7fde7bcf4700 1 -- 172.21.15.173:0/1740264612 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559aae3ca420 con 0x559aae3bf400 2024-09-13T23:57:02.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.550+0000 7fde98571f40 1 -- 172.21.15.173:0/1740264612 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559aadfa5d40 con 0x559aae3bf400 2024-09-13T23:57:02.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.550+0000 7fde7bcf4700 1 -- 172.21.15.173:0/1740264612 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x559aae08db80 con 0x559aae3bf400 2024-09-13T23:57:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.550+0000 7fde7bcf4700 1 --2- 172.21.15.173:0/1740264612 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559aae3bec00 0x559aae46a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.550+0000 7fde7bcf4700 1 -- 172.21.15.173:0/1740264612 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x559aadff96c0 con 0x559aae3bf400 2024-09-13T23:57:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.550+0000 7fde98571f40 5 note: GC not initialized 2024-09-13T23:57:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.550+0000 7fde9752b700 1 --2- 172.21.15.173:0/1740264612 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559aae3bec00 0x559aae46a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.554+0000 7fde9752b700 1 --2- 172.21.15.173:0/1740264612 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559aae3bec00 0x559aae46a000 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x559aae32f410 tx=0x559aae097f20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.554+0000 7fde794ef700 20 reqs_thread_entry: start 2024-09-13T23:57:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.554+0000 7fde98571f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.554+0000 7fde98571f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.554+0000 7fde774eb700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:33 2024 2024-09-13T23:57:02.560 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.554+0000 7fde98571f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.554+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae326800 con 0x559aae327400 2024-09-13T23:57:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.554+0000 7fde76cc9700 20 reqs_thread_entry: start 2024-09-13T23:57:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.554+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae327400 2024-09-13T23:57:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.554+0000 7fde98571f40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:57:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.554+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae327800 con 0x559aae3be800 2024-09-13T23:57:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.554+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae3be800 2024-09-13T23:57:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.558+0000 7fde7dcf8700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.558+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94122836574208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3d0800 con 0x559aae327400 2024-09-13T23:57:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.558+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94122836574208] v33'93 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae327400 2024-09-13T23:57:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.562+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94122835114752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3d0000 con 0x559aae327c00 2024-09-13T23:57:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.562+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94122835114752] v33'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559aae3b9200 con 0x559aae327c00 2024-09-13T23:57:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.562+0000 7fde98571f40 20 remove_watcher() i=0 2024-09-13T23:57:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.562+0000 7fde98571f40 2 removed watcher, disabling cache 2024-09-13T23:57:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.562+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94122835115904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3d0c00 con 0x559aae327400 2024-09-13T23:57:02.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.566+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94122835115904] v33'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae327400 2024-09-13T23:57:02.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.566+0000 7fde98571f40 20 remove_watcher() i=1 2024-09-13T23:57:02.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.566+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94122835117056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3d1000 con 0x559aae327c00 2024-09-13T23:57:02.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.566+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94122835117056] v33'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559aae3b9200 con 0x559aae327c00 2024-09-13T23:57:02.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.566+0000 7fde98571f40 20 remove_watcher() i=2 2024-09-13T23:57:02.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.566+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94122835118208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3d0400 con 0x559aae3be800 2024-09-13T23:57:02.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.570+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94122835118208] v33'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae3be800 2024-09-13T23:57:02.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.570+0000 7fde98571f40 20 remove_watcher() i=3 2024-09-13T23:57:02.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.570+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94122835119360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3bf000 con 0x559aae327c00 2024-09-13T23:57:02.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.574+0000 7fde96d2a700 1 -- 172.21.15.173:0/4059116104 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94122835119360] v33'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559aae3b9200 con 0x559aae327c00 2024-09-13T23:57:02.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.574+0000 7fde98571f40 20 remove_watcher() i=4 2024-09-13T23:57:02.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.574+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94122835120512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3b2000 con 0x559aae3be400 2024-09-13T23:57:02.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.574+0000 7fde96529700 1 -- 172.21.15.173:0/4059116104 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94122835120512] v33'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559aae3b9440 con 0x559aae3be400 2024-09-13T23:57:02.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.574+0000 7fde98571f40 20 remove_watcher() i=5 2024-09-13T23:57:02.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.574+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94122835121664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3b2400 con 0x559aae3be400 2024-09-13T23:57:02.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.578+0000 7fde96529700 1 -- 172.21.15.173:0/4059116104 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94122835121664] v33'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559aae3b9440 con 0x559aae3be400 2024-09-13T23:57:02.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.578+0000 7fde98571f40 20 remove_watcher() i=6 2024-09-13T23:57:02.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.578+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94122835122816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559aae3b2800 con 0x559aae3be800 2024-09-13T23:57:02.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.578+0000 7fde9752b700 1 -- 172.21.15.173:0/4059116104 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94122835122816] v33'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559aae3b8b40 con 0x559aae3be800 2024-09-13T23:57:02.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.578+0000 7fde98571f40 20 remove_watcher() i=7 2024-09-13T23:57:02.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.578+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559aae327c00 msgr2=0x559aae27a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.578+0000 7fde98571f40 1 --2- 172.21.15.173:0/4059116104 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559aae327c00 0x559aae27a100 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.578+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559aae327400 msgr2=0x559aae279b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.578+0000 7fde98571f40 1 --2- 172.21.15.173:0/4059116104 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559aae327400 0x559aae279b80 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.578+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559aae3be800 msgr2=0x559aae27ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.578+0000 7fde98571f40 1 --2- 172.21.15.173:0/4059116104 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559aae3be800 0x559aae27ac00 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.578+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559aae3be400 msgr2=0x559aae27a680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.578+0000 7fde98571f40 1 --2- 172.21.15.173:0/4059116104 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559aae3be400 0x559aae27a680 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.578+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559aae327000 msgr2=0x559aae279600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.578+0000 7fde98571f40 1 --2- 172.21.15.173:0/4059116104 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559aae327000 0x559aae279600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x559aae273920 tx=0x559aae097800 comp rx=0 tx=0).stop 2024-09-13T23:57:02.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93800 msgr2=0x559aae278b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 --2- 172.21.15.173:0/4059116104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93800 0x559aae278b00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x559aae32e660 tx=0x559aae2eec00 comp rx=0 tx=0).stop 2024-09-13T23:57:02.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde96529700 1 -- 172.21.15.173:0/4059116104 reap_dead start 2024-09-13T23:57:02.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 shutdown_connections 2024-09-13T23:57:02.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 --2- 172.21.15.173:0/4059116104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93800 0x559aae278b00 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 >> 172.21.15.173:0/4059116104 conn(0x559aadf93400 msgr2=0x559aae093800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 shutdown_connections 2024-09-13T23:57:02.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 -- 172.21.15.173:0/4059116104 wait complete. 2024-09-13T23:57:02.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 -- 172.21.15.173:0/1740264612 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559aae3bec00 msgr2=0x559aae46a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 --2- 172.21.15.173:0/1740264612 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559aae3bec00 0x559aae46a000 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x559aae32f410 tx=0x559aae097f20 comp rx=0 tx=0).stop 2024-09-13T23:57:02.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 -- 172.21.15.173:0/1740264612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aae3bf400 msgr2=0x559aae27b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 --2- 172.21.15.173:0/1740264612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aae3bf400 0x559aae27b180 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x559aae3e0c30 tx=0x559aae2efc20 comp rx=0 tx=0).stop 2024-09-13T23:57:02.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 -- 172.21.15.173:0/1740264612 shutdown_connections 2024-09-13T23:57:02.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 --2- 172.21.15.173:0/1740264612 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559aae3bec00 0x559aae46a000 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 --2- 172.21.15.173:0/1740264612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aae3bf400 0x559aae27b180 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 -- 172.21.15.173:0/1740264612 >> 172.21.15.173:0/1740264612 conn(0x559aae3bf800 msgr2=0x559aae094000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 -- 172.21.15.173:0/1740264612 shutdown_connections 2024-09-13T23:57:02.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 -- 172.21.15.173:0/1740264612 wait complete. 2024-09-13T23:57:02.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 -- 172.21.15.173:0/1091316026 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559aae326000 msgr2=0x559aae279080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 --2- 172.21.15.173:0/1091316026 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559aae326000 0x559aae279080 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x559aae32e030 tx=0x559aae2eea20 comp rx=0 tx=0).stop 2024-09-13T23:57:02.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 -- 172.21.15.173:0/1091316026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93000 msgr2=0x559aae278580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 --2- 172.21.15.173:0/1091316026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93000 0x559aae278580 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x559aaedfc0c0 tx=0x559aae097a40 comp rx=0 tx=0).stop 2024-09-13T23:57:02.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 -- 172.21.15.173:0/1091316026 shutdown_connections 2024-09-13T23:57:02.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 --2- 172.21.15.173:0/1091316026 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559aae326000 0x559aae279080 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 --2- 172.21.15.173:0/1091316026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559aadf93000 0x559aae278580 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 -- 172.21.15.173:0/1091316026 >> 172.21.15.173:0/1091316026 conn(0x559aadf92c00 msgr2=0x559aae093000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 -- 172.21.15.173:0/1091316026 shutdown_connections 2024-09-13T23:57:02.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.582+0000 7fde98571f40 1 -- 172.21.15.173:0/1091316026 wait complete. 2024-09-13T23:57:02.591 INFO:teuthology.orchestra.run.smithi173.stdout:[ 2024-09-13T23:57:02.591 INFO:teuthology.orchestra.run.smithi173.stdout: "myfoo" 2024-09-13T23:57:02.591 INFO:teuthology.orchestra.run.smithi173.stdout:] 2024-09-13T23:57:02.594 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-13T23:57:02.598 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:57:02.598 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-13T23:57:02.598 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-13T23:57:02.598 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-13T23:57:02.638 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:02.638 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:02.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.634+0000 7f22d9c79f40 1 Processor -- start 2024-09-13T23:57:02.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.634+0000 7f22d9c79f40 1 -- start start 2024-09-13T23:57:02.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.634+0000 7f22d9c79f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55940a349000 0x55940a62e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.634+0000 7f22d9c79f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55940a40d500 con 0x55940a349400 2024-09-13T23:57:02.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.634+0000 7f22d9c79f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55940a3d6a00 con 0x55940a349000 2024-09-13T23:57:02.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.634+0000 7f22d8432700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55940a349000 0x55940a62e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.634+0000 7f22d7c31700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55940a349400 0x55940a448800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47390/0 (socket says 172.21.15.173:47390) 2024-09-13T23:57:02.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.634+0000 7f22d7c31700 1 -- 172.21.15.173:0/2735524446 learned_addr learned my addr 172.21.15.173:0/2735524446 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:02.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.634+0000 7f22d8432700 1 -- 172.21.15.173:0/2735524446 >> v1:172.21.15.87:6789/0 conn(0x55940a349400 legacy=0x55940a448800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.634+0000 7f22d7430700 1 -- 172.21.15.173:0/2735524446 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777883545 0 0) 0x55940a4a4000 con 0x55940a349400 2024-09-13T23:57:02.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.634+0000 7f22d8432700 1 -- 172.21.15.173:0/2735524446 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55940a35bd40 con 0x55940a349000 2024-09-13T23:57:02.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.634+0000 7f22d8432700 1 --2- 172.21.15.173:0/2735524446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349000 0x55940a62e580 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x55940a629a70 tx=0x55940a44d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d4ddc81d07c8a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.634+0000 7f22d7430700 1 -- 172.21.15.173:0/2735524446 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55940a3ed4a0 con 0x55940a349000 2024-09-13T23:57:02.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.634+0000 7f22d7430700 1 -- 172.21.15.173:0/2735524446 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55940a40d800 con 0x55940a349000 2024-09-13T23:57:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.634+0000 7f22d7430700 1 -- 172.21.15.173:0/2735524446 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55940a3ed600 con 0x55940a349000 2024-09-13T23:57:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d9c79f40 1 -- 172.21.15.173:0/2735524446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349000 msgr2=0x55940a62e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/2735524446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349000 0x55940a62e580 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x55940a629a70 tx=0x55940a44d920 comp rx=0 tx=0).stop 2024-09-13T23:57:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d9c79f40 1 -- 172.21.15.173:0/2735524446 shutdown_connections 2024-09-13T23:57:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/2735524446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349000 0x55940a62e580 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d9c79f40 1 -- 172.21.15.173:0/2735524446 >> 172.21.15.173:0/2735524446 conn(0x55940a348c00 msgr2=0x55940a448000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d9c79f40 1 -- 172.21.15.173:0/2735524446 shutdown_connections 2024-09-13T23:57:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d9c79f40 1 -- 172.21.15.173:0/2735524446 wait complete. 2024-09-13T23:57:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d9c79f40 1 Processor -- start 2024-09-13T23:57:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d9c79f40 1 -- start start 2024-09-13T23:57:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d9c79f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349000 0x55940a62e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d9c79f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940a3d6500 con 0x55940a349000 2024-09-13T23:57:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d8432700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349000 0x55940a62e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d8432700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349000 0x55940a62e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49616/0 (socket says 172.21.15.173:49616) 2024-09-13T23:57:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d8432700 1 -- 172.21.15.173:0/124854576 learned_addr learned my addr 172.21.15.173:0/124854576 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d8432700 1 -- 172.21.15.173:0/124854576 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55940a35bba0 con 0x55940a349000 2024-09-13T23:57:02.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d8432700 1 --2- 172.21.15.173:0/124854576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349000 0x55940a62e580 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55940b113e00 tx=0x55940a44d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53f4d33a8d168ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d6c2f700 1 -- 172.21.15.173:0/124854576 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55940a3ed760 con 0x55940a349000 2024-09-13T23:57:02.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d6c2f700 1 -- 172.21.15.173:0/124854576 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55940a40db00 con 0x55940a349000 2024-09-13T23:57:02.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d6c2f700 1 -- 172.21.15.173:0/124854576 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55940a3ed4a0 con 0x55940a349000 2024-09-13T23:57:02.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d9c79f40 1 -- 172.21.15.173:0/124854576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349000 msgr2=0x55940a62e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/124854576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349000 0x55940a62e580 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55940b113e00 tx=0x55940a44d800 comp rx=0 tx=0).stop 2024-09-13T23:57:02.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d9c79f40 1 -- 172.21.15.173:0/124854576 shutdown_connections 2024-09-13T23:57:02.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/124854576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349000 0x55940a62e580 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d9c79f40 1 -- 172.21.15.173:0/124854576 >> 172.21.15.173:0/124854576 conn(0x55940a348c00 msgr2=0x55940a449000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d9c79f40 1 -- 172.21.15.173:0/124854576 shutdown_connections 2024-09-13T23:57:02.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.638+0000 7f22d9c79f40 1 -- 172.21.15.173:0/124854576 wait complete. 2024-09-13T23:57:02.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.642+0000 7f22d9c79f40 1 Processor -- start 2024-09-13T23:57:02.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.642+0000 7f22d9c79f40 1 -- start start 2024-09-13T23:57:02.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.642+0000 7f22d9c79f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349400 0x55940a62eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.642+0000 7f22d9c79f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940a3d63c0 con 0x55940a349400 2024-09-13T23:57:02.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.642+0000 7f22d8432700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349400 0x55940a62eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.642+0000 7f22d8432700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349400 0x55940a62eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49632/0 (socket says 172.21.15.173:49632) 2024-09-13T23:57:02.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.642+0000 7f22d8432700 1 -- 172.21.15.173:0/3419593553 learned_addr learned my addr 172.21.15.173:0/3419593553 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.642+0000 7f22d8432700 1 -- 172.21.15.173:0/3419593553 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55940a35ba00 con 0x55940a349400 2024-09-13T23:57:02.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.642+0000 7f22d8432700 1 --2- 172.21.15.173:0/3419593553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349400 0x55940a62eb00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x55940b113e90 tx=0x55940a44d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.642+0000 7f22d542c700 1 -- 172.21.15.173:0/3419593553 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55940a3ed600 con 0x55940a349400 2024-09-13T23:57:02.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.642+0000 7f22d542c700 1 -- 172.21.15.173:0/3419593553 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55940a40dc80 con 0x55940a349400 2024-09-13T23:57:02.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.642+0000 7f22d542c700 1 -- 172.21.15.173:0/3419593553 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55940a3ed8c0 con 0x55940a349400 2024-09-13T23:57:02.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.642+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3419593553 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55940a35b860 con 0x55940a349400 2024-09-13T23:57:02.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.642+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3419593553 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55940a35b6c0 con 0x55940a349400 2024-09-13T23:57:02.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.642+0000 7f22d9c79f40 1 Processor -- start 2024-09-13T23:57:02.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.642+0000 7f22d9c79f40 1 -- start start 2024-09-13T23:57:02.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.642+0000 7f22d9c79f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349c00 0x55940a62f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.642+0000 7f22d9c79f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940a3d6000 con 0x55940a349c00 2024-09-13T23:57:02.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.646+0000 7f22d8c33700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349c00 0x55940a62f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.646+0000 7f22d8c33700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349c00 0x55940a62f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49634/0 (socket says 172.21.15.173:49634) 2024-09-13T23:57:02.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.646+0000 7f22d8c33700 1 -- 172.21.15.173:0/2268910117 learned_addr learned my addr 172.21.15.173:0/2268910117 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.646+0000 7f22d542c700 1 -- 172.21.15.173:0/3419593553 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55940a442b00 con 0x55940a349400 2024-09-13T23:57:02.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.646+0000 7f22d8c33700 1 -- 172.21.15.173:0/2268910117 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55940a35a000 con 0x55940a349c00 2024-09-13T23:57:02.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.646+0000 7f22d542c700 1 --2- 172.21.15.173:0/3419593553 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55940a6e8000 0x55940a630100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.646+0000 7f22d542c700 1 -- 172.21.15.173:0/3419593553 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55940a3af180 con 0x55940a349400 2024-09-13T23:57:02.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.646+0000 7f22d8432700 1 --2- 172.21.15.173:0/3419593553 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55940a6e8000 0x55940a630100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.646+0000 7f22d8c33700 1 --2- 172.21.15.173:0/2268910117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349c00 0x55940a62f080 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x55940b1c1740 tx=0x55940a6ac660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d1714e87860cd43 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.646+0000 7f22d2c27700 1 -- 172.21.15.173:0/2268910117 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55940a3ed600 con 0x55940a349c00 2024-09-13T23:57:02.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.646+0000 7f22d2c27700 1 -- 172.21.15.173:0/2268910117 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55940a6fa000 con 0x55940a349c00 2024-09-13T23:57:02.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.646+0000 7f22d2c27700 1 -- 172.21.15.173:0/2268910117 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55940a3ed8c0 con 0x55940a349c00 2024-09-13T23:57:02.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.646+0000 7f22d8432700 1 --2- 172.21.15.173:0/3419593553 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55940a6e8000 0x55940a630100 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55940b1c15f0 tx=0x55940a6ac8a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.646+0000 7f22d9c79f40 1 -- 172.21.15.173:0/2268910117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349c00 msgr2=0x55940a62f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.646+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/2268910117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349c00 0x55940a62f080 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x55940b1c1740 tx=0x55940a6ac660 comp rx=0 tx=0).stop 2024-09-13T23:57:02.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.646+0000 7f22d9c79f40 1 -- 172.21.15.173:0/2268910117 shutdown_connections 2024-09-13T23:57:02.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.646+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/2268910117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349c00 0x55940a62f080 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.646+0000 7f22d9c79f40 1 -- 172.21.15.173:0/2268910117 >> 172.21.15.173:0/2268910117 conn(0x55940a349800 msgr2=0x55940a449800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.646+0000 7f22d9c79f40 1 -- 172.21.15.173:0/2268910117 shutdown_connections 2024-09-13T23:57:02.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.646+0000 7f22d9c79f40 1 -- 172.21.15.173:0/2268910117 wait complete. 2024-09-13T23:57:02.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.646+0000 7f22d9c79f40 1 Processor -- start 2024-09-13T23:57:02.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.646+0000 7f22d9c79f40 1 -- start start 2024-09-13T23:57:02.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.650+0000 7f22d9c79f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349c00 0x55940a62f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.650+0000 7f22d9c79f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940a36e640 con 0x55940a349c00 2024-09-13T23:57:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.650+0000 7f22d8c33700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349c00 0x55940a62f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.650+0000 7f22d8c33700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349c00 0x55940a62f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49646/0 (socket says 172.21.15.173:49646) 2024-09-13T23:57:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.650+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 learned_addr learned my addr 172.21.15.173:0/3550382548 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.650+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55940a35aea0 con 0x55940a349c00 2024-09-13T23:57:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.650+0000 7f22d8c33700 1 --2- 172.21.15.173:0/3550382548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349c00 0x55940a62f080 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x55940b113ef0 tx=0x55940a44dc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.650+0000 7f22d1424700 1 -- 172.21.15.173:0/3550382548 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55940a3ed760 con 0x55940a349c00 2024-09-13T23:57:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.650+0000 7f22d1424700 1 -- 172.21.15.173:0/3550382548 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55940a6fa180 con 0x55940a349c00 2024-09-13T23:57:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.650+0000 7f22d1424700 1 -- 172.21.15.173:0/3550382548 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55940a3ed600 con 0x55940a349c00 2024-09-13T23:57:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.650+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55940a35a820 con 0x55940a349c00 2024-09-13T23:57:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.650+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55940a35a9c0 con 0x55940a349c00 2024-09-13T23:57:02.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.650+0000 7f22d9c79f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.650+0000 7f22d1424700 1 -- 172.21.15.173:0/3550382548 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55940a442dc0 con 0x55940a349c00 2024-09-13T23:57:02.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.654+0000 7f22d1424700 1 --2- 172.21.15.173:0/3550382548 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55940a6e8c00 0x55940a630680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.654+0000 7f22d1424700 1 -- 172.21.15.173:0/3550382548 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55940a3af340 con 0x55940a349c00 2024-09-13T23:57:02.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.654+0000 7f22d7c31700 1 --2- 172.21.15.173:0/3550382548 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55940a6e8c00 0x55940a630680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.654+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/3550382548 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55940a6e9000 0x55940a62f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.654+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9400 con 0x55940a6e9000 2024-09-13T23:57:02.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.654+0000 7f22d8c33700 1 --2- 172.21.15.173:0/3550382548 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55940a6e9000 0x55940a62f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.654+0000 7f22d7c31700 1 --2- 172.21.15.173:0/3550382548 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55940a6e8c00 0x55940a630680 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55940b112030 tx=0x55940a6ad8c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.654+0000 7f22d8c33700 1 --2- 172.21.15.173:0/3550382548 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55940a6e9000 0x55940a62f600 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.654+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.654+0000 7f22d9c79f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.654+0000 7f22d9c79f40 20 realm 2024-09-13T23:57:02.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.654+0000 7f22d9c79f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.654+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9000 2024-09-13T23:57:02.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.654+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.654+0000 7f22d9c79f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.654+0000 7f22d9c79f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:02.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.654+0000 7f22d9c79f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.654+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9c00 con 0x55940a6e9000 2024-09-13T23:57:02.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.654+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.654+0000 7f22d9c79f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.654+0000 7f22d9c79f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.654+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/3550382548 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55940a6e9400 0x55940a62fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.654+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9400 2024-09-13T23:57:02.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.654+0000 7f22d8432700 1 --2- 172.21.15.173:0/3550382548 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55940a6e9400 0x55940a62fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.658+0000 7f22d8432700 1 --2- 172.21.15.173:0/3550382548 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55940a6e9400 0x55940a62fb80 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.658+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.658+0000 7f22d9c79f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:02.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.658+0000 7f22d9c79f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.658+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/3550382548 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55940a6e9c00 0x55940a630c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.658+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a8000 con 0x55940a6e9c00 2024-09-13T23:57:02.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.658+0000 7f22d7c31700 1 --2- 172.21.15.173:0/3550382548 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55940a6e9c00 0x55940a630c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.658+0000 7f22d7c31700 1 --2- 172.21.15.173:0/3550382548 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55940a6e9c00 0x55940a630c00 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.658+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.658+0000 7f22d9c79f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:02.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.658+0000 7f22d9c79f40 20 searching for the correct realm 2024-09-13T23:57:02.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.658+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a8400 con 0x55940a6e9c00 2024-09-13T23:57:02.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.658+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.658+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a8000 con 0x55940a6e9400 2024-09-13T23:57:02.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.658+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.658+0000 7f22d8432700 1 --2- 172.21.15.173:0/3550382548 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55940a7a8000 0x55940a62e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.658+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a7a8000 2024-09-13T23:57:02.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.662+0000 7f22d8c33700 1 --2- 172.21.15.173:0/3550382548 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55940a7a8000 0x55940a62e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.662+0000 7f22d8c33700 1 --2- 172.21.15.173:0/3550382548 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55940a7a8000 0x55940a62e580 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.662+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a7a8000 2024-09-13T23:57:02.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.662+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9000 2024-09-13T23:57:02.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.662+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.662+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9000 2024-09-13T23:57:02.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.662+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.662+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9c00 2024-09-13T23:57:02.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.662+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.662+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9000 2024-09-13T23:57:02.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.662+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.662+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9400 2024-09-13T23:57:02.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.662+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.662+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9400 2024-09-13T23:57:02.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.666+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.666+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9000 2024-09-13T23:57:02.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.666+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.666+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a7a8000 2024-09-13T23:57:02.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.666+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a7a8000 2024-09-13T23:57:02.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.666+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9000 2024-09-13T23:57:02.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.666+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.666+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a7a8000 2024-09-13T23:57:02.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.666+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a7a8000 2024-09-13T23:57:02.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.666+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9400 2024-09-13T23:57:02.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.666+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.666+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9c00 2024-09-13T23:57:02.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.670+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.670+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9000 2024-09-13T23:57:02.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.670+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.670+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9400 2024-09-13T23:57:02.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.670+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.670+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9c00 2024-09-13T23:57:02.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.670+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.670+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9000 2024-09-13T23:57:02.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.670+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.670+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9000 2024-09-13T23:57:02.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.670+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.670+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9000 2024-09-13T23:57:02.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.674+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.674+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9c00 2024-09-13T23:57:02.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.674+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.674+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a7a8000 2024-09-13T23:57:02.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.674+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a7a8000 2024-09-13T23:57:02.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.674+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9000 2024-09-13T23:57:02.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.674+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.674+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a7a8000 2024-09-13T23:57:02.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.674+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a7a8000 2024-09-13T23:57:02.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.674+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9c00 2024-09-13T23:57:02.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.674+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.674+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a7a8000 2024-09-13T23:57:02.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.678+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a7a8000 2024-09-13T23:57:02.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.678+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9400 2024-09-13T23:57:02.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.678+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.678+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9400 2024-09-13T23:57:02.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.678+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.678+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9c00 2024-09-13T23:57:02.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.678+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.678+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9400 2024-09-13T23:57:02.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.678+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.678+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9400 2024-09-13T23:57:02.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.678+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.678+0000 7f22d9c79f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:02.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.678+0000 7f22d9c79f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:02.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.678+0000 7f22d9c79f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:02.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.678+0000 7f22d9c79f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:02.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.678+0000 7f22d9c79f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.678+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a8800 con 0x55940a6e9000 2024-09-13T23:57:02.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d9c79f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d9c79f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a8c00 con 0x55940a6e9400 2024-09-13T23:57:02.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d9c79f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:02.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d9c79f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9000 con 0x55940a6e9000 2024-09-13T23:57:02.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d9c79f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:02.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d9c79f40 20 zone default found 2024-09-13T23:57:02.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d9c79f40 4 Realm: () 2024-09-13T23:57:02.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d9c79f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:02.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d9c79f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:02.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d9c79f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:02.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d9c79f40 20 zonegroup default 2024-09-13T23:57:02.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d9c79f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9400 con 0x55940a7a8000 2024-09-13T23:57:02.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55940a742b40 con 0x55940a7a8000 2024-09-13T23:57:02.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d9c79f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d9c79f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9c00 2024-09-13T23:57:02.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d9c79f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d9c79f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:02.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9c00 con 0x55940a6e9c00 2024-09-13T23:57:02.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d9c79f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:02.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d9c79f40 20 started sync module instance, tier type = 2024-09-13T23:57:02.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.682+0000 7f22d9c79f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:02.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.686+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7ae000 con 0x55940a6e9400 2024-09-13T23:57:02.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.686+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.686+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94094317738752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7ae400 con 0x55940a6e9400 2024-09-13T23:57:02.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.686+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7ae800 con 0x55940a6e9000 2024-09-13T23:57:02.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.690+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94094317738752] v33'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.690+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.690+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94094317739904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7aec00 con 0x55940a6e9000 2024-09-13T23:57:02.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.690+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7af000 con 0x55940a6e9400 2024-09-13T23:57:02.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.694+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94094317739904] v33'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.694+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.694+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94094317741056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7af400 con 0x55940a6e9400 2024-09-13T23:57:02.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.694+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7af800 con 0x55940a7a8000 2024-09-13T23:57:02.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.694+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55940a742b40 con 0x55940a7a8000 2024-09-13T23:57:02.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.694+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94094317742208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7afc00 con 0x55940a7a8000 2024-09-13T23:57:02.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.694+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7ae800 con 0x55940a6e9400 2024-09-13T23:57:02.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.698+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94094317741056] v33'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.698+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94094317742208] v33'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55940a742b40 con 0x55940a7a8000 2024-09-13T23:57:02.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.698+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.698+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94094317743360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7ae000 con 0x55940a6e9400 2024-09-13T23:57:02.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.698+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7ae400 con 0x55940a6e9c00 2024-09-13T23:57:02.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.702+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.702+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94094317744512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a8800 con 0x55940a6e9c00 2024-09-13T23:57:02.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.702+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9000 con 0x55940a6e9c00 2024-09-13T23:57:02.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.702+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94094317743360] v33'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.702+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94094317744512] v33'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.702+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.702+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94094317745664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9400 con 0x55940a6e9c00 2024-09-13T23:57:02.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.702+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a8c00 con 0x55940a7a8000 2024-09-13T23:57:02.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.706+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55940a742b40 con 0x55940a7a8000 2024-09-13T23:57:02.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.706+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94094317746816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a7a8000 2024-09-13T23:57:02.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.706+0000 7f22d9c79f40 20 add_watcher() i=0 2024-09-13T23:57:02.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.706+0000 7f22d9c79f40 20 add_watcher() i=1 2024-09-13T23:57:02.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.706+0000 7f22d9c79f40 20 add_watcher() i=2 2024-09-13T23:57:02.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.706+0000 7f22d9c79f40 20 add_watcher() i=3 2024-09-13T23:57:02.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.706+0000 7f22d9c79f40 20 add_watcher() i=4 2024-09-13T23:57:02.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.706+0000 7f22d9c79f40 20 add_watcher() i=5 2024-09-13T23:57:02.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.706+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94094317745664] v33'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.706+0000 7f22d9c79f40 20 add_watcher() i=6 2024-09-13T23:57:02.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.706+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94094317746816] v33'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55940a742b40 con 0x55940a7a8000 2024-09-13T23:57:02.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.706+0000 7f22d9c79f40 20 add_watcher() i=7 2024-09-13T23:57:02.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.706+0000 7f22d9c79f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:02.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.706+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7aec00 con 0x55940a6e9000 2024-09-13T23:57:02.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.706+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.706+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94094319370240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7af800 con 0x55940a6e9000 2024-09-13T23:57:02.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.710+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94094319370240] v33'94 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.710+0000 7f22d9c79f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:02.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.710+0000 7f22d9c79f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:02.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.710+0000 7f22d9c79f40 1 Processor -- start 2024-09-13T23:57:02.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.710+0000 7f22bf400700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:02.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.710+0000 7f22d9c79f40 1 -- start start 2024-09-13T23:57:02.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.710+0000 7f22d9c79f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a7ae400 0x55940a631180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.710+0000 7f22d9c79f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940a36e780 con 0x55940a7ae400 2024-09-13T23:57:02.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.710+0000 7f22d7c31700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a7ae400 0x55940a631180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.710+0000 7f22d7c31700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a7ae400 0x55940a631180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49648/0 (socket says 172.21.15.173:49648) 2024-09-13T23:57:02.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.710+0000 7f22d7c31700 1 -- 172.21.15.173:0/2134381155 learned_addr learned my addr 172.21.15.173:0/2134381155 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.714+0000 7f22d7c31700 1 -- 172.21.15.173:0/2134381155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55940a35ab60 con 0x55940a7ae400 2024-09-13T23:57:02.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.714+0000 7f22d7c31700 1 --2- 172.21.15.173:0/2134381155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a7ae400 0x55940a631180 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x55940a7bc0c0 tx=0x55940a6ad860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a0320a4fecef11 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.714+0000 7f22bebff700 1 -- 172.21.15.173:0/2134381155 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55940a7c4000 con 0x55940a7ae400 2024-09-13T23:57:02.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.714+0000 7f22bebff700 1 -- 172.21.15.173:0/2134381155 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55940a6fa600 con 0x55940a7ae400 2024-09-13T23:57:02.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.714+0000 7f22bebff700 1 -- 172.21.15.173:0/2134381155 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55940a7c4160 con 0x55940a7ae400 2024-09-13T23:57:02.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.714+0000 7f22d9c79f40 1 -- 172.21.15.173:0/2134381155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a7ae400 msgr2=0x55940a631180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.714+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/2134381155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a7ae400 0x55940a631180 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x55940a7bc0c0 tx=0x55940a6ad860 comp rx=0 tx=0).stop 2024-09-13T23:57:02.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.714+0000 7f22d9c79f40 1 -- 172.21.15.173:0/2134381155 shutdown_connections 2024-09-13T23:57:02.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.714+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/2134381155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a7ae400 0x55940a631180 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.714+0000 7f22d9c79f40 1 -- 172.21.15.173:0/2134381155 >> 172.21.15.173:0/2134381155 conn(0x55940a7afc00 msgr2=0x55940a44a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.714+0000 7f22d9c79f40 1 -- 172.21.15.173:0/2134381155 shutdown_connections 2024-09-13T23:57:02.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.714+0000 7f22d9c79f40 1 -- 172.21.15.173:0/2134381155 wait complete. 2024-09-13T23:57:02.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.714+0000 7f22d9c79f40 1 Processor -- start 2024-09-13T23:57:02.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.714+0000 7f22d9c79f40 1 -- start start 2024-09-13T23:57:02.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.714+0000 7f22d9c79f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a7ae400 0x55940a631180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.714+0000 7f22d9c79f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940a3d6000 con 0x55940a7ae400 2024-09-13T23:57:02.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.714+0000 7f22d7c31700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a7ae400 0x55940a631180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.714+0000 7f22d7c31700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a7ae400 0x55940a631180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49660/0 (socket says 172.21.15.173:49660) 2024-09-13T23:57:02.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.714+0000 7f22d7c31700 1 -- 172.21.15.173:0/3768251703 learned_addr learned my addr 172.21.15.173:0/3768251703 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:02.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.718+0000 7f22d7c31700 1 -- 172.21.15.173:0/3768251703 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55940a35ad00 con 0x55940a7ae400 2024-09-13T23:57:02.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.718+0000 7f22d7c31700 1 --2- 172.21.15.173:0/3768251703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a7ae400 0x55940a631180 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x55940a7bc2d0 tx=0x55940a6ad9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.718+0000 7f22bd3fc700 1 -- 172.21.15.173:0/3768251703 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55940a7c42c0 con 0x55940a7ae400 2024-09-13T23:57:02.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.718+0000 7f22bd3fc700 1 -- 172.21.15.173:0/3768251703 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55940a6fa300 con 0x55940a7ae400 2024-09-13T23:57:02.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.718+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3768251703 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55940a35a340 con 0x55940a7ae400 2024-09-13T23:57:02.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.718+0000 7f22bd3fc700 1 -- 172.21.15.173:0/3768251703 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55940a7c4000 con 0x55940a7ae400 2024-09-13T23:57:02.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.718+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3768251703 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55940a35ab60 con 0x55940a7ae400 2024-09-13T23:57:02.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.718+0000 7f22bd3fc700 1 -- 172.21.15.173:0/3768251703 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55940a443b80 con 0x55940a7ae400 2024-09-13T23:57:02.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.718+0000 7f22bd3fc700 1 --2- 172.21.15.173:0/3768251703 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55940a844000 0x55940a84a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:02.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.718+0000 7f22bd3fc700 1 -- 172.21.15.173:0/3768251703 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55940a3af500 con 0x55940a7ae400 2024-09-13T23:57:02.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.718+0000 7f22d9c79f40 5 note: GC not initialized 2024-09-13T23:57:02.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.718+0000 7f22d8c33700 1 --2- 172.21.15.173:0/3768251703 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55940a844000 0x55940a84a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:02.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.718+0000 7f22d8c33700 1 --2- 172.21.15.173:0/3768251703 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55940a844000 0x55940a84a000 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55940a74d7a0 tx=0x55940a80e660 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:02.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.722+0000 7f22babf7700 20 reqs_thread_entry: start 2024-09-13T23:57:02.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.722+0000 7f22d9c79f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:02.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.722+0000 7f22d9c79f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:02.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.722+0000 7f22b8bf3700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:32 2024 2024-09-13T23:57:02.727 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:02.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.722+0000 7f22b83d1700 20 reqs_thread_entry: start 2024-09-13T23:57:02.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.722+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9c00 2024-09-13T23:57:02.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.722+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(62 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.722+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9400 2024-09-13T23:57:02.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.722+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(63 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.722+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9000 2024-09-13T23:57:02.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.722+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(64 [pgnls start_epoch 33 out=49b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.722+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9000 2024-09-13T23:57:02.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.722+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(65 [pgnls start_epoch 33 out=49b] v33'11 uv11 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.722+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a7a8000 2024-09-13T23:57:02.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.726+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(66 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a7a8000 2024-09-13T23:57:02.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.726+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9400 2024-09-13T23:57:02.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.726+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(67 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.726+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9000 2024-09-13T23:57:02.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.726+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(68 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.726+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9c00 2024-09-13T23:57:02.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.726+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(69 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.726+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a7a8000 2024-09-13T23:57:02.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.726+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(70 [pgnls start_epoch 33 out=49b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a7a8000 2024-09-13T23:57:02.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.726+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9400 2024-09-13T23:57:02.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.726+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(71 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.726+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9000 2024-09-13T23:57:02.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.726+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(72 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.726+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9c00 2024-09-13T23:57:02.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.730+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(73 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.730+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9000 2024-09-13T23:57:02.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.730+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 24 ==== osd_op_reply(74 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.730+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9c00 2024-09-13T23:57:02.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.730+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(75 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.730+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a7a8000 2024-09-13T23:57:02.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.730+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(76 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a7a8000 2024-09-13T23:57:02.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.730+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9c00 2024-09-13T23:57:02.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.730+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== osd_op_reply(77 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.730+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9000 2024-09-13T23:57:02.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.730+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 25 ==== osd_op_reply(78 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.730+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9400 2024-09-13T23:57:02.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.730+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(79 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.730+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a7a8000 2024-09-13T23:57:02.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.734+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(80 [pgnls start_epoch 33 out=70b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+70 (crc 0 0 0) 0x55940a742b40 con 0x55940a7a8000 2024-09-13T23:57:02.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.734+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9400 2024-09-13T23:57:02.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.734+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(81 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.734+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9000 2024-09-13T23:57:02.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.734+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 26 ==== osd_op_reply(82 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.734+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9c00 2024-09-13T23:57:02.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.734+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 20 ==== osd_op_reply(83 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.734+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a7a8000 2024-09-13T23:57:02.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.734+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(84 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a7a8000 2024-09-13T23:57:02.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.734+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9000 2024-09-13T23:57:02.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.734+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 27 ==== osd_op_reply(85 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.734+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9000 2024-09-13T23:57:02.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.738+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 28 ==== osd_op_reply(86 [pgnls start_epoch 33 out=49b] v33'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.738+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9c00 2024-09-13T23:57:02.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.738+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 21 ==== osd_op_reply(87 [pgnls start_epoch 33 out=49b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.738+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9c00 2024-09-13T23:57:02.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.738+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 22 ==== osd_op_reply(88 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.738+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a7a8000 2024-09-13T23:57:02.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.738+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(89 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a7a8000 2024-09-13T23:57:02.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.738+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9000 2024-09-13T23:57:02.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.738+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 29 ==== osd_op_reply(90 [pgnls start_epoch 33 out=49b] v33'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.738+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9400 2024-09-13T23:57:02.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.738+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(91 [pgnls start_epoch 33 out=127b] v33'1 uv1 ondisk = 1) v8 ==== 144+0+127 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.738+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a6e9c00 2024-09-13T23:57:02.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.738+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 23 ==== osd_op_reply(92 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.738+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9800 con 0x55940a7a8000 2024-09-13T23:57:02.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.742+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.2 v2:172.21.15.173:6809/889985573 18 ==== osd_op_reply(93 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55940a742b40 con 0x55940a7a8000 2024-09-13T23:57:02.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.742+0000 7f22d9c79f40 20 RGWRados::pool_iterate: got myfoo 2024-09-13T23:57:02.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.742+0000 7f22d9c79f40 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 2024-09-13T23:57:02.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.742+0000 7f22bf400700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:02.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.742+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94094319370240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a7a9c00 con 0x55940a6e9000 2024-09-13T23:57:02.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.746+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94094319370240] v33'95 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.746+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94094317738752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a6e9800 con 0x55940a6e9400 2024-09-13T23:57:02.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.746+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94094317738752] v33'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.746+0000 7f22d9c79f40 20 remove_watcher() i=0 2024-09-13T23:57:02.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.746+0000 7f22d9c79f40 2 removed watcher, disabling cache 2024-09-13T23:57:02.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.746+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94094317739904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a844400 con 0x55940a6e9000 2024-09-13T23:57:02.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.750+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.1 v2:172.21.15.173:6808/3256211813 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94094317739904] v33'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55940a742b40 con 0x55940a6e9000 2024-09-13T23:57:02.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.750+0000 7f22d9c79f40 20 remove_watcher() i=1 2024-09-13T23:57:02.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.750+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94094317741056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a844800 con 0x55940a6e9400 2024-09-13T23:57:02.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.754+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94094317741056] v33'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.754+0000 7f22d9c79f40 20 remove_watcher() i=2 2024-09-13T23:57:02.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.754+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94094317742208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a844c00 con 0x55940a7a8000 2024-09-13T23:57:02.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.754+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.2 v2:172.21.15.173:6809/889985573 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94094317742208] v33'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55940a742b40 con 0x55940a7a8000 2024-09-13T23:57:02.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.754+0000 7f22d9c79f40 20 remove_watcher() i=3 2024-09-13T23:57:02.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.754+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94094317743360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a845000 con 0x55940a6e9400 2024-09-13T23:57:02.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.758+0000 7f22d8432700 1 -- 172.21.15.173:0/3550382548 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94094317743360] v33'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55940a743200 con 0x55940a6e9400 2024-09-13T23:57:02.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.758+0000 7f22d9c79f40 20 remove_watcher() i=4 2024-09-13T23:57:02.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.758+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94094317744512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a845400 con 0x55940a6e9c00 2024-09-13T23:57:02.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.758+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94094317744512] v33'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.758+0000 7f22d9c79f40 20 remove_watcher() i=5 2024-09-13T23:57:02.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.758+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94094317745664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a845800 con 0x55940a6e9c00 2024-09-13T23:57:02.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.762+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 <== osd.3 v2:172.21.15.173:6800/4020038786 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94094317745664] v33'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55940a743440 con 0x55940a6e9c00 2024-09-13T23:57:02.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.762+0000 7f22d9c79f40 20 remove_watcher() i=6 2024-09-13T23:57:02.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.762+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94094317746816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55940a845c00 con 0x55940a7a8000 2024-09-13T23:57:02.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d8c33700 1 -- 172.21.15.173:0/3550382548 <== osd.2 v2:172.21.15.173:6809/889985573 20 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94094317746816] v33'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55940a742b40 con 0x55940a7a8000 2024-09-13T23:57:02.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 20 remove_watcher() i=7 2024-09-13T23:57:02.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55940a6e9400 msgr2=0x55940a62fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/3550382548 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55940a6e9400 0x55940a62fb80 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55940a6e9000 msgr2=0x55940a62f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/3550382548 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55940a6e9000 0x55940a62f600 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55940a7a8000 msgr2=0x55940a62e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/3550382548 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55940a7a8000 0x55940a62e580 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55940a6e9c00 msgr2=0x55940a630c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/3550382548 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55940a6e9c00 0x55940a630c00 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55940a6e8c00 msgr2=0x55940a630680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/3550382548 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55940a6e8c00 0x55940a630680 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55940b112030 tx=0x55940a6ad8c0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349c00 msgr2=0x55940a62f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/3550382548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349c00 0x55940a62f080 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x55940b113ef0 tx=0x55940a44dc80 comp rx=0 tx=0).stop 2024-09-13T23:57:02.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d7c31700 1 -- 172.21.15.173:0/3550382548 reap_dead start 2024-09-13T23:57:02.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 shutdown_connections 2024-09-13T23:57:02.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/3550382548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349c00 0x55940a62f080 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 >> 172.21.15.173:0/3550382548 conn(0x55940a349800 msgr2=0x55940a449800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 shutdown_connections 2024-09-13T23:57:02.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3550382548 wait complete. 2024-09-13T23:57:02.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3768251703 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55940a844000 msgr2=0x55940a84a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/3768251703 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55940a844000 0x55940a84a000 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55940a74d7a0 tx=0x55940a80e660 comp rx=0 tx=0).stop 2024-09-13T23:57:02.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3768251703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a7ae400 msgr2=0x55940a631180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/3768251703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a7ae400 0x55940a631180 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x55940a7bc2d0 tx=0x55940a6ad9e0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3768251703 shutdown_connections 2024-09-13T23:57:02.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/3768251703 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55940a844000 0x55940a84a000 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/3768251703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a7ae400 0x55940a631180 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3768251703 >> 172.21.15.173:0/3768251703 conn(0x55940a7afc00 msgr2=0x55940a44a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3768251703 shutdown_connections 2024-09-13T23:57:02.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3768251703 wait complete. 2024-09-13T23:57:02.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3419593553 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55940a6e8000 msgr2=0x55940a630100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/3419593553 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55940a6e8000 0x55940a630100 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55940b1c15f0 tx=0x55940a6ac8a0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3419593553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349400 msgr2=0x55940a62eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:02.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/3419593553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349400 0x55940a62eb00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x55940b113e90 tx=0x55940a44d920 comp rx=0 tx=0).stop 2024-09-13T23:57:02.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3419593553 shutdown_connections 2024-09-13T23:57:02.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/3419593553 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55940a6e8000 0x55940a630100 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 --2- 172.21.15.173:0/3419593553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55940a349400 0x55940a62eb00 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:02.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3419593553 >> 172.21.15.173:0/3419593553 conn(0x55940a348c00 msgr2=0x55940a449000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:02.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3419593553 shutdown_connections 2024-09-13T23:57:02.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:02.766+0000 7f22d9c79f40 1 -- 172.21.15.173:0/3419593553 wait complete. 2024-09-13T23:57:02.777 INFO:teuthology.orchestra.run.smithi173.stdout:[ 2024-09-13T23:57:02.777 INFO:teuthology.orchestra.run.smithi173.stdout: "myfoo" 2024-09-13T23:57:02.777 INFO:teuthology.orchestra.run.smithi173.stdout:] 2024-09-13T23:57:02.779 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-13T23:57:02.802 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:57:02.822 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:57:02.843 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:57:02.893 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-13T23:57:02.969 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:57:03.030 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:57:03.100 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:57:03.100 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T23:57:03.100 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T23:57:03.100 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-13T23:57:03.137 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:03.138 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:03.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.134+0000 7f0661687f40 1 Processor -- start 2024-09-13T23:57:03.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.134+0000 7f0661687f40 1 -- start start 2024-09-13T23:57:03.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.134+0000 7f0661687f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x56107486b000 0x561074b50580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.134+0000 7f0661687f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56107492f500 con 0x56107486b400 2024-09-13T23:57:03.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.134+0000 7f0661687f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x5610748f8a00 con 0x56107486b000 2024-09-13T23:57:03.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.134+0000 7f065fe40700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x56107486b000 0x561074b50580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.134+0000 7f065f63f700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x56107486b400 0x56107496a800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47392/0 (socket says 172.21.15.173:47392) 2024-09-13T23:57:03.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.134+0000 7f065f63f700 1 -- 172.21.15.173:0/4063992117 learned_addr learned my addr 172.21.15.173:0/4063992117 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:03.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.134+0000 7f065fe40700 1 -- 172.21.15.173:0/4063992117 >> v1:172.21.15.87:6789/0 conn(0x56107486b400 legacy=0x56107496a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.134+0000 7f065fe40700 1 -- 172.21.15.173:0/4063992117 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56107487dd40 con 0x56107486b000 2024-09-13T23:57:03.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.134+0000 7f065fe40700 1 --2- 172.21.15.173:0/4063992117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b000 0x561074b50580 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x561074b4ba70 tx=0x56107496f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1dc11d326bf7755 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.134+0000 7f065ee3e700 1 -- 172.21.15.173:0/4063992117 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56107490f4a0 con 0x56107486b000 2024-09-13T23:57:03.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.134+0000 7f065ee3e700 1 -- 172.21.15.173:0/4063992117 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56107492f800 con 0x56107486b000 2024-09-13T23:57:03.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.134+0000 7f065ee3e700 1 -- 172.21.15.173:0/4063992117 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56107490f600 con 0x56107486b000 2024-09-13T23:57:03.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.134+0000 7f0661687f40 1 -- 172.21.15.173:0/4063992117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b000 msgr2=0x561074b50580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.134+0000 7f0661687f40 1 --2- 172.21.15.173:0/4063992117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b000 0x561074b50580 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x561074b4ba70 tx=0x56107496f920 comp rx=0 tx=0).stop 2024-09-13T23:57:03.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.134+0000 7f0661687f40 1 -- 172.21.15.173:0/4063992117 shutdown_connections 2024-09-13T23:57:03.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.134+0000 7f0661687f40 1 --2- 172.21.15.173:0/4063992117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b000 0x561074b50580 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.134+0000 7f0661687f40 1 -- 172.21.15.173:0/4063992117 >> 172.21.15.173:0/4063992117 conn(0x56107486ac00 msgr2=0x56107496a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.138+0000 7f0661687f40 1 -- 172.21.15.173:0/4063992117 shutdown_connections 2024-09-13T23:57:03.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.138+0000 7f0661687f40 1 -- 172.21.15.173:0/4063992117 wait complete. 2024-09-13T23:57:03.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.138+0000 7f0661687f40 1 Processor -- start 2024-09-13T23:57:03.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.138+0000 7f0661687f40 1 -- start start 2024-09-13T23:57:03.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.138+0000 7f0661687f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b000 0x561074b50580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.138+0000 7f0661687f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610748f8500 con 0x56107486b000 2024-09-13T23:57:03.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.138+0000 7f065fe40700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b000 0x561074b50580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.138+0000 7f065fe40700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b000 0x561074b50580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49670/0 (socket says 172.21.15.173:49670) 2024-09-13T23:57:03.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.138+0000 7f065fe40700 1 -- 172.21.15.173:0/4121058914 learned_addr learned my addr 172.21.15.173:0/4121058914 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.138+0000 7f065fe40700 1 -- 172.21.15.173:0/4121058914 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56107487dba0 con 0x56107486b000 2024-09-13T23:57:03.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.138+0000 7f065fe40700 1 --2- 172.21.15.173:0/4121058914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b000 0x561074b50580 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x5610749c7d40 tx=0x56107496f800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ecd0b2553fad12e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.138+0000 7f065e63d700 1 -- 172.21.15.173:0/4121058914 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56107490f760 con 0x56107486b000 2024-09-13T23:57:03.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.138+0000 7f065e63d700 1 -- 172.21.15.173:0/4121058914 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56107492fb00 con 0x56107486b000 2024-09-13T23:57:03.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.138+0000 7f065e63d700 1 -- 172.21.15.173:0/4121058914 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56107490f4a0 con 0x56107486b000 2024-09-13T23:57:03.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.138+0000 7f0661687f40 1 -- 172.21.15.173:0/4121058914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b000 msgr2=0x561074b50580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.138+0000 7f0661687f40 1 --2- 172.21.15.173:0/4121058914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b000 0x561074b50580 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x5610749c7d40 tx=0x56107496f800 comp rx=0 tx=0).stop 2024-09-13T23:57:03.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.138+0000 7f0661687f40 1 -- 172.21.15.173:0/4121058914 shutdown_connections 2024-09-13T23:57:03.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.138+0000 7f0661687f40 1 --2- 172.21.15.173:0/4121058914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b000 0x561074b50580 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.138+0000 7f0661687f40 1 -- 172.21.15.173:0/4121058914 >> 172.21.15.173:0/4121058914 conn(0x56107486ac00 msgr2=0x56107496b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.138+0000 7f0661687f40 1 -- 172.21.15.173:0/4121058914 shutdown_connections 2024-09-13T23:57:03.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.142+0000 7f0661687f40 1 -- 172.21.15.173:0/4121058914 wait complete. 2024-09-13T23:57:03.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.142+0000 7f0661687f40 1 Processor -- start 2024-09-13T23:57:03.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.142+0000 7f0661687f40 1 -- start start 2024-09-13T23:57:03.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.142+0000 7f0661687f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b000 0x561074b50580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.142+0000 7f0661687f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610748f83c0 con 0x56107486b000 2024-09-13T23:57:03.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.142+0000 7f065fe40700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b000 0x561074b50580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.142+0000 7f065fe40700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b000 0x561074b50580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49680/0 (socket says 172.21.15.173:49680) 2024-09-13T23:57:03.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.142+0000 7f065fe40700 1 -- 172.21.15.173:0/924319627 learned_addr learned my addr 172.21.15.173:0/924319627 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.142+0000 7f065fe40700 1 -- 172.21.15.173:0/924319627 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56107487da00 con 0x56107486b000 2024-09-13T23:57:03.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.142+0000 7f065fe40700 1 --2- 172.21.15.173:0/924319627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b000 0x561074b50580 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x5610749c76b0 tx=0x56107496f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.142+0000 7f065ce3a700 1 -- 172.21.15.173:0/924319627 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56107490f600 con 0x56107486b000 2024-09-13T23:57:03.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.142+0000 7f065ce3a700 1 -- 172.21.15.173:0/924319627 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56107492fc80 con 0x56107486b000 2024-09-13T23:57:03.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.142+0000 7f065ce3a700 1 -- 172.21.15.173:0/924319627 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56107490f8c0 con 0x56107486b000 2024-09-13T23:57:03.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.142+0000 7f0661687f40 1 -- 172.21.15.173:0/924319627 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56107487d860 con 0x56107486b000 2024-09-13T23:57:03.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.142+0000 7f0661687f40 1 -- 172.21.15.173:0/924319627 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56107487d6c0 con 0x56107486b000 2024-09-13T23:57:03.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f0661687f40 1 Processor -- start 2024-09-13T23:57:03.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f0661687f40 1 -- start start 2024-09-13T23:57:03.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f065ce3a700 1 -- 172.21.15.173:0/924319627 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x561074964b00 con 0x56107486b000 2024-09-13T23:57:03.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f0661687f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b800 0x561074b50b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f0661687f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610748f8000 con 0x56107486b800 2024-09-13T23:57:03.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f065ce3a700 1 --2- 172.21.15.173:0/924319627 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561074c02000 0x561074b51080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f065ce3a700 1 -- 172.21.15.173:0/924319627 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5610748d1180 con 0x56107486b000 2024-09-13T23:57:03.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f0660641700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b800 0x561074b50b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f0660641700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b800 0x561074b50b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49684/0 (socket says 172.21.15.173:49684) 2024-09-13T23:57:03.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f0660641700 1 -- 172.21.15.173:0/4277902154 learned_addr learned my addr 172.21.15.173:0/4277902154 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f065fe40700 1 --2- 172.21.15.173:0/924319627 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561074c02000 0x561074b51080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f0660641700 1 -- 172.21.15.173:0/4277902154 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56107487c000 con 0x56107486b800 2024-09-13T23:57:03.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f065fe40700 1 --2- 172.21.15.173:0/924319627 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561074c02000 0x561074b51080 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x561074b934a0 tx=0x561074bc48a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f0660641700 1 --2- 172.21.15.173:0/4277902154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b800 0x561074b50b00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x5610749c7f80 tx=0x561074bc4780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc42f9bab145e4b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f065a635700 1 -- 172.21.15.173:0/4277902154 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56107490f600 con 0x56107486b800 2024-09-13T23:57:03.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f065a635700 1 -- 172.21.15.173:0/4277902154 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561074c20000 con 0x56107486b800 2024-09-13T23:57:03.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f065a635700 1 -- 172.21.15.173:0/4277902154 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56107490f8c0 con 0x56107486b800 2024-09-13T23:57:03.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f0661687f40 1 -- 172.21.15.173:0/4277902154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b800 msgr2=0x561074b50b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f0661687f40 1 --2- 172.21.15.173:0/4277902154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b800 0x561074b50b00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x5610749c7f80 tx=0x561074bc4780 comp rx=0 tx=0).stop 2024-09-13T23:57:03.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f0661687f40 1 -- 172.21.15.173:0/4277902154 shutdown_connections 2024-09-13T23:57:03.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f0661687f40 1 --2- 172.21.15.173:0/4277902154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b800 0x561074b50b00 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f0661687f40 1 -- 172.21.15.173:0/4277902154 >> 172.21.15.173:0/4277902154 conn(0x56107486b400 msgr2=0x56107496b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f0661687f40 1 -- 172.21.15.173:0/4277902154 shutdown_connections 2024-09-13T23:57:03.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f0661687f40 1 -- 172.21.15.173:0/4277902154 wait complete. 2024-09-13T23:57:03.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f0661687f40 1 Processor -- start 2024-09-13T23:57:03.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f0661687f40 1 -- start start 2024-09-13T23:57:03.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f0661687f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b800 0x561074b50b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.146+0000 7f0661687f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x561074890640 con 0x56107486b800 2024-09-13T23:57:03.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.150+0000 7f0660641700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b800 0x561074b50b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.150+0000 7f0660641700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b800 0x561074b50b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49694/0 (socket says 172.21.15.173:49694) 2024-09-13T23:57:03.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.150+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 learned_addr learned my addr 172.21.15.173:0/2941140707 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.150+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56107487cea0 con 0x56107486b800 2024-09-13T23:57:03.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.150+0000 7f0660641700 1 --2- 172.21.15.173:0/2941140707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b800 0x561074b50b00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x5610749c7e00 tx=0x56107496fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.150+0000 7f0658e32700 1 -- 172.21.15.173:0/2941140707 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56107490f760 con 0x56107486b800 2024-09-13T23:57:03.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.150+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56107487c820 con 0x56107486b800 2024-09-13T23:57:03.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.150+0000 7f0658e32700 1 -- 172.21.15.173:0/2941140707 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561074c20180 con 0x56107486b800 2024-09-13T23:57:03.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.150+0000 7f0658e32700 1 -- 172.21.15.173:0/2941140707 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56107490f600 con 0x56107486b800 2024-09-13T23:57:03.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.150+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56107487c9c0 con 0x56107486b800 2024-09-13T23:57:03.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.150+0000 7f0661687f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.150+0000 7f0658e32700 1 -- 172.21.15.173:0/2941140707 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x561074964dc0 con 0x56107486b800 2024-09-13T23:57:03.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.150+0000 7f0658e32700 1 --2- 172.21.15.173:0/2941140707 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561074c02c00 0x561074b51600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.150+0000 7f0658e32700 1 -- 172.21.15.173:0/2941140707 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5610748d1340 con 0x56107486b800 2024-09-13T23:57:03.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.150+0000 7f065f63f700 1 --2- 172.21.15.173:0/2941140707 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561074c02c00 0x561074b51600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.150+0000 7f0661687f40 1 --2- 172.21.15.173:0/2941140707 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x561074c03000 0x561074b51b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.150+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03400 con 0x561074c03000 2024-09-13T23:57:03.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.154+0000 7f0660641700 1 --2- 172.21.15.173:0/2941140707 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x561074c03000 0x561074b51b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.154+0000 7f065f63f700 1 --2- 172.21.15.173:0/2941140707 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561074c02c00 0x561074b51600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x561074be1980 tx=0x561074bc5920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.154+0000 7f0660641700 1 --2- 172.21.15.173:0/2941140707 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x561074c03000 0x561074b51b80 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.154+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.154+0000 7f0661687f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.154+0000 7f0661687f40 20 realm 2024-09-13T23:57:03.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.154+0000 7f0661687f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.154+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03000 2024-09-13T23:57:03.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.154+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.154+0000 7f0661687f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.154+0000 7f0661687f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:03.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.154+0000 7f0661687f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.154+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03c00 con 0x561074c03000 2024-09-13T23:57:03.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.154+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.154+0000 7f0661687f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.154+0000 7f0661687f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.154+0000 7f0661687f40 1 --2- 172.21.15.173:0/2941140707 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x561074c03400 0x561074b52100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.154+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03400 2024-09-13T23:57:03.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.154+0000 7f065fe40700 1 --2- 172.21.15.173:0/2941140707 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x561074c03400 0x561074b52100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.154+0000 7f065fe40700 1 --2- 172.21.15.173:0/2941140707 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x561074c03400 0x561074b52100 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.154+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.154+0000 7f0661687f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:03.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.154+0000 7f0661687f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.154+0000 7f0661687f40 1 --2- 172.21.15.173:0/2941140707 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x561074c03c00 0x561074b52680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.158+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074ccc000 con 0x561074c03c00 2024-09-13T23:57:03.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.158+0000 7f065f63f700 1 --2- 172.21.15.173:0/2941140707 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x561074c03c00 0x561074b52680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.158+0000 7f065f63f700 1 --2- 172.21.15.173:0/2941140707 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x561074c03c00 0x561074b52680 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.158+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x561074ca7440 con 0x561074c03c00 2024-09-13T23:57:03.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.158+0000 7f0661687f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:03.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.158+0000 7f0661687f40 20 searching for the correct realm 2024-09-13T23:57:03.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.158+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074ccc400 con 0x561074c03c00 2024-09-13T23:57:03.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.158+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x561074ca7440 con 0x561074c03c00 2024-09-13T23:57:03.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.158+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074ccc000 con 0x561074c03400 2024-09-13T23:57:03.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.158+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.158+0000 7f065fe40700 1 --2- 172.21.15.173:0/2941140707 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x561074ccc000 0x561074b52c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.158+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074ccc000 2024-09-13T23:57:03.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.158+0000 7f0660641700 1 --2- 172.21.15.173:0/2941140707 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x561074ccc000 0x561074b52c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.158+0000 7f0660641700 1 --2- 172.21.15.173:0/2941140707 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x561074ccc000 0x561074b52c00 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.162+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca6b40 con 0x561074ccc000 2024-09-13T23:57:03.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.162+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03000 2024-09-13T23:57:03.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.162+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.162+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03000 2024-09-13T23:57:03.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.162+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.162+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03c00 2024-09-13T23:57:03.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.162+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca7440 con 0x561074c03c00 2024-09-13T23:57:03.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.162+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03000 2024-09-13T23:57:03.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.162+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.162+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03400 2024-09-13T23:57:03.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.162+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.162+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03400 2024-09-13T23:57:03.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.162+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.162+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03000 2024-09-13T23:57:03.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.166+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.166+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074ccc000 2024-09-13T23:57:03.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.166+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca6b40 con 0x561074ccc000 2024-09-13T23:57:03.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.166+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03000 2024-09-13T23:57:03.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.166+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.166+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074ccc000 2024-09-13T23:57:03.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.166+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca6b40 con 0x561074ccc000 2024-09-13T23:57:03.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.166+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03400 2024-09-13T23:57:03.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.166+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.166+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03c00 2024-09-13T23:57:03.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.166+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca7440 con 0x561074c03c00 2024-09-13T23:57:03.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.166+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03000 2024-09-13T23:57:03.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.166+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.166+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03400 2024-09-13T23:57:03.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.170+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.170+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03c00 2024-09-13T23:57:03.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.170+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca7440 con 0x561074c03c00 2024-09-13T23:57:03.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.170+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03000 2024-09-13T23:57:03.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.170+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.170+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03000 2024-09-13T23:57:03.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.170+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.170+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03000 2024-09-13T23:57:03.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.170+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.170+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03c00 2024-09-13T23:57:03.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.170+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca7440 con 0x561074c03c00 2024-09-13T23:57:03.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.170+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074ccc000 2024-09-13T23:57:03.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.174+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca6b40 con 0x561074ccc000 2024-09-13T23:57:03.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.174+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03000 2024-09-13T23:57:03.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.174+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.174+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074ccc000 2024-09-13T23:57:03.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.174+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca6b40 con 0x561074ccc000 2024-09-13T23:57:03.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.174+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03c00 2024-09-13T23:57:03.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.174+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca7440 con 0x561074c03c00 2024-09-13T23:57:03.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.174+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074ccc000 2024-09-13T23:57:03.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.174+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca6b40 con 0x561074ccc000 2024-09-13T23:57:03.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.174+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03400 2024-09-13T23:57:03.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.174+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.174+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03400 2024-09-13T23:57:03.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.174+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.178+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03c00 2024-09-13T23:57:03.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.178+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca7440 con 0x561074c03c00 2024-09-13T23:57:03.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.178+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03400 2024-09-13T23:57:03.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.178+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.178+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074c03400 2024-09-13T23:57:03.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.178+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.178+0000 7f0661687f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:03.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.178+0000 7f0661687f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:03.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.178+0000 7f0661687f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:03.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.178+0000 7f0661687f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:03.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.178+0000 7f0661687f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.178+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074ccc800 con 0x561074c03000 2024-09-13T23:57:03.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.178+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.178+0000 7f0661687f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.178+0000 7f0661687f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.178+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cccc00 con 0x561074c03400 2024-09-13T23:57:03.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.178+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.178+0000 7f0661687f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:03.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.178+0000 7f0661687f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.178+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074ccd000 con 0x561074c03000 2024-09-13T23:57:03.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.182+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.182+0000 7f0661687f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:03.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.182+0000 7f0661687f40 20 zone default found 2024-09-13T23:57:03.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.182+0000 7f0661687f40 4 Realm: () 2024-09-13T23:57:03.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.182+0000 7f0661687f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:03.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.182+0000 7f0661687f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:03.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.182+0000 7f0661687f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:03.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.182+0000 7f0661687f40 20 zonegroup default 2024-09-13T23:57:03.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.182+0000 7f0661687f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.182+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074ccd400 con 0x561074ccc000 2024-09-13T23:57:03.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.182+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x561074ca6b40 con 0x561074ccc000 2024-09-13T23:57:03.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.182+0000 7f0661687f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.182+0000 7f0661687f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.182+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074ccd800 con 0x561074c03c00 2024-09-13T23:57:03.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.182+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x561074ca7440 con 0x561074c03c00 2024-09-13T23:57:03.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.182+0000 7f0661687f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.182+0000 7f0661687f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.182+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074ccdc00 con 0x561074c03c00 2024-09-13T23:57:03.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.182+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x561074ca7440 con 0x561074c03c00 2024-09-13T23:57:03.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.182+0000 7f0661687f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.182+0000 7f0661687f40 20 started sync module instance, tier type = 2024-09-13T23:57:03.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.182+0000 7f0661687f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:03.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.182+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cd2000 con 0x561074c03400 2024-09-13T23:57:03.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.186+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.186+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94628677450496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cd2400 con 0x561074c03400 2024-09-13T23:57:03.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.186+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cd2800 con 0x561074c03000 2024-09-13T23:57:03.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.190+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94628677450496] v33'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.190+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.190+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94628677451648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cd2c00 con 0x561074c03000 2024-09-13T23:57:03.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.190+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cd3000 con 0x561074c03400 2024-09-13T23:57:03.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.190+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94628677451648] v33'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.194+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.194+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94628677452800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cd3400 con 0x561074c03400 2024-09-13T23:57:03.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.194+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cd3800 con 0x561074ccc000 2024-09-13T23:57:03.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.194+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561074ca6b40 con 0x561074ccc000 2024-09-13T23:57:03.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.194+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94628677453952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cd3c00 con 0x561074ccc000 2024-09-13T23:57:03.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.194+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cd2800 con 0x561074c03400 2024-09-13T23:57:03.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.194+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94628677452800] v33'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.198+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94628677453952] v33'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561074ca6b40 con 0x561074ccc000 2024-09-13T23:57:03.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.198+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.198+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94628677455104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cd2000 con 0x561074c03400 2024-09-13T23:57:03.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.198+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074ccc800 con 0x561074c03c00 2024-09-13T23:57:03.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.198+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561074ca7440 con 0x561074c03c00 2024-09-13T23:57:03.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.198+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94628677456256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074ccd000 con 0x561074c03c00 2024-09-13T23:57:03.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.198+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074ccd400 con 0x561074c03c00 2024-09-13T23:57:03.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.198+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94628677455104] v33'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.202+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94628677456256] v33'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561074ca7440 con 0x561074c03c00 2024-09-13T23:57:03.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.202+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561074ca7440 con 0x561074c03c00 2024-09-13T23:57:03.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.202+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94628677457408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cccc00 con 0x561074c03c00 2024-09-13T23:57:03.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.202+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074c03800 con 0x561074ccc000 2024-09-13T23:57:03.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.202+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94628677457408] v33'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561074ca7440 con 0x561074c03c00 2024-09-13T23:57:03.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.202+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561074ca6b40 con 0x561074ccc000 2024-09-13T23:57:03.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.206+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94628677458560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cd2400 con 0x561074ccc000 2024-09-13T23:57:03.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.206+0000 7f0661687f40 20 add_watcher() i=0 2024-09-13T23:57:03.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.206+0000 7f0661687f40 20 add_watcher() i=1 2024-09-13T23:57:03.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.206+0000 7f0661687f40 20 add_watcher() i=2 2024-09-13T23:57:03.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.206+0000 7f0661687f40 20 add_watcher() i=3 2024-09-13T23:57:03.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.206+0000 7f0661687f40 20 add_watcher() i=4 2024-09-13T23:57:03.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.206+0000 7f0661687f40 20 add_watcher() i=5 2024-09-13T23:57:03.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.206+0000 7f0661687f40 20 add_watcher() i=6 2024-09-13T23:57:03.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.206+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94628677458560] v33'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561074ca6b40 con 0x561074ccc000 2024-09-13T23:57:03.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.206+0000 7f0661687f40 20 add_watcher() i=7 2024-09-13T23:57:03.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.206+0000 7f0661687f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:03.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.206+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cd3000 con 0x561074c03000 2024-09-13T23:57:03.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.206+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.206+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94628679090176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cd3400 con 0x561074c03000 2024-09-13T23:57:03.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.210+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94628679090176] v33'96 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.210+0000 7f0646e0e700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:03.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.210+0000 7f0661687f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:03.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.210+0000 7f0661687f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:03.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.210+0000 7f0661687f40 1 Processor -- start 2024-09-13T23:57:03.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.210+0000 7f0661687f40 1 -- start start 2024-09-13T23:57:03.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.210+0000 7f0661687f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561074ccc400 0x561074b53180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.210+0000 7f0661687f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x561074890780 con 0x561074ccc400 2024-09-13T23:57:03.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.210+0000 7f065f63f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561074ccc400 0x561074b53180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.210+0000 7f065f63f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561074ccc400 0x561074b53180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49704/0 (socket says 172.21.15.173:49704) 2024-09-13T23:57:03.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.210+0000 7f065f63f700 1 -- 172.21.15.173:0/2051251271 learned_addr learned my addr 172.21.15.173:0/2051251271 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.210+0000 7f065f63f700 1 -- 172.21.15.173:0/2051251271 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56107487cb60 con 0x561074ccc400 2024-09-13T23:57:03.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.210+0000 7f065f63f700 1 --2- 172.21.15.173:0/2051251271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561074ccc400 0x561074b53180 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x561074ce0090 tx=0x561074bc58c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb643a867518588 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.210+0000 7f064660d700 1 -- 172.21.15.173:0/2051251271 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561074ce8000 con 0x561074ccc400 2024-09-13T23:57:03.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.210+0000 7f064660d700 1 -- 172.21.15.173:0/2051251271 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561074c20600 con 0x561074ccc400 2024-09-13T23:57:03.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.210+0000 7f064660d700 1 -- 172.21.15.173:0/2051251271 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561074ce8160 con 0x561074ccc400 2024-09-13T23:57:03.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.214+0000 7f0661687f40 1 -- 172.21.15.173:0/2051251271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561074ccc400 msgr2=0x561074b53180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.214+0000 7f0661687f40 1 --2- 172.21.15.173:0/2051251271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561074ccc400 0x561074b53180 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x561074ce0090 tx=0x561074bc58c0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.214+0000 7f0661687f40 1 -- 172.21.15.173:0/2051251271 shutdown_connections 2024-09-13T23:57:03.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.214+0000 7f0661687f40 1 --2- 172.21.15.173:0/2051251271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561074ccc400 0x561074b53180 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.214+0000 7f0661687f40 1 -- 172.21.15.173:0/2051251271 >> 172.21.15.173:0/2051251271 conn(0x561074cd2800 msgr2=0x56107496c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.214+0000 7f0661687f40 1 -- 172.21.15.173:0/2051251271 shutdown_connections 2024-09-13T23:57:03.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.214+0000 7f0661687f40 1 -- 172.21.15.173:0/2051251271 wait complete. 2024-09-13T23:57:03.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.214+0000 7f0661687f40 1 Processor -- start 2024-09-13T23:57:03.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.214+0000 7f0661687f40 1 -- start start 2024-09-13T23:57:03.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.214+0000 7f0661687f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561074ccc400 0x561074b53180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.214+0000 7f0661687f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610748f8000 con 0x561074ccc400 2024-09-13T23:57:03.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.214+0000 7f065f63f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561074ccc400 0x561074b53180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.214+0000 7f065f63f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561074ccc400 0x561074b53180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49720/0 (socket says 172.21.15.173:49720) 2024-09-13T23:57:03.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.214+0000 7f065f63f700 1 -- 172.21.15.173:0/33749375 learned_addr learned my addr 172.21.15.173:0/33749375 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.214+0000 7f065f63f700 1 -- 172.21.15.173:0/33749375 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56107487cd00 con 0x561074ccc400 2024-09-13T23:57:03.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.214+0000 7f065f63f700 1 --2- 172.21.15.173:0/33749375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561074ccc400 0x561074b53180 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x561074ce02a0 tx=0x561074bc5a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.214+0000 7f0644e0a700 1 -- 172.21.15.173:0/33749375 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561074ce82c0 con 0x561074ccc400 2024-09-13T23:57:03.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.214+0000 7f0644e0a700 1 -- 172.21.15.173:0/33749375 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561074c20300 con 0x561074ccc400 2024-09-13T23:57:03.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.214+0000 7f0661687f40 1 -- 172.21.15.173:0/33749375 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56107487c340 con 0x561074ccc400 2024-09-13T23:57:03.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.214+0000 7f0644e0a700 1 -- 172.21.15.173:0/33749375 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561074ce8000 con 0x561074ccc400 2024-09-13T23:57:03.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.214+0000 7f0661687f40 1 -- 172.21.15.173:0/33749375 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56107487cb60 con 0x561074ccc400 2024-09-13T23:57:03.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.218+0000 7f0644e0a700 1 -- 172.21.15.173:0/33749375 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x561074965b80 con 0x561074ccc400 2024-09-13T23:57:03.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.218+0000 7f0644e0a700 1 --2- 172.21.15.173:0/33749375 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561074c03800 0x561074d6c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.218+0000 7f0644e0a700 1 -- 172.21.15.173:0/33749375 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5610748d1500 con 0x561074ccc400 2024-09-13T23:57:03.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.218+0000 7f0660641700 1 --2- 172.21.15.173:0/33749375 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561074c03800 0x561074d6c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.218+0000 7f0661687f40 5 note: GC not initialized 2024-09-13T23:57:03.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.218+0000 7f0660641700 1 --2- 172.21.15.173:0/33749375 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561074c03800 0x561074d6c000 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x561074c774d0 tx=0x561074d30660 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.218+0000 7f0642605700 20 reqs_thread_entry: start 2024-09-13T23:57:03.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.218+0000 7f0661687f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:03.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.218+0000 7f0661687f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:03.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.218+0000 7f063fe00700 20 reqs_thread_entry: start 2024-09-13T23:57:03.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.218+0000 7f0661687f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.218+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074ccc800 con 0x561074ccc000 2024-09-13T23:57:03.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.218+0000 7f0640601700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:33 2024 2024-09-13T23:57:03.231 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:03.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x561074ca6b40 con 0x561074ccc000 2024-09-13T23:57:03.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0661687f40 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:57:03.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0661687f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:63 8.17 8:ea49432e:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cd2c00 con 0x561074c03400 2024-09-13T23:57:03.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(63 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0661687f40 20 rados_obj.operate() r=0 bl.length=352 2024-09-13T23:57:03.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0661687f40 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T23:57:03.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0661687f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cd3800 con 0x561074ccc000 2024-09-13T23:57:03.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x561074ca6b40 con 0x561074ccc000 2024-09-13T23:57:03.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0661687f40 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:57:03.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0661687f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 8.17 8:ea49432e:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cd3c00 con 0x561074c03400 2024-09-13T23:57:03.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(65 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0661687f40 20 rados_obj.operate() r=0 bl.length=352 2024-09-13T23:57:03.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0661687f40 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T23:57:03.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:66 4.3a 4:5ed28fc2:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cd2400 con 0x561074c03c00 2024-09-13T23:57:03.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 4.18 4:18584371:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074dda000 con 0x561074c03400 2024-09-13T23:57:03.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:68 4.34 4:2cdc3579:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074dda400 con 0x561074ccc000 2024-09-13T23:57:03.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:69 4.1e 4:7ad1e97c:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074dda800 con 0x561074c03000 2024-09-13T23:57:03.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:70 4.2f 4:f65cb84f:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074ddac00 con 0x561074c03000 2024-09-13T23:57:03.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:71 4.b 4:d29b135b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074ddb000 con 0x561074ccc000 2024-09-13T23:57:03.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:72 4.32 4:4e7c1df1:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074ddb400 con 0x561074c03400 2024-09-13T23:57:03.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:73 4.17 4:ebadd201:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074ddb800 con 0x561074c03c00 2024-09-13T23:57:03.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:74 4.2 4:40ba7f18:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074ddbc00 con 0x561074c03000 2024-09-13T23:57:03.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:75 4.26 4:66627631:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074dda000 con 0x561074c03000 2024-09-13T23:57:03.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:76 4.a 4:53f2fc8c:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074ddb400 con 0x561074c03400 2024-09-13T23:57:03.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(66 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561074ca7440 con 0x561074c03c00 2024-09-13T23:57:03.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.222+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(68 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561074ca6b40 con 0x561074ccc000 2024-09-13T23:57:03.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.226+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(70 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.226+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(67 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.226+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(71 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561074ca6b40 con 0x561074ccc000 2024-09-13T23:57:03.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.226+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(76 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.226+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(72 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.226+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(73 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561074ca7440 con 0x561074c03c00 2024-09-13T23:57:03.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.226+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(74 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.226+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(75 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.226+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(69 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.226+0000 7f0646e0e700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:03.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.226+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94628679090176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074dda400 con 0x561074c03000 2024-09-13T23:57:03.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.230+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 24 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94628679090176] v33'97 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.230+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94628677450496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074dda800 con 0x561074c03400 2024-09-13T23:57:03.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.230+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94628677450496] v33'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.230+0000 7f0661687f40 20 remove_watcher() i=0 2024-09-13T23:57:03.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.230+0000 7f0661687f40 2 removed watcher, disabling cache 2024-09-13T23:57:03.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.230+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94628677451648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cd2000 con 0x561074c03000 2024-09-13T23:57:03.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.234+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.1 v2:172.21.15.173:6808/3256211813 25 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94628677451648] v33'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561074ca6b40 con 0x561074c03000 2024-09-13T23:57:03.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.234+0000 7f0661687f40 20 remove_watcher() i=1 2024-09-13T23:57:03.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.234+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94628677452800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cd2c00 con 0x561074c03400 2024-09-13T23:57:03.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.234+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94628677452800] v33'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.234+0000 7f0661687f40 20 remove_watcher() i=2 2024-09-13T23:57:03.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.234+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94628677453952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cd3c00 con 0x561074ccc000 2024-09-13T23:57:03.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.238+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94628677453952] v33'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561074ca6b40 con 0x561074ccc000 2024-09-13T23:57:03.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.238+0000 7f0661687f40 20 remove_watcher() i=3 2024-09-13T23:57:03.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.238+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94628677455104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cd3000 con 0x561074c03400 2024-09-13T23:57:03.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.242+0000 7f065fe40700 1 -- 172.21.15.173:0/2941140707 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94628677455104] v33'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561074ca7200 con 0x561074c03400 2024-09-13T23:57:03.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.242+0000 7f0661687f40 20 remove_watcher() i=4 2024-09-13T23:57:03.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.242+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94628677456256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cd3400 con 0x561074c03c00 2024-09-13T23:57:03.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.242+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94628677456256] v33'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561074ca7440 con 0x561074c03c00 2024-09-13T23:57:03.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.242+0000 7f0661687f40 20 remove_watcher() i=5 2024-09-13T23:57:03.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.242+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94628677457408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074cd3800 con 0x561074c03c00 2024-09-13T23:57:03.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.246+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94628677457408] v33'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561074ca7440 con 0x561074c03c00 2024-09-13T23:57:03.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.246+0000 7f0661687f40 20 remove_watcher() i=6 2024-09-13T23:57:03.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.246+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94628677458560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561074ccc800 con 0x561074ccc000 2024-09-13T23:57:03.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.246+0000 7f0660641700 1 -- 172.21.15.173:0/2941140707 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94628677458560] v33'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561074ca6b40 con 0x561074ccc000 2024-09-13T23:57:03.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.246+0000 7f0661687f40 20 remove_watcher() i=7 2024-09-13T23:57:03.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.246+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x561074c03400 msgr2=0x561074b52100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.246+0000 7f0661687f40 1 --2- 172.21.15.173:0/2941140707 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x561074c03400 0x561074b52100 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.246+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x561074c03000 msgr2=0x561074b51b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.246+0000 7f0661687f40 1 --2- 172.21.15.173:0/2941140707 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x561074c03000 0x561074b51b80 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.246+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x561074ccc000 msgr2=0x561074b52c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.246+0000 7f0661687f40 1 --2- 172.21.15.173:0/2941140707 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x561074ccc000 0x561074b52c00 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.246+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x561074c03c00 msgr2=0x561074b52680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.246+0000 7f0661687f40 1 --2- 172.21.15.173:0/2941140707 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x561074c03c00 0x561074b52680 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.246+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561074c02c00 msgr2=0x561074b51600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.246+0000 7f0661687f40 1 --2- 172.21.15.173:0/2941140707 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561074c02c00 0x561074b51600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x561074be1980 tx=0x561074bc5920 comp rx=0 tx=0).stop 2024-09-13T23:57:03.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.246+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b800 msgr2=0x561074b50b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.246+0000 7f0661687f40 1 --2- 172.21.15.173:0/2941140707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b800 0x561074b50b00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x5610749c7e00 tx=0x56107496fce0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.246+0000 7f065f63f700 1 -- 172.21.15.173:0/2941140707 reap_dead start 2024-09-13T23:57:03.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.246+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 shutdown_connections 2024-09-13T23:57:03.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.246+0000 7f0661687f40 1 --2- 172.21.15.173:0/2941140707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b800 0x561074b50b00 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.246+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 >> 172.21.15.173:0/2941140707 conn(0x56107486b400 msgr2=0x56107496b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.246+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 shutdown_connections 2024-09-13T23:57:03.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.246+0000 7f0661687f40 1 -- 172.21.15.173:0/2941140707 wait complete. 2024-09-13T23:57:03.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.250+0000 7f0661687f40 1 -- 172.21.15.173:0/33749375 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561074c03800 msgr2=0x561074d6c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.250+0000 7f0661687f40 1 --2- 172.21.15.173:0/33749375 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561074c03800 0x561074d6c000 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x561074c774d0 tx=0x561074d30660 comp rx=0 tx=0).stop 2024-09-13T23:57:03.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.250+0000 7f0661687f40 1 -- 172.21.15.173:0/33749375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561074ccc400 msgr2=0x561074b53180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.250+0000 7f0661687f40 1 --2- 172.21.15.173:0/33749375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561074ccc400 0x561074b53180 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x561074ce02a0 tx=0x561074bc5a40 comp rx=0 tx=0).stop 2024-09-13T23:57:03.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.250+0000 7f0661687f40 1 -- 172.21.15.173:0/33749375 shutdown_connections 2024-09-13T23:57:03.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.250+0000 7f0661687f40 1 --2- 172.21.15.173:0/33749375 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561074c03800 0x561074d6c000 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.250+0000 7f0661687f40 1 --2- 172.21.15.173:0/33749375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561074ccc400 0x561074b53180 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.250+0000 7f0661687f40 1 -- 172.21.15.173:0/33749375 >> 172.21.15.173:0/33749375 conn(0x561074cd2800 msgr2=0x56107496c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.250+0000 7f0661687f40 1 -- 172.21.15.173:0/33749375 shutdown_connections 2024-09-13T23:57:03.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.250+0000 7f0661687f40 1 -- 172.21.15.173:0/33749375 wait complete. 2024-09-13T23:57:03.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.250+0000 7f0661687f40 1 -- 172.21.15.173:0/924319627 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561074c02000 msgr2=0x561074b51080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.250+0000 7f0661687f40 1 --2- 172.21.15.173:0/924319627 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561074c02000 0x561074b51080 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x561074b934a0 tx=0x561074bc48a0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.250+0000 7f0661687f40 1 -- 172.21.15.173:0/924319627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b000 msgr2=0x561074b50580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.250+0000 7f0661687f40 1 --2- 172.21.15.173:0/924319627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b000 0x561074b50580 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x5610749c76b0 tx=0x56107496f920 comp rx=0 tx=0).stop 2024-09-13T23:57:03.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.250+0000 7f0661687f40 1 -- 172.21.15.173:0/924319627 shutdown_connections 2024-09-13T23:57:03.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.250+0000 7f0661687f40 1 --2- 172.21.15.173:0/924319627 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561074c02000 0x561074b51080 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.250+0000 7f0661687f40 1 --2- 172.21.15.173:0/924319627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56107486b000 0x561074b50580 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.250+0000 7f0661687f40 1 -- 172.21.15.173:0/924319627 >> 172.21.15.173:0/924319627 conn(0x56107486ac00 msgr2=0x56107496b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.250+0000 7f0661687f40 1 -- 172.21.15.173:0/924319627 shutdown_connections 2024-09-13T23:57:03.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.250+0000 7f0661687f40 1 -- 172.21.15.173:0/924319627 wait complete. 2024-09-13T23:57:03.259 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:03.259 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo", 2024-09-13T23:57:03.259 INFO:teuthology.orchestra.run.smithi173.stdout: "num_shards": 11, 2024-09-13T23:57:03.259 INFO:teuthology.orchestra.run.smithi173.stdout: "tenant": "", 2024-09-13T23:57:03.260 INFO:teuthology.orchestra.run.smithi173.stdout: "zonegroup": "45606a84-a024-4d59-86ac-9903db661675", 2024-09-13T23:57:03.260 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_rule": "default-placement", 2024-09-13T23:57:03.260 INFO:teuthology.orchestra.run.smithi173.stdout: "explicit_placement": { 2024-09-13T23:57:03.260 INFO:teuthology.orchestra.run.smithi173.stdout: "data_pool": "", 2024-09-13T23:57:03.260 INFO:teuthology.orchestra.run.smithi173.stdout: "data_extra_pool": "", 2024-09-13T23:57:03.260 INFO:teuthology.orchestra.run.smithi173.stdout: "index_pool": "" 2024-09-13T23:57:03.260 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:03.260 INFO:teuthology.orchestra.run.smithi173.stdout: "id": "d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1", 2024-09-13T23:57:03.260 INFO:teuthology.orchestra.run.smithi173.stdout: "marker": "d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1", 2024-09-13T23:57:03.260 INFO:teuthology.orchestra.run.smithi173.stdout: "index_type": "Normal", 2024-09-13T23:57:03.260 INFO:teuthology.orchestra.run.smithi173.stdout: "versioned": false, 2024-09-13T23:57:03.260 INFO:teuthology.orchestra.run.smithi173.stdout: "versioning_enabled": false, 2024-09-13T23:57:03.261 INFO:teuthology.orchestra.run.smithi173.stdout: "object_lock_enabled": false, 2024-09-13T23:57:03.261 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_enabled": false, 2024-09-13T23:57:03.261 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:57:03.261 INFO:teuthology.orchestra.run.smithi173.stdout: "ver": "0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1", 2024-09-13T23:57:03.261 INFO:teuthology.orchestra.run.smithi173.stdout: "master_ver": "0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0", 2024-09-13T23:57:03.261 INFO:teuthology.orchestra.run.smithi173.stdout: "mtime": "2024-09-13T23:57:02.419798Z", 2024-09-13T23:57:03.262 INFO:teuthology.orchestra.run.smithi173.stdout: "creation_time": "2024-09-13T23:57:02.413869Z", 2024-09-13T23:57:03.262 INFO:teuthology.orchestra.run.smithi173.stdout: "max_marker": "0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#", 2024-09-13T23:57:03.262 INFO:teuthology.orchestra.run.smithi173.stdout: "usage": {}, 2024-09-13T23:57:03.262 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:57:03.262 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:03.262 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:03.262 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:03.262 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:03.262 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:03.262 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:03.262 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:03.263 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '45606a84-a024-4d59-86ac-9903db661675', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.1', 'marker': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.1', 'index_type': 'Normal', 'versioned': False, 'versioning_enabled': False, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T23:57:02.419798Z', 'creation_time': '2024-09-13T23:57:02.413869Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T23:57:03.264 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-13T23:57:03.264 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-13T23:57:03.264 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-13T23:57:03.345 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:03.345 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:03.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.342+0000 7ff94f667f40 1 Processor -- start 2024-09-13T23:57:03.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.342+0000 7ff94f667f40 1 -- start start 2024-09-13T23:57:03.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.342+0000 7ff94f667f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55a0e4ed7000 0x55a0e51bc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.342+0000 7ff94f667f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a0e4f9b500 con 0x55a0e4ed7400 2024-09-13T23:57:03.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.342+0000 7ff94f667f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a0e4f64a00 con 0x55a0e4ed7000 2024-09-13T23:57:03.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.342+0000 7ff94de20700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55a0e4ed7000 0x55a0e51bc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.342+0000 7ff94d61f700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55a0e4ed7400 0x55a0e4fd6800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47396/0 (socket says 172.21.15.173:47396) 2024-09-13T23:57:03.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.342+0000 7ff94d61f700 1 -- 172.21.15.173:0/4044684268 learned_addr learned my addr 172.21.15.173:0/4044684268 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:03.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.342+0000 7ff94de20700 1 -- 172.21.15.173:0/4044684268 >> v1:172.21.15.87:6789/0 conn(0x55a0e4ed7400 legacy=0x55a0e4fd6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.342+0000 7ff94de20700 1 -- 172.21.15.173:0/4044684268 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0e4ee9d40 con 0x55a0e4ed7000 2024-09-13T23:57:03.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.342+0000 7ff94de20700 1 --2- 172.21.15.173:0/4044684268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7000 0x55a0e51bc580 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x55a0e51b7a70 tx=0x55a0e4fdb920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cbdbbe6c601a009 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.342+0000 7ff94ce1e700 1 -- 172.21.15.173:0/4044684268 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a0e4f7b4a0 con 0x55a0e4ed7000 2024-09-13T23:57:03.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.342+0000 7ff94ce1e700 1 -- 172.21.15.173:0/4044684268 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a0e4f9b800 con 0x55a0e4ed7000 2024-09-13T23:57:03.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.342+0000 7ff94ce1e700 1 -- 172.21.15.173:0/4044684268 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a0e4f7b600 con 0x55a0e4ed7000 2024-09-13T23:57:03.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.342+0000 7ff94f667f40 1 -- 172.21.15.173:0/4044684268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7000 msgr2=0x55a0e51bc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.342+0000 7ff94f667f40 1 --2- 172.21.15.173:0/4044684268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7000 0x55a0e51bc580 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x55a0e51b7a70 tx=0x55a0e4fdb920 comp rx=0 tx=0).stop 2024-09-13T23:57:03.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.342+0000 7ff94f667f40 1 -- 172.21.15.173:0/4044684268 shutdown_connections 2024-09-13T23:57:03.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.342+0000 7ff94f667f40 1 --2- 172.21.15.173:0/4044684268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7000 0x55a0e51bc580 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.342+0000 7ff94f667f40 1 -- 172.21.15.173:0/4044684268 >> 172.21.15.173:0/4044684268 conn(0x55a0e4ed6c00 msgr2=0x55a0e4fd6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.342+0000 7ff94f667f40 1 -- 172.21.15.173:0/4044684268 shutdown_connections 2024-09-13T23:57:03.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.342+0000 7ff94f667f40 1 -- 172.21.15.173:0/4044684268 wait complete. 2024-09-13T23:57:03.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.346+0000 7ff94f667f40 1 Processor -- start 2024-09-13T23:57:03.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.346+0000 7ff94f667f40 1 -- start start 2024-09-13T23:57:03.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.346+0000 7ff94f667f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7000 0x55a0e51bc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.346+0000 7ff94f667f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0e4f64500 con 0x55a0e4ed7000 2024-09-13T23:57:03.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.346+0000 7ff94de20700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7000 0x55a0e51bc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.346+0000 7ff94de20700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7000 0x55a0e51bc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49736/0 (socket says 172.21.15.173:49736) 2024-09-13T23:57:03.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.346+0000 7ff94de20700 1 -- 172.21.15.173:0/3171620399 learned_addr learned my addr 172.21.15.173:0/3171620399 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.346+0000 7ff94de20700 1 -- 172.21.15.173:0/3171620399 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0e4ee9ba0 con 0x55a0e4ed7000 2024-09-13T23:57:03.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.346+0000 7ff94de20700 1 --2- 172.21.15.173:0/3171620399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7000 0x55a0e51bc580 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x55a0e5032120 tx=0x55a0e4fdb800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248d1d5e46d23ff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.346+0000 7ff94c61d700 1 -- 172.21.15.173:0/3171620399 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a0e4f7b760 con 0x55a0e4ed7000 2024-09-13T23:57:03.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.346+0000 7ff94c61d700 1 -- 172.21.15.173:0/3171620399 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a0e4f9bb00 con 0x55a0e4ed7000 2024-09-13T23:57:03.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.346+0000 7ff94c61d700 1 -- 172.21.15.173:0/3171620399 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a0e4f7b4a0 con 0x55a0e4ed7000 2024-09-13T23:57:03.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.346+0000 7ff94f667f40 1 -- 172.21.15.173:0/3171620399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7000 msgr2=0x55a0e51bc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.346+0000 7ff94f667f40 1 --2- 172.21.15.173:0/3171620399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7000 0x55a0e51bc580 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x55a0e5032120 tx=0x55a0e4fdb800 comp rx=0 tx=0).stop 2024-09-13T23:57:03.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.346+0000 7ff94f667f40 1 -- 172.21.15.173:0/3171620399 shutdown_connections 2024-09-13T23:57:03.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.346+0000 7ff94f667f40 1 --2- 172.21.15.173:0/3171620399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7000 0x55a0e51bc580 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.346+0000 7ff94f667f40 1 -- 172.21.15.173:0/3171620399 >> 172.21.15.173:0/3171620399 conn(0x55a0e4ed6c00 msgr2=0x55a0e4fd7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.346+0000 7ff94f667f40 1 -- 172.21.15.173:0/3171620399 shutdown_connections 2024-09-13T23:57:03.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.346+0000 7ff94f667f40 1 -- 172.21.15.173:0/3171620399 wait complete. 2024-09-13T23:57:03.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.346+0000 7ff94f667f40 1 Processor -- start 2024-09-13T23:57:03.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.346+0000 7ff94f667f40 1 -- start start 2024-09-13T23:57:03.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.346+0000 7ff94f667f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7400 0x55a0e51bcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.346+0000 7ff94f667f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0e4f643c0 con 0x55a0e4ed7400 2024-09-13T23:57:03.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.350+0000 7ff94de20700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7400 0x55a0e51bcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.350+0000 7ff94de20700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7400 0x55a0e51bcb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49742/0 (socket says 172.21.15.173:49742) 2024-09-13T23:57:03.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.350+0000 7ff94de20700 1 -- 172.21.15.173:0/857857390 learned_addr learned my addr 172.21.15.173:0/857857390 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.350+0000 7ff94de20700 1 -- 172.21.15.173:0/857857390 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0e4ee9a00 con 0x55a0e4ed7400 2024-09-13T23:57:03.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.350+0000 7ff94de20700 1 --2- 172.21.15.173:0/857857390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7400 0x55a0e51bcb00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x55a0e5032120 tx=0x55a0e4fdb920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.350+0000 7ff94ae1a700 1 -- 172.21.15.173:0/857857390 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a0e4f7b600 con 0x55a0e4ed7400 2024-09-13T23:57:03.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.350+0000 7ff94ae1a700 1 -- 172.21.15.173:0/857857390 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a0e4f9bc80 con 0x55a0e4ed7400 2024-09-13T23:57:03.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.350+0000 7ff94f667f40 1 -- 172.21.15.173:0/857857390 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a0e4ee9860 con 0x55a0e4ed7400 2024-09-13T23:57:03.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.350+0000 7ff94ae1a700 1 -- 172.21.15.173:0/857857390 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a0e4f7b8c0 con 0x55a0e4ed7400 2024-09-13T23:57:03.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.350+0000 7ff94f667f40 1 -- 172.21.15.173:0/857857390 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a0e4ee96c0 con 0x55a0e4ed7400 2024-09-13T23:57:03.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.350+0000 7ff94f667f40 1 Processor -- start 2024-09-13T23:57:03.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.350+0000 7ff94f667f40 1 -- start start 2024-09-13T23:57:03.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.350+0000 7ff94f667f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7c00 0x55a0e51bd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.350+0000 7ff94f667f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0e4f64000 con 0x55a0e4ed7c00 2024-09-13T23:57:03.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.350+0000 7ff94e621700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7c00 0x55a0e51bd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.350+0000 7ff94e621700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7c00 0x55a0e51bd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49744/0 (socket says 172.21.15.173:49744) 2024-09-13T23:57:03.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.350+0000 7ff94e621700 1 -- 172.21.15.173:0/2746852834 learned_addr learned my addr 172.21.15.173:0/2746852834 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.350+0000 7ff94ae1a700 1 -- 172.21.15.173:0/857857390 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55a0e4fd0b00 con 0x55a0e4ed7400 2024-09-13T23:57:03.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.350+0000 7ff94e621700 1 -- 172.21.15.173:0/2746852834 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0e4ee8000 con 0x55a0e4ed7c00 2024-09-13T23:57:03.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.350+0000 7ff94ae1a700 1 --2- 172.21.15.173:0/857857390 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a0e527a000 0x55a0e51be100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.350+0000 7ff94e621700 1 --2- 172.21.15.173:0/2746852834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7c00 0x55a0e51bd080 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x55a0e5202e10 tx=0x55a0e52388a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf55a3152137f62b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.350+0000 7ff94ae1a700 1 -- 172.21.15.173:0/857857390 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55a0e4f3d180 con 0x55a0e4ed7400 2024-09-13T23:57:03.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.354+0000 7ff94de20700 1 --2- 172.21.15.173:0/857857390 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a0e527a000 0x55a0e51be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.354+0000 7ff948615700 1 -- 172.21.15.173:0/2746852834 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a0e4f7b600 con 0x55a0e4ed7c00 2024-09-13T23:57:03.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.354+0000 7ff948615700 1 -- 172.21.15.173:0/2746852834 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a0e523e000 con 0x55a0e4ed7c00 2024-09-13T23:57:03.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.354+0000 7ff948615700 1 -- 172.21.15.173:0/2746852834 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a0e4f7b8c0 con 0x55a0e4ed7c00 2024-09-13T23:57:03.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.354+0000 7ff94de20700 1 --2- 172.21.15.173:0/857857390 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a0e527a000 0x55a0e51be100 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55a0e5203050 tx=0x55a0e5238120 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.354+0000 7ff94f667f40 1 -- 172.21.15.173:0/2746852834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7c00 msgr2=0x55a0e51bd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.354+0000 7ff94f667f40 1 --2- 172.21.15.173:0/2746852834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7c00 0x55a0e51bd080 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x55a0e5202e10 tx=0x55a0e52388a0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.354+0000 7ff94f667f40 1 -- 172.21.15.173:0/2746852834 shutdown_connections 2024-09-13T23:57:03.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.354+0000 7ff94f667f40 1 --2- 172.21.15.173:0/2746852834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7c00 0x55a0e51bd080 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.354+0000 7ff94f667f40 1 -- 172.21.15.173:0/2746852834 >> 172.21.15.173:0/2746852834 conn(0x55a0e4ed7800 msgr2=0x55a0e4fd7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.354+0000 7ff94f667f40 1 -- 172.21.15.173:0/2746852834 shutdown_connections 2024-09-13T23:57:03.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.354+0000 7ff94f667f40 1 -- 172.21.15.173:0/2746852834 wait complete. 2024-09-13T23:57:03.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.354+0000 7ff94f667f40 1 Processor -- start 2024-09-13T23:57:03.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.354+0000 7ff94f667f40 1 -- start start 2024-09-13T23:57:03.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.354+0000 7ff94f667f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7c00 0x55a0e51bd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.354+0000 7ff94f667f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0e4efc640 con 0x55a0e4ed7c00 2024-09-13T23:57:03.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.354+0000 7ff94e621700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7c00 0x55a0e51bd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.354+0000 7ff94e621700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7c00 0x55a0e51bd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49756/0 (socket says 172.21.15.173:49756) 2024-09-13T23:57:03.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.354+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 learned_addr learned my addr 172.21.15.173:0/1218106340 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.358+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0e4ee8ea0 con 0x55a0e4ed7c00 2024-09-13T23:57:03.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.358+0000 7ff94e621700 1 --2- 172.21.15.173:0/1218106340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7c00 0x55a0e51bd080 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x55a0e5202330 tx=0x55a0e4fdbda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.358+0000 7ff946e12700 1 -- 172.21.15.173:0/1218106340 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a0e4f7b760 con 0x55a0e4ed7c00 2024-09-13T23:57:03.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.358+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a0e4ee8820 con 0x55a0e4ed7c00 2024-09-13T23:57:03.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.358+0000 7ff946e12700 1 -- 172.21.15.173:0/1218106340 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a0e523e180 con 0x55a0e4ed7c00 2024-09-13T23:57:03.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.358+0000 7ff946e12700 1 -- 172.21.15.173:0/1218106340 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a0e4f7b600 con 0x55a0e4ed7c00 2024-09-13T23:57:03.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.358+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a0e4ee89c0 con 0x55a0e4ed7c00 2024-09-13T23:57:03.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.358+0000 7ff946e12700 1 -- 172.21.15.173:0/1218106340 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55a0e4fd0dc0 con 0x55a0e4ed7c00 2024-09-13T23:57:03.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.358+0000 7ff94f667f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.358+0000 7ff946e12700 1 --2- 172.21.15.173:0/1218106340 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a0e527ac00 0x55a0e51be680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.358+0000 7ff946e12700 1 -- 172.21.15.173:0/1218106340 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55a0e4f3d340 con 0x55a0e4ed7c00 2024-09-13T23:57:03.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.358+0000 7ff94d61f700 1 --2- 172.21.15.173:0/1218106340 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a0e527ac00 0x55a0e51be680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.358+0000 7ff94f667f40 1 --2- 172.21.15.173:0/1218106340 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a0e527b000 0x55a0e51bd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.358+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b400 con 0x55a0e527b000 2024-09-13T23:57:03.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.358+0000 7ff94e621700 1 --2- 172.21.15.173:0/1218106340 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a0e527b000 0x55a0e51bd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.362+0000 7ff94d61f700 1 --2- 172.21.15.173:0/1218106340 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a0e527ac00 0x55a0e51be680 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55a0e527dd10 tx=0x55a0e5239800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.362+0000 7ff94e621700 1 --2- 172.21.15.173:0/1218106340 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a0e527b000 0x55a0e51bd600 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.362+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.362+0000 7ff94f667f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.362+0000 7ff94f667f40 20 realm 2024-09-13T23:57:03.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.362+0000 7ff94f667f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.362+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527b000 2024-09-13T23:57:03.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.362+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.362+0000 7ff94f667f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.362+0000 7ff94f667f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:03.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.362+0000 7ff94f667f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.362+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527bc00 con 0x55a0e527b000 2024-09-13T23:57:03.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.362+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.362+0000 7ff94f667f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.362+0000 7ff94f667f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.362+0000 7ff94f667f40 1 --2- 172.21.15.173:0/1218106340 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a0e527b400 0x55a0e51bdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.362+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527b400 2024-09-13T23:57:03.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.362+0000 7ff94de20700 1 --2- 172.21.15.173:0/1218106340 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a0e527b400 0x55a0e51bdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.362+0000 7ff94de20700 1 --2- 172.21.15.173:0/1218106340 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a0e527b400 0x55a0e51bdb80 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.362+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55a0e5323200 con 0x55a0e527b400 2024-09-13T23:57:03.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.362+0000 7ff94f667f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:03.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.362+0000 7ff94f667f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.362+0000 7ff94f667f40 1 --2- 172.21.15.173:0/1218106340 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a0e527bc00 0x55a0e51bec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.362+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533a000 con 0x55a0e527bc00 2024-09-13T23:57:03.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.366+0000 7ff94d61f700 1 --2- 172.21.15.173:0/1218106340 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a0e527bc00 0x55a0e51bec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.366+0000 7ff94d61f700 1 --2- 172.21.15.173:0/1218106340 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a0e527bc00 0x55a0e51bec00 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.366+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55a0e5323440 con 0x55a0e527bc00 2024-09-13T23:57:03.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.366+0000 7ff94f667f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:03.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.366+0000 7ff94f667f40 20 searching for the correct realm 2024-09-13T23:57:03.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.366+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533a400 con 0x55a0e527bc00 2024-09-13T23:57:03.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.366+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55a0e5323440 con 0x55a0e527bc00 2024-09-13T23:57:03.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.366+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533a000 con 0x55a0e527b400 2024-09-13T23:57:03.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.366+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5323200 con 0x55a0e527b400 2024-09-13T23:57:03.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.366+0000 7ff94de20700 1 --2- 172.21.15.173:0/1218106340 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a0e533a000 0x55a0e51bc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.366+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e533a000 2024-09-13T23:57:03.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.366+0000 7ff94e621700 1 --2- 172.21.15.173:0/1218106340 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a0e533a000 0x55a0e51bc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.366+0000 7ff94e621700 1 --2- 172.21.15.173:0/1218106340 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a0e533a000 0x55a0e51bc580 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.366+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e533a000 2024-09-13T23:57:03.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.366+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527b000 2024-09-13T23:57:03.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.370+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.370+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527b000 2024-09-13T23:57:03.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.370+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.370+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527bc00 2024-09-13T23:57:03.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.370+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5323440 con 0x55a0e527bc00 2024-09-13T23:57:03.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.370+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527b000 2024-09-13T23:57:03.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.370+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.370+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527b400 2024-09-13T23:57:03.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.370+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5323200 con 0x55a0e527b400 2024-09-13T23:57:03.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.370+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527b400 2024-09-13T23:57:03.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.370+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5323200 con 0x55a0e527b400 2024-09-13T23:57:03.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.370+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527b000 2024-09-13T23:57:03.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.370+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.370+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e533a000 2024-09-13T23:57:03.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.374+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e533a000 2024-09-13T23:57:03.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.374+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527b000 2024-09-13T23:57:03.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.374+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.374+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e533a000 2024-09-13T23:57:03.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.374+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e533a000 2024-09-13T23:57:03.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.374+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527b400 2024-09-13T23:57:03.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.374+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5323200 con 0x55a0e527b400 2024-09-13T23:57:03.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.374+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527bc00 2024-09-13T23:57:03.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.374+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5323440 con 0x55a0e527bc00 2024-09-13T23:57:03.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.374+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527b000 2024-09-13T23:57:03.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.374+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.374+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527b400 2024-09-13T23:57:03.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.374+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5323200 con 0x55a0e527b400 2024-09-13T23:57:03.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.378+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527bc00 2024-09-13T23:57:03.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.378+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5323440 con 0x55a0e527bc00 2024-09-13T23:57:03.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.378+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527b000 2024-09-13T23:57:03.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.378+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.378+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527b000 2024-09-13T23:57:03.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.378+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.378+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527b000 2024-09-13T23:57:03.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.378+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.378+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527bc00 2024-09-13T23:57:03.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.378+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5323440 con 0x55a0e527bc00 2024-09-13T23:57:03.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.378+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e533a000 2024-09-13T23:57:03.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.378+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e533a000 2024-09-13T23:57:03.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.378+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527b000 2024-09-13T23:57:03.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.378+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.378+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e533a000 2024-09-13T23:57:03.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.382+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e533a000 2024-09-13T23:57:03.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.382+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527bc00 2024-09-13T23:57:03.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.382+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5323440 con 0x55a0e527bc00 2024-09-13T23:57:03.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.382+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e533a000 2024-09-13T23:57:03.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.382+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e533a000 2024-09-13T23:57:03.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.382+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527b400 2024-09-13T23:57:03.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.382+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5323200 con 0x55a0e527b400 2024-09-13T23:57:03.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.382+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527b400 2024-09-13T23:57:03.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.382+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5323200 con 0x55a0e527b400 2024-09-13T23:57:03.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.382+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527bc00 2024-09-13T23:57:03.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.382+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5323440 con 0x55a0e527bc00 2024-09-13T23:57:03.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.382+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527b400 2024-09-13T23:57:03.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55a0e5323200 con 0x55a0e527b400 2024-09-13T23:57:03.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527b400 2024-09-13T23:57:03.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a0e5323200 con 0x55a0e527b400 2024-09-13T23:57:03.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94f667f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:03.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94f667f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:03.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94f667f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:03.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94f667f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:03.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94f667f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533a800 con 0x55a0e527b000 2024-09-13T23:57:03.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94f667f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94f667f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533ac00 con 0x55a0e527b400 2024-09-13T23:57:03.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55a0e5323200 con 0x55a0e527b400 2024-09-13T23:57:03.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94f667f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:03.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94f667f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533b000 con 0x55a0e527b000 2024-09-13T23:57:03.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94f667f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:03.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94f667f40 20 zone default found 2024-09-13T23:57:03.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94f667f40 4 Realm: () 2024-09-13T23:57:03.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94f667f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:03.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94f667f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:03.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94f667f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:03.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94f667f40 20 zonegroup default 2024-09-13T23:57:03.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94f667f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533b400 con 0x55a0e533a000 2024-09-13T23:57:03.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e533a000 2024-09-13T23:57:03.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94f667f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94f667f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.386+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533b800 con 0x55a0e527bc00 2024-09-13T23:57:03.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.390+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55a0e5323440 con 0x55a0e527bc00 2024-09-13T23:57:03.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.390+0000 7ff94f667f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.390+0000 7ff94f667f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.390+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533bc00 con 0x55a0e527bc00 2024-09-13T23:57:03.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.390+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55a0e5323440 con 0x55a0e527bc00 2024-09-13T23:57:03.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.390+0000 7ff94f667f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.390+0000 7ff94f667f40 20 started sync module instance, tier type = 2024-09-13T23:57:03.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.390+0000 7ff94f667f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:03.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.390+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533c000 con 0x55a0e527b400 2024-09-13T23:57:03.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.390+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a0e5323200 con 0x55a0e527b400 2024-09-13T23:57:03.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.390+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94149526895360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533c400 con 0x55a0e527b400 2024-09-13T23:57:03.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.390+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533c800 con 0x55a0e527b000 2024-09-13T23:57:03.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.394+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94149526895360] v33'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a0e5323200 con 0x55a0e527b400 2024-09-13T23:57:03.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.394+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.394+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94149526896512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533cc00 con 0x55a0e527b000 2024-09-13T23:57:03.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.394+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533d000 con 0x55a0e527b400 2024-09-13T23:57:03.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.398+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94149526896512] v33'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.398+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a0e5323200 con 0x55a0e527b400 2024-09-13T23:57:03.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.398+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94149526897664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533d400 con 0x55a0e527b400 2024-09-13T23:57:03.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.398+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533d800 con 0x55a0e533a000 2024-09-13T23:57:03.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.398+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e533a000 2024-09-13T23:57:03.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.398+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94149526898816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533dc00 con 0x55a0e533a000 2024-09-13T23:57:03.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.398+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533c800 con 0x55a0e527b400 2024-09-13T23:57:03.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.402+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94149526897664] v33'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a0e5323200 con 0x55a0e527b400 2024-09-13T23:57:03.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.402+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94149526898816] v33'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e533a000 2024-09-13T23:57:03.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.402+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a0e5323200 con 0x55a0e527b400 2024-09-13T23:57:03.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.402+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94149526899968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533c000 con 0x55a0e527b400 2024-09-13T23:57:03.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.402+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533c400 con 0x55a0e527bc00 2024-09-13T23:57:03.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.406+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a0e5323440 con 0x55a0e527bc00 2024-09-13T23:57:03.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.406+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94149526901120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533a800 con 0x55a0e527bc00 2024-09-13T23:57:03.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.406+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533b000 con 0x55a0e527bc00 2024-09-13T23:57:03.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.406+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94149526899968] v33'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a0e5323200 con 0x55a0e527b400 2024-09-13T23:57:03.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.406+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94149526901120] v33'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a0e5323440 con 0x55a0e527bc00 2024-09-13T23:57:03.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.406+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a0e5323440 con 0x55a0e527bc00 2024-09-13T23:57:03.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.406+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94149526902272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533b400 con 0x55a0e527bc00 2024-09-13T23:57:03.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.406+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533ac00 con 0x55a0e533a000 2024-09-13T23:57:03.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.410+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e533a000 2024-09-13T23:57:03.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.410+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94149526902272] v33'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a0e5323440 con 0x55a0e527bc00 2024-09-13T23:57:03.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.410+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94149526903424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e533a000 2024-09-13T23:57:03.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.410+0000 7ff94f667f40 20 add_watcher() i=0 2024-09-13T23:57:03.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.410+0000 7ff94f667f40 20 add_watcher() i=1 2024-09-13T23:57:03.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.410+0000 7ff94f667f40 20 add_watcher() i=2 2024-09-13T23:57:03.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.410+0000 7ff94f667f40 20 add_watcher() i=3 2024-09-13T23:57:03.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.410+0000 7ff94f667f40 20 add_watcher() i=4 2024-09-13T23:57:03.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.410+0000 7ff94f667f40 20 add_watcher() i=5 2024-09-13T23:57:03.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.410+0000 7ff94f667f40 20 add_watcher() i=6 2024-09-13T23:57:03.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.410+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94149526903424] v33'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e533a000 2024-09-13T23:57:03.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.410+0000 7ff94f667f40 20 add_watcher() i=7 2024-09-13T23:57:03.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.410+0000 7ff94f667f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:03.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.410+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533cc00 con 0x55a0e527b000 2024-09-13T23:57:03.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.410+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.410+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94149528526848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533d800 con 0x55a0e527b000 2024-09-13T23:57:03.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.414+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94149528526848] v33'98 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.414+0000 7ff934dee700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:03.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.414+0000 7ff94f667f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:03.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.414+0000 7ff94f667f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:03.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.414+0000 7ff94f667f40 1 Processor -- start 2024-09-13T23:57:03.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.414+0000 7ff94f667f40 1 -- start start 2024-09-13T23:57:03.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.414+0000 7ff94f667f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e533c400 0x55a0e51bf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.414+0000 7ff94f667f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0e4efc780 con 0x55a0e533c400 2024-09-13T23:57:03.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.414+0000 7ff94d61f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e533c400 0x55a0e51bf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.414+0000 7ff94d61f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e533c400 0x55a0e51bf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49764/0 (socket says 172.21.15.173:49764) 2024-09-13T23:57:03.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.414+0000 7ff94d61f700 1 -- 172.21.15.173:0/1225169589 learned_addr learned my addr 172.21.15.173:0/1225169589 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.414+0000 7ff94d61f700 1 -- 172.21.15.173:0/1225169589 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0e4ee8b60 con 0x55a0e533c400 2024-09-13T23:57:03.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff94d61f700 1 --2- 172.21.15.173:0/1225169589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e533c400 0x55a0e51bf180 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x55a0e534a090 tx=0x55a0e52397a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=719d98a47cac09d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff9345ed700 1 -- 172.21.15.173:0/1225169589 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a0e5352000 con 0x55a0e533c400 2024-09-13T23:57:03.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff9345ed700 1 -- 172.21.15.173:0/1225169589 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a0e523e600 con 0x55a0e533c400 2024-09-13T23:57:03.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff9345ed700 1 -- 172.21.15.173:0/1225169589 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a0e5352160 con 0x55a0e533c400 2024-09-13T23:57:03.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff94f667f40 1 -- 172.21.15.173:0/1225169589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e533c400 msgr2=0x55a0e51bf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff94f667f40 1 --2- 172.21.15.173:0/1225169589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e533c400 0x55a0e51bf180 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x55a0e534a090 tx=0x55a0e52397a0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff94f667f40 1 -- 172.21.15.173:0/1225169589 shutdown_connections 2024-09-13T23:57:03.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff94f667f40 1 --2- 172.21.15.173:0/1225169589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e533c400 0x55a0e51bf180 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff94f667f40 1 -- 172.21.15.173:0/1225169589 >> 172.21.15.173:0/1225169589 conn(0x55a0e533dc00 msgr2=0x55a0e4fd8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff94f667f40 1 -- 172.21.15.173:0/1225169589 shutdown_connections 2024-09-13T23:57:03.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff94f667f40 1 -- 172.21.15.173:0/1225169589 wait complete. 2024-09-13T23:57:03.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff94f667f40 1 Processor -- start 2024-09-13T23:57:03.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff94f667f40 1 -- start start 2024-09-13T23:57:03.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff94f667f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e533c400 0x55a0e51bf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff94f667f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0e4f64000 con 0x55a0e533c400 2024-09-13T23:57:03.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff94d61f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e533c400 0x55a0e51bf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff94d61f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e533c400 0x55a0e51bf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49776/0 (socket says 172.21.15.173:49776) 2024-09-13T23:57:03.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff94d61f700 1 -- 172.21.15.173:0/562371907 learned_addr learned my addr 172.21.15.173:0/562371907 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff94d61f700 1 -- 172.21.15.173:0/562371907 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0e4ee8d00 con 0x55a0e533c400 2024-09-13T23:57:03.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff94d61f700 1 --2- 172.21.15.173:0/562371907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e533c400 0x55a0e51bf180 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x55a0e534a2a0 tx=0x55a0e5239920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff932dea700 1 -- 172.21.15.173:0/562371907 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a0e53522c0 con 0x55a0e533c400 2024-09-13T23:57:03.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff932dea700 1 -- 172.21.15.173:0/562371907 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a0e523e300 con 0x55a0e533c400 2024-09-13T23:57:03.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff94f667f40 1 -- 172.21.15.173:0/562371907 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a0e4ee8340 con 0x55a0e533c400 2024-09-13T23:57:03.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff932dea700 1 -- 172.21.15.173:0/562371907 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a0e5352000 con 0x55a0e533c400 2024-09-13T23:57:03.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.418+0000 7ff94f667f40 1 -- 172.21.15.173:0/562371907 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a0e4ee8b60 con 0x55a0e533c400 2024-09-13T23:57:03.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.422+0000 7ff932dea700 1 -- 172.21.15.173:0/562371907 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55a0e4fd1b80 con 0x55a0e533c400 2024-09-13T23:57:03.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.422+0000 7ff932dea700 1 --2- 172.21.15.173:0/562371907 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a0e53d0000 0x55a0e53d6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.422+0000 7ff932dea700 1 -- 172.21.15.173:0/562371907 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55a0e4f3d500 con 0x55a0e533c400 2024-09-13T23:57:03.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.422+0000 7ff94e621700 1 --2- 172.21.15.173:0/562371907 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a0e53d0000 0x55a0e53d6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.422+0000 7ff94f667f40 5 note: GC not initialized 2024-09-13T23:57:03.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.422+0000 7ff94e621700 1 --2- 172.21.15.173:0/562371907 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a0e53d0000 0x55a0e53d6000 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x55a0e527d3e0 tx=0x55a0e539c660 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.422+0000 7ff9305e5700 20 reqs_thread_entry: start 2024-09-13T23:57:03.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.422+0000 7ff94f667f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:03.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.422+0000 7ff94f667f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:03.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff92dde0700 20 reqs_thread_entry: start 2024-09-13T23:57:03.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94f667f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533b800 con 0x55a0e527b000 2024-09-13T23:57:03.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff92e5e1700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:33 2024 2024-09-13T23:57:03.430 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:03.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94f667f40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:57:03.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533bc00 con 0x55a0e533a000 2024-09-13T23:57:03.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e533a000 2024-09-13T23:57:03.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94f667f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e533a000 2024-09-13T23:57:03.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e533a000 2024-09-13T23:57:03.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94f667f40 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:57:03.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94f667f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 8.17 8:ea49432e:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e53d0400 con 0x55a0e527b400 2024-09-13T23:57:03.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(65 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x55a0e5323200 con 0x55a0e527b400 2024-09-13T23:57:03.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94f667f40 20 rados_obj.operate() r=0 bl.length=352 2024-09-13T23:57:03.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94f667f40 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T23:57:03.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:66 4.3a 4:5ed28fc2:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e53d0800 con 0x55a0e527bc00 2024-09-13T23:57:03.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 4.18 4:18584371:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e53d0c00 con 0x55a0e527b400 2024-09-13T23:57:03.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:68 4.34 4:2cdc3579:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e53d1000 con 0x55a0e533a000 2024-09-13T23:57:03.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:69 4.1e 4:7ad1e97c:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e53d1400 con 0x55a0e527b000 2024-09-13T23:57:03.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:70 4.2f 4:f65cb84f:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e53d1800 con 0x55a0e527b000 2024-09-13T23:57:03.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:71 4.b 4:d29b135b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e53d1c00 con 0x55a0e533a000 2024-09-13T23:57:03.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:72 4.32 4:4e7c1df1:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e53d1000 con 0x55a0e527b400 2024-09-13T23:57:03.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:73 4.17 4:ebadd201:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e53d0400 con 0x55a0e527bc00 2024-09-13T23:57:03.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:74 4.2 4:40ba7f18:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533cc00 con 0x55a0e527b000 2024-09-13T23:57:03.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:75 4.26 4:66627631:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533d800 con 0x55a0e527b000 2024-09-13T23:57:03.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.426+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:76 4.a 4:53f2fc8c:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533d000 con 0x55a0e527b400 2024-09-13T23:57:03.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.430+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(66 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55a0e5323440 con 0x55a0e527bc00 2024-09-13T23:57:03.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.430+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(71 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e533a000 2024-09-13T23:57:03.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.430+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(67 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55a0e5323200 con 0x55a0e527b400 2024-09-13T23:57:03.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.430+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(68 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e533a000 2024-09-13T23:57:03.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.430+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(73 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55a0e5323440 con 0x55a0e527bc00 2024-09-13T23:57:03.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.430+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(70 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.430+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(69 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.430+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(75 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.430+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 24 ==== osd_op_reply(74 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.430+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(76 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x55a0e5323200 con 0x55a0e527b400 2024-09-13T23:57:03.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.430+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(72 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55a0e5323200 con 0x55a0e527b400 2024-09-13T23:57:03.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.430+0000 7ff934dee700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:03.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.430+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94149528526848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533d400 con 0x55a0e527b000 2024-09-13T23:57:03.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.434+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94149528526848] v33'99 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.434+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94149526895360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533c800 con 0x55a0e527b400 2024-09-13T23:57:03.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.434+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94149526895360] v33'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a0e5323200 con 0x55a0e527b400 2024-09-13T23:57:03.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.434+0000 7ff94f667f40 20 remove_watcher() i=0 2024-09-13T23:57:03.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.434+0000 7ff94f667f40 2 removed watcher, disabling cache 2024-09-13T23:57:03.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.438+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94149526896512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533c000 con 0x55a0e527b000 2024-09-13T23:57:03.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.438+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.1 v2:172.21.15.173:6808/3256211813 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94149526896512] v33'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e527b000 2024-09-13T23:57:03.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.438+0000 7ff94f667f40 20 remove_watcher() i=1 2024-09-13T23:57:03.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.438+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94149526897664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e527b800 con 0x55a0e527b400 2024-09-13T23:57:03.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.442+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94149526897664] v33'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a0e5323200 con 0x55a0e527b400 2024-09-13T23:57:03.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.442+0000 7ff94f667f40 20 remove_watcher() i=2 2024-09-13T23:57:03.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.442+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94149526898816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533b800 con 0x55a0e533a000 2024-09-13T23:57:03.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.442+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94149526898816] v33'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e533a000 2024-09-13T23:57:03.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.442+0000 7ff94f667f40 20 remove_watcher() i=3 2024-09-13T23:57:03.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.442+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94149526899968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533bc00 con 0x55a0e527b400 2024-09-13T23:57:03.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.446+0000 7ff94de20700 1 -- 172.21.15.173:0/1218106340 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94149526899968] v33'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a0e5323200 con 0x55a0e527b400 2024-09-13T23:57:03.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.446+0000 7ff94f667f40 20 remove_watcher() i=4 2024-09-13T23:57:03.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.446+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94149526901120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533d000 con 0x55a0e527bc00 2024-09-13T23:57:03.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.450+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94149526901120] v33'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a0e5323440 con 0x55a0e527bc00 2024-09-13T23:57:03.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.450+0000 7ff94f667f40 20 remove_watcher() i=5 2024-09-13T23:57:03.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.450+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94149526902272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533c800 con 0x55a0e527bc00 2024-09-13T23:57:03.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.450+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94149526902272] v33'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a0e5323440 con 0x55a0e527bc00 2024-09-13T23:57:03.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.450+0000 7ff94f667f40 20 remove_watcher() i=6 2024-09-13T23:57:03.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.450+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94149526903424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a0e533cc00 con 0x55a0e533a000 2024-09-13T23:57:03.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94e621700 1 -- 172.21.15.173:0/1218106340 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94149526903424] v33'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a0e5322b40 con 0x55a0e533a000 2024-09-13T23:57:03.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 20 remove_watcher() i=7 2024-09-13T23:57:03.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a0e527b400 msgr2=0x55a0e51bdb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 --2- 172.21.15.173:0/1218106340 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a0e527b400 0x55a0e51bdb80 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a0e527b000 msgr2=0x55a0e51bd600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 --2- 172.21.15.173:0/1218106340 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a0e527b000 0x55a0e51bd600 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a0e533a000 msgr2=0x55a0e51bc580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 --2- 172.21.15.173:0/1218106340 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a0e533a000 0x55a0e51bc580 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a0e527bc00 msgr2=0x55a0e51bec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 --2- 172.21.15.173:0/1218106340 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a0e527bc00 0x55a0e51bec00 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a0e527ac00 msgr2=0x55a0e51be680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 --2- 172.21.15.173:0/1218106340 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a0e527ac00 0x55a0e51be680 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55a0e527dd10 tx=0x55a0e5239800 comp rx=0 tx=0).stop 2024-09-13T23:57:03.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7c00 msgr2=0x55a0e51bd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94d61f700 1 -- 172.21.15.173:0/1218106340 reap_dead start 2024-09-13T23:57:03.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 --2- 172.21.15.173:0/1218106340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7c00 0x55a0e51bd080 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x55a0e5202330 tx=0x55a0e4fdbda0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 shutdown_connections 2024-09-13T23:57:03.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 --2- 172.21.15.173:0/1218106340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7c00 0x55a0e51bd080 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 >> 172.21.15.173:0/1218106340 conn(0x55a0e4ed7800 msgr2=0x55a0e4fd7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 shutdown_connections 2024-09-13T23:57:03.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 -- 172.21.15.173:0/1218106340 wait complete. 2024-09-13T23:57:03.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 -- 172.21.15.173:0/562371907 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a0e53d0000 msgr2=0x55a0e53d6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 --2- 172.21.15.173:0/562371907 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a0e53d0000 0x55a0e53d6000 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x55a0e527d3e0 tx=0x55a0e539c660 comp rx=0 tx=0).stop 2024-09-13T23:57:03.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 -- 172.21.15.173:0/562371907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e533c400 msgr2=0x55a0e51bf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 --2- 172.21.15.173:0/562371907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e533c400 0x55a0e51bf180 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x55a0e534a2a0 tx=0x55a0e5239920 comp rx=0 tx=0).stop 2024-09-13T23:57:03.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 -- 172.21.15.173:0/562371907 shutdown_connections 2024-09-13T23:57:03.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 --2- 172.21.15.173:0/562371907 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a0e53d0000 0x55a0e53d6000 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 --2- 172.21.15.173:0/562371907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e533c400 0x55a0e51bf180 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 -- 172.21.15.173:0/562371907 >> 172.21.15.173:0/562371907 conn(0x55a0e533dc00 msgr2=0x55a0e4fd8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 -- 172.21.15.173:0/562371907 shutdown_connections 2024-09-13T23:57:03.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 -- 172.21.15.173:0/562371907 wait complete. 2024-09-13T23:57:03.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 -- 172.21.15.173:0/857857390 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a0e527a000 msgr2=0x55a0e51be100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 --2- 172.21.15.173:0/857857390 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a0e527a000 0x55a0e51be100 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55a0e5203050 tx=0x55a0e5238120 comp rx=0 tx=0).stop 2024-09-13T23:57:03.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 -- 172.21.15.173:0/857857390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7400 msgr2=0x55a0e51bcb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 --2- 172.21.15.173:0/857857390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7400 0x55a0e51bcb00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x55a0e5032120 tx=0x55a0e4fdb920 comp rx=0 tx=0).stop 2024-09-13T23:57:03.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 -- 172.21.15.173:0/857857390 shutdown_connections 2024-09-13T23:57:03.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 --2- 172.21.15.173:0/857857390 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a0e527a000 0x55a0e51be100 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 --2- 172.21.15.173:0/857857390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a0e4ed7400 0x55a0e51bcb00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 -- 172.21.15.173:0/857857390 >> 172.21.15.173:0/857857390 conn(0x55a0e4ed6c00 msgr2=0x55a0e4fd7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 -- 172.21.15.173:0/857857390 shutdown_connections 2024-09-13T23:57:03.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.454+0000 7ff94f667f40 1 -- 172.21.15.173:0/857857390 wait complete. 2024-09-13T23:57:03.464 INFO:teuthology.orchestra.run.smithi173.stdout:[ 2024-09-13T23:57:03.464 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:03.464 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo", 2024-09-13T23:57:03.464 INFO:teuthology.orchestra.run.smithi173.stdout: "num_shards": 11, 2024-09-13T23:57:03.465 INFO:teuthology.orchestra.run.smithi173.stdout: "tenant": "", 2024-09-13T23:57:03.465 INFO:teuthology.orchestra.run.smithi173.stdout: "zonegroup": "45606a84-a024-4d59-86ac-9903db661675", 2024-09-13T23:57:03.465 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_rule": "default-placement", 2024-09-13T23:57:03.465 INFO:teuthology.orchestra.run.smithi173.stdout: "explicit_placement": { 2024-09-13T23:57:03.465 INFO:teuthology.orchestra.run.smithi173.stdout: "data_pool": "", 2024-09-13T23:57:03.465 INFO:teuthology.orchestra.run.smithi173.stdout: "data_extra_pool": "", 2024-09-13T23:57:03.465 INFO:teuthology.orchestra.run.smithi173.stdout: "index_pool": "" 2024-09-13T23:57:03.465 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:03.465 INFO:teuthology.orchestra.run.smithi173.stdout: "id": "d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1", 2024-09-13T23:57:03.465 INFO:teuthology.orchestra.run.smithi173.stdout: "marker": "d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1", 2024-09-13T23:57:03.465 INFO:teuthology.orchestra.run.smithi173.stdout: "index_type": "Normal", 2024-09-13T23:57:03.465 INFO:teuthology.orchestra.run.smithi173.stdout: "versioned": false, 2024-09-13T23:57:03.465 INFO:teuthology.orchestra.run.smithi173.stdout: "versioning_enabled": false, 2024-09-13T23:57:03.466 INFO:teuthology.orchestra.run.smithi173.stdout: "object_lock_enabled": false, 2024-09-13T23:57:03.466 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_enabled": false, 2024-09-13T23:57:03.466 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:57:03.466 INFO:teuthology.orchestra.run.smithi173.stdout: "ver": "0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1", 2024-09-13T23:57:03.466 INFO:teuthology.orchestra.run.smithi173.stdout: "master_ver": "0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0", 2024-09-13T23:57:03.466 INFO:teuthology.orchestra.run.smithi173.stdout: "mtime": "2024-09-13T23:57:02.419798Z", 2024-09-13T23:57:03.466 INFO:teuthology.orchestra.run.smithi173.stdout: "creation_time": "2024-09-13T23:57:02.413869Z", 2024-09-13T23:57:03.466 INFO:teuthology.orchestra.run.smithi173.stdout: "max_marker": "0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#", 2024-09-13T23:57:03.466 INFO:teuthology.orchestra.run.smithi173.stdout: "usage": {}, 2024-09-13T23:57:03.466 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:57:03.466 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:03.466 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:03.466 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:03.467 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:03.467 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:03.467 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:03.467 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:03.467 INFO:teuthology.orchestra.run.smithi173.stdout:] 2024-09-13T23:57:03.468 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '45606a84-a024-4d59-86ac-9903db661675', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.1', 'marker': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.1', 'index_type': 'Normal', 'versioned': False, 'versioning_enabled': False, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T23:57:02.419798Z', 'creation_time': '2024-09-13T23:57:02.413869Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-13T23:57:03.481 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T23:57:03.481 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T23:57:03.481 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T23:57:03.481 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-13T23:57:03.522 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:03.522 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:03.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.518+0000 7f49a840cf40 1 Processor -- start 2024-09-13T23:57:03.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.518+0000 7f49a840cf40 1 -- start start 2024-09-13T23:57:03.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.518+0000 7f49a840cf40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x555ed3467000 0x555ed374c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.518+0000 7f49a840cf40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555ed352b500 con 0x555ed3467400 2024-09-13T23:57:03.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.518+0000 7f49a840cf40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x555ed34f4a00 con 0x555ed3467000 2024-09-13T23:57:03.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.518+0000 7f49a6bc5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x555ed3467000 0x555ed374c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.518+0000 7f49a63c4700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x555ed3467400 0x555ed3566800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47398/0 (socket says 172.21.15.173:47398) 2024-09-13T23:57:03.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.518+0000 7f49a63c4700 1 -- 172.21.15.173:0/1616779871 learned_addr learned my addr 172.21.15.173:0/1616779871 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:03.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.518+0000 7f49a5bc3700 1 -- 172.21.15.173:0/1616779871 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 789200959 0 0) 0x555ed35c2000 con 0x555ed3467400 2024-09-13T23:57:03.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.518+0000 7f49a5bc3700 1 -- 172.21.15.173:0/1616779871 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x555ed352b680 con 0x555ed3467400 2024-09-13T23:57:03.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.518+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1616779871 >> v1:172.21.15.87:6789/0 conn(0x555ed3467400 legacy=0x555ed3566800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.518+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1616779871 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ed3479d40 con 0x555ed3467000 2024-09-13T23:57:03.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.518+0000 7f49a6bc5700 1 --2- 172.21.15.173:0/1616779871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467000 0x555ed374c580 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x555ed3747a70 tx=0x555ed356b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2efe31b028e82060 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.518+0000 7f49a5bc3700 1 -- 172.21.15.173:0/1616779871 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ed350b4a0 con 0x555ed3467000 2024-09-13T23:57:03.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.522+0000 7f49a5bc3700 1 -- 172.21.15.173:0/1616779871 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555ed352b680 con 0x555ed3467000 2024-09-13T23:57:03.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.522+0000 7f49a5bc3700 1 -- 172.21.15.173:0/1616779871 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ed350b600 con 0x555ed3467000 2024-09-13T23:57:03.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.522+0000 7f49a840cf40 1 -- 172.21.15.173:0/1616779871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467000 msgr2=0x555ed374c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.522+0000 7f49a840cf40 1 --2- 172.21.15.173:0/1616779871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467000 0x555ed374c580 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x555ed3747a70 tx=0x555ed356b980 comp rx=0 tx=0).stop 2024-09-13T23:57:03.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.522+0000 7f49a840cf40 1 -- 172.21.15.173:0/1616779871 shutdown_connections 2024-09-13T23:57:03.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.522+0000 7f49a840cf40 1 --2- 172.21.15.173:0/1616779871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467000 0x555ed374c580 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.522+0000 7f49a840cf40 1 -- 172.21.15.173:0/1616779871 >> 172.21.15.173:0/1616779871 conn(0x555ed3466c00 msgr2=0x555ed3566000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.522+0000 7f49a840cf40 1 -- 172.21.15.173:0/1616779871 shutdown_connections 2024-09-13T23:57:03.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.522+0000 7f49a840cf40 1 -- 172.21.15.173:0/1616779871 wait complete. 2024-09-13T23:57:03.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.522+0000 7f49a840cf40 1 Processor -- start 2024-09-13T23:57:03.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.522+0000 7f49a840cf40 1 -- start start 2024-09-13T23:57:03.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.522+0000 7f49a840cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467000 0x555ed374c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.522+0000 7f49a840cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ed34f4500 con 0x555ed3467000 2024-09-13T23:57:03.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.526+0000 7f49a6bc5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467000 0x555ed374c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.526+0000 7f49a6bc5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467000 0x555ed374c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49784/0 (socket says 172.21.15.173:49784) 2024-09-13T23:57:03.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.526+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1743257057 learned_addr learned my addr 172.21.15.173:0/1743257057 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.526+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1743257057 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ed3479ba0 con 0x555ed3467000 2024-09-13T23:57:03.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.526+0000 7f49a6bc5700 1 --2- 172.21.15.173:0/1743257057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467000 0x555ed374c580 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x555ed4231e00 tx=0x555ed356b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193066708c698982 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.526+0000 7f49a53c2700 1 -- 172.21.15.173:0/1743257057 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ed350b760 con 0x555ed3467000 2024-09-13T23:57:03.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.526+0000 7f49a53c2700 1 -- 172.21.15.173:0/1743257057 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555ed352b980 con 0x555ed3467000 2024-09-13T23:57:03.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.526+0000 7f49a53c2700 1 -- 172.21.15.173:0/1743257057 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ed350b4a0 con 0x555ed3467000 2024-09-13T23:57:03.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.526+0000 7f49a840cf40 1 -- 172.21.15.173:0/1743257057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467000 msgr2=0x555ed374c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.526+0000 7f49a840cf40 1 --2- 172.21.15.173:0/1743257057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467000 0x555ed374c580 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x555ed4231e00 tx=0x555ed356b800 comp rx=0 tx=0).stop 2024-09-13T23:57:03.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.526+0000 7f49a840cf40 1 -- 172.21.15.173:0/1743257057 shutdown_connections 2024-09-13T23:57:03.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.526+0000 7f49a840cf40 1 --2- 172.21.15.173:0/1743257057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467000 0x555ed374c580 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.526+0000 7f49a840cf40 1 -- 172.21.15.173:0/1743257057 >> 172.21.15.173:0/1743257057 conn(0x555ed3466c00 msgr2=0x555ed3567000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.526+0000 7f49a840cf40 1 -- 172.21.15.173:0/1743257057 shutdown_connections 2024-09-13T23:57:03.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.526+0000 7f49a840cf40 1 -- 172.21.15.173:0/1743257057 wait complete. 2024-09-13T23:57:03.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.526+0000 7f49a840cf40 1 Processor -- start 2024-09-13T23:57:03.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.526+0000 7f49a840cf40 1 -- start start 2024-09-13T23:57:03.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.526+0000 7f49a840cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467000 0x555ed374c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.526+0000 7f49a840cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ed34f43c0 con 0x555ed3467000 2024-09-13T23:57:03.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.530+0000 7f49a6bc5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467000 0x555ed374c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.530+0000 7f49a6bc5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467000 0x555ed374c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49792/0 (socket says 172.21.15.173:49792) 2024-09-13T23:57:03.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.530+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1529093741 learned_addr learned my addr 172.21.15.173:0/1529093741 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.530+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1529093741 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ed3479a00 con 0x555ed3467000 2024-09-13T23:57:03.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.530+0000 7f49a6bc5700 1 --2- 172.21.15.173:0/1529093741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467000 0x555ed374c580 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x555ed4231ef0 tx=0x555ed356b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.530+0000 7f49a3bbf700 1 -- 172.21.15.173:0/1529093741 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ed350b600 con 0x555ed3467000 2024-09-13T23:57:03.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.530+0000 7f49a3bbf700 1 -- 172.21.15.173:0/1529093741 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555ed352bb00 con 0x555ed3467000 2024-09-13T23:57:03.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.530+0000 7f49a840cf40 1 -- 172.21.15.173:0/1529093741 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555ed3479860 con 0x555ed3467000 2024-09-13T23:57:03.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.530+0000 7f49a3bbf700 1 -- 172.21.15.173:0/1529093741 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ed350b8c0 con 0x555ed3467000 2024-09-13T23:57:03.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.530+0000 7f49a840cf40 1 -- 172.21.15.173:0/1529093741 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555ed34796c0 con 0x555ed3467000 2024-09-13T23:57:03.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.530+0000 7f49a840cf40 1 Processor -- start 2024-09-13T23:57:03.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.530+0000 7f49a840cf40 1 -- start start 2024-09-13T23:57:03.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.530+0000 7f49a840cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467800 0x555ed374cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.530+0000 7f49a840cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ed34f4000 con 0x555ed3467800 2024-09-13T23:57:03.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.530+0000 7f49a3bbf700 1 -- 172.21.15.173:0/1529093741 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x555ed3560b00 con 0x555ed3467000 2024-09-13T23:57:03.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.530+0000 7f49a73c6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467800 0x555ed374cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.530+0000 7f49a73c6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467800 0x555ed374cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49806/0 (socket says 172.21.15.173:49806) 2024-09-13T23:57:03.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.530+0000 7f49a73c6700 1 -- 172.21.15.173:0/2842201152 learned_addr learned my addr 172.21.15.173:0/2842201152 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.530+0000 7f49a3bbf700 1 --2- 172.21.15.173:0/1529093741 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ed380e000 0x555ed374d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.530+0000 7f49a3bbf700 1 -- 172.21.15.173:0/1529093741 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x555ed34cd180 con 0x555ed3467000 2024-09-13T23:57:03.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.530+0000 7f49a6bc5700 1 --2- 172.21.15.173:0/1529093741 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ed380e000 0x555ed374d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.530+0000 7f49a73c6700 1 -- 172.21.15.173:0/2842201152 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ed3478000 con 0x555ed3467800 2024-09-13T23:57:03.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.530+0000 7f49a73c6700 1 --2- 172.21.15.173:0/2842201152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467800 0x555ed374cb00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x555ed37ec2a0 tx=0x555ed37cc780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=944deeccbfbc51ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f49a6bc5700 1 --2- 172.21.15.173:0/1529093741 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ed380e000 0x555ed374d080 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x555ed37835f0 tx=0x555ed37cc8a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f49a13ba700 1 -- 172.21.15.173:0/2842201152 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ed350b600 con 0x555ed3467800 2024-09-13T23:57:03.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f49a13ba700 1 -- 172.21.15.173:0/2842201152 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555ed352bb00 con 0x555ed3467800 2024-09-13T23:57:03.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f49a13ba700 1 -- 172.21.15.173:0/2842201152 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ed350b8c0 con 0x555ed3467800 2024-09-13T23:57:03.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f49a840cf40 1 -- 172.21.15.173:0/2842201152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467800 msgr2=0x555ed374cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f49a840cf40 1 --2- 172.21.15.173:0/2842201152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467800 0x555ed374cb00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x555ed37ec2a0 tx=0x555ed37cc780 comp rx=0 tx=0).stop 2024-09-13T23:57:03.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f49a840cf40 1 -- 172.21.15.173:0/2842201152 shutdown_connections 2024-09-13T23:57:03.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f49a840cf40 1 --2- 172.21.15.173:0/2842201152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467800 0x555ed374cb00 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f49a840cf40 1 -- 172.21.15.173:0/2842201152 >> 172.21.15.173:0/2842201152 conn(0x555ed3467400 msgr2=0x555ed3567800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f49a840cf40 1 -- 172.21.15.173:0/2842201152 shutdown_connections 2024-09-13T23:57:03.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f49a840cf40 1 -- 172.21.15.173:0/2842201152 wait complete. 2024-09-13T23:57:03.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f49a840cf40 1 Processor -- start 2024-09-13T23:57:03.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f49a840cf40 1 -- start start 2024-09-13T23:57:03.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f49a840cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467800 0x555ed374cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f49a840cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ed348c640 con 0x555ed3467800 2024-09-13T23:57:03.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f49a73c6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467800 0x555ed374cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f49a73c6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467800 0x555ed374cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49822/0 (socket says 172.21.15.173:49822) 2024-09-13T23:57:03.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 learned_addr learned my addr 172.21.15.173:0/1955965382 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ed3478ea0 con 0x555ed3467800 2024-09-13T23:57:03.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f49a73c6700 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467800 0x555ed374cb00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x555ed3782a50 tx=0x555ed37cc5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f499fbb7700 1 -- 172.21.15.173:0/1955965382 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ed350b760 con 0x555ed3467800 2024-09-13T23:57:03.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f499fbb7700 1 -- 172.21.15.173:0/1955965382 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555ed382a000 con 0x555ed3467800 2024-09-13T23:57:03.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f499fbb7700 1 -- 172.21.15.173:0/1955965382 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ed350b600 con 0x555ed3467800 2024-09-13T23:57:03.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555ed3478820 con 0x555ed3467800 2024-09-13T23:57:03.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.534+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555ed34789c0 con 0x555ed3467800 2024-09-13T23:57:03.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.538+0000 7f499fbb7700 1 -- 172.21.15.173:0/1955965382 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x555ed3560dc0 con 0x555ed3467800 2024-09-13T23:57:03.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.538+0000 7f499fbb7700 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ed380ec00 0x555ed374d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.538+0000 7f499fbb7700 1 -- 172.21.15.173:0/1955965382 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x555ed34cd340 con 0x555ed3467800 2024-09-13T23:57:03.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.538+0000 7f49a63c4700 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ed380ec00 0x555ed374d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.538+0000 7f49a840cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.538+0000 7f49a840cf40 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x555ed380f000 0x555ed374db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.538+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f400 con 0x555ed380f000 2024-09-13T23:57:03.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.538+0000 7f49a73c6700 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x555ed380f000 0x555ed374db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.538+0000 7f49a63c4700 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ed380ec00 0x555ed374d600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x555ed4230030 tx=0x555ed37cd920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.538+0000 7f49a73c6700 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x555ed380f000 0x555ed374db80 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.538+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.538+0000 7f49a840cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.538+0000 7f49a840cf40 20 realm 2024-09-13T23:57:03.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.538+0000 7f49a840cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.538+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380f000 2024-09-13T23:57:03.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.542+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.542+0000 7f49a840cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.542+0000 7f49a840cf40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:03.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.542+0000 7f49a840cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.542+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380fc00 con 0x555ed380f000 2024-09-13T23:57:03.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.542+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.542+0000 7f49a840cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.542+0000 7f49a840cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.542+0000 7f49a840cf40 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x555ed380f400 0x555ed374e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.542+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380f400 2024-09-13T23:57:03.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.542+0000 7f49a6bc5700 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x555ed380f400 0x555ed374e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.542+0000 7f49a6bc5700 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x555ed380f400 0x555ed374e100 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.542+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.542+0000 7f49a840cf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:03.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.542+0000 7f49a840cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.542+0000 7f49a840cf40 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x555ed380fc00 0x555ed374e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.542+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38be000 con 0x555ed380fc00 2024-09-13T23:57:03.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.542+0000 7f49a63c4700 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x555ed380fc00 0x555ed374e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.542+0000 7f49a63c4700 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x555ed380fc00 0x555ed374e680 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.542+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x555ed38b9440 con 0x555ed380fc00 2024-09-13T23:57:03.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.542+0000 7f49a840cf40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:03.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.542+0000 7f49a840cf40 20 searching for the correct realm 2024-09-13T23:57:03.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.546+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38be400 con 0x555ed380fc00 2024-09-13T23:57:03.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.546+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x555ed38b9440 con 0x555ed380fc00 2024-09-13T23:57:03.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.546+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38be000 con 0x555ed380f400 2024-09-13T23:57:03.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.546+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.546+0000 7f49a6bc5700 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x555ed38be000 0x555ed374ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.546+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed38be000 2024-09-13T23:57:03.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.546+0000 7f49a73c6700 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x555ed38be000 0x555ed374ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.546+0000 7f49a73c6700 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x555ed38be000 0x555ed374ec00 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.546+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed38be000 2024-09-13T23:57:03.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.546+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380f000 2024-09-13T23:57:03.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.546+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.546+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380f000 2024-09-13T23:57:03.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.546+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.546+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380fc00 2024-09-13T23:57:03.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.550+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b9440 con 0x555ed380fc00 2024-09-13T23:57:03.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.550+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380f000 2024-09-13T23:57:03.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.550+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.550+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380f400 2024-09-13T23:57:03.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.550+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.550+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380f400 2024-09-13T23:57:03.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.550+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.550+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380f000 2024-09-13T23:57:03.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.550+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.550+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed38be000 2024-09-13T23:57:03.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.550+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed38be000 2024-09-13T23:57:03.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.550+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380f000 2024-09-13T23:57:03.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.550+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.550+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed38be000 2024-09-13T23:57:03.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.554+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed38be000 2024-09-13T23:57:03.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.554+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380f400 2024-09-13T23:57:03.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.554+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.554+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380fc00 2024-09-13T23:57:03.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.554+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b9440 con 0x555ed380fc00 2024-09-13T23:57:03.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.554+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380f000 2024-09-13T23:57:03.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.554+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.554+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380f400 2024-09-13T23:57:03.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.554+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.554+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380fc00 2024-09-13T23:57:03.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.554+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b9440 con 0x555ed380fc00 2024-09-13T23:57:03.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.554+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380f000 2024-09-13T23:57:03.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.554+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.554+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380f000 2024-09-13T23:57:03.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.558+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.558+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380f000 2024-09-13T23:57:03.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.558+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.558+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380fc00 2024-09-13T23:57:03.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.558+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b9440 con 0x555ed380fc00 2024-09-13T23:57:03.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.558+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed38be000 2024-09-13T23:57:03.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.558+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed38be000 2024-09-13T23:57:03.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.558+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380f000 2024-09-13T23:57:03.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.558+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.558+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed38be000 2024-09-13T23:57:03.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.558+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed38be000 2024-09-13T23:57:03.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.558+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380fc00 2024-09-13T23:57:03.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.558+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b9440 con 0x555ed380fc00 2024-09-13T23:57:03.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.558+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed38be000 2024-09-13T23:57:03.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.558+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed38be000 2024-09-13T23:57:03.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.558+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380f400 2024-09-13T23:57:03.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.562+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.562+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380f400 2024-09-13T23:57:03.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.562+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.562+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380fc00 2024-09-13T23:57:03.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.562+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b9440 con 0x555ed380fc00 2024-09-13T23:57:03.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.562+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380f400 2024-09-13T23:57:03.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.562+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.562+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed380f400 2024-09-13T23:57:03.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.562+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.562+0000 7f49a840cf40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:03.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.562+0000 7f49a840cf40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:03.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.562+0000 7f49a840cf40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:03.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.562+0000 7f49a840cf40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:03.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.562+0000 7f49a840cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.562+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38be800 con 0x555ed380f000 2024-09-13T23:57:03.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.562+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.562+0000 7f49a840cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.562+0000 7f49a840cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.562+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38bec00 con 0x555ed380f400 2024-09-13T23:57:03.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a840cf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:03.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a840cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38bf000 con 0x555ed380f000 2024-09-13T23:57:03.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a840cf40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:03.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a840cf40 20 zone default found 2024-09-13T23:57:03.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a840cf40 4 Realm: () 2024-09-13T23:57:03.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a840cf40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:03.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a840cf40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:03.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a840cf40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:03.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a840cf40 20 zonegroup default 2024-09-13T23:57:03.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a840cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38bf400 con 0x555ed38be000 2024-09-13T23:57:03.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed38be000 2024-09-13T23:57:03.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a840cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a840cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38bf800 con 0x555ed380fc00 2024-09-13T23:57:03.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x555ed38b9440 con 0x555ed380fc00 2024-09-13T23:57:03.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a840cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a840cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38bfc00 con 0x555ed380fc00 2024-09-13T23:57:03.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x555ed38b9440 con 0x555ed380fc00 2024-09-13T23:57:03.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a840cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a840cf40 20 started sync module instance, tier type = 2024-09-13T23:57:03.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a840cf40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:03.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.566+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38c8000 con 0x555ed380f400 2024-09-13T23:57:03.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.570+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.570+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93865762896640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38c8400 con 0x555ed380f400 2024-09-13T23:57:03.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.570+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38c8800 con 0x555ed380f000 2024-09-13T23:57:03.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.574+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93865762896640] v33'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.574+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.574+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93865762897792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38c8c00 con 0x555ed380f000 2024-09-13T23:57:03.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.574+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38c9000 con 0x555ed380f400 2024-09-13T23:57:03.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.574+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93865762897792] v33'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.574+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.574+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93865762898944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38c9400 con 0x555ed380f400 2024-09-13T23:57:03.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.578+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38c9800 con 0x555ed38be000 2024-09-13T23:57:03.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.578+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed38be000 2024-09-13T23:57:03.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.578+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93865762900096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38c9c00 con 0x555ed38be000 2024-09-13T23:57:03.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.578+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38c8800 con 0x555ed380f400 2024-09-13T23:57:03.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.578+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93865762898944] v33'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.582+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93865762900096] v33'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed38be000 2024-09-13T23:57:03.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.582+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.582+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93865762901248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38c8000 con 0x555ed380f400 2024-09-13T23:57:03.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.582+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38be800 con 0x555ed380fc00 2024-09-13T23:57:03.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.582+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ed38b9440 con 0x555ed380fc00 2024-09-13T23:57:03.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.582+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93865762902400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38bf000 con 0x555ed380fc00 2024-09-13T23:57:03.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.582+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38bf400 con 0x555ed380fc00 2024-09-13T23:57:03.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.586+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93865762901248] v33'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.586+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v33'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ed38b9440 con 0x555ed380fc00 2024-09-13T23:57:03.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.586+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93865762903552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38bec00 con 0x555ed380fc00 2024-09-13T23:57:03.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.586+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed380f800 con 0x555ed38be000 2024-09-13T23:57:03.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.586+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93865762902400] v33'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ed38b9440 con 0x555ed380fc00 2024-09-13T23:57:03.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.590+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed38be000 2024-09-13T23:57:03.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.590+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93865762904704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38c8400 con 0x555ed38be000 2024-09-13T23:57:03.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.590+0000 7f49a840cf40 20 add_watcher() i=0 2024-09-13T23:57:03.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.590+0000 7f49a840cf40 20 add_watcher() i=1 2024-09-13T23:57:03.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.590+0000 7f49a840cf40 20 add_watcher() i=2 2024-09-13T23:57:03.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.590+0000 7f49a840cf40 20 add_watcher() i=3 2024-09-13T23:57:03.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.590+0000 7f49a840cf40 20 add_watcher() i=4 2024-09-13T23:57:03.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.590+0000 7f49a840cf40 20 add_watcher() i=5 2024-09-13T23:57:03.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.590+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93865762903552] v33'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ed38b9440 con 0x555ed380fc00 2024-09-13T23:57:03.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.590+0000 7f49a840cf40 20 add_watcher() i=6 2024-09-13T23:57:03.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.590+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93865762904704] v33'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed38be000 2024-09-13T23:57:03.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.590+0000 7f49a840cf40 20 add_watcher() i=7 2024-09-13T23:57:03.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.590+0000 7f49a840cf40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:03.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.590+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38c9000 con 0x555ed380f000 2024-09-13T23:57:03.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.590+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.590+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93865764511744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38c9400 con 0x555ed380f000 2024-09-13T23:57:03.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.594+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93865764511744] v33'100 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.594+0000 7f498db93700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:03.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.594+0000 7f49a840cf40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:03.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.594+0000 7f49a840cf40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:03.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.594+0000 7f49a840cf40 1 Processor -- start 2024-09-13T23:57:03.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.594+0000 7f49a840cf40 1 -- start start 2024-09-13T23:57:03.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.594+0000 7f49a840cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed38be400 0x555ed374f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.594+0000 7f49a840cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ed348c780 con 0x555ed38be400 2024-09-13T23:57:03.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.594+0000 7f49a63c4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed38be400 0x555ed374f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.594+0000 7f49a63c4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed38be400 0x555ed374f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49830/0 (socket says 172.21.15.173:49830) 2024-09-13T23:57:03.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.594+0000 7f49a63c4700 1 -- 172.21.15.173:0/2340685745 learned_addr learned my addr 172.21.15.173:0/2340685745 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.594+0000 7f49a63c4700 1 -- 172.21.15.173:0/2340685745 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ed3478b60 con 0x555ed38be400 2024-09-13T23:57:03.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.594+0000 7f49a63c4700 1 --2- 172.21.15.173:0/2340685745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed38be400 0x555ed374f180 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x555ed38d60c0 tx=0x555ed37cd8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7eba290be4ffac3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.594+0000 7f498d392700 1 -- 172.21.15.173:0/2340685745 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ed38da000 con 0x555ed38be400 2024-09-13T23:57:03.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.594+0000 7f498d392700 1 -- 172.21.15.173:0/2340685745 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555ed382a480 con 0x555ed38be400 2024-09-13T23:57:03.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.594+0000 7f498d392700 1 -- 172.21.15.173:0/2340685745 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ed38da160 con 0x555ed38be400 2024-09-13T23:57:03.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.598+0000 7f49a840cf40 1 -- 172.21.15.173:0/2340685745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed38be400 msgr2=0x555ed374f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.598+0000 7f49a840cf40 1 --2- 172.21.15.173:0/2340685745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed38be400 0x555ed374f180 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x555ed38d60c0 tx=0x555ed37cd8c0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.598+0000 7f49a840cf40 1 -- 172.21.15.173:0/2340685745 shutdown_connections 2024-09-13T23:57:03.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.598+0000 7f49a840cf40 1 --2- 172.21.15.173:0/2340685745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed38be400 0x555ed374f180 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.598+0000 7f49a840cf40 1 -- 172.21.15.173:0/2340685745 >> 172.21.15.173:0/2340685745 conn(0x555ed38c8800 msgr2=0x555ed3568000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.598+0000 7f49a840cf40 1 -- 172.21.15.173:0/2340685745 shutdown_connections 2024-09-13T23:57:03.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.598+0000 7f49a840cf40 1 -- 172.21.15.173:0/2340685745 wait complete. 2024-09-13T23:57:03.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.598+0000 7f49a840cf40 1 Processor -- start 2024-09-13T23:57:03.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.598+0000 7f49a840cf40 1 -- start start 2024-09-13T23:57:03.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.598+0000 7f49a840cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed38be400 0x555ed374f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.598+0000 7f49a840cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ed34f4000 con 0x555ed38be400 2024-09-13T23:57:03.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.598+0000 7f49a63c4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed38be400 0x555ed374f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.598+0000 7f49a63c4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed38be400 0x555ed374f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49834/0 (socket says 172.21.15.173:49834) 2024-09-13T23:57:03.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.598+0000 7f49a63c4700 1 -- 172.21.15.173:0/994722604 learned_addr learned my addr 172.21.15.173:0/994722604 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.598+0000 7f49a63c4700 1 -- 172.21.15.173:0/994722604 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ed3478d00 con 0x555ed38be400 2024-09-13T23:57:03.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.598+0000 7f49a63c4700 1 --2- 172.21.15.173:0/994722604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed38be400 0x555ed374f180 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x555ed38d62d0 tx=0x555ed37cda40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.598+0000 7f498bb8f700 1 -- 172.21.15.173:0/994722604 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ed38da2c0 con 0x555ed38be400 2024-09-13T23:57:03.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.598+0000 7f498bb8f700 1 -- 172.21.15.173:0/994722604 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555ed382a600 con 0x555ed38be400 2024-09-13T23:57:03.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.598+0000 7f49a840cf40 1 -- 172.21.15.173:0/994722604 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555ed3478340 con 0x555ed38be400 2024-09-13T23:57:03.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.598+0000 7f498bb8f700 1 -- 172.21.15.173:0/994722604 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ed38da000 con 0x555ed38be400 2024-09-13T23:57:03.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.598+0000 7f49a840cf40 1 -- 172.21.15.173:0/994722604 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555ed3478b60 con 0x555ed38be400 2024-09-13T23:57:03.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.602+0000 7f498bb8f700 1 -- 172.21.15.173:0/994722604 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x555ed3561b80 con 0x555ed38be400 2024-09-13T23:57:03.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.602+0000 7f498bb8f700 1 --2- 172.21.15.173:0/994722604 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ed380f800 0x555ed3962000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.602+0000 7f498bb8f700 1 -- 172.21.15.173:0/994722604 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x555ed34cd500 con 0x555ed38be400 2024-09-13T23:57:03.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.602+0000 7f49a73c6700 1 --2- 172.21.15.173:0/994722604 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ed380f800 0x555ed3962000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.602+0000 7f49a840cf40 5 note: GC not initialized 2024-09-13T23:57:03.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.602+0000 7f49a73c6700 1 --2- 172.21.15.173:0/994722604 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ed380f800 0x555ed3962000 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x555ed3863710 tx=0x555ed3928660 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.602+0000 7f498938a700 20 reqs_thread_entry: start 2024-09-13T23:57:03.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.602+0000 7f49a840cf40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:03.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.602+0000 7f49a840cf40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:03.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.602+0000 7f4987386700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:33 2024 2024-09-13T23:57:03.609 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:03.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.602+0000 7f49a840cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.602+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38be800 con 0x555ed38be000 2024-09-13T23:57:03.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.602+0000 7f4986b64700 20 reqs_thread_entry: start 2024-09-13T23:57:03.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.602+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed38be000 2024-09-13T23:57:03.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.602+0000 7f49a840cf40 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:57:03.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.602+0000 7f49a840cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.602+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:63 8.17 8:ea49432e:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38c8c00 con 0x555ed380f400 2024-09-13T23:57:03.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.606+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(63 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.606+0000 7f49a840cf40 20 rados_obj.operate() r=0 bl.length=352 2024-09-13T23:57:03.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.606+0000 7f49a840cf40 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T23:57:03.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.606+0000 7f49a840cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.606+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38c9800 con 0x555ed38be000 2024-09-13T23:57:03.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.606+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed38be000 2024-09-13T23:57:03.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.606+0000 7f49a840cf40 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:57:03.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.606+0000 7f49a840cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.606+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 8.17 8:ea49432e:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38c9c00 con 0x555ed380f400 2024-09-13T23:57:03.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.606+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(65 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.606+0000 7f49a840cf40 20 rados_obj.operate() r=0 bl.length=352 2024-09-13T23:57:03.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.606+0000 7f49a840cf40 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T23:57:03.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.606+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:66 4.3a 4:5ed28fc2:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38c8400 con 0x555ed380fc00 2024-09-13T23:57:03.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.606+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 4.18 4:18584371:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed39d2000 con 0x555ed380f400 2024-09-13T23:57:03.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.606+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:68 4.34 4:2cdc3579:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed39d2400 con 0x555ed38be000 2024-09-13T23:57:03.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.606+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:69 4.1e 4:7ad1e97c:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed39d2800 con 0x555ed380f000 2024-09-13T23:57:03.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.606+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:70 4.2f 4:f65cb84f:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed39d2c00 con 0x555ed380f000 2024-09-13T23:57:03.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.606+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:71 4.b 4:d29b135b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed39d3000 con 0x555ed38be000 2024-09-13T23:57:03.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.606+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:72 4.32 4:4e7c1df1:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed39d3400 con 0x555ed380f400 2024-09-13T23:57:03.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.606+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:73 4.17 4:ebadd201:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed39d3800 con 0x555ed380fc00 2024-09-13T23:57:03.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.606+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:74 4.2 4:40ba7f18:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed39d3c00 con 0x555ed380f000 2024-09-13T23:57:03.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.606+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:75 4.26 4:66627631:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed39d2400 con 0x555ed380f000 2024-09-13T23:57:03.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.606+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:76 4.a 4:53f2fc8c:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed39d2800 con 0x555ed380f400 2024-09-13T23:57:03.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.606+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(67 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.610+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(66 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x555ed38b9440 con 0x555ed380fc00 2024-09-13T23:57:03.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.610+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(68 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed38be000 2024-09-13T23:57:03.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.610+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(72 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.610+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(71 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.5 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed38be000 2024-09-13T23:57:03.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.610+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(70 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.610+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(69 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.610+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(76 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.610+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(75 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.610+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(74 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.610+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(73 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x555ed38b9440 con 0x555ed380fc00 2024-09-13T23:57:03.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.610+0000 7f498db93700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:03.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.610+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93865764511744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38c9000 con 0x555ed380f000 2024-09-13T23:57:03.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.614+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 24 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 93865764511744] v33'101 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.614+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93865762896640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38c9400 con 0x555ed380f400 2024-09-13T23:57:03.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.614+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 93865762896640] v33'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.614+0000 7f49a840cf40 20 remove_watcher() i=0 2024-09-13T23:57:03.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.614+0000 7f49a840cf40 2 removed watcher, disabling cache 2024-09-13T23:57:03.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.614+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93865762897792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38c9800 con 0x555ed380f000 2024-09-13T23:57:03.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.618+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.1 v2:172.21.15.173:6808/3256211813 25 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 93865762897792] v33'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed380f000 2024-09-13T23:57:03.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.618+0000 7f49a840cf40 20 remove_watcher() i=1 2024-09-13T23:57:03.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.618+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93865762898944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38be800 con 0x555ed380f400 2024-09-13T23:57:03.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.618+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 93865762898944] v33'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.618+0000 7f49a840cf40 20 remove_watcher() i=2 2024-09-13T23:57:03.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.618+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93865762900096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed39d2000 con 0x555ed38be000 2024-09-13T23:57:03.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.622+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 93865762900096] v33'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed38be000 2024-09-13T23:57:03.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.622+0000 7f49a840cf40 20 remove_watcher() i=3 2024-09-13T23:57:03.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.622+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93865762901248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed39d3400 con 0x555ed380f400 2024-09-13T23:57:03.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.626+0000 7f49a6bc5700 1 -- 172.21.15.173:0/1955965382 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 93865762901248] v33'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ed38b9200 con 0x555ed380f400 2024-09-13T23:57:03.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.626+0000 7f49a840cf40 20 remove_watcher() i=4 2024-09-13T23:57:03.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.626+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93865762902400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38c8000 con 0x555ed380fc00 2024-09-13T23:57:03.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.626+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 93865762902400] v33'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ed38b9440 con 0x555ed380fc00 2024-09-13T23:57:03.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.626+0000 7f49a840cf40 20 remove_watcher() i=5 2024-09-13T23:57:03.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.626+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93865762903552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38c8c00 con 0x555ed380fc00 2024-09-13T23:57:03.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.630+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 93865762903552] v33'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ed38b9440 con 0x555ed380fc00 2024-09-13T23:57:03.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.630+0000 7f49a840cf40 20 remove_watcher() i=6 2024-09-13T23:57:03.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.630+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93865762904704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ed38c9c00 con 0x555ed38be000 2024-09-13T23:57:03.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.630+0000 7f49a73c6700 1 -- 172.21.15.173:0/1955965382 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 93865762904704] v33'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ed38b8b40 con 0x555ed38be000 2024-09-13T23:57:03.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.630+0000 7f49a840cf40 20 remove_watcher() i=7 2024-09-13T23:57:03.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.630+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x555ed380f400 msgr2=0x555ed374e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.630+0000 7f49a840cf40 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x555ed380f400 0x555ed374e100 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.630+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x555ed380f000 msgr2=0x555ed374db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.630+0000 7f49a840cf40 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x555ed380f000 0x555ed374db80 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.630+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x555ed38be000 msgr2=0x555ed374ec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.630+0000 7f49a840cf40 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x555ed38be000 0x555ed374ec00 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.630+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x555ed380fc00 msgr2=0x555ed374e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.630+0000 7f49a840cf40 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x555ed380fc00 0x555ed374e680 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.630+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ed380ec00 msgr2=0x555ed374d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.630+0000 7f49a840cf40 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ed380ec00 0x555ed374d600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x555ed4230030 tx=0x555ed37cd920 comp rx=0 tx=0).stop 2024-09-13T23:57:03.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.630+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467800 msgr2=0x555ed374cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.630+0000 7f49a840cf40 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467800 0x555ed374cb00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x555ed3782a50 tx=0x555ed37cc5a0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 shutdown_connections 2024-09-13T23:57:03.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x555ed38be000 0x555ed374ec00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x555ed380fc00 0x555ed374e680 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 reap_dead start 2024-09-13T23:57:03.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x555ed380f400 0x555ed374e100 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ed380ec00 0x555ed374d600 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x555ed380f000 0x555ed374db80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 --2- 172.21.15.173:0/1955965382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467800 0x555ed374cb00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 >> 172.21.15.173:0/1955965382 conn(0x555ed3467400 msgr2=0x555ed3567800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a63c4700 1 -- 172.21.15.173:0/1955965382 reap_dead start 2024-09-13T23:57:03.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 shutdown_connections 2024-09-13T23:57:03.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 -- 172.21.15.173:0/1955965382 wait complete. 2024-09-13T23:57:03.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 -- 172.21.15.173:0/994722604 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ed380f800 msgr2=0x555ed3962000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 --2- 172.21.15.173:0/994722604 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ed380f800 0x555ed3962000 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x555ed3863710 tx=0x555ed3928660 comp rx=0 tx=0).stop 2024-09-13T23:57:03.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 -- 172.21.15.173:0/994722604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed38be400 msgr2=0x555ed374f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 --2- 172.21.15.173:0/994722604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed38be400 0x555ed374f180 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x555ed38d62d0 tx=0x555ed37cda40 comp rx=0 tx=0).stop 2024-09-13T23:57:03.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 -- 172.21.15.173:0/994722604 shutdown_connections 2024-09-13T23:57:03.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 --2- 172.21.15.173:0/994722604 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ed380f800 0x555ed3962000 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 --2- 172.21.15.173:0/994722604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed38be400 0x555ed374f180 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 -- 172.21.15.173:0/994722604 >> 172.21.15.173:0/994722604 conn(0x555ed38c8800 msgr2=0x555ed3568000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 -- 172.21.15.173:0/994722604 shutdown_connections 2024-09-13T23:57:03.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 -- 172.21.15.173:0/994722604 wait complete. 2024-09-13T23:57:03.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 -- 172.21.15.173:0/1529093741 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ed380e000 msgr2=0x555ed374d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 --2- 172.21.15.173:0/1529093741 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ed380e000 0x555ed374d080 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x555ed37835f0 tx=0x555ed37cc8a0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 -- 172.21.15.173:0/1529093741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467000 msgr2=0x555ed374c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 --2- 172.21.15.173:0/1529093741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467000 0x555ed374c580 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x555ed4231ef0 tx=0x555ed356b980 comp rx=0 tx=0).stop 2024-09-13T23:57:03.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 -- 172.21.15.173:0/1529093741 shutdown_connections 2024-09-13T23:57:03.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 --2- 172.21.15.173:0/1529093741 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ed380e000 0x555ed374d080 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 --2- 172.21.15.173:0/1529093741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ed3467000 0x555ed374c580 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 -- 172.21.15.173:0/1529093741 >> 172.21.15.173:0/1529093741 conn(0x555ed3466c00 msgr2=0x555ed3567000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 -- 172.21.15.173:0/1529093741 shutdown_connections 2024-09-13T23:57:03.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.634+0000 7f49a840cf40 1 -- 172.21.15.173:0/1529093741 wait complete. 2024-09-13T23:57:03.643 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:03.643 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo", 2024-09-13T23:57:03.643 INFO:teuthology.orchestra.run.smithi173.stdout: "num_shards": 11, 2024-09-13T23:57:03.643 INFO:teuthology.orchestra.run.smithi173.stdout: "tenant": "", 2024-09-13T23:57:03.643 INFO:teuthology.orchestra.run.smithi173.stdout: "zonegroup": "45606a84-a024-4d59-86ac-9903db661675", 2024-09-13T23:57:03.643 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_rule": "default-placement", 2024-09-13T23:57:03.643 INFO:teuthology.orchestra.run.smithi173.stdout: "explicit_placement": { 2024-09-13T23:57:03.643 INFO:teuthology.orchestra.run.smithi173.stdout: "data_pool": "", 2024-09-13T23:57:03.643 INFO:teuthology.orchestra.run.smithi173.stdout: "data_extra_pool": "", 2024-09-13T23:57:03.643 INFO:teuthology.orchestra.run.smithi173.stdout: "index_pool": "" 2024-09-13T23:57:03.643 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:03.643 INFO:teuthology.orchestra.run.smithi173.stdout: "id": "d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1", 2024-09-13T23:57:03.643 INFO:teuthology.orchestra.run.smithi173.stdout: "marker": "d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1", 2024-09-13T23:57:03.644 INFO:teuthology.orchestra.run.smithi173.stdout: "index_type": "Normal", 2024-09-13T23:57:03.644 INFO:teuthology.orchestra.run.smithi173.stdout: "versioned": false, 2024-09-13T23:57:03.644 INFO:teuthology.orchestra.run.smithi173.stdout: "versioning_enabled": false, 2024-09-13T23:57:03.644 INFO:teuthology.orchestra.run.smithi173.stdout: "object_lock_enabled": false, 2024-09-13T23:57:03.644 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_enabled": false, 2024-09-13T23:57:03.644 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:57:03.644 INFO:teuthology.orchestra.run.smithi173.stdout: "ver": "0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1", 2024-09-13T23:57:03.644 INFO:teuthology.orchestra.run.smithi173.stdout: "master_ver": "0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0", 2024-09-13T23:57:03.644 INFO:teuthology.orchestra.run.smithi173.stdout: "mtime": "2024-09-13T23:57:02.419798Z", 2024-09-13T23:57:03.644 INFO:teuthology.orchestra.run.smithi173.stdout: "creation_time": "2024-09-13T23:57:02.413869Z", 2024-09-13T23:57:03.644 INFO:teuthology.orchestra.run.smithi173.stdout: "max_marker": "0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#", 2024-09-13T23:57:03.644 INFO:teuthology.orchestra.run.smithi173.stdout: "usage": { 2024-09-13T23:57:03.644 INFO:teuthology.orchestra.run.smithi173.stdout: "rgw.main": { 2024-09-13T23:57:03.644 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 3, 2024-09-13T23:57:03.644 INFO:teuthology.orchestra.run.smithi173.stdout: "size_actual": 4096, 2024-09-13T23:57:03.645 INFO:teuthology.orchestra.run.smithi173.stdout: "size_utilized": 3, 2024-09-13T23:57:03.645 INFO:teuthology.orchestra.run.smithi173.stdout: "size_kb": 1, 2024-09-13T23:57:03.645 INFO:teuthology.orchestra.run.smithi173.stdout: "size_kb_actual": 4, 2024-09-13T23:57:03.645 INFO:teuthology.orchestra.run.smithi173.stdout: "size_kb_utilized": 1, 2024-09-13T23:57:03.645 INFO:teuthology.orchestra.run.smithi173.stdout: "num_objects": 1 2024-09-13T23:57:03.645 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:03.645 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:03.645 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:57:03.645 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:03.645 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:03.645 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:03.645 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:03.645 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:03.645 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:03.645 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:03.646 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '45606a84-a024-4d59-86ac-9903db661675', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.1', 'marker': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.1', 'index_type': 'Normal', 'versioned': False, 'versioning_enabled': False, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T23:57:02.419798Z', 'creation_time': '2024-09-13T23:57:02.413869Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T23:57:03.646 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-13T23:57:03.647 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-13T23:57:03.647 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-13T23:57:03.682 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:03.683 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:03.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.678+0000 7f6844f62f40 1 Processor -- start 2024-09-13T23:57:03.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.678+0000 7f6844f62f40 1 -- start start 2024-09-13T23:57:03.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.678+0000 7f6844f62f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55f865591000 0x55f865876580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.678+0000 7f6844f62f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f865655500 con 0x55f865591400 2024-09-13T23:57:03.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.678+0000 7f6844f62f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f86561ea00 con 0x55f865591000 2024-09-13T23:57:03.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.678+0000 7f684371b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55f865591000 0x55f865876580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.678+0000 7f6842f1a700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55f865591400 0x55f865690800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47402/0 (socket says 172.21.15.173:47402) 2024-09-13T23:57:03.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.678+0000 7f6842f1a700 1 -- 172.21.15.173:0/483949671 learned_addr learned my addr 172.21.15.173:0/483949671 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:03.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.678+0000 7f684371b700 1 -- 172.21.15.173:0/483949671 >> v1:172.21.15.87:6789/0 conn(0x55f865591400 legacy=0x55f865690800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.678+0000 7f684371b700 1 -- 172.21.15.173:0/483949671 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8655a3d40 con 0x55f865591000 2024-09-13T23:57:03.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.678+0000 7f684371b700 1 --2- 172.21.15.173:0/483949671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865591000 0x55f865876580 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x55f865871a70 tx=0x55f865695920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f906fb7691699 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.682+0000 7f6842719700 1 -- 172.21.15.173:0/483949671 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f8656354a0 con 0x55f865591000 2024-09-13T23:57:03.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.682+0000 7f6842719700 1 -- 172.21.15.173:0/483949671 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f865655800 con 0x55f865591000 2024-09-13T23:57:03.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.682+0000 7f6842719700 1 -- 172.21.15.173:0/483949671 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f865635600 con 0x55f865591000 2024-09-13T23:57:03.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.682+0000 7f6844f62f40 1 -- 172.21.15.173:0/483949671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865591000 msgr2=0x55f865876580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.682+0000 7f6844f62f40 1 --2- 172.21.15.173:0/483949671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865591000 0x55f865876580 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x55f865871a70 tx=0x55f865695920 comp rx=0 tx=0).stop 2024-09-13T23:57:03.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.682+0000 7f6844f62f40 1 -- 172.21.15.173:0/483949671 shutdown_connections 2024-09-13T23:57:03.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.682+0000 7f6844f62f40 1 --2- 172.21.15.173:0/483949671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865591000 0x55f865876580 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.682+0000 7f6844f62f40 1 -- 172.21.15.173:0/483949671 >> 172.21.15.173:0/483949671 conn(0x55f865590c00 msgr2=0x55f865690000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.682+0000 7f6844f62f40 1 -- 172.21.15.173:0/483949671 shutdown_connections 2024-09-13T23:57:03.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.682+0000 7f6844f62f40 1 -- 172.21.15.173:0/483949671 wait complete. 2024-09-13T23:57:03.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.682+0000 7f6844f62f40 1 Processor -- start 2024-09-13T23:57:03.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.682+0000 7f6844f62f40 1 -- start start 2024-09-13T23:57:03.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.682+0000 7f6844f62f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865591000 0x55f865876580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.682+0000 7f6844f62f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f86561e500 con 0x55f865591000 2024-09-13T23:57:03.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.682+0000 7f684371b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865591000 0x55f865876580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.682+0000 7f684371b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865591000 0x55f865876580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49850/0 (socket says 172.21.15.173:49850) 2024-09-13T23:57:03.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.682+0000 7f684371b700 1 -- 172.21.15.173:0/556769805 learned_addr learned my addr 172.21.15.173:0/556769805 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.682+0000 7f684371b700 1 -- 172.21.15.173:0/556769805 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8655a3ba0 con 0x55f865591000 2024-09-13T23:57:03.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.682+0000 7f684371b700 1 --2- 172.21.15.173:0/556769805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865591000 0x55f865876580 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x55f8656edd40 tx=0x55f865695800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5a6e162c7cdafc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.682+0000 7f6841f18700 1 -- 172.21.15.173:0/556769805 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f865635760 con 0x55f865591000 2024-09-13T23:57:03.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.682+0000 7f6841f18700 1 -- 172.21.15.173:0/556769805 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f865655b00 con 0x55f865591000 2024-09-13T23:57:03.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.682+0000 7f6841f18700 1 -- 172.21.15.173:0/556769805 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f8656354a0 con 0x55f865591000 2024-09-13T23:57:03.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.686+0000 7f6844f62f40 1 -- 172.21.15.173:0/556769805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865591000 msgr2=0x55f865876580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.686+0000 7f6844f62f40 1 --2- 172.21.15.173:0/556769805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865591000 0x55f865876580 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x55f8656edd40 tx=0x55f865695800 comp rx=0 tx=0).stop 2024-09-13T23:57:03.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.686+0000 7f6844f62f40 1 -- 172.21.15.173:0/556769805 shutdown_connections 2024-09-13T23:57:03.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.686+0000 7f6844f62f40 1 --2- 172.21.15.173:0/556769805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865591000 0x55f865876580 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.686+0000 7f6844f62f40 1 -- 172.21.15.173:0/556769805 >> 172.21.15.173:0/556769805 conn(0x55f865590c00 msgr2=0x55f865691000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.686+0000 7f6844f62f40 1 -- 172.21.15.173:0/556769805 shutdown_connections 2024-09-13T23:57:03.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.686+0000 7f6844f62f40 1 -- 172.21.15.173:0/556769805 wait complete. 2024-09-13T23:57:03.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.686+0000 7f6844f62f40 1 Processor -- start 2024-09-13T23:57:03.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.686+0000 7f6844f62f40 1 -- start start 2024-09-13T23:57:03.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.686+0000 7f6844f62f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865591400 0x55f865876b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.686+0000 7f6844f62f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f86561e3c0 con 0x55f865591400 2024-09-13T23:57:03.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.686+0000 7f684371b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865591400 0x55f865876b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.686+0000 7f684371b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865591400 0x55f865876b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49854/0 (socket says 172.21.15.173:49854) 2024-09-13T23:57:03.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.686+0000 7f684371b700 1 -- 172.21.15.173:0/728936704 learned_addr learned my addr 172.21.15.173:0/728936704 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.686+0000 7f684371b700 1 -- 172.21.15.173:0/728936704 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8655a3a00 con 0x55f865591400 2024-09-13T23:57:03.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.686+0000 7f684371b700 1 --2- 172.21.15.173:0/728936704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865591400 0x55f865876b00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x55f8656edef0 tx=0x55f865695920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.686+0000 7f6840715700 1 -- 172.21.15.173:0/728936704 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f865635600 con 0x55f865591400 2024-09-13T23:57:03.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.686+0000 7f6840715700 1 -- 172.21.15.173:0/728936704 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f865655c80 con 0x55f865591400 2024-09-13T23:57:03.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.686+0000 7f6844f62f40 1 -- 172.21.15.173:0/728936704 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f8655a3860 con 0x55f865591400 2024-09-13T23:57:03.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.686+0000 7f6840715700 1 -- 172.21.15.173:0/728936704 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f8656358c0 con 0x55f865591400 2024-09-13T23:57:03.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.686+0000 7f6844f62f40 1 -- 172.21.15.173:0/728936704 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f8655a36c0 con 0x55f865591400 2024-09-13T23:57:03.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.690+0000 7f6844f62f40 1 Processor -- start 2024-09-13T23:57:03.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.690+0000 7f6840715700 1 -- 172.21.15.173:0/728936704 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55f86568ab00 con 0x55f865591400 2024-09-13T23:57:03.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.690+0000 7f6844f62f40 1 -- start start 2024-09-13T23:57:03.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.690+0000 7f6840715700 1 --2- 172.21.15.173:0/728936704 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f865591c00 0x55f865877080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.690+0000 7f6840715700 1 -- 172.21.15.173:0/728936704 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55f8655f7180 con 0x55f865591400 2024-09-13T23:57:03.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.690+0000 7f6844f62f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865926000 0x55f865877600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.690+0000 7f6844f62f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f86561e000 con 0x55f865926000 2024-09-13T23:57:03.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.690+0000 7f6843f1c700 1 --2- 172.21.15.173:0/728936704 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f865591c00 0x55f865877080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.690+0000 7f684371b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865926000 0x55f865877600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.690+0000 7f684371b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865926000 0x55f865877600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49870/0 (socket says 172.21.15.173:49870) 2024-09-13T23:57:03.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.690+0000 7f684371b700 1 -- 172.21.15.173:0/522927281 learned_addr learned my addr 172.21.15.173:0/522927281 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.690+0000 7f684371b700 1 -- 172.21.15.173:0/522927281 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8655a2000 con 0x55f865926000 2024-09-13T23:57:03.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.690+0000 7f6843f1c700 1 --2- 172.21.15.173:0/728936704 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f865591c00 0x55f865877080 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55f8656edf20 tx=0x55f8658ea780 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.690+0000 7f684371b700 1 --2- 172.21.15.173:0/522927281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865926000 0x55f865877600 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x55f8658b8a80 tx=0x55f8658ea8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee5f75c1c0e3796 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.690+0000 7f683df10700 1 -- 172.21.15.173:0/522927281 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f865635600 con 0x55f865926000 2024-09-13T23:57:03.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.690+0000 7f683df10700 1 -- 172.21.15.173:0/522927281 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f865655c80 con 0x55f865926000 2024-09-13T23:57:03.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.690+0000 7f683df10700 1 -- 172.21.15.173:0/522927281 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f8656358c0 con 0x55f865926000 2024-09-13T23:57:03.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.690+0000 7f6844f62f40 1 -- 172.21.15.173:0/522927281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865926000 msgr2=0x55f865877600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.690+0000 7f6844f62f40 1 --2- 172.21.15.173:0/522927281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865926000 0x55f865877600 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x55f8658b8a80 tx=0x55f8658ea8a0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.690+0000 7f6844f62f40 1 -- 172.21.15.173:0/522927281 shutdown_connections 2024-09-13T23:57:03.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.690+0000 7f6844f62f40 1 --2- 172.21.15.173:0/522927281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865926000 0x55f865877600 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.690+0000 7f6844f62f40 1 -- 172.21.15.173:0/522927281 >> 172.21.15.173:0/522927281 conn(0x55f865591800 msgr2=0x55f865691800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.690+0000 7f6844f62f40 1 -- 172.21.15.173:0/522927281 shutdown_connections 2024-09-13T23:57:03.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.690+0000 7f6844f62f40 1 -- 172.21.15.173:0/522927281 wait complete. 2024-09-13T23:57:03.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.694+0000 7f6844f62f40 1 Processor -- start 2024-09-13T23:57:03.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.694+0000 7f6844f62f40 1 -- start start 2024-09-13T23:57:03.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.694+0000 7f6844f62f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865926000 0x55f865877600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.694+0000 7f6844f62f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8655b6640 con 0x55f865926000 2024-09-13T23:57:03.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.694+0000 7f684371b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865926000 0x55f865877600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.694+0000 7f684371b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865926000 0x55f865877600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49880/0 (socket says 172.21.15.173:49880) 2024-09-13T23:57:03.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.694+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 learned_addr learned my addr 172.21.15.173:0/2289439123 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.694+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8655a2ea0 con 0x55f865926000 2024-09-13T23:57:03.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.694+0000 7f684371b700 1 --2- 172.21.15.173:0/2289439123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865926000 0x55f865877600 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x55f865910810 tx=0x55f8658eaa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.694+0000 7f683c70d700 1 -- 172.21.15.173:0/2289439123 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f865635760 con 0x55f865926000 2024-09-13T23:57:03.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.694+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f8655a2820 con 0x55f865926000 2024-09-13T23:57:03.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.694+0000 7f683c70d700 1 -- 172.21.15.173:0/2289439123 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f86594a000 con 0x55f865926000 2024-09-13T23:57:03.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.694+0000 7f683c70d700 1 -- 172.21.15.173:0/2289439123 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f8656354a0 con 0x55f865926000 2024-09-13T23:57:03.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.694+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f8655a29c0 con 0x55f865926000 2024-09-13T23:57:03.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.694+0000 7f683c70d700 1 -- 172.21.15.173:0/2289439123 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55f86568adc0 con 0x55f865926000 2024-09-13T23:57:03.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.694+0000 7f683c70d700 1 --2- 172.21.15.173:0/2289439123 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f865927800 0x55f865878680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.694+0000 7f683c70d700 1 -- 172.21.15.173:0/2289439123 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55f8655f7340 con 0x55f865926000 2024-09-13T23:57:03.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.694+0000 7f6844f62f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.694+0000 7f6842f1a700 1 --2- 172.21.15.173:0/2289439123 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f865927800 0x55f865878680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.694+0000 7f6844f62f40 1 --2- 172.21.15.173:0/2289439123 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f865926400 0x55f865877b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.694+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865926800 con 0x55f865926400 2024-09-13T23:57:03.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f6843f1c700 1 --2- 172.21.15.173:0/2289439123 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f865926400 0x55f865877b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f6842f1a700 1 --2- 172.21.15.173:0/2289439123 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f865927800 0x55f865878680 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x55f865911350 tx=0x55f8658eb860 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f6843f1c700 1 --2- 172.21.15.173:0/2289439123 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f865926400 0x55f865877b80 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f6844f62f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f6844f62f40 20 realm 2024-09-13T23:57:03.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f6844f62f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865926c00 con 0x55f865926400 2024-09-13T23:57:03.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f6844f62f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f6844f62f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:03.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f6844f62f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865926800 con 0x55f865926400 2024-09-13T23:57:03.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f6844f62f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f6844f62f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f6844f62f40 1 --2- 172.21.15.173:0/2289439123 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f865926c00 0x55f865878100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f865926c00 2024-09-13T23:57:03.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f684371b700 1 --2- 172.21.15.173:0/2289439123 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f865926c00 0x55f865878100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f684371b700 1 --2- 172.21.15.173:0/2289439123 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f865926c00 0x55f865878100 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55f8659c1200 con 0x55f865926c00 2024-09-13T23:57:03.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f6844f62f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:03.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f6844f62f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f6844f62f40 1 --2- 172.21.15.173:0/2289439123 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f8659c4000 0x55f865878c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659c4400 con 0x55f8659c4000 2024-09-13T23:57:03.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.698+0000 7f6842f1a700 1 --2- 172.21.15.173:0/2289439123 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f8659c4000 0x55f865878c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.702+0000 7f6842f1a700 1 --2- 172.21.15.173:0/2289439123 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f8659c4000 0x55f865878c00 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.702+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55f8659c1440 con 0x55f8659c4000 2024-09-13T23:57:03.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.702+0000 7f6844f62f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:03.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.702+0000 7f6844f62f40 20 searching for the correct realm 2024-09-13T23:57:03.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.702+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659c4800 con 0x55f8659c4000 2024-09-13T23:57:03.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.702+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55f8659c1440 con 0x55f8659c4000 2024-09-13T23:57:03.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.702+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659c4400 con 0x55f865926c00 2024-09-13T23:57:03.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.702+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c1200 con 0x55f865926c00 2024-09-13T23:57:03.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.702+0000 7f684371b700 1 --2- 172.21.15.173:0/2289439123 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f8659c4400 0x55f865876580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.702+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f8659c4400 2024-09-13T23:57:03.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.702+0000 7f6843f1c700 1 --2- 172.21.15.173:0/2289439123 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f8659c4400 0x55f865876580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.702+0000 7f6843f1c700 1 --2- 172.21.15.173:0/2289439123 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f8659c4400 0x55f865876580 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.702+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c0b40 con 0x55f8659c4400 2024-09-13T23:57:03.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.702+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f865926400 2024-09-13T23:57:03.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.702+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.702+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f865926400 2024-09-13T23:57:03.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.702+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.702+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f8659c4000 2024-09-13T23:57:03.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.702+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c1440 con 0x55f8659c4000 2024-09-13T23:57:03.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.706+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f865926400 2024-09-13T23:57:03.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.706+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.706+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f865926c00 2024-09-13T23:57:03.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.706+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c1200 con 0x55f865926c00 2024-09-13T23:57:03.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.706+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f865926c00 2024-09-13T23:57:03.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.706+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c1200 con 0x55f865926c00 2024-09-13T23:57:03.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.706+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f865926400 2024-09-13T23:57:03.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.706+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.706+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f8659c4400 2024-09-13T23:57:03.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.706+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c0b40 con 0x55f8659c4400 2024-09-13T23:57:03.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.706+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f865926400 2024-09-13T23:57:03.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.706+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.706+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f8659c4400 2024-09-13T23:57:03.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.706+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c0b40 con 0x55f8659c4400 2024-09-13T23:57:03.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.706+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f865926c00 2024-09-13T23:57:03.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.710+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c1200 con 0x55f865926c00 2024-09-13T23:57:03.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.710+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f8659c4000 2024-09-13T23:57:03.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.710+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c1440 con 0x55f8659c4000 2024-09-13T23:57:03.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.710+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f865926400 2024-09-13T23:57:03.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.710+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.710+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f865926c00 2024-09-13T23:57:03.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.710+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c1200 con 0x55f865926c00 2024-09-13T23:57:03.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.710+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f8659c4000 2024-09-13T23:57:03.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.710+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c1440 con 0x55f8659c4000 2024-09-13T23:57:03.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.710+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f865926400 2024-09-13T23:57:03.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.710+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.710+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f865926400 2024-09-13T23:57:03.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.710+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.710+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f865926400 2024-09-13T23:57:03.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.710+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.710+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f8659c4000 2024-09-13T23:57:03.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.714+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c1440 con 0x55f8659c4000 2024-09-13T23:57:03.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.714+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f8659c4400 2024-09-13T23:57:03.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.714+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c0b40 con 0x55f8659c4400 2024-09-13T23:57:03.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.714+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f865926400 2024-09-13T23:57:03.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.714+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.714+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f8659c4400 2024-09-13T23:57:03.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.714+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c0b40 con 0x55f8659c4400 2024-09-13T23:57:03.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.714+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f8659c4000 2024-09-13T23:57:03.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.714+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c1440 con 0x55f8659c4000 2024-09-13T23:57:03.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.714+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f8659c4400 2024-09-13T23:57:03.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.714+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c0b40 con 0x55f8659c4400 2024-09-13T23:57:03.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.714+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f865926c00 2024-09-13T23:57:03.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.714+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c1200 con 0x55f865926c00 2024-09-13T23:57:03.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.714+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f865926c00 2024-09-13T23:57:03.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.714+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c1200 con 0x55f865926c00 2024-09-13T23:57:03.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.714+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f8659c4000 2024-09-13T23:57:03.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c1440 con 0x55f8659c4000 2024-09-13T23:57:03.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f865926c00 2024-09-13T23:57:03.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55f8659c1200 con 0x55f865926c00 2024-09-13T23:57:03.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f865926c00 2024-09-13T23:57:03.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f8659c1200 con 0x55f865926c00 2024-09-13T23:57:03.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6844f62f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:03.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6844f62f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:03.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6844f62f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:03.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6844f62f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:03.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6844f62f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659c4c00 con 0x55f865926400 2024-09-13T23:57:03.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6844f62f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6844f62f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659c5000 con 0x55f865926c00 2024-09-13T23:57:03.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55f8659c1200 con 0x55f865926c00 2024-09-13T23:57:03.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6844f62f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:03.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6844f62f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659c5400 con 0x55f865926400 2024-09-13T23:57:03.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6844f62f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:03.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6844f62f40 20 zone default found 2024-09-13T23:57:03.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6844f62f40 4 Realm: () 2024-09-13T23:57:03.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6844f62f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:03.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6844f62f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:03.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6844f62f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:03.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6844f62f40 20 zonegroup default 2024-09-13T23:57:03.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6844f62f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.718+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659c4c00 con 0x55f8659c4400 2024-09-13T23:57:03.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.722+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55f8659c0b40 con 0x55f8659c4400 2024-09-13T23:57:03.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.722+0000 7f6844f62f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.722+0000 7f6844f62f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.722+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659c5400 con 0x55f8659c4000 2024-09-13T23:57:03.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.722+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55f8659c1440 con 0x55f8659c4000 2024-09-13T23:57:03.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.722+0000 7f6844f62f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.722+0000 7f6844f62f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.722+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659c5800 con 0x55f8659c4000 2024-09-13T23:57:03.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.722+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55f8659c1440 con 0x55f8659c4000 2024-09-13T23:57:03.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.722+0000 7f6844f62f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.722+0000 7f6844f62f40 20 started sync module instance, tier type = 2024-09-13T23:57:03.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.722+0000 7f6844f62f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:03.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.722+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659c5c00 con 0x55f865926c00 2024-09-13T23:57:03.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.726+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f8659c1200 con 0x55f865926c00 2024-09-13T23:57:03.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.726+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94525343587072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865926800 con 0x55f865926c00 2024-09-13T23:57:03.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.726+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659c5000 con 0x55f865926400 2024-09-13T23:57:03.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.726+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.726+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94525343588224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659c5c00 con 0x55f865926400 2024-09-13T23:57:03.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.726+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f865926c00 2024-09-13T23:57:03.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.726+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94525343587072] v33'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f8659c1200 con 0x55f865926c00 2024-09-13T23:57:03.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.730+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94525343588224] v33'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.730+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f8659c1200 con 0x55f865926c00 2024-09-13T23:57:03.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.730+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94525343589376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659ca000 con 0x55f865926c00 2024-09-13T23:57:03.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.730+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659ca400 con 0x55f8659c4400 2024-09-13T23:57:03.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.730+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94525343589376] v33'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f8659c1200 con 0x55f865926c00 2024-09-13T23:57:03.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.734+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f8659c0b40 con 0x55f8659c4400 2024-09-13T23:57:03.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.734+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94525343590528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659ca800 con 0x55f8659c4400 2024-09-13T23:57:03.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.734+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659cac00 con 0x55f865926c00 2024-09-13T23:57:03.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.734+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94525343590528] v33'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f8659c0b40 con 0x55f8659c4400 2024-09-13T23:57:03.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.734+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f8659c1200 con 0x55f865926c00 2024-09-13T23:57:03.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.734+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94525343591680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659cb000 con 0x55f865926c00 2024-09-13T23:57:03.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.734+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659cb400 con 0x55f8659c4000 2024-09-13T23:57:03.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.738+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f8659c1440 con 0x55f8659c4000 2024-09-13T23:57:03.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.738+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94525343592832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659cb800 con 0x55f8659c4000 2024-09-13T23:57:03.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.738+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659cbc00 con 0x55f8659c4000 2024-09-13T23:57:03.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.738+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94525343591680] v33'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f8659c1200 con 0x55f865926c00 2024-09-13T23:57:03.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.738+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94525343592832] v33'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f8659c1440 con 0x55f8659c4000 2024-09-13T23:57:03.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.738+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f8659c1440 con 0x55f8659c4000 2024-09-13T23:57:03.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.738+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94525343593984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659cb400 con 0x55f8659c4000 2024-09-13T23:57:03.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.738+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659ca000 con 0x55f8659c4400 2024-09-13T23:57:03.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.742+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f8659c0b40 con 0x55f8659c4400 2024-09-13T23:57:03.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.742+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94525343595136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659c4800 con 0x55f8659c4400 2024-09-13T23:57:03.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.742+0000 7f6844f62f40 20 add_watcher() i=0 2024-09-13T23:57:03.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.742+0000 7f6844f62f40 20 add_watcher() i=1 2024-09-13T23:57:03.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.742+0000 7f6844f62f40 20 add_watcher() i=2 2024-09-13T23:57:03.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.742+0000 7f6844f62f40 20 add_watcher() i=3 2024-09-13T23:57:03.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.742+0000 7f6844f62f40 20 add_watcher() i=4 2024-09-13T23:57:03.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.742+0000 7f6844f62f40 20 add_watcher() i=5 2024-09-13T23:57:03.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.742+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94525343593984] v33'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f8659c1440 con 0x55f8659c4000 2024-09-13T23:57:03.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.742+0000 7f6844f62f40 20 add_watcher() i=6 2024-09-13T23:57:03.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.742+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94525343595136] v33'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f8659c0b40 con 0x55f8659c4400 2024-09-13T23:57:03.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.742+0000 7f6844f62f40 20 add_watcher() i=7 2024-09-13T23:57:03.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.742+0000 7f6844f62f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:03.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.742+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659c5400 con 0x55f865926400 2024-09-13T23:57:03.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.746+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.746+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94525345054720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659c5800 con 0x55f865926400 2024-09-13T23:57:03.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.746+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94525345054720] v33'102 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.746+0000 7f682a6e9700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:03.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.746+0000 7f6844f62f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:03.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.746+0000 7f6844f62f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:03.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.746+0000 7f6844f62f40 1 Processor -- start 2024-09-13T23:57:03.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.746+0000 7f6844f62f40 1 -- start start 2024-09-13T23:57:03.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.746+0000 7f6844f62f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f8659c5000 0x55f865879180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.746+0000 7f6844f62f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8655b6780 con 0x55f8659c5000 2024-09-13T23:57:03.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.746+0000 7f6842f1a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f8659c5000 0x55f865879180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.746+0000 7f6842f1a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f8659c5000 0x55f865879180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49882/0 (socket says 172.21.15.173:49882) 2024-09-13T23:57:03.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.746+0000 7f6842f1a700 1 -- 172.21.15.173:0/4061089261 learned_addr learned my addr 172.21.15.173:0/4061089261 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.750+0000 7f6842f1a700 1 -- 172.21.15.173:0/4061089261 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8655a2b60 con 0x55f8659c5000 2024-09-13T23:57:03.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.750+0000 7f6842f1a700 1 --2- 172.21.15.173:0/4061089261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f8659c5000 0x55f865879180 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x55f8659dc090 tx=0x55f8658eb800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2688dfc0ae10d9f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.750+0000 7f6829ee8700 1 -- 172.21.15.173:0/4061089261 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f8659d2160 con 0x55f8659c5000 2024-09-13T23:57:03.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.750+0000 7f6829ee8700 1 -- 172.21.15.173:0/4061089261 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f86594aa80 con 0x55f8659c5000 2024-09-13T23:57:03.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.750+0000 7f6829ee8700 1 -- 172.21.15.173:0/4061089261 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f8659d22c0 con 0x55f8659c5000 2024-09-13T23:57:03.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.750+0000 7f6844f62f40 1 -- 172.21.15.173:0/4061089261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f8659c5000 msgr2=0x55f865879180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.750+0000 7f6844f62f40 1 --2- 172.21.15.173:0/4061089261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f8659c5000 0x55f865879180 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x55f8659dc090 tx=0x55f8658eb800 comp rx=0 tx=0).stop 2024-09-13T23:57:03.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.750+0000 7f6844f62f40 1 -- 172.21.15.173:0/4061089261 shutdown_connections 2024-09-13T23:57:03.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.750+0000 7f6844f62f40 1 --2- 172.21.15.173:0/4061089261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f8659c5000 0x55f865879180 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.750+0000 7f6844f62f40 1 -- 172.21.15.173:0/4061089261 >> 172.21.15.173:0/4061089261 conn(0x55f8659c4c00 msgr2=0x55f865692000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.750+0000 7f6844f62f40 1 -- 172.21.15.173:0/4061089261 shutdown_connections 2024-09-13T23:57:03.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.750+0000 7f6844f62f40 1 -- 172.21.15.173:0/4061089261 wait complete. 2024-09-13T23:57:03.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.750+0000 7f6844f62f40 1 Processor -- start 2024-09-13T23:57:03.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.750+0000 7f6844f62f40 1 -- start start 2024-09-13T23:57:03.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.750+0000 7f6844f62f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f8659c5000 0x55f865879180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.750+0000 7f6844f62f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f86561e000 con 0x55f8659c5000 2024-09-13T23:57:03.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.750+0000 7f6842f1a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f8659c5000 0x55f865879180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.750+0000 7f6842f1a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f8659c5000 0x55f865879180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49890/0 (socket says 172.21.15.173:49890) 2024-09-13T23:57:03.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.750+0000 7f6842f1a700 1 -- 172.21.15.173:0/2119700488 learned_addr learned my addr 172.21.15.173:0/2119700488 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.750+0000 7f6842f1a700 1 -- 172.21.15.173:0/2119700488 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8655a2d00 con 0x55f8659c5000 2024-09-13T23:57:03.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.750+0000 7f6842f1a700 1 --2- 172.21.15.173:0/2119700488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f8659c5000 0x55f865879180 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x55f8659dc2a0 tx=0x55f8658eb980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.750+0000 7f68286e5700 1 -- 172.21.15.173:0/2119700488 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f8659d2420 con 0x55f8659c5000 2024-09-13T23:57:03.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.754+0000 7f68286e5700 1 -- 172.21.15.173:0/2119700488 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f86594a780 con 0x55f8659c5000 2024-09-13T23:57:03.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.754+0000 7f6844f62f40 1 -- 172.21.15.173:0/2119700488 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f8655a2340 con 0x55f8659c5000 2024-09-13T23:57:03.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.754+0000 7f68286e5700 1 -- 172.21.15.173:0/2119700488 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f8659d2160 con 0x55f8659c5000 2024-09-13T23:57:03.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.754+0000 7f6844f62f40 1 -- 172.21.15.173:0/2119700488 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f8655a2b60 con 0x55f8659c5000 2024-09-13T23:57:03.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.754+0000 7f68286e5700 1 -- 172.21.15.173:0/2119700488 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55f86568b8c0 con 0x55f8659c5000 2024-09-13T23:57:03.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.754+0000 7f68286e5700 1 --2- 172.21.15.173:0/2119700488 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f8659c4800 0x55f865a6c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.754+0000 7f68286e5700 1 -- 172.21.15.173:0/2119700488 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55f8655f76c0 con 0x55f8659c5000 2024-09-13T23:57:03.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.754+0000 7f6843f1c700 1 --2- 172.21.15.173:0/2119700488 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f8659c4800 0x55f865a6c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.754+0000 7f6844f62f40 5 note: GC not initialized 2024-09-13T23:57:03.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.754+0000 7f6843f1c700 1 --2- 172.21.15.173:0/2119700488 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f8659c4800 0x55f865a6c000 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55f865969290 tx=0x55f8658ea720 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6825ee0700 20 reqs_thread_entry: start 2024-09-13T23:57:03.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6844f62f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:03.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6844f62f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:03.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6823edc700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:34 2024 2024-09-13T23:57:03.762 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:03.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f68236ba700 20 reqs_thread_entry: start 2024-09-13T23:57:03.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6844f62f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f865926400 2024-09-13T23:57:03.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6844f62f40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:57:03.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659ca800 con 0x55f8659c4400 2024-09-13T23:57:03.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x55f8659c0b40 con 0x55f8659c4400 2024-09-13T23:57:03.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6844f62f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 8.17 8:ea49432e:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659ca000 con 0x55f865926c00 2024-09-13T23:57:03.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(64 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x55f8659c1200 con 0x55f865926c00 2024-09-13T23:57:03.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6844f62f40 20 rados_obj.operate() r=0 bl.length=352 2024-09-13T23:57:03.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6844f62f40 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T23:57:03.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:65 4.3a 4:5ed28fc2:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659cac00 con 0x55f8659c4000 2024-09-13T23:57:03.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 4.18 4:18584371:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659ca400 con 0x55f865926c00 2024-09-13T23:57:03.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:67 4.34 4:2cdc3579:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659c5400 con 0x55f8659c4400 2024-09-13T23:57:03.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:68 4.1e 4:7ad1e97c:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659c5800 con 0x55f865926400 2024-09-13T23:57:03.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:69 4.2f 4:f65cb84f:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865ada000 con 0x55f865926400 2024-09-13T23:57:03.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:70 4.b 4:d29b135b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865ada400 con 0x55f8659c4400 2024-09-13T23:57:03.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 4.32 4:4e7c1df1:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865ada800 con 0x55f865926c00 2024-09-13T23:57:03.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:72 4.17 4:ebadd201:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865adac00 con 0x55f8659c4000 2024-09-13T23:57:03.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:73 4.2 4:40ba7f18:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865adb000 con 0x55f865926400 2024-09-13T23:57:03.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:74 4.26 4:66627631:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865adb400 con 0x55f865926400 2024-09-13T23:57:03.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.758+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:75 4.a 4:53f2fc8c:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865adb800 con 0x55f865926c00 2024-09-13T23:57:03.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.762+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(66 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55f8659c1200 con 0x55f865926c00 2024-09-13T23:57:03.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.762+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(67 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55f8659c0b40 con 0x55f8659c4400 2024-09-13T23:57:03.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.762+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(71 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55f8659c1200 con 0x55f865926c00 2024-09-13T23:57:03.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.762+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(70 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.5 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x55f8659c0b40 con 0x55f8659c4400 2024-09-13T23:57:03.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.762+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(65 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55f8659c1440 con 0x55f8659c4000 2024-09-13T23:57:03.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.762+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(72 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55f8659c1440 con 0x55f8659c4000 2024-09-13T23:57:03.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.762+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(75 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x55f8659c1200 con 0x55f865926c00 2024-09-13T23:57:03.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.762+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(68 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.762+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(69 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.762+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(73 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.762+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 24 ==== osd_op_reply(74 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.762+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865adbc00 con 0x55f8659c4400 2024-09-13T23:57:03.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.762+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(76 foo.buckets [call] v33'15 uv15 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x55f8659c0b40 con 0x55f8659c4400 2024-09-13T23:57:03.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.762+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865ada800 con 0x55f8659c4400 2024-09-13T23:57:03.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.766+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(77 foo.buckets [call] v33'16 uv16 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x55f8659c0b40 con 0x55f8659c4400 2024-09-13T23:57:03.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.766+0000 7f6844f62f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.766+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865adb800 con 0x55f865926400 2024-09-13T23:57:03.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.766+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 25 ==== osd_op_reply(78 foo [stat out=16b,read 0~357 out=357b] v0'0 uv11 ondisk = 0) v8 ==== 189+0+373 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.766+0000 7f6844f62f40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:57:03.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.766+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865ada000 con 0x55f8659c4400 2024-09-13T23:57:03.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.766+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) v8 ==== 155+0+58 (crc 0 0 0) 0x55f8659c0b40 con 0x55f8659c4400 2024-09-13T23:57:03.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.770+0000 7f682a6e9700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:03.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.770+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94525345054720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659ca000 con 0x55f865926400 2024-09-13T23:57:03.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.770+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 26 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94525345054720] v33'103 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.770+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94525343587072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659ca400 con 0x55f865926c00 2024-09-13T23:57:03.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.774+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94525343587072] v33'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f8659c1200 con 0x55f865926c00 2024-09-13T23:57:03.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.774+0000 7f6844f62f40 20 remove_watcher() i=0 2024-09-13T23:57:03.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.774+0000 7f6844f62f40 2 removed watcher, disabling cache 2024-09-13T23:57:03.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.774+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94525343588224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f8659ca800 con 0x55f865926400 2024-09-13T23:57:03.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.774+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.1 v2:172.21.15.173:6808/3256211813 27 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94525343588224] v33'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f8659c0b40 con 0x55f865926400 2024-09-13T23:57:03.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.774+0000 7f6844f62f40 20 remove_watcher() i=1 2024-09-13T23:57:03.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.774+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94525343589376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865927c00 con 0x55f865926c00 2024-09-13T23:57:03.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.778+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94525343589376] v33'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f8659c1200 con 0x55f865926c00 2024-09-13T23:57:03.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.778+0000 7f6844f62f40 20 remove_watcher() i=2 2024-09-13T23:57:03.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.778+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94525343590528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865adb000 con 0x55f8659c4400 2024-09-13T23:57:03.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.782+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.2 v2:172.21.15.173:6809/889985573 18 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94525343590528] v33'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f8659c0b40 con 0x55f8659c4400 2024-09-13T23:57:03.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.782+0000 7f6844f62f40 20 remove_watcher() i=3 2024-09-13T23:57:03.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.782+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94525343591680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865adb400 con 0x55f865926c00 2024-09-13T23:57:03.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.782+0000 7f684371b700 1 -- 172.21.15.173:0/2289439123 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94525343591680] v33'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f8659c1200 con 0x55f865926c00 2024-09-13T23:57:03.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.782+0000 7f6844f62f40 20 remove_watcher() i=4 2024-09-13T23:57:03.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.782+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94525343592832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865adbc00 con 0x55f8659c4000 2024-09-13T23:57:03.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.786+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94525343592832] v33'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f8659c1440 con 0x55f8659c4000 2024-09-13T23:57:03.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.786+0000 7f6844f62f40 20 remove_watcher() i=5 2024-09-13T23:57:03.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.786+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94525343593984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865ada800 con 0x55f8659c4000 2024-09-13T23:57:03.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.790+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94525343593984] v33'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f8659c1440 con 0x55f8659c4000 2024-09-13T23:57:03.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.790+0000 7f6844f62f40 20 remove_watcher() i=6 2024-09-13T23:57:03.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.790+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94525343595136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f865adb800 con 0x55f8659c4400 2024-09-13T23:57:03.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.790+0000 7f6843f1c700 1 -- 172.21.15.173:0/2289439123 <== osd.2 v2:172.21.15.173:6809/889985573 19 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94525343595136] v33'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f8659c0b40 con 0x55f8659c4400 2024-09-13T23:57:03.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.790+0000 7f6844f62f40 20 remove_watcher() i=7 2024-09-13T23:57:03.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.790+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f865926c00 msgr2=0x55f865878100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.790+0000 7f6844f62f40 1 --2- 172.21.15.173:0/2289439123 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f865926c00 0x55f865878100 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.790+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f865926400 msgr2=0x55f865877b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.790+0000 7f6844f62f40 1 --2- 172.21.15.173:0/2289439123 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f865926400 0x55f865877b80 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.790+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f8659c4400 msgr2=0x55f865876580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.790+0000 7f6844f62f40 1 --2- 172.21.15.173:0/2289439123 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f8659c4400 0x55f865876580 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.790+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f8659c4000 msgr2=0x55f865878c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.790+0000 7f6844f62f40 1 --2- 172.21.15.173:0/2289439123 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f8659c4000 0x55f865878c00 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.790+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f865927800 msgr2=0x55f865878680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.790+0000 7f6844f62f40 1 --2- 172.21.15.173:0/2289439123 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f865927800 0x55f865878680 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x55f865911350 tx=0x55f8658eb860 comp rx=0 tx=0).stop 2024-09-13T23:57:03.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.790+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865926000 msgr2=0x55f865877600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.790+0000 7f6844f62f40 1 --2- 172.21.15.173:0/2289439123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865926000 0x55f865877600 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x55f865910810 tx=0x55f8658eaa80 comp rx=0 tx=0).stop 2024-09-13T23:57:03.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.790+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 reap_dead start 2024-09-13T23:57:03.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.790+0000 7f6842f1a700 1 -- 172.21.15.173:0/2289439123 reap_dead start 2024-09-13T23:57:03.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.790+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 shutdown_connections 2024-09-13T23:57:03.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.790+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 >> 172.21.15.173:0/2289439123 conn(0x55f865591800 msgr2=0x55f865691800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.790+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 shutdown_connections 2024-09-13T23:57:03.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.790+0000 7f6844f62f40 1 -- 172.21.15.173:0/2289439123 wait complete. 2024-09-13T23:57:03.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.794+0000 7f6844f62f40 1 -- 172.21.15.173:0/2119700488 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f8659c4800 msgr2=0x55f865a6c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.794+0000 7f6844f62f40 1 --2- 172.21.15.173:0/2119700488 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f8659c4800 0x55f865a6c000 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55f865969290 tx=0x55f8658ea720 comp rx=0 tx=0).stop 2024-09-13T23:57:03.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.794+0000 7f6844f62f40 1 -- 172.21.15.173:0/2119700488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f8659c5000 msgr2=0x55f865879180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.794+0000 7f6844f62f40 1 --2- 172.21.15.173:0/2119700488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f8659c5000 0x55f865879180 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x55f8659dc2a0 tx=0x55f8658eb980 comp rx=0 tx=0).stop 2024-09-13T23:57:03.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.794+0000 7f6844f62f40 1 -- 172.21.15.173:0/2119700488 shutdown_connections 2024-09-13T23:57:03.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.794+0000 7f6844f62f40 1 --2- 172.21.15.173:0/2119700488 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f8659c4800 0x55f865a6c000 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.794+0000 7f6844f62f40 1 --2- 172.21.15.173:0/2119700488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f8659c5000 0x55f865879180 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.794+0000 7f6844f62f40 1 -- 172.21.15.173:0/2119700488 >> 172.21.15.173:0/2119700488 conn(0x55f8659c4c00 msgr2=0x55f865692000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.794+0000 7f6844f62f40 1 -- 172.21.15.173:0/2119700488 shutdown_connections 2024-09-13T23:57:03.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.794+0000 7f6844f62f40 1 -- 172.21.15.173:0/2119700488 wait complete. 2024-09-13T23:57:03.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.794+0000 7f6844f62f40 1 -- 172.21.15.173:0/728936704 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f865591c00 msgr2=0x55f865877080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.794+0000 7f6844f62f40 1 --2- 172.21.15.173:0/728936704 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f865591c00 0x55f865877080 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55f8656edf20 tx=0x55f8658ea780 comp rx=0 tx=0).stop 2024-09-13T23:57:03.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.794+0000 7f6844f62f40 1 -- 172.21.15.173:0/728936704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865591400 msgr2=0x55f865876b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.794+0000 7f6844f62f40 1 --2- 172.21.15.173:0/728936704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865591400 0x55f865876b00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x55f8656edef0 tx=0x55f865695920 comp rx=0 tx=0).stop 2024-09-13T23:57:03.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.794+0000 7f6844f62f40 1 -- 172.21.15.173:0/728936704 shutdown_connections 2024-09-13T23:57:03.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.794+0000 7f6844f62f40 1 --2- 172.21.15.173:0/728936704 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f865591c00 0x55f865877080 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.794+0000 7f6844f62f40 1 --2- 172.21.15.173:0/728936704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f865591400 0x55f865876b00 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.794+0000 7f6844f62f40 1 -- 172.21.15.173:0/728936704 >> 172.21.15.173:0/728936704 conn(0x55f865590c00 msgr2=0x55f865691000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.794+0000 7f6844f62f40 1 -- 172.21.15.173:0/728936704 shutdown_connections 2024-09-13T23:57:03.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.794+0000 7f6844f62f40 1 -- 172.21.15.173:0/728936704 wait complete. 2024-09-13T23:57:03.801 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:03.802 INFO:teuthology.orchestra.run.smithi173.stdout: "stats": { 2024-09-13T23:57:03.802 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 3, 2024-09-13T23:57:03.802 INFO:teuthology.orchestra.run.smithi173.stdout: "size_actual": 4096, 2024-09-13T23:57:03.802 INFO:teuthology.orchestra.run.smithi173.stdout: "size_kb": 1, 2024-09-13T23:57:03.802 INFO:teuthology.orchestra.run.smithi173.stdout: "size_kb_actual": 4, 2024-09-13T23:57:03.802 INFO:teuthology.orchestra.run.smithi173.stdout: "num_objects": 1 2024-09-13T23:57:03.802 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:03.802 INFO:teuthology.orchestra.run.smithi173.stdout: "last_stats_sync": "2024-09-13T23:57:03.769011Z", 2024-09-13T23:57:03.802 INFO:teuthology.orchestra.run.smithi173.stdout: "last_stats_update": "2024-09-13T23:57:03.766661Z" 2024-09-13T23:57:03.802 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:03.803 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-13T23:57:03.769011Z', 'last_stats_update': '2024-09-13T23:57:03.766661Z'} 2024-09-13T23:57:03.813 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:57:03.813 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-13T23:57:03.814 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-13T23:57:03.814 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-13T23:57:03.887 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:03.887 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:03.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.882+0000 7f97d9451f40 1 Processor -- start 2024-09-13T23:57:03.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.882+0000 7f97d9451f40 1 -- start start 2024-09-13T23:57:03.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.882+0000 7f97d9451f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x5559ef8d9400 0x5559efbbe580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.882+0000 7f97d9451f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5559ef99d500 con 0x5559ef8d9000 2024-09-13T23:57:03.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.882+0000 7f97d9451f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x5559ef966a00 con 0x5559ef8d9400 2024-09-13T23:57:03.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.882+0000 7f97d7409700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x5559ef8d9400 0x5559efbbe580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.882+0000 7f97d7c0a700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x5559ef8d9000 0x5559ef9d8800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47416/0 (socket says 172.21.15.173:47416) 2024-09-13T23:57:03.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.882+0000 7f97d7c0a700 1 -- 172.21.15.173:0/4173953637 learned_addr learned my addr 172.21.15.173:0/4173953637 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:03.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.886+0000 7f97d7409700 1 -- 172.21.15.173:0/4173953637 >> v1:172.21.15.87:6789/0 conn(0x5559ef8d9000 legacy=0x5559ef9d8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.886+0000 7f97d7409700 1 -- 172.21.15.173:0/4173953637 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559ef8ebd40 con 0x5559ef8d9400 2024-09-13T23:57:03.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.886+0000 7f97d7409700 1 --2- 172.21.15.173:0/4173953637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9400 0x5559efbbe580 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x5559efbb9920 tx=0x5559ef9dd920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83429516838bee30 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.886+0000 7f97d6c08700 1 -- 172.21.15.173:0/4173953637 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559ef97d4a0 con 0x5559ef8d9400 2024-09-13T23:57:03.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.886+0000 7f97d6c08700 1 -- 172.21.15.173:0/4173953637 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5559ef99d800 con 0x5559ef8d9400 2024-09-13T23:57:03.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.886+0000 7f97d6c08700 1 -- 172.21.15.173:0/4173953637 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559ef97d600 con 0x5559ef8d9400 2024-09-13T23:57:03.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.886+0000 7f97d9451f40 1 -- 172.21.15.173:0/4173953637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9400 msgr2=0x5559efbbe580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.886+0000 7f97d9451f40 1 --2- 172.21.15.173:0/4173953637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9400 0x5559efbbe580 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x5559efbb9920 tx=0x5559ef9dd920 comp rx=0 tx=0).stop 2024-09-13T23:57:03.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.886+0000 7f97d9451f40 1 -- 172.21.15.173:0/4173953637 shutdown_connections 2024-09-13T23:57:03.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.886+0000 7f97d9451f40 1 --2- 172.21.15.173:0/4173953637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9400 0x5559efbbe580 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.886+0000 7f97d9451f40 1 -- 172.21.15.173:0/4173953637 >> 172.21.15.173:0/4173953637 conn(0x5559ef8d8c00 msgr2=0x5559ef9d8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.886+0000 7f97d9451f40 1 -- 172.21.15.173:0/4173953637 shutdown_connections 2024-09-13T23:57:03.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.886+0000 7f97d9451f40 1 -- 172.21.15.173:0/4173953637 wait complete. 2024-09-13T23:57:03.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.886+0000 7f97d9451f40 1 Processor -- start 2024-09-13T23:57:03.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.886+0000 7f97d9451f40 1 -- start start 2024-09-13T23:57:03.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.886+0000 7f97d9451f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9000 0x5559efbbe580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.886+0000 7f97d9451f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ef966500 con 0x5559ef8d9000 2024-09-13T23:57:03.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.886+0000 7f97d7c0a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9000 0x5559efbbe580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.886+0000 7f97d7c0a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9000 0x5559efbbe580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49894/0 (socket says 172.21.15.173:49894) 2024-09-13T23:57:03.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.886+0000 7f97d7c0a700 1 -- 172.21.15.173:0/3581300895 learned_addr learned my addr 172.21.15.173:0/3581300895 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.886+0000 7f97d7c0a700 1 -- 172.21.15.173:0/3581300895 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559ef8ebba0 con 0x5559ef8d9000 2024-09-13T23:57:03.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.890+0000 7f97d7c0a700 1 --2- 172.21.15.173:0/3581300895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9000 0x5559efbbe580 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x5559f073d8c0 tx=0x5559ef9ddb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366e628a3858659 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.890+0000 7f97d6407700 1 -- 172.21.15.173:0/3581300895 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559ef97d4a0 con 0x5559ef8d9000 2024-09-13T23:57:03.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.890+0000 7f97d6407700 1 -- 172.21.15.173:0/3581300895 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5559ef99db00 con 0x5559ef8d9000 2024-09-13T23:57:03.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.890+0000 7f97d6407700 1 -- 172.21.15.173:0/3581300895 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559ef97d600 con 0x5559ef8d9000 2024-09-13T23:57:03.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.890+0000 7f97d9451f40 1 -- 172.21.15.173:0/3581300895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9000 msgr2=0x5559efbbe580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.890+0000 7f97d9451f40 1 --2- 172.21.15.173:0/3581300895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9000 0x5559efbbe580 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x5559f073d8c0 tx=0x5559ef9ddb60 comp rx=0 tx=0).stop 2024-09-13T23:57:03.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.890+0000 7f97d9451f40 1 -- 172.21.15.173:0/3581300895 shutdown_connections 2024-09-13T23:57:03.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.890+0000 7f97d9451f40 1 --2- 172.21.15.173:0/3581300895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9000 0x5559efbbe580 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.890+0000 7f97d9451f40 1 -- 172.21.15.173:0/3581300895 >> 172.21.15.173:0/3581300895 conn(0x5559ef8d8c00 msgr2=0x5559ef9d9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.890+0000 7f97d9451f40 1 -- 172.21.15.173:0/3581300895 shutdown_connections 2024-09-13T23:57:03.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.890+0000 7f97d9451f40 1 -- 172.21.15.173:0/3581300895 wait complete. 2024-09-13T23:57:03.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.890+0000 7f97d9451f40 1 Processor -- start 2024-09-13T23:57:03.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.890+0000 7f97d9451f40 1 -- start start 2024-09-13T23:57:03.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.890+0000 7f97d9451f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9000 0x5559efbbe580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.890+0000 7f97d9451f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ef9663c0 con 0x5559ef8d9000 2024-09-13T23:57:03.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.890+0000 7f97d7c0a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9000 0x5559efbbe580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.890+0000 7f97d7c0a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9000 0x5559efbbe580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49900/0 (socket says 172.21.15.173:49900) 2024-09-13T23:57:03.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.890+0000 7f97d7c0a700 1 -- 172.21.15.173:0/809644060 learned_addr learned my addr 172.21.15.173:0/809644060 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.894+0000 7f97d7c0a700 1 -- 172.21.15.173:0/809644060 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559ef8eba00 con 0x5559ef8d9000 2024-09-13T23:57:03.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.894+0000 7f97d7c0a700 1 --2- 172.21.15.173:0/809644060 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9000 0x5559efbbe580 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x5559f073daa0 tx=0x5559ef9dda40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.894+0000 7f97d4c04700 1 -- 172.21.15.173:0/809644060 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559ef97d8c0 con 0x5559ef8d9000 2024-09-13T23:57:03.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.894+0000 7f97d4c04700 1 -- 172.21.15.173:0/809644060 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5559ef99dc80 con 0x5559ef8d9000 2024-09-13T23:57:03.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.894+0000 7f97d9451f40 1 -- 172.21.15.173:0/809644060 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5559ef8eb860 con 0x5559ef8d9000 2024-09-13T23:57:03.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.894+0000 7f97d4c04700 1 -- 172.21.15.173:0/809644060 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559ef97d4a0 con 0x5559ef8d9000 2024-09-13T23:57:03.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.894+0000 7f97d9451f40 1 -- 172.21.15.173:0/809644060 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5559ef8eb6c0 con 0x5559ef8d9000 2024-09-13T23:57:03.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.894+0000 7f97d9451f40 1 Processor -- start 2024-09-13T23:57:03.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.894+0000 7f97d9451f40 1 -- start start 2024-09-13T23:57:03.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.894+0000 7f97d4c04700 1 -- 172.21.15.173:0/809644060 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x5559ef9d2b00 con 0x5559ef8d9000 2024-09-13T23:57:03.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.894+0000 7f97d9451f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9800 0x5559efbbeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.894+0000 7f97d9451f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ef8fe640 con 0x5559ef8d9800 2024-09-13T23:57:03.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.894+0000 7f97d4c04700 1 --2- 172.21.15.173:0/809644060 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559efc76000 0x5559efbbf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.894+0000 7f97d840b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9800 0x5559efbbeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.894+0000 7f97d4c04700 1 -- 172.21.15.173:0/809644060 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5559ef93f180 con 0x5559ef8d9000 2024-09-13T23:57:03.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.894+0000 7f97d840b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9800 0x5559efbbeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49904/0 (socket says 172.21.15.173:49904) 2024-09-13T23:57:03.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.894+0000 7f97d840b700 1 -- 172.21.15.173:0/2102277283 learned_addr learned my addr 172.21.15.173:0/2102277283 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.894+0000 7f97d7c0a700 1 --2- 172.21.15.173:0/809644060 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559efc76000 0x5559efbbf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.894+0000 7f97d7c0a700 1 --2- 172.21.15.173:0/809644060 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559efc76000 0x5559efbbf080 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x5559f0750ff0 tx=0x5559efc38240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d840b700 1 -- 172.21.15.173:0/2102277283 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559ef8ea000 con 0x5559ef8d9800 2024-09-13T23:57:03.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d840b700 1 --2- 172.21.15.173:0/2102277283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9800 0x5559efbbeb00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x5559f0750c00 tx=0x5559efc38d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1a0e0b40bace6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d23ff700 1 -- 172.21.15.173:0/2102277283 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559ef97d8c0 con 0x5559ef8d9800 2024-09-13T23:57:03.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d23ff700 1 -- 172.21.15.173:0/2102277283 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5559efc82000 con 0x5559ef8d9800 2024-09-13T23:57:03.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d23ff700 1 -- 172.21.15.173:0/2102277283 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559ef97d4a0 con 0x5559ef8d9800 2024-09-13T23:57:03.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d9451f40 1 -- 172.21.15.173:0/2102277283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9800 msgr2=0x5559efbbeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d9451f40 1 --2- 172.21.15.173:0/2102277283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9800 0x5559efbbeb00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x5559f0750c00 tx=0x5559efc38d20 comp rx=0 tx=0).stop 2024-09-13T23:57:03.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d9451f40 1 -- 172.21.15.173:0/2102277283 shutdown_connections 2024-09-13T23:57:03.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d9451f40 1 --2- 172.21.15.173:0/2102277283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9800 0x5559efbbeb00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d9451f40 1 -- 172.21.15.173:0/2102277283 >> 172.21.15.173:0/2102277283 conn(0x5559ef8d9400 msgr2=0x5559ef9d9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d9451f40 1 -- 172.21.15.173:0/2102277283 shutdown_connections 2024-09-13T23:57:03.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d9451f40 1 -- 172.21.15.173:0/2102277283 wait complete. 2024-09-13T23:57:03.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d9451f40 1 Processor -- start 2024-09-13T23:57:03.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d9451f40 1 -- start start 2024-09-13T23:57:03.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d9451f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9800 0x5559efbbeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d9451f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ef8fe8c0 con 0x5559ef8d9800 2024-09-13T23:57:03.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d840b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9800 0x5559efbbeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d840b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9800 0x5559efbbeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49914/0 (socket says 172.21.15.173:49914) 2024-09-13T23:57:03.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 learned_addr learned my addr 172.21.15.173:0/2691448580 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559ef8eaea0 con 0x5559ef8d9800 2024-09-13T23:57:03.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d840b700 1 --2- 172.21.15.173:0/2691448580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9800 0x5559efbbeb00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x5559f07500c0 tx=0x5559efc38840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d0bfc700 1 -- 172.21.15.173:0/2691448580 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559ef97db80 con 0x5559ef8d9800 2024-09-13T23:57:03.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d0bfc700 1 -- 172.21.15.173:0/2691448580 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5559efc82180 con 0x5559ef8d9800 2024-09-13T23:57:03.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5559ef8ea820 con 0x5559ef8d9800 2024-09-13T23:57:03.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d0bfc700 1 -- 172.21.15.173:0/2691448580 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559ef97d8c0 con 0x5559ef8d9800 2024-09-13T23:57:03.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.898+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5559ef8ea9c0 con 0x5559ef8d9800 2024-09-13T23:57:03.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.902+0000 7f97d9451f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.902+0000 7f97d0bfc700 1 -- 172.21.15.173:0/2691448580 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x5559ef9d2dc0 con 0x5559ef8d9800 2024-09-13T23:57:03.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.902+0000 7f97d0bfc700 1 --2- 172.21.15.173:0/2691448580 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559efc76c00 0x5559efbbf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.902+0000 7f97d0bfc700 1 -- 172.21.15.173:0/2691448580 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5559ef93f340 con 0x5559ef8d9800 2024-09-13T23:57:03.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.902+0000 7f97d9451f40 1 --2- 172.21.15.173:0/2691448580 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5559efc77000 0x5559efbbfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.902+0000 7f97d7409700 1 --2- 172.21.15.173:0/2691448580 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559efc76c00 0x5559efbbf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.902+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77400 con 0x5559efc77000 2024-09-13T23:57:03.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.902+0000 7f97d840b700 1 --2- 172.21.15.173:0/2691448580 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5559efc77000 0x5559efbbfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.902+0000 7f97d7409700 1 --2- 172.21.15.173:0/2691448580 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559efc76c00 0x5559efbbf600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x5559efbb9920 tx=0x5559ef9dd800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.902+0000 7f97d840b700 1 --2- 172.21.15.173:0/2691448580 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5559efc77000 0x5559efbbfb80 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.902+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5559efd22b40 con 0x5559efc77000 2024-09-13T23:57:03.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.902+0000 7f97d9451f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.902+0000 7f97d9451f40 20 realm 2024-09-13T23:57:03.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.902+0000 7f97d9451f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.902+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77000 2024-09-13T23:57:03.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.902+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5559efd22b40 con 0x5559efc77000 2024-09-13T23:57:03.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.902+0000 7f97d9451f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.902+0000 7f97d9451f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:03.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.902+0000 7f97d9451f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.902+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77c00 con 0x5559efc77000 2024-09-13T23:57:03.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.906+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5559efd22b40 con 0x5559efc77000 2024-09-13T23:57:03.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.906+0000 7f97d9451f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.906+0000 7f97d9451f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.906+0000 7f97d9451f40 1 --2- 172.21.15.173:0/2691448580 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5559efc77400 0x5559efbc0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.906+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77400 2024-09-13T23:57:03.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.906+0000 7f97d7c0a700 1 --2- 172.21.15.173:0/2691448580 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5559efc77400 0x5559efbc0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.906+0000 7f97d7c0a700 1 --2- 172.21.15.173:0/2691448580 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5559efc77400 0x5559efbc0100 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.906+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5559efd23200 con 0x5559efc77400 2024-09-13T23:57:03.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.906+0000 7f97d9451f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:03.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.906+0000 7f97d9451f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.906+0000 7f97d9451f40 1 --2- 172.21.15.173:0/2691448580 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5559efc77c00 0x5559efbc0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.906+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efd38000 con 0x5559efc77c00 2024-09-13T23:57:03.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.906+0000 7f97d7409700 1 --2- 172.21.15.173:0/2691448580 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5559efc77c00 0x5559efbc0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.906+0000 7f97d7409700 1 --2- 172.21.15.173:0/2691448580 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5559efc77c00 0x5559efbc0680 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.906+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5559efd23440 con 0x5559efc77c00 2024-09-13T23:57:03.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.906+0000 7f97d9451f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:03.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.906+0000 7f97d9451f40 20 searching for the correct realm 2024-09-13T23:57:03.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.906+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efd38400 con 0x5559efc77c00 2024-09-13T23:57:03.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.910+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5559efd23440 con 0x5559efc77c00 2024-09-13T23:57:03.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.910+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efd38000 con 0x5559efc77400 2024-09-13T23:57:03.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.910+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd23200 con 0x5559efc77400 2024-09-13T23:57:03.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.910+0000 7f97d7c0a700 1 --2- 172.21.15.173:0/2691448580 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5559efd38000 0x5559efbc0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.910+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efd38000 2024-09-13T23:57:03.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.910+0000 7f97d840b700 1 --2- 172.21.15.173:0/2691448580 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5559efd38000 0x5559efbc0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.910+0000 7f97d840b700 1 --2- 172.21.15.173:0/2691448580 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5559efd38000 0x5559efbc0c00 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.910+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd22b40 con 0x5559efd38000 2024-09-13T23:57:03.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.910+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77000 2024-09-13T23:57:03.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.910+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5559efd22b40 con 0x5559efc77000 2024-09-13T23:57:03.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.910+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77000 2024-09-13T23:57:03.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.910+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd22b40 con 0x5559efc77000 2024-09-13T23:57:03.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.910+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77c00 2024-09-13T23:57:03.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.910+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd23440 con 0x5559efc77c00 2024-09-13T23:57:03.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.914+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77000 2024-09-13T23:57:03.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.914+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd22b40 con 0x5559efc77000 2024-09-13T23:57:03.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.914+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77400 2024-09-13T23:57:03.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.914+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd23200 con 0x5559efc77400 2024-09-13T23:57:03.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.914+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77400 2024-09-13T23:57:03.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.914+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd23200 con 0x5559efc77400 2024-09-13T23:57:03.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.914+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77000 2024-09-13T23:57:03.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.914+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd22b40 con 0x5559efc77000 2024-09-13T23:57:03.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.914+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efd38000 2024-09-13T23:57:03.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.914+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd22b40 con 0x5559efd38000 2024-09-13T23:57:03.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.914+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77000 2024-09-13T23:57:03.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.914+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd22b40 con 0x5559efc77000 2024-09-13T23:57:03.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.914+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efd38000 2024-09-13T23:57:03.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.918+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd22b40 con 0x5559efd38000 2024-09-13T23:57:03.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.918+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77400 2024-09-13T23:57:03.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.918+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd23200 con 0x5559efc77400 2024-09-13T23:57:03.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.918+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77c00 2024-09-13T23:57:03.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.918+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd23440 con 0x5559efc77c00 2024-09-13T23:57:03.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.918+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77000 2024-09-13T23:57:03.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.918+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd22b40 con 0x5559efc77000 2024-09-13T23:57:03.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.918+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77400 2024-09-13T23:57:03.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.918+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd23200 con 0x5559efc77400 2024-09-13T23:57:03.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.918+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77c00 2024-09-13T23:57:03.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.918+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd23440 con 0x5559efc77c00 2024-09-13T23:57:03.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.918+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77000 2024-09-13T23:57:03.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.918+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd22b40 con 0x5559efc77000 2024-09-13T23:57:03.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.918+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77000 2024-09-13T23:57:03.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.922+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd22b40 con 0x5559efc77000 2024-09-13T23:57:03.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.922+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77000 2024-09-13T23:57:03.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.922+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd22b40 con 0x5559efc77000 2024-09-13T23:57:03.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.922+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77c00 2024-09-13T23:57:03.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.922+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd23440 con 0x5559efc77c00 2024-09-13T23:57:03.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.922+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efd38000 2024-09-13T23:57:03.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.922+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd22b40 con 0x5559efd38000 2024-09-13T23:57:03.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.922+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77000 2024-09-13T23:57:03.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.922+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd22b40 con 0x5559efc77000 2024-09-13T23:57:03.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.922+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efd38000 2024-09-13T23:57:03.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.922+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd22b40 con 0x5559efd38000 2024-09-13T23:57:03.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.922+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77c00 2024-09-13T23:57:03.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.922+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd23440 con 0x5559efc77c00 2024-09-13T23:57:03.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.922+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efd38000 2024-09-13T23:57:03.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.926+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd22b40 con 0x5559efd38000 2024-09-13T23:57:03.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.926+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77400 2024-09-13T23:57:03.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.926+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd23200 con 0x5559efc77400 2024-09-13T23:57:03.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.926+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77400 2024-09-13T23:57:03.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.926+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd23200 con 0x5559efc77400 2024-09-13T23:57:03.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.926+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77c00 2024-09-13T23:57:03.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.926+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd23440 con 0x5559efc77c00 2024-09-13T23:57:03.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.926+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77400 2024-09-13T23:57:03.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.926+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5559efd23200 con 0x5559efc77400 2024-09-13T23:57:03.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.926+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efc77400 2024-09-13T23:57:03.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.926+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5559efd23200 con 0x5559efc77400 2024-09-13T23:57:03.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:03.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:03.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:03.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:03.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efd38800 con 0x5559efc77000 2024-09-13T23:57:03.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5559efd22b40 con 0x5559efc77000 2024-09-13T23:57:03.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efd38c00 con 0x5559efc77400 2024-09-13T23:57:03.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5559efd23200 con 0x5559efc77400 2024-09-13T23:57:03.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:03.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efd39000 con 0x5559efc77000 2024-09-13T23:57:03.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5559efd22b40 con 0x5559efc77000 2024-09-13T23:57:03.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:03.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 20 zone default found 2024-09-13T23:57:03.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 4 Realm: () 2024-09-13T23:57:03.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:03.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:03.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:03.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 20 zonegroup default 2024-09-13T23:57:03.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efd39400 con 0x5559efd38000 2024-09-13T23:57:03.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5559efd22b40 con 0x5559efd38000 2024-09-13T23:57:03.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efd39800 con 0x5559efc77c00 2024-09-13T23:57:03.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5559efd23440 con 0x5559efc77c00 2024-09-13T23:57:03.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.930+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efd39c00 con 0x5559efc77c00 2024-09-13T23:57:03.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.934+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5559efd23440 con 0x5559efc77c00 2024-09-13T23:57:03.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.934+0000 7f97d9451f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:03.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.934+0000 7f97d9451f40 20 started sync module instance, tier type = 2024-09-13T23:57:03.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.934+0000 7f97d9451f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:03.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.934+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc22000 con 0x5559efc77400 2024-09-13T23:57:03.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.934+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd23200 con 0x5559efc77400 2024-09-13T23:57:03.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.934+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93844762483456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc22400 con 0x5559efc77400 2024-09-13T23:57:03.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.934+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc22800 con 0x5559efc77000 2024-09-13T23:57:03.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.938+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd22b40 con 0x5559efc77000 2024-09-13T23:57:03.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.938+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93844762484608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc22c00 con 0x5559efc77000 2024-09-13T23:57:03.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.938+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc23000 con 0x5559efc77400 2024-09-13T23:57:03.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.938+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93844762483456] v33'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd23200 con 0x5559efc77400 2024-09-13T23:57:03.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.942+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93844762484608] v33'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd22b40 con 0x5559efc77000 2024-09-13T23:57:03.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.942+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd23200 con 0x5559efc77400 2024-09-13T23:57:03.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.942+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93844762485760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc23400 con 0x5559efc77400 2024-09-13T23:57:03.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.942+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc23800 con 0x5559efd38000 2024-09-13T23:57:03.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.942+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd22b40 con 0x5559efd38000 2024-09-13T23:57:03.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.942+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93844762486912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc23c00 con 0x5559efd38000 2024-09-13T23:57:03.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.942+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc22800 con 0x5559efc77400 2024-09-13T23:57:03.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.946+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93844762485760] v33'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd23200 con 0x5559efc77400 2024-09-13T23:57:03.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.946+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93844762486912] v33'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd22b40 con 0x5559efd38000 2024-09-13T23:57:03.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.946+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd23200 con 0x5559efc77400 2024-09-13T23:57:03.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.946+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93844762488064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc22000 con 0x5559efc77400 2024-09-13T23:57:03.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.946+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efd38800 con 0x5559efc77c00 2024-09-13T23:57:03.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.950+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd23440 con 0x5559efc77c00 2024-09-13T23:57:03.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.950+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93844762489216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efd39000 con 0x5559efc77c00 2024-09-13T23:57:03.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.950+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efd39400 con 0x5559efc77c00 2024-09-13T23:57:03.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.950+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93844762488064] v33'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd23200 con 0x5559efc77400 2024-09-13T23:57:03.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.950+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93844762489216] v33'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd23440 con 0x5559efc77c00 2024-09-13T23:57:03.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.950+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd23440 con 0x5559efc77c00 2024-09-13T23:57:03.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.950+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93844762490368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efd38c00 con 0x5559efc77c00 2024-09-13T23:57:03.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.950+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc77800 con 0x5559efd38000 2024-09-13T23:57:03.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.954+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93844762490368] v33'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd23440 con 0x5559efc77c00 2024-09-13T23:57:03.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.954+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd22b40 con 0x5559efd38000 2024-09-13T23:57:03.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.954+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93844762491520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc22400 con 0x5559efd38000 2024-09-13T23:57:03.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.954+0000 7f97d9451f40 20 add_watcher() i=0 2024-09-13T23:57:03.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.954+0000 7f97d9451f40 20 add_watcher() i=1 2024-09-13T23:57:03.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.954+0000 7f97d9451f40 20 add_watcher() i=2 2024-09-13T23:57:03.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.954+0000 7f97d9451f40 20 add_watcher() i=3 2024-09-13T23:57:03.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.954+0000 7f97d9451f40 20 add_watcher() i=4 2024-09-13T23:57:03.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.954+0000 7f97d9451f40 20 add_watcher() i=5 2024-09-13T23:57:03.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.954+0000 7f97d9451f40 20 add_watcher() i=6 2024-09-13T23:57:03.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.954+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93844762491520] v33'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd22b40 con 0x5559efd38000 2024-09-13T23:57:03.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.954+0000 7f97d9451f40 20 add_watcher() i=7 2024-09-13T23:57:03.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.954+0000 7f97d9451f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:03.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.954+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc23000 con 0x5559efc77000 2024-09-13T23:57:03.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.954+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5559efd22b40 con 0x5559efc77000 2024-09-13T23:57:03.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.954+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93844764139520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc23400 con 0x5559efc77000 2024-09-13T23:57:03.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.958+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93844764139520] v33'104 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5559efd22b40 con 0x5559efc77000 2024-09-13T23:57:03.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.958+0000 7f97bebd8700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:03.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.958+0000 7f97d9451f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:03.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.958+0000 7f97d9451f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:03.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.958+0000 7f97d9451f40 1 Processor -- start 2024-09-13T23:57:03.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.958+0000 7f97d9451f40 1 -- start start 2024-09-13T23:57:03.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.958+0000 7f97d9451f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559efd38400 0x5559efbc1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.958+0000 7f97d9451f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ef9663c0 con 0x5559efd38400 2024-09-13T23:57:03.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.958+0000 7f97d7409700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559efd38400 0x5559efbc1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.958+0000 7f97d7409700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559efd38400 0x5559efbc1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49926/0 (socket says 172.21.15.173:49926) 2024-09-13T23:57:03.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.958+0000 7f97d7409700 1 -- 172.21.15.173:0/1897924908 learned_addr learned my addr 172.21.15.173:0/1897924908 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.958+0000 7f97d7409700 1 -- 172.21.15.173:0/1897924908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559ef8eab60 con 0x5559efd38400 2024-09-13T23:57:03.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.958+0000 7f97d7409700 1 --2- 172.21.15.173:0/1897924908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559efd38400 0x5559efbc1180 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x5559efc69b00 tx=0x5559ef9dd980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab359227e77dc4b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.958+0000 7f97be3d7700 1 -- 172.21.15.173:0/1897924908 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559ef97d760 con 0x5559efd38400 2024-09-13T23:57:03.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.958+0000 7f97be3d7700 1 -- 172.21.15.173:0/1897924908 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5559efc82600 con 0x5559efd38400 2024-09-13T23:57:03.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.958+0000 7f97be3d7700 1 -- 172.21.15.173:0/1897924908 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559efd5c000 con 0x5559efd38400 2024-09-13T23:57:03.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.961+0000 7f97d9451f40 1 -- 172.21.15.173:0/1897924908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559efd38400 msgr2=0x5559efbc1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:03.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.961+0000 7f97d9451f40 1 --2- 172.21.15.173:0/1897924908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559efd38400 0x5559efbc1180 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x5559efc69b00 tx=0x5559ef9dd980 comp rx=0 tx=0).stop 2024-09-13T23:57:03.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.961+0000 7f97d9451f40 1 -- 172.21.15.173:0/1897924908 shutdown_connections 2024-09-13T23:57:03.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.961+0000 7f97d9451f40 1 --2- 172.21.15.173:0/1897924908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559efd38400 0x5559efbc1180 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:03.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.961+0000 7f97d9451f40 1 -- 172.21.15.173:0/1897924908 >> 172.21.15.173:0/1897924908 conn(0x5559efc22800 msgr2=0x5559ef9da000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:03.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.961+0000 7f97d9451f40 1 -- 172.21.15.173:0/1897924908 shutdown_connections 2024-09-13T23:57:03.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.961+0000 7f97d9451f40 1 -- 172.21.15.173:0/1897924908 wait complete. 2024-09-13T23:57:03.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.961+0000 7f97d9451f40 1 Processor -- start 2024-09-13T23:57:03.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.961+0000 7f97d9451f40 1 -- start start 2024-09-13T23:57:03.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.961+0000 7f97d9451f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559efd38400 0x5559efbc1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.961+0000 7f97d9451f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ef966500 con 0x5559efd38400 2024-09-13T23:57:03.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.961+0000 7f97d7409700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559efd38400 0x5559efbc1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.961+0000 7f97d7409700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559efd38400 0x5559efbc1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49942/0 (socket says 172.21.15.173:49942) 2024-09-13T23:57:03.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.961+0000 7f97d7409700 1 -- 172.21.15.173:0/2266165573 learned_addr learned my addr 172.21.15.173:0/2266165573 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:03.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.961+0000 7f97d7409700 1 -- 172.21.15.173:0/2266165573 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559ef8ead00 con 0x5559efd38400 2024-09-13T23:57:03.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.961+0000 7f97d7409700 1 --2- 172.21.15.173:0/2266165573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559efd38400 0x5559efbc1180 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x5559efd5a150 tx=0x5559efc39c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.961+0000 7f97bcbd4700 1 -- 172.21.15.173:0/2266165573 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559efd5c160 con 0x5559efd38400 2024-09-13T23:57:03.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.961+0000 7f97bcbd4700 1 -- 172.21.15.173:0/2266165573 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5559efc82300 con 0x5559efd38400 2024-09-13T23:57:03.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.961+0000 7f97bcbd4700 1 -- 172.21.15.173:0/2266165573 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5559efd5c2c0 con 0x5559efd38400 2024-09-13T23:57:03.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.961+0000 7f97d9451f40 1 -- 172.21.15.173:0/2266165573 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5559ef8ea340 con 0x5559efd38400 2024-09-13T23:57:03.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.961+0000 7f97d9451f40 1 -- 172.21.15.173:0/2266165573 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5559ef8ebd40 con 0x5559efd38400 2024-09-13T23:57:03.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.965+0000 7f97bcbd4700 1 -- 172.21.15.173:0/2266165573 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x5559ef9d3b80 con 0x5559efd38400 2024-09-13T23:57:03.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.965+0000 7f97bcbd4700 1 --2- 172.21.15.173:0/2266165573 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559efc77800 0x5559efdd2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:03.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.965+0000 7f97bcbd4700 1 -- 172.21.15.173:0/2266165573 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5559ef93f500 con 0x5559efd38400 2024-09-13T23:57:03.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.965+0000 7f97d840b700 1 --2- 172.21.15.173:0/2266165573 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559efc77800 0x5559efdd2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:03.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.965+0000 7f97d9451f40 5 note: GC not initialized 2024-09-13T23:57:03.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.965+0000 7f97d840b700 1 --2- 172.21.15.173:0/2266165573 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559efc77800 0x5559efdd2000 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x5559f0751230 tx=0x5559efd98ae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:03.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.965+0000 7f97ba3cf700 20 reqs_thread_entry: start 2024-09-13T23:57:03.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.965+0000 7f97d9451f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:03.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.965+0000 7f97d9451f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:03.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97b83cb700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:34 2024 2024-09-13T23:57:03.974 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:03.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d9451f40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:57:03.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d9451f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efd38800 con 0x5559efc77000 2024-09-13T23:57:03.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97b7ba9700 20 reqs_thread_entry: start 2024-09-13T23:57:03.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x5559efd22b40 con 0x5559efc77000 2024-09-13T23:57:03.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d9451f40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:57:03.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d9451f40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:57:03.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d9451f40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:03.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d9451f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:03.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d9451f40 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:57:03.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d9451f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc22c00 con 0x5559efd38000 2024-09-13T23:57:03.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x5559efd22b40 con 0x5559efd38000 2024-09-13T23:57:03.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d9451f40 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:57:03.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d9451f40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:57:03.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d9451f40 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:57:03.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d9451f40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 : miss 2024-09-13T23:57:03.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d9451f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 8.17 8:ea49432e:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc23800 con 0x5559efc77400 2024-09-13T23:57:03.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(64 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x5559efd23200 con 0x5559efc77400 2024-09-13T23:57:03.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d9451f40 20 rados_obj.operate() r=0 bl.length=352 2024-09-13T23:57:03.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d9451f40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 info.flags=0x17 2024-09-13T23:57:03.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d9451f40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 to cache LRU end 2024-09-13T23:57:03.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d9451f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:03.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d9451f40 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:57:03.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d9451f40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 2024-09-13T23:57:03.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d9451f40 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-13T23:57:03.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.969+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc23c00 con 0x5559efd38000 2024-09-13T23:57:03.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.973+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(65 foo.buckets [call] v33'17 uv17 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x5559efd22b40 con 0x5559efd38000 2024-09-13T23:57:03.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.973+0000 7f97d9451f40 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-13T23:57:03.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.973+0000 7f97d9451f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:03.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.973+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc22400 con 0x5559efd38000 2024-09-13T23:57:03.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.973+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+288 (crc 0 0 0) 0x5559efd22b40 con 0x5559efd38000 2024-09-13T23:57:03.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.973+0000 7f97d9451f40 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:57:03.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.973+0000 7f97d9451f40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-13T23:57:03.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.973+0000 7f97d9451f40 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:57:03.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.973+0000 7f97d9451f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:03.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.973+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc23400 con 0x5559efd38000 2024-09-13T23:57:03.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.977+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v33'18 uv18 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x5559efd22b40 con 0x5559efd38000 2024-09-13T23:57:03.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.977+0000 7f97d9451f40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T23:57:03.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.977+0000 7f97d9451f40 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:57:03.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.977+0000 7f97d9451f40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T23:57:03.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.977+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93844764141824 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc22c00 con 0x5559efc77c00 2024-09-13T23:57:03.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.977+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== watch-notify(notify (1) cookie 93844762490368 notify 141733920778 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x5559efd969c0 con 0x5559efc77c00 2024-09-13T23:57:03.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.977+0000 7f97d23ff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920778 cookie 93844762490368 notifier 4520 bl.length()=338 2024-09-13T23:57:03.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.977+0000 7f97d23ff700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T23:57:03.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.977+0000 7f97d23ff700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:57:03.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.977+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(68 notify.6 [notify cookie 93844764141824 out=8b] v0'0 uv105 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x5559efd23440 con 0x5559efc77c00 2024-09-13T23:57:03.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.977+0000 7f97d23ff700 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efe46000 con 0x5559efc77c00 2024-09-13T23:57:03.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.977+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd23440 con 0x5559efc77c00 2024-09-13T23:57:03.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.977+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== watch-notify(notify_complete (2) cookie 93844764141824 notify 141733920778 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5559efd96b60 con 0x5559efc77c00 2024-09-13T23:57:03.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.977+0000 7f97bebd8700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:03.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.977+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93844764139520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc23c00 con 0x5559efc77000 2024-09-13T23:57:03.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.981+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93844764139520] v33'105 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5559efd22b40 con 0x5559efc77000 2024-09-13T23:57:03.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.981+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93844762483456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efc22400 con 0x5559efc77400 2024-09-13T23:57:03.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.985+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93844762483456] v33'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd23200 con 0x5559efc77400 2024-09-13T23:57:03.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.985+0000 7f97d9451f40 20 remove_watcher() i=0 2024-09-13T23:57:03.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.985+0000 7f97d9451f40 2 removed watcher, disabling cache 2024-09-13T23:57:03.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.985+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93844762484608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efd38800 con 0x5559efc77000 2024-09-13T23:57:03.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.985+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93844762484608] v33'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd22b40 con 0x5559efc77000 2024-09-13T23:57:03.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.985+0000 7f97d9451f40 20 remove_watcher() i=1 2024-09-13T23:57:03.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.985+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93844762485760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efe46800 con 0x5559efc77400 2024-09-13T23:57:03.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.989+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93844762485760] v33'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd23200 con 0x5559efc77400 2024-09-13T23:57:03.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.989+0000 7f97d9451f40 20 remove_watcher() i=2 2024-09-13T23:57:03.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.989+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93844762486912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efe46c00 con 0x5559efd38000 2024-09-13T23:57:03.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.989+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93844762486912] v33'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd22b40 con 0x5559efd38000 2024-09-13T23:57:03.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.989+0000 7f97d9451f40 20 remove_watcher() i=3 2024-09-13T23:57:03.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.989+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93844762488064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efe47000 con 0x5559efc77400 2024-09-13T23:57:03.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.993+0000 7f97d7c0a700 1 -- 172.21.15.173:0/2691448580 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93844762488064] v33'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd23200 con 0x5559efc77400 2024-09-13T23:57:03.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.993+0000 7f97d9451f40 20 remove_watcher() i=4 2024-09-13T23:57:03.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.993+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93844762489216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efe47400 con 0x5559efc77c00 2024-09-13T23:57:04.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.997+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93844762489216] v33'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd23440 con 0x5559efc77c00 2024-09-13T23:57:04.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.997+0000 7f97d9451f40 20 remove_watcher() i=5 2024-09-13T23:57:04.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.997+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93844762490368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efe47800 con 0x5559efc77c00 2024-09-13T23:57:04.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.997+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 <== osd.3 v2:172.21.15.173:6800/4020038786 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93844762490368] v33'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd23440 con 0x5559efc77c00 2024-09-13T23:57:04.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.997+0000 7f97d9451f40 20 remove_watcher() i=6 2024-09-13T23:57:04.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:03.997+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93844762491520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5559efe47c00 con 0x5559efd38000 2024-09-13T23:57:04.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d840b700 1 -- 172.21.15.173:0/2691448580 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93844762491520] v33'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5559efd22b40 con 0x5559efd38000 2024-09-13T23:57:04.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 20 remove_watcher() i=7 2024-09-13T23:57:04.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5559efc77400 msgr2=0x5559efbc0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 --2- 172.21.15.173:0/2691448580 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5559efc77400 0x5559efbc0100 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5559efc77000 msgr2=0x5559efbbfb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 --2- 172.21.15.173:0/2691448580 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5559efc77000 0x5559efbbfb80 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5559efd38000 msgr2=0x5559efbc0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 --2- 172.21.15.173:0/2691448580 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5559efd38000 0x5559efbc0c00 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5559efc77c00 msgr2=0x5559efbc0680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 --2- 172.21.15.173:0/2691448580 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5559efc77c00 0x5559efbc0680 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559efc76c00 msgr2=0x5559efbbf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 --2- 172.21.15.173:0/2691448580 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559efc76c00 0x5559efbbf600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x5559efbb9920 tx=0x5559ef9dd800 comp rx=0 tx=0).stop 2024-09-13T23:57:04.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9800 msgr2=0x5559efbbeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 --2- 172.21.15.173:0/2691448580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9800 0x5559efbbeb00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x5559f07500c0 tx=0x5559efc38840 comp rx=0 tx=0).stop 2024-09-13T23:57:04.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d7409700 1 -- 172.21.15.173:0/2691448580 reap_dead start 2024-09-13T23:57:04.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 shutdown_connections 2024-09-13T23:57:04.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 --2- 172.21.15.173:0/2691448580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9800 0x5559efbbeb00 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 >> 172.21.15.173:0/2691448580 conn(0x5559ef8d9400 msgr2=0x5559ef9d9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 shutdown_connections 2024-09-13T23:57:04.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 -- 172.21.15.173:0/2691448580 wait complete. 2024-09-13T23:57:04.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 -- 172.21.15.173:0/2266165573 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559efc77800 msgr2=0x5559efdd2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 --2- 172.21.15.173:0/2266165573 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559efc77800 0x5559efdd2000 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x5559f0751230 tx=0x5559efd98ae0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 -- 172.21.15.173:0/2266165573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559efd38400 msgr2=0x5559efbc1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 --2- 172.21.15.173:0/2266165573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559efd38400 0x5559efbc1180 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x5559efd5a150 tx=0x5559efc39c20 comp rx=0 tx=0).stop 2024-09-13T23:57:04.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 -- 172.21.15.173:0/2266165573 shutdown_connections 2024-09-13T23:57:04.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 --2- 172.21.15.173:0/2266165573 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559efc77800 0x5559efdd2000 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 --2- 172.21.15.173:0/2266165573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559efd38400 0x5559efbc1180 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 -- 172.21.15.173:0/2266165573 >> 172.21.15.173:0/2266165573 conn(0x5559efc22800 msgr2=0x5559ef9da000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 -- 172.21.15.173:0/2266165573 shutdown_connections 2024-09-13T23:57:04.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 -- 172.21.15.173:0/2266165573 wait complete. 2024-09-13T23:57:04.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 -- 172.21.15.173:0/809644060 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559efc76000 msgr2=0x5559efbbf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 --2- 172.21.15.173:0/809644060 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559efc76000 0x5559efbbf080 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x5559f0750ff0 tx=0x5559efc38240 comp rx=0 tx=0).stop 2024-09-13T23:57:04.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 -- 172.21.15.173:0/809644060 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9000 msgr2=0x5559efbbe580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.001+0000 7f97d9451f40 1 --2- 172.21.15.173:0/809644060 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9000 0x5559efbbe580 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x5559f073daa0 tx=0x5559ef9dda40 comp rx=0 tx=0).stop 2024-09-13T23:57:04.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.005+0000 7f97d9451f40 1 -- 172.21.15.173:0/809644060 shutdown_connections 2024-09-13T23:57:04.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.005+0000 7f97d9451f40 1 --2- 172.21.15.173:0/809644060 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5559efc76000 0x5559efbbf080 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.005+0000 7f97d9451f40 1 --2- 172.21.15.173:0/809644060 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5559ef8d9000 0x5559efbbe580 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.005+0000 7f97d9451f40 1 -- 172.21.15.173:0/809644060 >> 172.21.15.173:0/809644060 conn(0x5559ef8d8c00 msgr2=0x5559ef9d9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.005+0000 7f97d9451f40 1 -- 172.21.15.173:0/809644060 shutdown_connections 2024-09-13T23:57:04.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.005+0000 7f97d9451f40 1 -- 172.21.15.173:0/809644060 wait complete. 2024-09-13T23:57:04.015 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T23:57:04.016 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T23:57:04.016 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-13T23:57:04.064 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:04.064 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:04.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.057+0000 7fd727049f40 1 Processor -- start 2024-09-13T23:57:04.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.057+0000 7fd727049f40 1 -- start start 2024-09-13T23:57:04.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.057+0000 7fd727049f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55716e4ff000 0x55716e7e4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.057+0000 7fd727049f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55716e5c3500 con 0x55716e4ff400 2024-09-13T23:57:04.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.057+0000 7fd727049f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55716e58ca00 con 0x55716e4ff000 2024-09-13T23:57:04.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.061+0000 7fd725802700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55716e4ff000 0x55716e7e4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.061+0000 7fd725001700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55716e4ff400 0x55716e5fe800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47428/0 (socket says 172.21.15.173:47428) 2024-09-13T23:57:04.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.061+0000 7fd725001700 1 -- 172.21.15.173:0/3211610124 learned_addr learned my addr 172.21.15.173:0/3211610124 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:04.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.061+0000 7fd725802700 1 -- 172.21.15.173:0/3211610124 >> v1:172.21.15.87:6789/0 conn(0x55716e4ff400 legacy=0x55716e5fe800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.061+0000 7fd725802700 1 -- 172.21.15.173:0/3211610124 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55716e511d40 con 0x55716e4ff000 2024-09-13T23:57:04.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.061+0000 7fd725802700 1 --2- 172.21.15.173:0/3211610124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff000 0x55716e7e4580 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x55716e7dfa70 tx=0x55716e603920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca6c05e1ca455dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.061+0000 7fd724800700 1 -- 172.21.15.173:0/3211610124 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55716e5a34a0 con 0x55716e4ff000 2024-09-13T23:57:04.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.061+0000 7fd724800700 1 -- 172.21.15.173:0/3211610124 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55716e5c3800 con 0x55716e4ff000 2024-09-13T23:57:04.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.061+0000 7fd724800700 1 -- 172.21.15.173:0/3211610124 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55716e5a3600 con 0x55716e4ff000 2024-09-13T23:57:04.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.061+0000 7fd727049f40 1 -- 172.21.15.173:0/3211610124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff000 msgr2=0x55716e7e4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.061+0000 7fd727049f40 1 --2- 172.21.15.173:0/3211610124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff000 0x55716e7e4580 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x55716e7dfa70 tx=0x55716e603920 comp rx=0 tx=0).stop 2024-09-13T23:57:04.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.061+0000 7fd727049f40 1 -- 172.21.15.173:0/3211610124 shutdown_connections 2024-09-13T23:57:04.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.061+0000 7fd727049f40 1 --2- 172.21.15.173:0/3211610124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff000 0x55716e7e4580 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.061+0000 7fd727049f40 1 -- 172.21.15.173:0/3211610124 >> 172.21.15.173:0/3211610124 conn(0x55716e4fec00 msgr2=0x55716e5fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.061+0000 7fd727049f40 1 -- 172.21.15.173:0/3211610124 shutdown_connections 2024-09-13T23:57:04.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.061+0000 7fd727049f40 1 -- 172.21.15.173:0/3211610124 wait complete. 2024-09-13T23:57:04.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.061+0000 7fd727049f40 1 Processor -- start 2024-09-13T23:57:04.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.061+0000 7fd727049f40 1 -- start start 2024-09-13T23:57:04.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.061+0000 7fd727049f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff000 0x55716e7e4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.061+0000 7fd727049f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55716e58c500 con 0x55716e4ff000 2024-09-13T23:57:04.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.061+0000 7fd725802700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff000 0x55716e7e4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.061+0000 7fd725802700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff000 0x55716e7e4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49958/0 (socket says 172.21.15.173:49958) 2024-09-13T23:57:04.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.061+0000 7fd725802700 1 -- 172.21.15.173:0/377464894 learned_addr learned my addr 172.21.15.173:0/377464894 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.065+0000 7fd725802700 1 -- 172.21.15.173:0/377464894 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55716e511ba0 con 0x55716e4ff000 2024-09-13T23:57:04.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.065+0000 7fd725802700 1 --2- 172.21.15.173:0/377464894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff000 0x55716e7e4580 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x55716f2c81e0 tx=0x55716e603800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e97331216d95702 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.065+0000 7fd723fff700 1 -- 172.21.15.173:0/377464894 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55716e5a3760 con 0x55716e4ff000 2024-09-13T23:57:04.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.065+0000 7fd723fff700 1 -- 172.21.15.173:0/377464894 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55716e5c3b00 con 0x55716e4ff000 2024-09-13T23:57:04.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.065+0000 7fd723fff700 1 -- 172.21.15.173:0/377464894 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55716e5a34a0 con 0x55716e4ff000 2024-09-13T23:57:04.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.065+0000 7fd727049f40 1 -- 172.21.15.173:0/377464894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff000 msgr2=0x55716e7e4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.065+0000 7fd727049f40 1 --2- 172.21.15.173:0/377464894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff000 0x55716e7e4580 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x55716f2c81e0 tx=0x55716e603800 comp rx=0 tx=0).stop 2024-09-13T23:57:04.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.065+0000 7fd727049f40 1 -- 172.21.15.173:0/377464894 shutdown_connections 2024-09-13T23:57:04.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.065+0000 7fd727049f40 1 --2- 172.21.15.173:0/377464894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff000 0x55716e7e4580 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.065+0000 7fd727049f40 1 -- 172.21.15.173:0/377464894 >> 172.21.15.173:0/377464894 conn(0x55716e4fec00 msgr2=0x55716e5ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.065+0000 7fd727049f40 1 -- 172.21.15.173:0/377464894 shutdown_connections 2024-09-13T23:57:04.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.065+0000 7fd727049f40 1 -- 172.21.15.173:0/377464894 wait complete. 2024-09-13T23:57:04.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.065+0000 7fd727049f40 1 Processor -- start 2024-09-13T23:57:04.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.065+0000 7fd727049f40 1 -- start start 2024-09-13T23:57:04.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.065+0000 7fd727049f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff000 0x55716e7e4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.065+0000 7fd727049f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55716e58c3c0 con 0x55716e4ff000 2024-09-13T23:57:04.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.065+0000 7fd725802700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff000 0x55716e7e4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.065+0000 7fd725802700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff000 0x55716e7e4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49964/0 (socket says 172.21.15.173:49964) 2024-09-13T23:57:04.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.065+0000 7fd725802700 1 -- 172.21.15.173:0/579196866 learned_addr learned my addr 172.21.15.173:0/579196866 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.065+0000 7fd725802700 1 -- 172.21.15.173:0/579196866 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55716e511a00 con 0x55716e4ff000 2024-09-13T23:57:04.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.069+0000 7fd725802700 1 --2- 172.21.15.173:0/579196866 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff000 0x55716e7e4580 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x55716e7dff80 tx=0x55716e603920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.069+0000 7fd7227fc700 1 -- 172.21.15.173:0/579196866 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55716e5a3600 con 0x55716e4ff000 2024-09-13T23:57:04.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.069+0000 7fd7227fc700 1 -- 172.21.15.173:0/579196866 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55716e5c3c80 con 0x55716e4ff000 2024-09-13T23:57:04.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.069+0000 7fd727049f40 1 -- 172.21.15.173:0/579196866 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55716e511860 con 0x55716e4ff000 2024-09-13T23:57:04.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.069+0000 7fd7227fc700 1 -- 172.21.15.173:0/579196866 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55716e5a38c0 con 0x55716e4ff000 2024-09-13T23:57:04.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.069+0000 7fd727049f40 1 -- 172.21.15.173:0/579196866 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55716e5116c0 con 0x55716e4ff000 2024-09-13T23:57:04.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.069+0000 7fd727049f40 1 Processor -- start 2024-09-13T23:57:04.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.069+0000 7fd7227fc700 1 -- 172.21.15.173:0/579196866 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55716e5f8b00 con 0x55716e4ff000 2024-09-13T23:57:04.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.069+0000 7fd727049f40 1 -- start start 2024-09-13T23:57:04.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.069+0000 7fd727049f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff800 0x55716e7e4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.069+0000 7fd7227fc700 1 --2- 172.21.15.173:0/579196866 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55716e894000 0x55716e7e5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.069+0000 7fd727049f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55716e524640 con 0x55716e4ff800 2024-09-13T23:57:04.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.069+0000 7fd7227fc700 1 -- 172.21.15.173:0/579196866 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55716e565180 con 0x55716e4ff000 2024-09-13T23:57:04.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.069+0000 7fd726003700 1 --2- 172.21.15.173:0/579196866 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55716e894000 0x55716e7e5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.069+0000 7fd725802700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff800 0x55716e7e4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.069+0000 7fd725802700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff800 0x55716e7e4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49980/0 (socket says 172.21.15.173:49980) 2024-09-13T23:57:04.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.069+0000 7fd725802700 1 -- 172.21.15.173:0/2130798273 learned_addr learned my addr 172.21.15.173:0/2130798273 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.073+0000 7fd725802700 1 -- 172.21.15.173:0/2130798273 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55716e510000 con 0x55716e4ff800 2024-09-13T23:57:04.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.073+0000 7fd726003700 1 --2- 172.21.15.173:0/579196866 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55716e894000 0x55716e7e5080 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55716f2c9ec0 tx=0x55716e858780 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.073+0000 7fd725802700 1 --2- 172.21.15.173:0/2130798273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff800 0x55716e7e4b00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x55716f372fc0 tx=0x55716e8588a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b384f21cec6ba68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.073+0000 7fd71fff7700 1 -- 172.21.15.173:0/2130798273 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55716e5a3600 con 0x55716e4ff800 2024-09-13T23:57:04.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.073+0000 7fd71fff7700 1 -- 172.21.15.173:0/2130798273 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55716e5c3c80 con 0x55716e4ff800 2024-09-13T23:57:04.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.073+0000 7fd71fff7700 1 -- 172.21.15.173:0/2130798273 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55716e5a38c0 con 0x55716e4ff800 2024-09-13T23:57:04.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.073+0000 7fd727049f40 1 -- 172.21.15.173:0/2130798273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff800 msgr2=0x55716e7e4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.073+0000 7fd727049f40 1 --2- 172.21.15.173:0/2130798273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff800 0x55716e7e4b00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x55716f372fc0 tx=0x55716e8588a0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.073+0000 7fd727049f40 1 -- 172.21.15.173:0/2130798273 shutdown_connections 2024-09-13T23:57:04.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.073+0000 7fd727049f40 1 --2- 172.21.15.173:0/2130798273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff800 0x55716e7e4b00 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.073+0000 7fd727049f40 1 -- 172.21.15.173:0/2130798273 >> 172.21.15.173:0/2130798273 conn(0x55716e4ff400 msgr2=0x55716e5ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.073+0000 7fd727049f40 1 -- 172.21.15.173:0/2130798273 shutdown_connections 2024-09-13T23:57:04.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.073+0000 7fd727049f40 1 -- 172.21.15.173:0/2130798273 wait complete. 2024-09-13T23:57:04.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.073+0000 7fd727049f40 1 Processor -- start 2024-09-13T23:57:04.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.073+0000 7fd727049f40 1 -- start start 2024-09-13T23:57:04.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.073+0000 7fd727049f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e894400 0x55716e7e5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.073+0000 7fd727049f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55716e5248c0 con 0x55716e894400 2024-09-13T23:57:04.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.073+0000 7fd725802700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e894400 0x55716e7e5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.073+0000 7fd725802700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e894400 0x55716e7e5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49982/0 (socket says 172.21.15.173:49982) 2024-09-13T23:57:04.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.073+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 learned_addr learned my addr 172.21.15.173:0/673339453 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.073+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55716e510ea0 con 0x55716e894400 2024-09-13T23:57:04.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.073+0000 7fd725802700 1 --2- 172.21.15.173:0/673339453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e894400 0x55716e7e5600 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x55716e872960 tx=0x55716e858a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.077+0000 7fd71e7f4700 1 -- 172.21.15.173:0/673339453 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55716e5a3760 con 0x55716e894400 2024-09-13T23:57:04.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.077+0000 7fd71e7f4700 1 -- 172.21.15.173:0/673339453 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55716e8b4000 con 0x55716e894400 2024-09-13T23:57:04.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.077+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55716e510820 con 0x55716e894400 2024-09-13T23:57:04.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.077+0000 7fd71e7f4700 1 -- 172.21.15.173:0/673339453 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55716e5a34a0 con 0x55716e894400 2024-09-13T23:57:04.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.077+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55716e5109c0 con 0x55716e894400 2024-09-13T23:57:04.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.077+0000 7fd71e7f4700 1 -- 172.21.15.173:0/673339453 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55716e5f8dc0 con 0x55716e894400 2024-09-13T23:57:04.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.077+0000 7fd71e7f4700 1 --2- 172.21.15.173:0/673339453 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55716e895800 0x55716e7e6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.077+0000 7fd71e7f4700 1 -- 172.21.15.173:0/673339453 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55716e565340 con 0x55716e894400 2024-09-13T23:57:04.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.077+0000 7fd727049f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.077+0000 7fd725001700 1 --2- 172.21.15.173:0/673339453 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55716e895800 0x55716e7e6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.077+0000 7fd727049f40 1 --2- 172.21.15.173:0/673339453 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55716e894800 0x55716e7e5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.077+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e894c00 con 0x55716e894800 2024-09-13T23:57:04.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.077+0000 7fd726003700 1 --2- 172.21.15.173:0/673339453 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55716e894800 0x55716e7e5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.077+0000 7fd725001700 1 --2- 172.21.15.173:0/673339453 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55716e895800 0x55716e7e6680 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55716f2c8030 tx=0x55716e859860 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.077+0000 7fd726003700 1 --2- 172.21.15.173:0/673339453 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55716e894800 0x55716e7e5b80 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.077+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55716e930b40 con 0x55716e894800 2024-09-13T23:57:04.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.081+0000 7fd727049f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.081+0000 7fd727049f40 20 realm 2024-09-13T23:57:04.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.081+0000 7fd727049f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.081+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895000 con 0x55716e894800 2024-09-13T23:57:04.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.081+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55716e930b40 con 0x55716e894800 2024-09-13T23:57:04.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.081+0000 7fd727049f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.081+0000 7fd727049f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:04.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.081+0000 7fd727049f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.081+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e894c00 con 0x55716e894800 2024-09-13T23:57:04.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.081+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55716e930b40 con 0x55716e894800 2024-09-13T23:57:04.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.081+0000 7fd727049f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.081+0000 7fd727049f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.081+0000 7fd727049f40 1 --2- 172.21.15.173:0/673339453 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55716e895000 0x55716e7e6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.081+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e895000 2024-09-13T23:57:04.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.081+0000 7fd725802700 1 --2- 172.21.15.173:0/673339453 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55716e895000 0x55716e7e6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.081+0000 7fd725802700 1 --2- 172.21.15.173:0/673339453 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55716e895000 0x55716e7e6100 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.081+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55716e931200 con 0x55716e895000 2024-09-13T23:57:04.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.081+0000 7fd727049f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:04.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.081+0000 7fd727049f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.081+0000 7fd727049f40 1 --2- 172.21.15.173:0/673339453 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55716e934000 0x55716e7e6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.081+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e934400 con 0x55716e934000 2024-09-13T23:57:04.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.081+0000 7fd725001700 1 --2- 172.21.15.173:0/673339453 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55716e934000 0x55716e7e6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.081+0000 7fd725001700 1 --2- 172.21.15.173:0/673339453 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55716e934000 0x55716e7e6c00 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.085+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55716e931440 con 0x55716e934000 2024-09-13T23:57:04.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.085+0000 7fd727049f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:04.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.085+0000 7fd727049f40 20 searching for the correct realm 2024-09-13T23:57:04.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.085+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e934800 con 0x55716e934000 2024-09-13T23:57:04.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.085+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55716e931440 con 0x55716e934000 2024-09-13T23:57:04.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.085+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e934400 con 0x55716e895000 2024-09-13T23:57:04.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.085+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e931200 con 0x55716e895000 2024-09-13T23:57:04.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.085+0000 7fd725802700 1 --2- 172.21.15.173:0/673339453 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55716e934400 0x55716e7e4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.085+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e934400 2024-09-13T23:57:04.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.085+0000 7fd726003700 1 --2- 172.21.15.173:0/673339453 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55716e934400 0x55716e7e4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.085+0000 7fd726003700 1 --2- 172.21.15.173:0/673339453 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55716e934400 0x55716e7e4b00 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.085+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e930b40 con 0x55716e934400 2024-09-13T23:57:04.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.085+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e894800 2024-09-13T23:57:04.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.085+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55716e930b40 con 0x55716e894800 2024-09-13T23:57:04.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.085+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e894800 2024-09-13T23:57:04.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.089+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e930b40 con 0x55716e894800 2024-09-13T23:57:04.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.089+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e934000 2024-09-13T23:57:04.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.089+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e931440 con 0x55716e934000 2024-09-13T23:57:04.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.089+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e894800 2024-09-13T23:57:04.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.089+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e930b40 con 0x55716e894800 2024-09-13T23:57:04.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.089+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e895000 2024-09-13T23:57:04.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.089+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e931200 con 0x55716e895000 2024-09-13T23:57:04.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.089+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e895000 2024-09-13T23:57:04.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.089+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e931200 con 0x55716e895000 2024-09-13T23:57:04.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.089+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e894800 2024-09-13T23:57:04.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.089+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e930b40 con 0x55716e894800 2024-09-13T23:57:04.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.089+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e934400 2024-09-13T23:57:04.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.093+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e930b40 con 0x55716e934400 2024-09-13T23:57:04.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.093+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e894800 2024-09-13T23:57:04.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.093+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e930b40 con 0x55716e894800 2024-09-13T23:57:04.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.093+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e934400 2024-09-13T23:57:04.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.093+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e930b40 con 0x55716e934400 2024-09-13T23:57:04.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.093+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e895000 2024-09-13T23:57:04.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.093+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e931200 con 0x55716e895000 2024-09-13T23:57:04.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.093+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e934000 2024-09-13T23:57:04.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.093+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e931440 con 0x55716e934000 2024-09-13T23:57:04.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.093+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e894800 2024-09-13T23:57:04.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.093+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e930b40 con 0x55716e894800 2024-09-13T23:57:04.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.093+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e895000 2024-09-13T23:57:04.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.097+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e931200 con 0x55716e895000 2024-09-13T23:57:04.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.097+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e934000 2024-09-13T23:57:04.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.097+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e931440 con 0x55716e934000 2024-09-13T23:57:04.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.097+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e894800 2024-09-13T23:57:04.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.097+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e930b40 con 0x55716e894800 2024-09-13T23:57:04.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.097+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e894800 2024-09-13T23:57:04.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.097+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e930b40 con 0x55716e894800 2024-09-13T23:57:04.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.097+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e894800 2024-09-13T23:57:04.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.097+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e930b40 con 0x55716e894800 2024-09-13T23:57:04.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.097+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e934000 2024-09-13T23:57:04.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.097+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e931440 con 0x55716e934000 2024-09-13T23:57:04.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.097+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e934400 2024-09-13T23:57:04.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.097+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e930b40 con 0x55716e934400 2024-09-13T23:57:04.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.097+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e894800 2024-09-13T23:57:04.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.101+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e930b40 con 0x55716e894800 2024-09-13T23:57:04.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.101+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e934400 2024-09-13T23:57:04.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.101+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e930b40 con 0x55716e934400 2024-09-13T23:57:04.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.101+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e934000 2024-09-13T23:57:04.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.101+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e931440 con 0x55716e934000 2024-09-13T23:57:04.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.101+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e934400 2024-09-13T23:57:04.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.101+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e930b40 con 0x55716e934400 2024-09-13T23:57:04.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.101+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e895000 2024-09-13T23:57:04.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.101+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e931200 con 0x55716e895000 2024-09-13T23:57:04.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.101+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e895000 2024-09-13T23:57:04.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.101+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e931200 con 0x55716e895000 2024-09-13T23:57:04.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.101+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e934000 2024-09-13T23:57:04.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.101+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e931440 con 0x55716e934000 2024-09-13T23:57:04.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.101+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e895000 2024-09-13T23:57:04.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55716e931200 con 0x55716e895000 2024-09-13T23:57:04.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e895000 2024-09-13T23:57:04.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55716e931200 con 0x55716e895000 2024-09-13T23:57:04.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd727049f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:04.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd727049f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:04.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd727049f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:04.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd727049f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:04.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd727049f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e934c00 con 0x55716e894800 2024-09-13T23:57:04.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55716e930b40 con 0x55716e894800 2024-09-13T23:57:04.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd727049f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd727049f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e935000 con 0x55716e895000 2024-09-13T23:57:04.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55716e931200 con 0x55716e895000 2024-09-13T23:57:04.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd727049f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:04.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd727049f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e935400 con 0x55716e894800 2024-09-13T23:57:04.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55716e930b40 con 0x55716e894800 2024-09-13T23:57:04.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd727049f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:04.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd727049f40 20 zone default found 2024-09-13T23:57:04.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd727049f40 4 Realm: () 2024-09-13T23:57:04.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd727049f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:04.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd727049f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:04.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd727049f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:04.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd727049f40 20 zonegroup default 2024-09-13T23:57:04.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd727049f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.105+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e934c00 con 0x55716e934400 2024-09-13T23:57:04.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.109+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55716e930b40 con 0x55716e934400 2024-09-13T23:57:04.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.109+0000 7fd727049f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.109+0000 7fd727049f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.109+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e935400 con 0x55716e934000 2024-09-13T23:57:04.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.109+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55716e931440 con 0x55716e934000 2024-09-13T23:57:04.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.109+0000 7fd727049f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.109+0000 7fd727049f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.109+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e935800 con 0x55716e934000 2024-09-13T23:57:04.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.109+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55716e931440 con 0x55716e934000 2024-09-13T23:57:04.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.109+0000 7fd727049f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.109+0000 7fd727049f40 20 started sync module instance, tier type = 2024-09-13T23:57:04.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.109+0000 7fd727049f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:04.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.109+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e935c00 con 0x55716e895000 2024-09-13T23:57:04.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.113+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e931200 con 0x55716e895000 2024-09-13T23:57:04.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.113+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93945673399040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e894c00 con 0x55716e895000 2024-09-13T23:57:04.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.113+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e935000 con 0x55716e894800 2024-09-13T23:57:04.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.113+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e930b40 con 0x55716e894800 2024-09-13T23:57:04.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.113+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93945673399040] v33'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e931200 con 0x55716e895000 2024-09-13T23:57:04.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.113+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93945673400192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e935c00 con 0x55716e894800 2024-09-13T23:57:04.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.113+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e895000 2024-09-13T23:57:04.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.117+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93945673400192] v33'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e930b40 con 0x55716e894800 2024-09-13T23:57:04.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.117+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e931200 con 0x55716e895000 2024-09-13T23:57:04.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.117+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93945673401344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e93a000 con 0x55716e895000 2024-09-13T23:57:04.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.117+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e93a400 con 0x55716e934400 2024-09-13T23:57:04.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.121+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e930b40 con 0x55716e934400 2024-09-13T23:57:04.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.121+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93945673402496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e93a800 con 0x55716e934400 2024-09-13T23:57:04.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.121+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e93ac00 con 0x55716e895000 2024-09-13T23:57:04.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.121+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93945673401344] v33'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e931200 con 0x55716e895000 2024-09-13T23:57:04.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.121+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93945673402496] v33'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e930b40 con 0x55716e934400 2024-09-13T23:57:04.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.125+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e931200 con 0x55716e895000 2024-09-13T23:57:04.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.125+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93945673403648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e93b000 con 0x55716e895000 2024-09-13T23:57:04.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.125+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e93b400 con 0x55716e934000 2024-09-13T23:57:04.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.125+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e931440 con 0x55716e934000 2024-09-13T23:57:04.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.125+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93945673404800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e93b800 con 0x55716e934000 2024-09-13T23:57:04.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.125+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e93bc00 con 0x55716e934000 2024-09-13T23:57:04.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.125+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93945673403648] v33'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e931200 con 0x55716e895000 2024-09-13T23:57:04.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.129+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93945673404800] v33'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e931440 con 0x55716e934000 2024-09-13T23:57:04.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.129+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e931440 con 0x55716e934000 2024-09-13T23:57:04.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.129+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93945673405952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e93b400 con 0x55716e934000 2024-09-13T23:57:04.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.129+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e93a000 con 0x55716e934400 2024-09-13T23:57:04.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.129+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93945673405952] v33'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e931440 con 0x55716e934000 2024-09-13T23:57:04.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.129+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e930b40 con 0x55716e934400 2024-09-13T23:57:04.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.129+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93945673407104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e934800 con 0x55716e934400 2024-09-13T23:57:04.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.129+0000 7fd727049f40 20 add_watcher() i=0 2024-09-13T23:57:04.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.129+0000 7fd727049f40 20 add_watcher() i=1 2024-09-13T23:57:04.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.129+0000 7fd727049f40 20 add_watcher() i=2 2024-09-13T23:57:04.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.129+0000 7fd727049f40 20 add_watcher() i=3 2024-09-13T23:57:04.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.129+0000 7fd727049f40 20 add_watcher() i=4 2024-09-13T23:57:04.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.129+0000 7fd727049f40 20 add_watcher() i=5 2024-09-13T23:57:04.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.129+0000 7fd727049f40 20 add_watcher() i=6 2024-09-13T23:57:04.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.133+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93945673407104] v33'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e930b40 con 0x55716e934400 2024-09-13T23:57:04.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.133+0000 7fd727049f40 20 add_watcher() i=7 2024-09-13T23:57:04.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.133+0000 7fd727049f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:04.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.133+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e935400 con 0x55716e894800 2024-09-13T23:57:04.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.133+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55716e930b40 con 0x55716e894800 2024-09-13T23:57:04.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.133+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93945674874880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e935800 con 0x55716e894800 2024-09-13T23:57:04.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.133+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93945674874880] v33'106 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55716e930b40 con 0x55716e894800 2024-09-13T23:57:04.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.133+0000 7fd70c7d0700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:04.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.137+0000 7fd727049f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:04.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.137+0000 7fd727049f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:04.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.137+0000 7fd727049f40 1 Processor -- start 2024-09-13T23:57:04.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.137+0000 7fd727049f40 1 -- start start 2024-09-13T23:57:04.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.137+0000 7fd727049f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e935000 0x55716e7e7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.137+0000 7fd727049f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55716e58c3c0 con 0x55716e935000 2024-09-13T23:57:04.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.137+0000 7fd725001700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e935000 0x55716e7e7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.137+0000 7fd725001700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e935000 0x55716e7e7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49996/0 (socket says 172.21.15.173:49996) 2024-09-13T23:57:04.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.137+0000 7fd725001700 1 -- 172.21.15.173:0/3334324477 learned_addr learned my addr 172.21.15.173:0/3334324477 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.137+0000 7fd725001700 1 -- 172.21.15.173:0/3334324477 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55716e510b60 con 0x55716e935000 2024-09-13T23:57:04.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.137+0000 7fd725001700 1 --2- 172.21.15.173:0/3334324477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e935000 0x55716e7e7180 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x55716e8d3fb0 tx=0x55716e859800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c999fb221224927 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.137+0000 7fd70bfcf700 1 -- 172.21.15.173:0/3334324477 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55716e942160 con 0x55716e935000 2024-09-13T23:57:04.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.137+0000 7fd70bfcf700 1 -- 172.21.15.173:0/3334324477 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55716e8b4a80 con 0x55716e935000 2024-09-13T23:57:04.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.137+0000 7fd70bfcf700 1 -- 172.21.15.173:0/3334324477 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55716e9422c0 con 0x55716e935000 2024-09-13T23:57:04.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.137+0000 7fd727049f40 1 -- 172.21.15.173:0/3334324477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e935000 msgr2=0x55716e7e7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.137+0000 7fd727049f40 1 --2- 172.21.15.173:0/3334324477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e935000 0x55716e7e7180 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x55716e8d3fb0 tx=0x55716e859800 comp rx=0 tx=0).stop 2024-09-13T23:57:04.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.137+0000 7fd727049f40 1 -- 172.21.15.173:0/3334324477 shutdown_connections 2024-09-13T23:57:04.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.137+0000 7fd727049f40 1 --2- 172.21.15.173:0/3334324477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e935000 0x55716e7e7180 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.137+0000 7fd727049f40 1 -- 172.21.15.173:0/3334324477 >> 172.21.15.173:0/3334324477 conn(0x55716e934c00 msgr2=0x55716e600000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.137+0000 7fd727049f40 1 -- 172.21.15.173:0/3334324477 shutdown_connections 2024-09-13T23:57:04.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.137+0000 7fd727049f40 1 -- 172.21.15.173:0/3334324477 wait complete. 2024-09-13T23:57:04.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.137+0000 7fd727049f40 1 Processor -- start 2024-09-13T23:57:04.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.137+0000 7fd727049f40 1 -- start start 2024-09-13T23:57:04.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.141+0000 7fd727049f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e935000 0x55716e7e7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.141+0000 7fd727049f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55716e58c500 con 0x55716e935000 2024-09-13T23:57:04.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.141+0000 7fd725001700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e935000 0x55716e7e7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.141+0000 7fd725001700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e935000 0x55716e7e7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50000/0 (socket says 172.21.15.173:50000) 2024-09-13T23:57:04.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.141+0000 7fd725001700 1 -- 172.21.15.173:0/3557705040 learned_addr learned my addr 172.21.15.173:0/3557705040 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.141+0000 7fd725001700 1 -- 172.21.15.173:0/3557705040 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55716e510d00 con 0x55716e935000 2024-09-13T23:57:04.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.141+0000 7fd725001700 1 --2- 172.21.15.173:0/3557705040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e935000 0x55716e7e7180 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x55716e951290 tx=0x55716e859980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.141+0000 7fd70a7cc700 1 -- 172.21.15.173:0/3557705040 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55716e942420 con 0x55716e935000 2024-09-13T23:57:04.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.141+0000 7fd70a7cc700 1 -- 172.21.15.173:0/3557705040 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55716e8b4780 con 0x55716e935000 2024-09-13T23:57:04.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.141+0000 7fd727049f40 1 -- 172.21.15.173:0/3557705040 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55716e510340 con 0x55716e935000 2024-09-13T23:57:04.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.141+0000 7fd70a7cc700 1 -- 172.21.15.173:0/3557705040 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55716e942160 con 0x55716e935000 2024-09-13T23:57:04.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.141+0000 7fd727049f40 1 -- 172.21.15.173:0/3557705040 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55716e510b60 con 0x55716e935000 2024-09-13T23:57:04.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.141+0000 7fd70a7cc700 1 -- 172.21.15.173:0/3557705040 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55716e5f9b80 con 0x55716e935000 2024-09-13T23:57:04.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.141+0000 7fd70a7cc700 1 --2- 172.21.15.173:0/3557705040 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55716e934800 0x55716e9d8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.145+0000 7fd70a7cc700 1 -- 172.21.15.173:0/3557705040 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55716e5656c0 con 0x55716e935000 2024-09-13T23:57:04.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.145+0000 7fd726003700 1 --2- 172.21.15.173:0/3557705040 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55716e934800 0x55716e9d8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.145+0000 7fd727049f40 5 note: GC not initialized 2024-09-13T23:57:04.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.145+0000 7fd726003700 1 --2- 172.21.15.173:0/3557705040 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55716e934800 0x55716e9d8000 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55716e8d3080 tx=0x55716e858720 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.145+0000 7fd707fc7700 20 reqs_thread_entry: start 2024-09-13T23:57:04.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.145+0000 7fd727049f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:04.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.145+0000 7fd727049f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:04.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.145+0000 7fd7057c2700 20 reqs_thread_entry: start 2024-09-13T23:57:04.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.145+0000 7fd727049f40 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:57:04.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.145+0000 7fd727049f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.145+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e895c00 con 0x55716e934400 2024-09-13T23:57:04.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.145+0000 7fd705fc3700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:34 2024 2024-09-13T23:57:04.153 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:04.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.149+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x55716e930b40 con 0x55716e934400 2024-09-13T23:57:04.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.149+0000 7fd727049f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.149+0000 7fd727049f40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T23:57:04.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.149+0000 7fd727049f40 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:57:04.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.149+0000 7fd727049f40 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T23:57:04.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.149+0000 7fd727049f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.149+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e93a800 con 0x55716e934000 2024-09-13T23:57:04.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.149+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x55716e931440 con 0x55716e934000 2024-09-13T23:57:04.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.149+0000 7fd727049f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.149+0000 7fd727049f40 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T23:57:04.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.149+0000 7fd727049f40 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:57:04.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.149+0000 7fd727049f40 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T23:57:04.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.149+0000 7fd727049f40 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T23:57:04.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.149+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e93a000 con 0x55716e934400 2024-09-13T23:57:04.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.153+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~346] v33'1 uv1 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x55716e930b40 con 0x55716e934400 2024-09-13T23:57:04.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.153+0000 7fd727049f40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T23:57:04.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.153+0000 7fd727049f40 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:57:04.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.153+0000 7fd727049f40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T23:57:04.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.153+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 93945674877184 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e93ac00 con 0x55716e934000 2024-09-13T23:57:04.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.153+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== watch-notify(notify (1) cookie 93945673404800 notify 141733920779 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x55716e998d00 con 0x55716e934000 2024-09-13T23:57:04.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.153+0000 7fd71fff7700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920779 cookie 93945673404800 notifier 4528 bl.length()=522 2024-09-13T23:57:04.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.153+0000 7fd71fff7700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T23:57:04.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.153+0000 7fd71fff7700 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:57:04.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.153+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(65 notify.5 [notify cookie 93945674877184 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55716e931440 con 0x55716e934000 2024-09-13T23:57:04.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.153+0000 7fd71fff7700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716ea42000 con 0x55716e934000 2024-09-13T23:57:04.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.153+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e931440 con 0x55716e934000 2024-09-13T23:57:04.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.153+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== watch-notify(notify_complete (2) cookie 93945674877184 notify 141733920779 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55716e998ea0 con 0x55716e934000 2024-09-13T23:57:04.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.153+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e93a400 con 0x55716e934000 2024-09-13T23:57:04.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.153+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 <== osd.3 v2:172.21.15.173:6800/4020038786 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v33'3 uv3 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55716e931440 con 0x55716e934000 2024-09-13T23:57:04.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.153+0000 7fd727049f40 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T23:57:04.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.153+0000 7fd727049f40 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:57:04.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.153+0000 7fd727049f40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T23:57:04.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.153+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93945674877184 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e935400 con 0x55716e895000 2024-09-13T23:57:04.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.157+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== watch-notify(notify (1) cookie 93945673401344 notify 141733920786 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55716e511a00 con 0x55716e895000 2024-09-13T23:57:04.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.157+0000 7fd71fff7700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920786 cookie 93945673401344 notifier 4528 bl.length()=177 2024-09-13T23:57:04.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.157+0000 7fd71fff7700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T23:57:04.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.157+0000 7fd71fff7700 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:57:04.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.157+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(68 notify.2 [notify cookie 93945674877184 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55716e931200 con 0x55716e895000 2024-09-13T23:57:04.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.157+0000 7fd71fff7700 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716ea42400 con 0x55716e895000 2024-09-13T23:57:04.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.157+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== watch-notify(notify_complete (2) cookie 93945674877184 notify 141733920786 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55716e511860 con 0x55716e895000 2024-09-13T23:57:04.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.157+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e931200 con 0x55716e895000 2024-09-13T23:57:04.163 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:04.163 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "fud", 2024-09-13T23:57:04.163 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Fud", 2024-09-13T23:57:04.163 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "", 2024-09-13T23:57:04.163 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:57:04.163 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 1, 2024-09-13T23:57:04.163 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [], 2024-09-13T23:57:04.163 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:57:04.163 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:04.163 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "fud", 2024-09-13T23:57:04.164 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "p5YnriCv1nAtykxBrupQ", 2024-09-13T23:57:04.164 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh" 2024-09-13T23:57:04.164 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:04.164 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:04.164 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [], 2024-09-13T23:57:04.164 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:57:04.164 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:57:04.164 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:57:04.164 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:57:04.164 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:57:04.164 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:57:04.164 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:04.164 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:04.164 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:04.165 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:04.165 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:04.165 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:04.165 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:57:04.165 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:04.165 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:04.165 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:04.165 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:04.165 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:04.165 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:04.165 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:57:04.165 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:57:04.165 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:57:04.165 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:04.165 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:57:04.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.157+0000 7fd70c7d0700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:04.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.157+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93945674874880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e935800 con 0x55716e894800 2024-09-13T23:57:04.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.161+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93945674874880] v33'107 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55716e930b40 con 0x55716e894800 2024-09-13T23:57:04.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.161+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93945673399040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716ea42000 con 0x55716e895000 2024-09-13T23:57:04.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.161+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93945673399040] v33'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e931200 con 0x55716e895000 2024-09-13T23:57:04.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.161+0000 7fd727049f40 20 remove_watcher() i=0 2024-09-13T23:57:04.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.161+0000 7fd727049f40 2 removed watcher, disabling cache 2024-09-13T23:57:04.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.161+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93945673400192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716ea42800 con 0x55716e894800 2024-09-13T23:57:04.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.165+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93945673400192] v33'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e930b40 con 0x55716e894800 2024-09-13T23:57:04.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.165+0000 7fd727049f40 20 remove_watcher() i=1 2024-09-13T23:57:04.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.165+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93945673401344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716ea42c00 con 0x55716e895000 2024-09-13T23:57:04.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.169+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93945673401344] v33'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e931200 con 0x55716e895000 2024-09-13T23:57:04.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.169+0000 7fd727049f40 20 remove_watcher() i=2 2024-09-13T23:57:04.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.169+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93945673402496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716ea43000 con 0x55716e934400 2024-09-13T23:57:04.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.169+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93945673402496] v33'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e930b40 con 0x55716e934400 2024-09-13T23:57:04.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.169+0000 7fd727049f40 20 remove_watcher() i=3 2024-09-13T23:57:04.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.169+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93945673403648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716ea43400 con 0x55716e895000 2024-09-13T23:57:04.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.173+0000 7fd725802700 1 -- 172.21.15.173:0/673339453 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93945673403648] v33'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e931200 con 0x55716e895000 2024-09-13T23:57:04.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.173+0000 7fd727049f40 20 remove_watcher() i=4 2024-09-13T23:57:04.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.173+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93945673404800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716ea43800 con 0x55716e934000 2024-09-13T23:57:04.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.173+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 <== osd.3 v2:172.21.15.173:6800/4020038786 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93945673404800] v33'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e931440 con 0x55716e934000 2024-09-13T23:57:04.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.173+0000 7fd727049f40 20 remove_watcher() i=5 2024-09-13T23:57:04.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.173+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93945673405952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716ea43c00 con 0x55716e934000 2024-09-13T23:57:04.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.177+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 <== osd.3 v2:172.21.15.173:6800/4020038786 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93945673405952] v33'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e931440 con 0x55716e934000 2024-09-13T23:57:04.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.177+0000 7fd727049f40 20 remove_watcher() i=6 2024-09-13T23:57:04.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.177+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93945673407104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55716e93b800 con 0x55716e934400 2024-09-13T23:57:04.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd726003700 1 -- 172.21.15.173:0/673339453 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93945673407104] v33'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55716e930b40 con 0x55716e934400 2024-09-13T23:57:04.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 20 remove_watcher() i=7 2024-09-13T23:57:04.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55716e895000 msgr2=0x55716e7e6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 --2- 172.21.15.173:0/673339453 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55716e895000 0x55716e7e6100 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55716e894800 msgr2=0x55716e7e5b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 --2- 172.21.15.173:0/673339453 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55716e894800 0x55716e7e5b80 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55716e934400 msgr2=0x55716e7e4b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 --2- 172.21.15.173:0/673339453 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55716e934400 0x55716e7e4b00 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55716e934000 msgr2=0x55716e7e6c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 --2- 172.21.15.173:0/673339453 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55716e934000 0x55716e7e6c00 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55716e895800 msgr2=0x55716e7e6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 --2- 172.21.15.173:0/673339453 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55716e895800 0x55716e7e6680 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55716f2c8030 tx=0x55716e859860 comp rx=0 tx=0).stop 2024-09-13T23:57:04.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e894400 msgr2=0x55716e7e5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 --2- 172.21.15.173:0/673339453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e894400 0x55716e7e5600 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x55716e872960 tx=0x55716e858a80 comp rx=0 tx=0).stop 2024-09-13T23:57:04.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 reap_dead start 2024-09-13T23:57:04.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 shutdown_connections 2024-09-13T23:57:04.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd725001700 1 -- 172.21.15.173:0/673339453 reap_dead start 2024-09-13T23:57:04.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 >> 172.21.15.173:0/673339453 conn(0x55716e4ff400 msgr2=0x55716e5ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 shutdown_connections 2024-09-13T23:57:04.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 -- 172.21.15.173:0/673339453 wait complete. 2024-09-13T23:57:04.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 -- 172.21.15.173:0/3557705040 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55716e934800 msgr2=0x55716e9d8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 --2- 172.21.15.173:0/3557705040 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55716e934800 0x55716e9d8000 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55716e8d3080 tx=0x55716e858720 comp rx=0 tx=0).stop 2024-09-13T23:57:04.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 -- 172.21.15.173:0/3557705040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e935000 msgr2=0x55716e7e7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 --2- 172.21.15.173:0/3557705040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e935000 0x55716e7e7180 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x55716e951290 tx=0x55716e859980 comp rx=0 tx=0).stop 2024-09-13T23:57:04.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 -- 172.21.15.173:0/3557705040 shutdown_connections 2024-09-13T23:57:04.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 --2- 172.21.15.173:0/3557705040 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55716e934800 0x55716e9d8000 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 --2- 172.21.15.173:0/3557705040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e935000 0x55716e7e7180 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 -- 172.21.15.173:0/3557705040 >> 172.21.15.173:0/3557705040 conn(0x55716e934c00 msgr2=0x55716e600000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 -- 172.21.15.173:0/3557705040 shutdown_connections 2024-09-13T23:57:04.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 -- 172.21.15.173:0/3557705040 wait complete. 2024-09-13T23:57:04.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 -- 172.21.15.173:0/579196866 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55716e894000 msgr2=0x55716e7e5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 --2- 172.21.15.173:0/579196866 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55716e894000 0x55716e7e5080 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55716f2c9ec0 tx=0x55716e858780 comp rx=0 tx=0).stop 2024-09-13T23:57:04.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 -- 172.21.15.173:0/579196866 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff000 msgr2=0x55716e7e4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 --2- 172.21.15.173:0/579196866 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff000 0x55716e7e4580 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x55716e7dff80 tx=0x55716e603920 comp rx=0 tx=0).stop 2024-09-13T23:57:04.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 -- 172.21.15.173:0/579196866 shutdown_connections 2024-09-13T23:57:04.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 --2- 172.21.15.173:0/579196866 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55716e894000 0x55716e7e5080 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 --2- 172.21.15.173:0/579196866 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55716e4ff000 0x55716e7e4580 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 -- 172.21.15.173:0/579196866 >> 172.21.15.173:0/579196866 conn(0x55716e4fec00 msgr2=0x55716e5ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 -- 172.21.15.173:0/579196866 shutdown_connections 2024-09-13T23:57:04.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.181+0000 7fd727049f40 1 -- 172.21.15.173:0/579196866 wait complete. 2024-09-13T23:57:04.194 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:57:04.204 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T23:57:04.212 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:57:04.212 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-13T23:57:04.212 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-13T23:57:04.213 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-13T23:57:04.251 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:04.252 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:04.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.245+0000 7f2461f0cf40 1 Processor -- start 2024-09-13T23:57:04.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.245+0000 7f2461f0cf40 1 -- start start 2024-09-13T23:57:04.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.245+0000 7f2461f0cf40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x5561a45a5400 0x5561a488a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.245+0000 7f2461f0cf40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5561a4669500 con 0x5561a45a5000 2024-09-13T23:57:04.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.245+0000 7f2461f0cf40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x5561a4632a00 con 0x5561a45a5400 2024-09-13T23:57:04.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.249+0000 7f245fec4700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x5561a45a5400 0x5561a488a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.249+0000 7f24606c5700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x5561a45a5000 0x5561a46a4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47436/0 (socket says 172.21.15.173:47436) 2024-09-13T23:57:04.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.249+0000 7f24606c5700 1 -- 172.21.15.173:0/2746012376 learned_addr learned my addr 172.21.15.173:0/2746012376 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:04.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.249+0000 7f245fec4700 1 -- 172.21.15.173:0/2746012376 >> v1:172.21.15.87:6789/0 conn(0x5561a45a5000 legacy=0x5561a46a4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.249+0000 7f245f6c3700 1 -- 172.21.15.173:0/2746012376 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358290213 0 0) 0x5561a4700000 con 0x5561a45a5000 2024-09-13T23:57:04.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.249+0000 7f245fec4700 1 -- 172.21.15.173:0/2746012376 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561a45b7d40 con 0x5561a45a5400 2024-09-13T23:57:04.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.249+0000 7f245fec4700 1 --2- 172.21.15.173:0/2746012376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5400 0x5561a488a580 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x5561a4885920 tx=0x5561a46a9920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a421fc18d5ee7ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.249+0000 7f245f6c3700 1 -- 172.21.15.173:0/2746012376 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5561a46494a0 con 0x5561a45a5400 2024-09-13T23:57:04.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.249+0000 7f245f6c3700 1 -- 172.21.15.173:0/2746012376 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561a4669800 con 0x5561a45a5400 2024-09-13T23:57:04.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.249+0000 7f245f6c3700 1 -- 172.21.15.173:0/2746012376 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5561a4649600 con 0x5561a45a5400 2024-09-13T23:57:04.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.249+0000 7f2461f0cf40 1 -- 172.21.15.173:0/2746012376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5400 msgr2=0x5561a488a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.249+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/2746012376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5400 0x5561a488a580 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x5561a4885920 tx=0x5561a46a9920 comp rx=0 tx=0).stop 2024-09-13T23:57:04.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.249+0000 7f2461f0cf40 1 -- 172.21.15.173:0/2746012376 shutdown_connections 2024-09-13T23:57:04.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.249+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/2746012376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5400 0x5561a488a580 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.249+0000 7f2461f0cf40 1 -- 172.21.15.173:0/2746012376 >> 172.21.15.173:0/2746012376 conn(0x5561a45a4c00 msgr2=0x5561a46a4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.249+0000 7f2461f0cf40 1 -- 172.21.15.173:0/2746012376 shutdown_connections 2024-09-13T23:57:04.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.249+0000 7f2461f0cf40 1 -- 172.21.15.173:0/2746012376 wait complete. 2024-09-13T23:57:04.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.249+0000 7f2461f0cf40 1 Processor -- start 2024-09-13T23:57:04.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.249+0000 7f2461f0cf40 1 -- start start 2024-09-13T23:57:04.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.249+0000 7f2461f0cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5000 0x5561a488a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.249+0000 7f2461f0cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a4632500 con 0x5561a45a5000 2024-09-13T23:57:04.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.253+0000 7f24606c5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5000 0x5561a488a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.253+0000 7f24606c5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5000 0x5561a488a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50016/0 (socket says 172.21.15.173:50016) 2024-09-13T23:57:04.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.253+0000 7f24606c5700 1 -- 172.21.15.173:0/207462908 learned_addr learned my addr 172.21.15.173:0/207462908 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.253+0000 7f24606c5700 1 -- 172.21.15.173:0/207462908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561a45b7ba0 con 0x5561a45a5000 2024-09-13T23:57:04.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.253+0000 7f24606c5700 1 --2- 172.21.15.173:0/207462908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5000 0x5561a488a580 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x5561a536fd70 tx=0x5561a46a9b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e9cb180483abab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.253+0000 7f245eec2700 1 -- 172.21.15.173:0/207462908 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5561a46494a0 con 0x5561a45a5000 2024-09-13T23:57:04.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.253+0000 7f245eec2700 1 -- 172.21.15.173:0/207462908 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561a4669b00 con 0x5561a45a5000 2024-09-13T23:57:04.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.253+0000 7f245eec2700 1 -- 172.21.15.173:0/207462908 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5561a4649600 con 0x5561a45a5000 2024-09-13T23:57:04.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.253+0000 7f2461f0cf40 1 -- 172.21.15.173:0/207462908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5000 msgr2=0x5561a488a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.253+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/207462908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5000 0x5561a488a580 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x5561a536fd70 tx=0x5561a46a9b60 comp rx=0 tx=0).stop 2024-09-13T23:57:04.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.253+0000 7f2461f0cf40 1 -- 172.21.15.173:0/207462908 shutdown_connections 2024-09-13T23:57:04.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.253+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/207462908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5000 0x5561a488a580 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.253+0000 7f2461f0cf40 1 -- 172.21.15.173:0/207462908 >> 172.21.15.173:0/207462908 conn(0x5561a45a4c00 msgr2=0x5561a46a5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.253+0000 7f2461f0cf40 1 -- 172.21.15.173:0/207462908 shutdown_connections 2024-09-13T23:57:04.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.253+0000 7f2461f0cf40 1 -- 172.21.15.173:0/207462908 wait complete. 2024-09-13T23:57:04.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.253+0000 7f2461f0cf40 1 Processor -- start 2024-09-13T23:57:04.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.253+0000 7f2461f0cf40 1 -- start start 2024-09-13T23:57:04.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.253+0000 7f2461f0cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5400 0x5561a488ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.253+0000 7f2461f0cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a46323c0 con 0x5561a45a5400 2024-09-13T23:57:04.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.253+0000 7f24606c5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5400 0x5561a488ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.253+0000 7f24606c5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5400 0x5561a488ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50032/0 (socket says 172.21.15.173:50032) 2024-09-13T23:57:04.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.253+0000 7f24606c5700 1 -- 172.21.15.173:0/1331417000 learned_addr learned my addr 172.21.15.173:0/1331417000 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.257+0000 7f24606c5700 1 -- 172.21.15.173:0/1331417000 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561a45b7a00 con 0x5561a45a5400 2024-09-13T23:57:04.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.257+0000 7f24606c5700 1 --2- 172.21.15.173:0/1331417000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5400 0x5561a488ab00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x5561a536fef0 tx=0x5561a46a9a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.257+0000 7f245d6bf700 1 -- 172.21.15.173:0/1331417000 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5561a46498c0 con 0x5561a45a5400 2024-09-13T23:57:04.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.257+0000 7f245d6bf700 1 -- 172.21.15.173:0/1331417000 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561a4669c80 con 0x5561a45a5400 2024-09-13T23:57:04.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.257+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1331417000 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5561a45b7860 con 0x5561a45a5400 2024-09-13T23:57:04.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.257+0000 7f245d6bf700 1 -- 172.21.15.173:0/1331417000 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5561a46494a0 con 0x5561a45a5400 2024-09-13T23:57:04.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.257+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1331417000 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561a45b76c0 con 0x5561a45a5400 2024-09-13T23:57:04.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.257+0000 7f2461f0cf40 1 Processor -- start 2024-09-13T23:57:04.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.257+0000 7f2461f0cf40 1 -- start start 2024-09-13T23:57:04.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.257+0000 7f2461f0cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5c00 0x5561a488b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.257+0000 7f245d6bf700 1 -- 172.21.15.173:0/1331417000 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x5561a469eb00 con 0x5561a45a5400 2024-09-13T23:57:04.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.257+0000 7f2461f0cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a4632000 con 0x5561a45a5c00 2024-09-13T23:57:04.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.257+0000 7f2460ec6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5c00 0x5561a488b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.257+0000 7f2460ec6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5c00 0x5561a488b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50038/0 (socket says 172.21.15.173:50038) 2024-09-13T23:57:04.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.257+0000 7f2460ec6700 1 -- 172.21.15.173:0/1465593272 learned_addr learned my addr 172.21.15.173:0/1465593272 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.257+0000 7f245d6bf700 1 --2- 172.21.15.173:0/1331417000 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5561a494a000 0x5561a488c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.257+0000 7f245d6bf700 1 -- 172.21.15.173:0/1331417000 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5561a460b180 con 0x5561a45a5400 2024-09-13T23:57:04.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.257+0000 7f24606c5700 1 --2- 172.21.15.173:0/1331417000 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5561a494a000 0x5561a488c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.257+0000 7f2460ec6700 1 -- 172.21.15.173:0/1465593272 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561a45b6000 con 0x5561a45a5c00 2024-09-13T23:57:04.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.257+0000 7f2460ec6700 1 --2- 172.21.15.173:0/1465593272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5c00 0x5561a488b080 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x5561a492a510 tx=0x5561a4904a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62eb428bfb108e2e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f245aeba700 1 -- 172.21.15.173:0/1465593272 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5561a46498c0 con 0x5561a45a5c00 2024-09-13T23:57:04.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f245aeba700 1 -- 172.21.15.173:0/1465593272 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561a4950000 con 0x5561a45a5c00 2024-09-13T23:57:04.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f245aeba700 1 -- 172.21.15.173:0/1465593272 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5561a46494a0 con 0x5561a45a5c00 2024-09-13T23:57:04.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1465593272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5c00 msgr2=0x5561a488b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/1465593272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5c00 0x5561a488b080 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x5561a492a510 tx=0x5561a4904a20 comp rx=0 tx=0).stop 2024-09-13T23:57:04.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f24606c5700 1 --2- 172.21.15.173:0/1331417000 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5561a494a000 0x5561a488c100 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x5561a48d1440 tx=0x5561a4904240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1465593272 shutdown_connections 2024-09-13T23:57:04.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/1465593272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5c00 0x5561a488b080 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1465593272 >> 172.21.15.173:0/1465593272 conn(0x5561a45a5800 msgr2=0x5561a46a5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1465593272 shutdown_connections 2024-09-13T23:57:04.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1465593272 wait complete. 2024-09-13T23:57:04.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f2461f0cf40 1 Processor -- start 2024-09-13T23:57:04.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f2461f0cf40 1 -- start start 2024-09-13T23:57:04.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f2461f0cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5c00 0x5561a488b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f2461f0cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a45ca640 con 0x5561a45a5c00 2024-09-13T23:57:04.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f2460ec6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5c00 0x5561a488b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f2460ec6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5c00 0x5561a488b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50052/0 (socket says 172.21.15.173:50052) 2024-09-13T23:57:04.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 learned_addr learned my addr 172.21.15.173:0/1971300782 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561a45b6ea0 con 0x5561a45a5c00 2024-09-13T23:57:04.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f2460ec6700 1 --2- 172.21.15.173:0/1971300782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5c00 0x5561a488b080 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x5561a48d01b0 tx=0x5561a4904840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f24596b7700 1 -- 172.21.15.173:0/1971300782 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5561a4649b80 con 0x5561a45a5c00 2024-09-13T23:57:04.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f24596b7700 1 -- 172.21.15.173:0/1971300782 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561a4950180 con 0x5561a45a5c00 2024-09-13T23:57:04.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5561a45b6820 con 0x5561a45a5c00 2024-09-13T23:57:04.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f24596b7700 1 -- 172.21.15.173:0/1971300782 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5561a46498c0 con 0x5561a45a5c00 2024-09-13T23:57:04.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.261+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561a45b69c0 con 0x5561a45a5c00 2024-09-13T23:57:04.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f24596b7700 1 -- 172.21.15.173:0/1971300782 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x5561a469edc0 con 0x5561a45a5c00 2024-09-13T23:57:04.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f2461f0cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f24596b7700 1 --2- 172.21.15.173:0/1971300782 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5561a494ac00 0x5561a488c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f24596b7700 1 -- 172.21.15.173:0/1971300782 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5561a460b340 con 0x5561a45a5c00 2024-09-13T23:57:04.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/1971300782 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5561a494b000 0x5561a488b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f245fec4700 1 --2- 172.21.15.173:0/1971300782 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5561a494ac00 0x5561a488c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b400 con 0x5561a494b000 2024-09-13T23:57:04.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f2460ec6700 1 --2- 172.21.15.173:0/1971300782 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5561a494b000 0x5561a488b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f245fec4700 1 --2- 172.21.15.173:0/1971300782 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5561a494ac00 0x5561a488c680 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x5561a4885920 tx=0x5561a46a9800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f2460ec6700 1 --2- 172.21.15.173:0/1971300782 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5561a494b000 0x5561a488b600 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5561a49feb40 con 0x5561a494b000 2024-09-13T23:57:04.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f2461f0cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f2461f0cf40 20 realm 2024-09-13T23:57:04.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f2461f0cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494b000 2024-09-13T23:57:04.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5561a49feb40 con 0x5561a494b000 2024-09-13T23:57:04.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f2461f0cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f2461f0cf40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:04.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f2461f0cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494bc00 con 0x5561a494b000 2024-09-13T23:57:04.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5561a49feb40 con 0x5561a494b000 2024-09-13T23:57:04.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f2461f0cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f2461f0cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/1971300782 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5561a494b400 0x5561a488bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.265+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494b400 2024-09-13T23:57:04.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.269+0000 7f24606c5700 1 --2- 172.21.15.173:0/1971300782 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5561a494b400 0x5561a488bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.269+0000 7f24606c5700 1 --2- 172.21.15.173:0/1971300782 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5561a494b400 0x5561a488bb80 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.269+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5561a49ff200 con 0x5561a494b400 2024-09-13T23:57:04.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.269+0000 7f2461f0cf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:04.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.269+0000 7f2461f0cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.269+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/1971300782 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5561a494bc00 0x5561a488cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.269+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a0a000 con 0x5561a494bc00 2024-09-13T23:57:04.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.269+0000 7f245fec4700 1 --2- 172.21.15.173:0/1971300782 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5561a494bc00 0x5561a488cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.269+0000 7f245fec4700 1 --2- 172.21.15.173:0/1971300782 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5561a494bc00 0x5561a488cc00 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.269+0000 7f245fec4700 1 -- 172.21.15.173:0/1971300782 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5561a49ff440 con 0x5561a494bc00 2024-09-13T23:57:04.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.269+0000 7f2461f0cf40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:04.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.269+0000 7f2461f0cf40 20 searching for the correct realm 2024-09-13T23:57:04.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.269+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a0a400 con 0x5561a494bc00 2024-09-13T23:57:04.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.269+0000 7f245fec4700 1 -- 172.21.15.173:0/1971300782 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5561a49ff440 con 0x5561a494bc00 2024-09-13T23:57:04.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.273+0000 7f245fec4700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a0a000 con 0x5561a494b400 2024-09-13T23:57:04.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.273+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49ff200 con 0x5561a494b400 2024-09-13T23:57:04.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.273+0000 7f24606c5700 1 --2- 172.21.15.173:0/1971300782 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5561a4a0a000 0x5561a488a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.273+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a4a0a000 2024-09-13T23:57:04.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.273+0000 7f2460ec6700 1 --2- 172.21.15.173:0/1971300782 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5561a4a0a000 0x5561a488a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.273+0000 7f2460ec6700 1 --2- 172.21.15.173:0/1971300782 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5561a4a0a000 0x5561a488a580 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.273+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49feb40 con 0x5561a4a0a000 2024-09-13T23:57:04.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.273+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494b000 2024-09-13T23:57:04.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.273+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5561a49feb40 con 0x5561a494b000 2024-09-13T23:57:04.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.273+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494b000 2024-09-13T23:57:04.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.273+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49feb40 con 0x5561a494b000 2024-09-13T23:57:04.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.273+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494bc00 2024-09-13T23:57:04.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.273+0000 7f245fec4700 1 -- 172.21.15.173:0/1971300782 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49ff440 con 0x5561a494bc00 2024-09-13T23:57:04.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.273+0000 7f245fec4700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494b000 2024-09-13T23:57:04.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.277+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49feb40 con 0x5561a494b000 2024-09-13T23:57:04.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.277+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494b400 2024-09-13T23:57:04.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.277+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49ff200 con 0x5561a494b400 2024-09-13T23:57:04.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.277+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494b400 2024-09-13T23:57:04.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.277+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49ff200 con 0x5561a494b400 2024-09-13T23:57:04.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.277+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494b000 2024-09-13T23:57:04.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.277+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49feb40 con 0x5561a494b000 2024-09-13T23:57:04.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.277+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a4a0a000 2024-09-13T23:57:04.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.277+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49feb40 con 0x5561a4a0a000 2024-09-13T23:57:04.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.277+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494b000 2024-09-13T23:57:04.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.277+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49feb40 con 0x5561a494b000 2024-09-13T23:57:04.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.277+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a4a0a000 2024-09-13T23:57:04.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.277+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49feb40 con 0x5561a4a0a000 2024-09-13T23:57:04.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.277+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494b400 2024-09-13T23:57:04.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.281+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49ff200 con 0x5561a494b400 2024-09-13T23:57:04.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.281+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494bc00 2024-09-13T23:57:04.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.281+0000 7f245fec4700 1 -- 172.21.15.173:0/1971300782 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49ff440 con 0x5561a494bc00 2024-09-13T23:57:04.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.281+0000 7f245fec4700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494b000 2024-09-13T23:57:04.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.281+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49feb40 con 0x5561a494b000 2024-09-13T23:57:04.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.281+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494b400 2024-09-13T23:57:04.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.281+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49ff200 con 0x5561a494b400 2024-09-13T23:57:04.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.281+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494bc00 2024-09-13T23:57:04.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.281+0000 7f245fec4700 1 -- 172.21.15.173:0/1971300782 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49ff440 con 0x5561a494bc00 2024-09-13T23:57:04.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.281+0000 7f245fec4700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494b000 2024-09-13T23:57:04.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.281+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49feb40 con 0x5561a494b000 2024-09-13T23:57:04.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.281+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494b000 2024-09-13T23:57:04.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.281+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49feb40 con 0x5561a494b000 2024-09-13T23:57:04.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.281+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494b000 2024-09-13T23:57:04.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.285+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49feb40 con 0x5561a494b000 2024-09-13T23:57:04.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.285+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494bc00 2024-09-13T23:57:04.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.285+0000 7f245fec4700 1 -- 172.21.15.173:0/1971300782 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49ff440 con 0x5561a494bc00 2024-09-13T23:57:04.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.285+0000 7f245fec4700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a4a0a000 2024-09-13T23:57:04.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.285+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49feb40 con 0x5561a4a0a000 2024-09-13T23:57:04.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.285+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494b000 2024-09-13T23:57:04.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.285+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49feb40 con 0x5561a494b000 2024-09-13T23:57:04.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.285+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a4a0a000 2024-09-13T23:57:04.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.285+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49feb40 con 0x5561a4a0a000 2024-09-13T23:57:04.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.285+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494bc00 2024-09-13T23:57:04.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.285+0000 7f245fec4700 1 -- 172.21.15.173:0/1971300782 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49ff440 con 0x5561a494bc00 2024-09-13T23:57:04.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.285+0000 7f245fec4700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a4a0a000 2024-09-13T23:57:04.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.285+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49feb40 con 0x5561a4a0a000 2024-09-13T23:57:04.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.285+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494b400 2024-09-13T23:57:04.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.289+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49ff200 con 0x5561a494b400 2024-09-13T23:57:04.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.289+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494b400 2024-09-13T23:57:04.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.289+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49ff200 con 0x5561a494b400 2024-09-13T23:57:04.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.289+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494bc00 2024-09-13T23:57:04.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.289+0000 7f245fec4700 1 -- 172.21.15.173:0/1971300782 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49ff440 con 0x5561a494bc00 2024-09-13T23:57:04.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.289+0000 7f245fec4700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494b400 2024-09-13T23:57:04.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.289+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5561a49ff200 con 0x5561a494b400 2024-09-13T23:57:04.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.289+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494b400 2024-09-13T23:57:04.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.289+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5561a49ff200 con 0x5561a494b400 2024-09-13T23:57:04.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.289+0000 7f2461f0cf40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:04.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.289+0000 7f2461f0cf40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:04.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.289+0000 7f2461f0cf40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:04.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.289+0000 7f2461f0cf40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:04.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.289+0000 7f2461f0cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.289+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a0a800 con 0x5561a494b000 2024-09-13T23:57:04.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.289+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5561a49feb40 con 0x5561a494b000 2024-09-13T23:57:04.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.289+0000 7f2461f0cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.289+0000 7f2461f0cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.289+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a0ac00 con 0x5561a494b400 2024-09-13T23:57:04.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5561a49ff200 con 0x5561a494b400 2024-09-13T23:57:04.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f2461f0cf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:04.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f2461f0cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a0b000 con 0x5561a494b000 2024-09-13T23:57:04.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5561a49feb40 con 0x5561a494b000 2024-09-13T23:57:04.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f2461f0cf40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:04.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f2461f0cf40 20 zone default found 2024-09-13T23:57:04.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f2461f0cf40 4 Realm: () 2024-09-13T23:57:04.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f2461f0cf40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:04.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f2461f0cf40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:04.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f2461f0cf40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:04.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f2461f0cf40 20 zonegroup default 2024-09-13T23:57:04.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f2461f0cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a0b400 con 0x5561a4a0a000 2024-09-13T23:57:04.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5561a49feb40 con 0x5561a4a0a000 2024-09-13T23:57:04.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f2461f0cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f2461f0cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a0b800 con 0x5561a494bc00 2024-09-13T23:57:04.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f245fec4700 1 -- 172.21.15.173:0/1971300782 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5561a49ff440 con 0x5561a494bc00 2024-09-13T23:57:04.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f2461f0cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f2461f0cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a0bc00 con 0x5561a494bc00 2024-09-13T23:57:04.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f245fec4700 1 -- 172.21.15.173:0/1971300782 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5561a49ff440 con 0x5561a494bc00 2024-09-13T23:57:04.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f2461f0cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f2461f0cf40 20 started sync module instance, tier type = 2024-09-13T23:57:04.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f2461f0cf40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:04.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.293+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a10000 con 0x5561a494b400 2024-09-13T23:57:04.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.297+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5561a49ff200 con 0x5561a494b400 2024-09-13T23:57:04.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.297+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93877860571904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a10400 con 0x5561a494b400 2024-09-13T23:57:04.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.297+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a10800 con 0x5561a494b000 2024-09-13T23:57:04.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.301+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5561a49feb40 con 0x5561a494b000 2024-09-13T23:57:04.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.301+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93877860571904] v33'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5561a49ff200 con 0x5561a494b400 2024-09-13T23:57:04.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.301+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93877860573056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a10c00 con 0x5561a494b000 2024-09-13T23:57:04.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.301+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a11000 con 0x5561a494b400 2024-09-13T23:57:04.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.301+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93877860573056] v33'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5561a49feb40 con 0x5561a494b000 2024-09-13T23:57:04.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.301+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5561a49ff200 con 0x5561a494b400 2024-09-13T23:57:04.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.301+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93877860574208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a11400 con 0x5561a494b400 2024-09-13T23:57:04.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.301+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a11800 con 0x5561a4a0a000 2024-09-13T23:57:04.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.305+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93877860574208] v33'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5561a49ff200 con 0x5561a494b400 2024-09-13T23:57:04.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.305+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5561a49feb40 con 0x5561a4a0a000 2024-09-13T23:57:04.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.305+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93877860575360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a11c00 con 0x5561a4a0a000 2024-09-13T23:57:04.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.305+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a10800 con 0x5561a494b400 2024-09-13T23:57:04.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.309+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93877860575360] v33'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5561a49feb40 con 0x5561a4a0a000 2024-09-13T23:57:04.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.309+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5561a49ff200 con 0x5561a494b400 2024-09-13T23:57:04.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.309+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93877860576512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a10000 con 0x5561a494b400 2024-09-13T23:57:04.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.309+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a10400 con 0x5561a494bc00 2024-09-13T23:57:04.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.309+0000 7f245fec4700 1 -- 172.21.15.173:0/1971300782 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5561a49ff440 con 0x5561a494bc00 2024-09-13T23:57:04.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.309+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93877860576512] v33'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5561a49ff200 con 0x5561a494b400 2024-09-13T23:57:04.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.309+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93877860577664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a0a800 con 0x5561a494bc00 2024-09-13T23:57:04.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.309+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a0b000 con 0x5561a494bc00 2024-09-13T23:57:04.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.313+0000 7f245fec4700 1 -- 172.21.15.173:0/1971300782 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v33'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5561a49ff440 con 0x5561a494bc00 2024-09-13T23:57:04.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.313+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93877860578816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a0b400 con 0x5561a494bc00 2024-09-13T23:57:04.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.313+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a0ac00 con 0x5561a4a0a000 2024-09-13T23:57:04.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.313+0000 7f245fec4700 1 -- 172.21.15.173:0/1971300782 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93877860577664] v33'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5561a49ff440 con 0x5561a494bc00 2024-09-13T23:57:04.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.313+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5561a49feb40 con 0x5561a4a0a000 2024-09-13T23:57:04.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.313+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93877860579968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a4a0a000 2024-09-13T23:57:04.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.313+0000 7f2461f0cf40 20 add_watcher() i=0 2024-09-13T23:57:04.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.313+0000 7f2461f0cf40 20 add_watcher() i=1 2024-09-13T23:57:04.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.313+0000 7f2461f0cf40 20 add_watcher() i=2 2024-09-13T23:57:04.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.313+0000 7f2461f0cf40 20 add_watcher() i=3 2024-09-13T23:57:04.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.313+0000 7f2461f0cf40 20 add_watcher() i=4 2024-09-13T23:57:04.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.313+0000 7f2461f0cf40 20 add_watcher() i=5 2024-09-13T23:57:04.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.313+0000 7f245fec4700 1 -- 172.21.15.173:0/1971300782 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93877860578816] v33'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5561a49ff440 con 0x5561a494bc00 2024-09-13T23:57:04.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.313+0000 7f2461f0cf40 20 add_watcher() i=6 2024-09-13T23:57:04.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.317+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93877860579968] v33'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5561a49feb40 con 0x5561a4a0a000 2024-09-13T23:57:04.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.317+0000 7f2461f0cf40 20 add_watcher() i=7 2024-09-13T23:57:04.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.317+0000 7f2461f0cf40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:04.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.317+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a10c00 con 0x5561a494b000 2024-09-13T23:57:04.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.317+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5561a49feb40 con 0x5561a494b000 2024-09-13T23:57:04.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.317+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93877862227968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a11800 con 0x5561a494b000 2024-09-13T23:57:04.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.317+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93877862227968] v33'108 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5561a49feb40 con 0x5561a494b000 2024-09-13T23:57:04.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.321+0000 7f2447693700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:04.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.321+0000 7f2461f0cf40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:04.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.321+0000 7f2461f0cf40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:04.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.321+0000 7f2461f0cf40 1 Processor -- start 2024-09-13T23:57:04.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.321+0000 7f2461f0cf40 1 -- start start 2024-09-13T23:57:04.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.321+0000 7f2461f0cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a4a10400 0x5561a488d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.321+0000 7f2461f0cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a45ca780 con 0x5561a4a10400 2024-09-13T23:57:04.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.321+0000 7f245fec4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a4a10400 0x5561a488d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.321+0000 7f245fec4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a4a10400 0x5561a488d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50064/0 (socket says 172.21.15.173:50064) 2024-09-13T23:57:04.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.321+0000 7f245fec4700 1 -- 172.21.15.173:0/557518954 learned_addr learned my addr 172.21.15.173:0/557518954 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.321+0000 7f245fec4700 1 -- 172.21.15.173:0/557518954 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561a45b6b60 con 0x5561a4a10400 2024-09-13T23:57:04.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.321+0000 7f245fec4700 1 --2- 172.21.15.173:0/557518954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a4a10400 0x5561a488d180 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x5561a4a1e000 tx=0x5561a46a9980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5891e0c84032f4e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.321+0000 7f2446e92700 1 -- 172.21.15.173:0/557518954 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5561a4649760 con 0x5561a4a10400 2024-09-13T23:57:04.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.321+0000 7f2446e92700 1 -- 172.21.15.173:0/557518954 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561a4950600 con 0x5561a4a10400 2024-09-13T23:57:04.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.321+0000 7f2446e92700 1 -- 172.21.15.173:0/557518954 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5561a4a28000 con 0x5561a4a10400 2024-09-13T23:57:04.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.321+0000 7f2461f0cf40 1 -- 172.21.15.173:0/557518954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a4a10400 msgr2=0x5561a488d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.321+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/557518954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a4a10400 0x5561a488d180 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x5561a4a1e000 tx=0x5561a46a9980 comp rx=0 tx=0).stop 2024-09-13T23:57:04.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.321+0000 7f2461f0cf40 1 -- 172.21.15.173:0/557518954 shutdown_connections 2024-09-13T23:57:04.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.321+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/557518954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a4a10400 0x5561a488d180 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.321+0000 7f2461f0cf40 1 -- 172.21.15.173:0/557518954 >> 172.21.15.173:0/557518954 conn(0x5561a4a11c00 msgr2=0x5561a46a6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.321+0000 7f2461f0cf40 1 -- 172.21.15.173:0/557518954 shutdown_connections 2024-09-13T23:57:04.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.321+0000 7f2461f0cf40 1 -- 172.21.15.173:0/557518954 wait complete. 2024-09-13T23:57:04.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.325+0000 7f2461f0cf40 1 Processor -- start 2024-09-13T23:57:04.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.325+0000 7f2461f0cf40 1 -- start start 2024-09-13T23:57:04.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.325+0000 7f2461f0cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a4a10400 0x5561a488d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.325+0000 7f2461f0cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a4632000 con 0x5561a4a10400 2024-09-13T23:57:04.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.325+0000 7f245fec4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a4a10400 0x5561a488d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.325+0000 7f245fec4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a4a10400 0x5561a488d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50076/0 (socket says 172.21.15.173:50076) 2024-09-13T23:57:04.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.325+0000 7f245fec4700 1 -- 172.21.15.173:0/3388236688 learned_addr learned my addr 172.21.15.173:0/3388236688 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.325+0000 7f245fec4700 1 -- 172.21.15.173:0/3388236688 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561a45b6d00 con 0x5561a4a10400 2024-09-13T23:57:04.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.325+0000 7f245fec4700 1 --2- 172.21.15.173:0/3388236688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a4a10400 0x5561a488d180 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x5561a4a1e240 tx=0x5561a4905c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.325+0000 7f244568f700 1 -- 172.21.15.173:0/3388236688 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5561a4a28160 con 0x5561a4a10400 2024-09-13T23:57:04.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.325+0000 7f244568f700 1 -- 172.21.15.173:0/3388236688 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561a4950300 con 0x5561a4a10400 2024-09-13T23:57:04.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.325+0000 7f2461f0cf40 1 -- 172.21.15.173:0/3388236688 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5561a45b6340 con 0x5561a4a10400 2024-09-13T23:57:04.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.325+0000 7f244568f700 1 -- 172.21.15.173:0/3388236688 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5561a4a282c0 con 0x5561a4a10400 2024-09-13T23:57:04.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.325+0000 7f2461f0cf40 1 -- 172.21.15.173:0/3388236688 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561a45b7d40 con 0x5561a4a10400 2024-09-13T23:57:04.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.325+0000 7f244568f700 1 -- 172.21.15.173:0/3388236688 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x5561a469fb80 con 0x5561a4a10400 2024-09-13T23:57:04.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.325+0000 7f244568f700 1 --2- 172.21.15.173:0/3388236688 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5561a4a9c000 0x5561a4aa2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.325+0000 7f244568f700 1 -- 172.21.15.173:0/3388236688 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5561a460b500 con 0x5561a4a10400 2024-09-13T23:57:04.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.329+0000 7f2461f0cf40 5 note: GC not initialized 2024-09-13T23:57:04.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.329+0000 7f2460ec6700 1 --2- 172.21.15.173:0/3388236688 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5561a4a9c000 0x5561a4aa2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.329+0000 7f2460ec6700 1 --2- 172.21.15.173:0/3388236688 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5561a4a9c000 0x5561a4aa2000 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x5561a49b47b0 tx=0x5561a4a66ae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.329+0000 7f2442e8a700 20 reqs_thread_entry: start 2024-09-13T23:57:04.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.329+0000 7f2461f0cf40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:04.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.329+0000 7f2461f0cf40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:04.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.329+0000 7f2440e86700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:34 2024 2024-09-13T23:57:04.336 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:04.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.329+0000 7f2461f0cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.329+0000 7f2440664700 20 reqs_thread_entry: start 2024-09-13T23:57:04.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.329+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a0b800 con 0x5561a4a0a000 2024-09-13T23:57:04.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.329+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) v8 ==== 275+0+304 (crc 0 0 0) 0x5561a49feb40 con 0x5561a4a0a000 2024-09-13T23:57:04.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.329+0000 7f2461f0cf40 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:57:04.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.333+0000 7f2447693700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:04.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.333+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93877862227968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a0bc00 con 0x5561a494b000 2024-09-13T23:57:04.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.333+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93877862227968] v33'109 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5561a49feb40 con 0x5561a494b000 2024-09-13T23:57:04.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.333+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93877860571904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a494b800 con 0x5561a494b400 2024-09-13T23:57:04.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.337+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93877860571904] v33'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5561a49ff200 con 0x5561a494b400 2024-09-13T23:57:04.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.337+0000 7f2461f0cf40 20 remove_watcher() i=0 2024-09-13T23:57:04.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.337+0000 7f2461f0cf40 2 removed watcher, disabling cache 2024-09-13T23:57:04.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.337+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93877860573056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a9c400 con 0x5561a494b000 2024-09-13T23:57:04.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.341+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93877860573056] v33'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5561a49feb40 con 0x5561a494b000 2024-09-13T23:57:04.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.341+0000 7f2461f0cf40 20 remove_watcher() i=1 2024-09-13T23:57:04.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.341+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93877860574208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a9c800 con 0x5561a494b400 2024-09-13T23:57:04.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.341+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93877860574208] v33'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5561a49ff200 con 0x5561a494b400 2024-09-13T23:57:04.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.341+0000 7f2461f0cf40 20 remove_watcher() i=2 2024-09-13T23:57:04.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.341+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93877860575360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a9cc00 con 0x5561a4a0a000 2024-09-13T23:57:04.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.345+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93877860575360] v33'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5561a49feb40 con 0x5561a4a0a000 2024-09-13T23:57:04.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.345+0000 7f2461f0cf40 20 remove_watcher() i=3 2024-09-13T23:57:04.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.345+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93877860576512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a9d000 con 0x5561a494b400 2024-09-13T23:57:04.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.345+0000 7f24606c5700 1 -- 172.21.15.173:0/1971300782 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93877860576512] v33'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5561a49ff200 con 0x5561a494b400 2024-09-13T23:57:04.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.345+0000 7f2461f0cf40 20 remove_watcher() i=4 2024-09-13T23:57:04.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.345+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93877860577664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a9d400 con 0x5561a494bc00 2024-09-13T23:57:04.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.349+0000 7f245fec4700 1 -- 172.21.15.173:0/1971300782 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93877860577664] v33'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5561a49ff440 con 0x5561a494bc00 2024-09-13T23:57:04.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.349+0000 7f2461f0cf40 20 remove_watcher() i=5 2024-09-13T23:57:04.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.349+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93877860578816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a9d800 con 0x5561a494bc00 2024-09-13T23:57:04.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.349+0000 7f245fec4700 1 -- 172.21.15.173:0/1971300782 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93877860578816] v33'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5561a49ff440 con 0x5561a494bc00 2024-09-13T23:57:04.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2461f0cf40 20 remove_watcher() i=6 2024-09-13T23:57:04.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93877860579968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5561a4a9dc00 con 0x5561a4a0a000 2024-09-13T23:57:04.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2460ec6700 1 -- 172.21.15.173:0/1971300782 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93877860579968] v33'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5561a49feb40 con 0x5561a4a0a000 2024-09-13T23:57:04.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2461f0cf40 20 remove_watcher() i=7 2024-09-13T23:57:04.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5561a494b400 msgr2=0x5561a488bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/1971300782 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5561a494b400 0x5561a488bb80 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5561a494b000 msgr2=0x5561a488b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/1971300782 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5561a494b000 0x5561a488b600 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5561a4a0a000 msgr2=0x5561a488a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/1971300782 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5561a4a0a000 0x5561a488a580 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5561a494bc00 msgr2=0x5561a488cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/1971300782 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5561a494bc00 0x5561a488cc00 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5561a494ac00 msgr2=0x5561a488c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/1971300782 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5561a494ac00 0x5561a488c680 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x5561a4885920 tx=0x5561a46a9800 comp rx=0 tx=0).stop 2024-09-13T23:57:04.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5c00 msgr2=0x5561a488b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/1971300782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5c00 0x5561a488b080 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x5561a48d01b0 tx=0x5561a4904840 comp rx=0 tx=0).stop 2024-09-13T23:57:04.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f245fec4700 1 -- 172.21.15.173:0/1971300782 reap_dead start 2024-09-13T23:57:04.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 shutdown_connections 2024-09-13T23:57:04.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/1971300782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5c00 0x5561a488b080 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 >> 172.21.15.173:0/1971300782 conn(0x5561a45a5800 msgr2=0x5561a46a5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 shutdown_connections 2024-09-13T23:57:04.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1971300782 wait complete. 2024-09-13T23:57:04.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2461f0cf40 1 -- 172.21.15.173:0/3388236688 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5561a4a9c000 msgr2=0x5561a4aa2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/3388236688 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5561a4a9c000 0x5561a4aa2000 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x5561a49b47b0 tx=0x5561a4a66ae0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2461f0cf40 1 -- 172.21.15.173:0/3388236688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a4a10400 msgr2=0x5561a488d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.353+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/3388236688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a4a10400 0x5561a488d180 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x5561a4a1e240 tx=0x5561a4905c20 comp rx=0 tx=0).stop 2024-09-13T23:57:04.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.357+0000 7f2461f0cf40 1 -- 172.21.15.173:0/3388236688 shutdown_connections 2024-09-13T23:57:04.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.357+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/3388236688 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5561a4a9c000 0x5561a4aa2000 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.357+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/3388236688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a4a10400 0x5561a488d180 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.357+0000 7f2461f0cf40 1 -- 172.21.15.173:0/3388236688 >> 172.21.15.173:0/3388236688 conn(0x5561a4a11c00 msgr2=0x5561a46a6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.357+0000 7f2461f0cf40 1 -- 172.21.15.173:0/3388236688 shutdown_connections 2024-09-13T23:57:04.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.357+0000 7f2461f0cf40 1 -- 172.21.15.173:0/3388236688 wait complete. 2024-09-13T23:57:04.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.357+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1331417000 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5561a494a000 msgr2=0x5561a488c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.357+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/1331417000 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5561a494a000 0x5561a488c100 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x5561a48d1440 tx=0x5561a4904240 comp rx=0 tx=0).stop 2024-09-13T23:57:04.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.357+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1331417000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5400 msgr2=0x5561a488ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.357+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/1331417000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5400 0x5561a488ab00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x5561a536fef0 tx=0x5561a46a9a40 comp rx=0 tx=0).stop 2024-09-13T23:57:04.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.357+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1331417000 shutdown_connections 2024-09-13T23:57:04.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.357+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/1331417000 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5561a494a000 0x5561a488c100 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.357+0000 7f2461f0cf40 1 --2- 172.21.15.173:0/1331417000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5561a45a5400 0x5561a488ab00 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.357+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1331417000 >> 172.21.15.173:0/1331417000 conn(0x5561a45a4c00 msgr2=0x5561a46a5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.357+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1331417000 shutdown_connections 2024-09-13T23:57:04.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.357+0000 7f2461f0cf40 1 -- 172.21.15.173:0/1331417000 wait complete. 2024-09-13T23:57:04.365 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:04.365 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "bucket:myfoo", 2024-09-13T23:57:04.365 INFO:teuthology.orchestra.run.smithi173.stdout: "ver": { 2024-09-13T23:57:04.365 INFO:teuthology.orchestra.run.smithi173.stdout: "tag": "_WD2FEZQZMUXmlzj1_IG83sE", 2024-09-13T23:57:04.365 INFO:teuthology.orchestra.run.smithi173.stdout: "ver": 2 2024-09-13T23:57:04.365 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:04.366 INFO:teuthology.orchestra.run.smithi173.stdout: "mtime": "2024-09-13T23:57:03.979015Z", 2024-09-13T23:57:04.366 INFO:teuthology.orchestra.run.smithi173.stdout: "data": { 2024-09-13T23:57:04.366 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": { 2024-09-13T23:57:04.366 INFO:teuthology.orchestra.run.smithi173.stdout: "name": "myfoo", 2024-09-13T23:57:04.366 INFO:teuthology.orchestra.run.smithi173.stdout: "marker": "d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1", 2024-09-13T23:57:04.366 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_id": "d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1", 2024-09-13T23:57:04.366 INFO:teuthology.orchestra.run.smithi173.stdout: "tenant": "", 2024-09-13T23:57:04.366 INFO:teuthology.orchestra.run.smithi173.stdout: "explicit_placement": { 2024-09-13T23:57:04.366 INFO:teuthology.orchestra.run.smithi173.stdout: "data_pool": "", 2024-09-13T23:57:04.366 INFO:teuthology.orchestra.run.smithi173.stdout: "data_extra_pool": "", 2024-09-13T23:57:04.366 INFO:teuthology.orchestra.run.smithi173.stdout: "index_pool": "" 2024-09-13T23:57:04.366 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:04.366 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:04.366 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:57:04.366 INFO:teuthology.orchestra.run.smithi173.stdout: "creation_time": "2024-09-13T23:57:02.413869Z", 2024-09-13T23:57:04.367 INFO:teuthology.orchestra.run.smithi173.stdout: "linked": false, 2024-09-13T23:57:04.367 INFO:teuthology.orchestra.run.smithi173.stdout: "has_bucket_info": false 2024-09-13T23:57:04.367 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:04.367 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:04.368 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_WD2FEZQZMUXmlzj1_IG83sE', 'ver': 2}, 'mtime': '2024-09-13T23:57:03.979015Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.1', 'bucket_id': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-13T23:57:02.413869Z', 'linked': False, 'has_bucket_info': False}} 2024-09-13T23:57:04.368 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.1'] 2024-09-13T23:57:04.368 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.1'] 2024-09-13T23:57:04.369 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 2024-09-13T23:57:04.453 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:04.454 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:04.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.449+0000 7f3fc0399f40 1 Processor -- start 2024-09-13T23:57:04.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.449+0000 7f3fc0399f40 1 -- start start 2024-09-13T23:57:04.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.449+0000 7f3fc0399f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x559fa2b01400 0x559fa2de6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.449+0000 7f3fc0399f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559fa2bc5500 con 0x559fa2b01000 2024-09-13T23:57:04.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.449+0000 7f3fc0399f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x559fa2b8ea00 con 0x559fa2b01400 2024-09-13T23:57:04.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.449+0000 7f3fbe351700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x559fa2b01400 0x559fa2de6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.449+0000 7f3fbeb52700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x559fa2b01000 0x559fa2c00800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47444/0 (socket says 172.21.15.173:47444) 2024-09-13T23:57:04.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.449+0000 7f3fbeb52700 1 -- 172.21.15.173:0/397532427 learned_addr learned my addr 172.21.15.173:0/397532427 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:04.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.449+0000 7f3fbe351700 1 -- 172.21.15.173:0/397532427 >> v1:172.21.15.87:6789/0 conn(0x559fa2b01000 legacy=0x559fa2c00800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.449+0000 7f3fbe351700 1 -- 172.21.15.173:0/397532427 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559fa2b13d40 con 0x559fa2b01400 2024-09-13T23:57:04.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.449+0000 7f3fbe351700 1 --2- 172.21.15.173:0/397532427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01400 0x559fa2de6580 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x559fa2de1920 tx=0x559fa2c05920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd0d604e7e4d7d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.449+0000 7f3fbdb50700 1 -- 172.21.15.173:0/397532427 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559fa2ba54a0 con 0x559fa2b01400 2024-09-13T23:57:04.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.449+0000 7f3fbdb50700 1 -- 172.21.15.173:0/397532427 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559fa2bc5800 con 0x559fa2b01400 2024-09-13T23:57:04.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.449+0000 7f3fbdb50700 1 -- 172.21.15.173:0/397532427 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559fa2ba5600 con 0x559fa2b01400 2024-09-13T23:57:04.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.449+0000 7f3fc0399f40 1 -- 172.21.15.173:0/397532427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01400 msgr2=0x559fa2de6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.449+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/397532427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01400 0x559fa2de6580 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x559fa2de1920 tx=0x559fa2c05920 comp rx=0 tx=0).stop 2024-09-13T23:57:04.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.449+0000 7f3fc0399f40 1 -- 172.21.15.173:0/397532427 shutdown_connections 2024-09-13T23:57:04.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.449+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/397532427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01400 0x559fa2de6580 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.449+0000 7f3fc0399f40 1 -- 172.21.15.173:0/397532427 >> 172.21.15.173:0/397532427 conn(0x559fa2b00c00 msgr2=0x559fa2c00000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.449+0000 7f3fc0399f40 1 -- 172.21.15.173:0/397532427 shutdown_connections 2024-09-13T23:57:04.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.449+0000 7f3fc0399f40 1 -- 172.21.15.173:0/397532427 wait complete. 2024-09-13T23:57:04.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.453+0000 7f3fc0399f40 1 Processor -- start 2024-09-13T23:57:04.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.453+0000 7f3fc0399f40 1 -- start start 2024-09-13T23:57:04.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.453+0000 7f3fc0399f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01000 0x559fa2de6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.453+0000 7f3fc0399f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fa2b8e500 con 0x559fa2b01000 2024-09-13T23:57:04.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.453+0000 7f3fbeb52700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01000 0x559fa2de6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.453+0000 7f3fbeb52700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01000 0x559fa2de6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50084/0 (socket says 172.21.15.173:50084) 2024-09-13T23:57:04.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.453+0000 7f3fbeb52700 1 -- 172.21.15.173:0/2785439353 learned_addr learned my addr 172.21.15.173:0/2785439353 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.453+0000 7f3fbeb52700 1 -- 172.21.15.173:0/2785439353 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559fa2b13ba0 con 0x559fa2b01000 2024-09-13T23:57:04.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.453+0000 7f3fbeb52700 1 --2- 172.21.15.173:0/2785439353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01000 0x559fa2de6580 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x559fa2c5de00 tx=0x559fa2c05b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e566627733ff18d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.453+0000 7f3fbd34f700 1 -- 172.21.15.173:0/2785439353 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559fa2ba54a0 con 0x559fa2b01000 2024-09-13T23:57:04.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.453+0000 7f3fbd34f700 1 -- 172.21.15.173:0/2785439353 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559fa2bc5b00 con 0x559fa2b01000 2024-09-13T23:57:04.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.453+0000 7f3fbd34f700 1 -- 172.21.15.173:0/2785439353 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559fa2ba5600 con 0x559fa2b01000 2024-09-13T23:57:04.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.453+0000 7f3fc0399f40 1 -- 172.21.15.173:0/2785439353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01000 msgr2=0x559fa2de6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.453+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/2785439353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01000 0x559fa2de6580 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x559fa2c5de00 tx=0x559fa2c05b60 comp rx=0 tx=0).stop 2024-09-13T23:57:04.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.453+0000 7f3fc0399f40 1 -- 172.21.15.173:0/2785439353 shutdown_connections 2024-09-13T23:57:04.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.453+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/2785439353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01000 0x559fa2de6580 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.453+0000 7f3fc0399f40 1 -- 172.21.15.173:0/2785439353 >> 172.21.15.173:0/2785439353 conn(0x559fa2b00c00 msgr2=0x559fa2c01000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.453+0000 7f3fc0399f40 1 -- 172.21.15.173:0/2785439353 shutdown_connections 2024-09-13T23:57:04.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.453+0000 7f3fc0399f40 1 -- 172.21.15.173:0/2785439353 wait complete. 2024-09-13T23:57:04.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.453+0000 7f3fc0399f40 1 Processor -- start 2024-09-13T23:57:04.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.453+0000 7f3fc0399f40 1 -- start start 2024-09-13T23:57:04.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.457+0000 7f3fc0399f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01400 0x559fa2de6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.457+0000 7f3fc0399f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fa2b8e3c0 con 0x559fa2b01400 2024-09-13T23:57:04.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.457+0000 7f3fbeb52700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01400 0x559fa2de6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.457+0000 7f3fbeb52700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01400 0x559fa2de6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50090/0 (socket says 172.21.15.173:50090) 2024-09-13T23:57:04.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.457+0000 7f3fbeb52700 1 -- 172.21.15.173:0/477249629 learned_addr learned my addr 172.21.15.173:0/477249629 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.457+0000 7f3fbeb52700 1 -- 172.21.15.173:0/477249629 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559fa2b13a00 con 0x559fa2b01400 2024-09-13T23:57:04.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.457+0000 7f3fbeb52700 1 --2- 172.21.15.173:0/477249629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01400 0x559fa2de6b00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x559fa2c5de00 tx=0x559fa2c05a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.457+0000 7f3fbbb4c700 1 -- 172.21.15.173:0/477249629 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559fa2ba58c0 con 0x559fa2b01400 2024-09-13T23:57:04.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.457+0000 7f3fbbb4c700 1 -- 172.21.15.173:0/477249629 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559fa2bc5c80 con 0x559fa2b01400 2024-09-13T23:57:04.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.457+0000 7f3fc0399f40 1 -- 172.21.15.173:0/477249629 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559fa2b13860 con 0x559fa2b01400 2024-09-13T23:57:04.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.457+0000 7f3fbbb4c700 1 -- 172.21.15.173:0/477249629 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559fa2ba54a0 con 0x559fa2b01400 2024-09-13T23:57:04.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.457+0000 7f3fc0399f40 1 -- 172.21.15.173:0/477249629 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559fa2b136c0 con 0x559fa2b01400 2024-09-13T23:57:04.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.457+0000 7f3fc0399f40 1 Processor -- start 2024-09-13T23:57:04.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.457+0000 7f3fc0399f40 1 -- start start 2024-09-13T23:57:04.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.457+0000 7f3fc0399f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01c00 0x559fa2de7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.457+0000 7f3fc0399f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fa2b26640 con 0x559fa2b01c00 2024-09-13T23:57:04.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.457+0000 7f3fbbb4c700 1 -- 172.21.15.173:0/477249629 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x559fa2bfab00 con 0x559fa2b01400 2024-09-13T23:57:04.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.457+0000 7f3fbf353700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01c00 0x559fa2de7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.457+0000 7f3fbf353700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01c00 0x559fa2de7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50100/0 (socket says 172.21.15.173:50100) 2024-09-13T23:57:04.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.457+0000 7f3fbf353700 1 -- 172.21.15.173:0/235215102 learned_addr learned my addr 172.21.15.173:0/235215102 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.461+0000 7f3fbbb4c700 1 --2- 172.21.15.173:0/477249629 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559fa2ea6000 0x559fa2de8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.461+0000 7f3fbbb4c700 1 -- 172.21.15.173:0/477249629 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x559fa2b67180 con 0x559fa2b01400 2024-09-13T23:57:04.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.461+0000 7f3fbeb52700 1 --2- 172.21.15.173:0/477249629 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559fa2ea6000 0x559fa2de8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.461+0000 7f3fbf353700 1 -- 172.21.15.173:0/235215102 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559fa2b12000 con 0x559fa2b01c00 2024-09-13T23:57:04.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.461+0000 7f3fbf353700 1 --2- 172.21.15.173:0/235215102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01c00 0x559fa2de7080 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x559fa2e7c4b0 tx=0x559fa2e64a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e075342adba1d4b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.461+0000 7f3fbeb52700 1 --2- 172.21.15.173:0/477249629 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559fa2ea6000 0x559fa2de8100 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x559fa2e29650 tx=0x559fa2e64240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.461+0000 7f3fb9347700 1 -- 172.21.15.173:0/235215102 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559fa2ba58c0 con 0x559fa2b01c00 2024-09-13T23:57:04.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.461+0000 7f3fb9347700 1 -- 172.21.15.173:0/235215102 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559fa2ebe000 con 0x559fa2b01c00 2024-09-13T23:57:04.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.461+0000 7f3fb9347700 1 -- 172.21.15.173:0/235215102 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559fa2ba54a0 con 0x559fa2b01c00 2024-09-13T23:57:04.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.461+0000 7f3fc0399f40 1 -- 172.21.15.173:0/235215102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01c00 msgr2=0x559fa2de7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.461+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/235215102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01c00 0x559fa2de7080 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x559fa2e7c4b0 tx=0x559fa2e64a20 comp rx=0 tx=0).stop 2024-09-13T23:57:04.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.461+0000 7f3fc0399f40 1 -- 172.21.15.173:0/235215102 shutdown_connections 2024-09-13T23:57:04.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.461+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/235215102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01c00 0x559fa2de7080 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.461+0000 7f3fc0399f40 1 -- 172.21.15.173:0/235215102 >> 172.21.15.173:0/235215102 conn(0x559fa2b01800 msgr2=0x559fa2c01800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.461+0000 7f3fc0399f40 1 -- 172.21.15.173:0/235215102 shutdown_connections 2024-09-13T23:57:04.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.461+0000 7f3fc0399f40 1 -- 172.21.15.173:0/235215102 wait complete. 2024-09-13T23:57:04.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.461+0000 7f3fc0399f40 1 Processor -- start 2024-09-13T23:57:04.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.461+0000 7f3fc0399f40 1 -- start start 2024-09-13T23:57:04.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.461+0000 7f3fc0399f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01c00 0x559fa2de7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.461+0000 7f3fc0399f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fa2b268c0 con 0x559fa2b01c00 2024-09-13T23:57:04.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.461+0000 7f3fbf353700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01c00 0x559fa2de7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.461+0000 7f3fbf353700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01c00 0x559fa2de7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50102/0 (socket says 172.21.15.173:50102) 2024-09-13T23:57:04.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.461+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 learned_addr learned my addr 172.21.15.173:0/807012302 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.465+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559fa2b12ea0 con 0x559fa2b01c00 2024-09-13T23:57:04.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.465+0000 7f3fbf353700 1 --2- 172.21.15.173:0/807012302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01c00 0x559fa2de7080 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x559fa2e28150 tx=0x559fa2e64840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.465+0000 7f3fb7b44700 1 -- 172.21.15.173:0/807012302 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559fa2ba5b80 con 0x559fa2b01c00 2024-09-13T23:57:04.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.465+0000 7f3fb7b44700 1 -- 172.21.15.173:0/807012302 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559fa2ebe180 con 0x559fa2b01c00 2024-09-13T23:57:04.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.465+0000 7f3fb7b44700 1 -- 172.21.15.173:0/807012302 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559fa2ba58c0 con 0x559fa2b01c00 2024-09-13T23:57:04.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.465+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559fa2b12820 con 0x559fa2b01c00 2024-09-13T23:57:04.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.465+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559fa2b129c0 con 0x559fa2b01c00 2024-09-13T23:57:04.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.465+0000 7f3fb7b44700 1 -- 172.21.15.173:0/807012302 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x559fa2bfadc0 con 0x559fa2b01c00 2024-09-13T23:57:04.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.465+0000 7f3fc0399f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.465+0000 7f3fb7b44700 1 --2- 172.21.15.173:0/807012302 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559fa2ea6c00 0x559fa2de8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.465+0000 7f3fb7b44700 1 -- 172.21.15.173:0/807012302 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x559fa2b67340 con 0x559fa2b01c00 2024-09-13T23:57:04.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.465+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/807012302 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559fa2ea7000 0x559fa2de7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.465+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7400 con 0x559fa2ea7000 2024-09-13T23:57:04.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.465+0000 7f3fbe351700 1 --2- 172.21.15.173:0/807012302 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559fa2ea6c00 0x559fa2de8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.469+0000 7f3fbf353700 1 --2- 172.21.15.173:0/807012302 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559fa2ea7000 0x559fa2de7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.469+0000 7f3fbe351700 1 --2- 172.21.15.173:0/807012302 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559fa2ea6c00 0x559fa2de8680 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x559fa2de1920 tx=0x559fa2c05800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.469+0000 7f3fbf353700 1 --2- 172.21.15.173:0/807012302 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559fa2ea7000 0x559fa2de7600 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.469+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2ea7000 2024-09-13T23:57:04.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.469+0000 7f3fc0399f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.469+0000 7f3fc0399f40 20 realm 2024-09-13T23:57:04.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.469+0000 7f3fc0399f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.469+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7000 2024-09-13T23:57:04.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.469+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2ea7000 2024-09-13T23:57:04.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.469+0000 7f3fc0399f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.469+0000 7f3fc0399f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:04.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.469+0000 7f3fc0399f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.469+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7c00 con 0x559fa2ea7000 2024-09-13T23:57:04.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.469+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2ea7000 2024-09-13T23:57:04.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.469+0000 7f3fc0399f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.469+0000 7f3fc0399f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.469+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/807012302 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559fa2ea7400 0x559fa2de7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.469+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7400 2024-09-13T23:57:04.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.469+0000 7f3fbeb52700 1 --2- 172.21.15.173:0/807012302 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559fa2ea7400 0x559fa2de7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.469+0000 7f3fbeb52700 1 --2- 172.21.15.173:0/807012302 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559fa2ea7400 0x559fa2de7b80 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.473+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x559fa2f51200 con 0x559fa2ea7400 2024-09-13T23:57:04.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.473+0000 7f3fc0399f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:04.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.473+0000 7f3fc0399f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.473+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/807012302 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559fa2ea7c00 0x559fa2de8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.473+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2f64000 con 0x559fa2ea7c00 2024-09-13T23:57:04.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.473+0000 7f3fbe351700 1 --2- 172.21.15.173:0/807012302 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559fa2ea7c00 0x559fa2de8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.473+0000 7f3fbe351700 1 --2- 172.21.15.173:0/807012302 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559fa2ea7c00 0x559fa2de8c00 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.473+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x559fa2f51440 con 0x559fa2ea7c00 2024-09-13T23:57:04.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.473+0000 7f3fc0399f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:04.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.473+0000 7f3fc0399f40 20 searching for the correct realm 2024-09-13T23:57:04.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.473+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2f64400 con 0x559fa2ea7c00 2024-09-13T23:57:04.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.473+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x559fa2f51440 con 0x559fa2ea7c00 2024-09-13T23:57:04.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.473+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2f64000 con 0x559fa2ea7400 2024-09-13T23:57:04.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.473+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f51200 con 0x559fa2ea7400 2024-09-13T23:57:04.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.473+0000 7f3fbeb52700 1 --2- 172.21.15.173:0/807012302 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559fa2f64000 0x559fa2de6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.473+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2f64000 2024-09-13T23:57:04.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.473+0000 7f3fbf353700 1 --2- 172.21.15.173:0/807012302 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559fa2f64000 0x559fa2de6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.473+0000 7f3fbf353700 1 --2- 172.21.15.173:0/807012302 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559fa2f64000 0x559fa2de6580 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.477+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2f64000 2024-09-13T23:57:04.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.477+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7000 2024-09-13T23:57:04.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.477+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2ea7000 2024-09-13T23:57:04.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.477+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7000 2024-09-13T23:57:04.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.477+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2ea7000 2024-09-13T23:57:04.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.477+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7c00 2024-09-13T23:57:04.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.477+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f51440 con 0x559fa2ea7c00 2024-09-13T23:57:04.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.477+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7000 2024-09-13T23:57:04.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.477+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2ea7000 2024-09-13T23:57:04.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.477+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7400 2024-09-13T23:57:04.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.477+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f51200 con 0x559fa2ea7400 2024-09-13T23:57:04.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.477+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7400 2024-09-13T23:57:04.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.481+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f51200 con 0x559fa2ea7400 2024-09-13T23:57:04.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.481+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7000 2024-09-13T23:57:04.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.481+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2ea7000 2024-09-13T23:57:04.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.481+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2f64000 2024-09-13T23:57:04.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.481+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2f64000 2024-09-13T23:57:04.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.481+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7000 2024-09-13T23:57:04.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.481+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2ea7000 2024-09-13T23:57:04.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.481+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2f64000 2024-09-13T23:57:04.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.481+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2f64000 2024-09-13T23:57:04.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.481+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7400 2024-09-13T23:57:04.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.481+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f51200 con 0x559fa2ea7400 2024-09-13T23:57:04.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.481+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7c00 2024-09-13T23:57:04.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.481+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f51440 con 0x559fa2ea7c00 2024-09-13T23:57:04.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.481+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7000 2024-09-13T23:57:04.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.481+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2ea7000 2024-09-13T23:57:04.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.481+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7400 2024-09-13T23:57:04.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.485+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f51200 con 0x559fa2ea7400 2024-09-13T23:57:04.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.485+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7c00 2024-09-13T23:57:04.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.485+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f51440 con 0x559fa2ea7c00 2024-09-13T23:57:04.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.485+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7000 2024-09-13T23:57:04.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.485+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2ea7000 2024-09-13T23:57:04.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.485+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7000 2024-09-13T23:57:04.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.485+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2ea7000 2024-09-13T23:57:04.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.485+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7000 2024-09-13T23:57:04.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.485+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2ea7000 2024-09-13T23:57:04.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.485+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7c00 2024-09-13T23:57:04.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.485+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f51440 con 0x559fa2ea7c00 2024-09-13T23:57:04.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.485+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2f64000 2024-09-13T23:57:04.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.489+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2f64000 2024-09-13T23:57:04.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.489+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7000 2024-09-13T23:57:04.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.489+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2ea7000 2024-09-13T23:57:04.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.489+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2f64000 2024-09-13T23:57:04.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.489+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2f64000 2024-09-13T23:57:04.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.489+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7c00 2024-09-13T23:57:04.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.489+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f51440 con 0x559fa2ea7c00 2024-09-13T23:57:04.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.489+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2f64000 2024-09-13T23:57:04.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.489+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2f64000 2024-09-13T23:57:04.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.489+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7400 2024-09-13T23:57:04.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.489+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f51200 con 0x559fa2ea7400 2024-09-13T23:57:04.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.489+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7400 2024-09-13T23:57:04.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.493+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f51200 con 0x559fa2ea7400 2024-09-13T23:57:04.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.493+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7c00 2024-09-13T23:57:04.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.493+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f51440 con 0x559fa2ea7c00 2024-09-13T23:57:04.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.493+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7400 2024-09-13T23:57:04.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.493+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x559fa2f51200 con 0x559fa2ea7400 2024-09-13T23:57:04.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.493+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7400 2024-09-13T23:57:04.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.493+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559fa2f51200 con 0x559fa2ea7400 2024-09-13T23:57:04.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.493+0000 7f3fc0399f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:04.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.493+0000 7f3fc0399f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:04.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.493+0000 7f3fc0399f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:04.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.493+0000 7f3fc0399f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:04.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.493+0000 7f3fc0399f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.493+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2f64800 con 0x559fa2ea7000 2024-09-13T23:57:04.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.493+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2ea7000 2024-09-13T23:57:04.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.493+0000 7f3fc0399f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.493+0000 7f3fc0399f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.493+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2f64c00 con 0x559fa2ea7400 2024-09-13T23:57:04.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x559fa2f51200 con 0x559fa2ea7400 2024-09-13T23:57:04.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fc0399f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:04.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fc0399f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2f65000 con 0x559fa2ea7000 2024-09-13T23:57:04.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2ea7000 2024-09-13T23:57:04.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fc0399f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:04.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fc0399f40 20 zone default found 2024-09-13T23:57:04.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fc0399f40 4 Realm: () 2024-09-13T23:57:04.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fc0399f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:04.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fc0399f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:04.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fc0399f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:04.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fc0399f40 20 zonegroup default 2024-09-13T23:57:04.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fc0399f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2f65400 con 0x559fa2f64000 2024-09-13T23:57:04.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2f64000 2024-09-13T23:57:04.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fc0399f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fc0399f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2f65800 con 0x559fa2ea7c00 2024-09-13T23:57:04.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x559fa2f51440 con 0x559fa2ea7c00 2024-09-13T23:57:04.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fc0399f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fc0399f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2f65c00 con 0x559fa2ea7c00 2024-09-13T23:57:04.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x559fa2f51440 con 0x559fa2ea7c00 2024-09-13T23:57:04.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fc0399f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fc0399f40 20 started sync module instance, tier type = 2024-09-13T23:57:04.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fc0399f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:04.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.497+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2e4a000 con 0x559fa2ea7400 2024-09-13T23:57:04.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.501+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f51200 con 0x559fa2ea7400 2024-09-13T23:57:04.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.501+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94144120609536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2e4a400 con 0x559fa2ea7400 2024-09-13T23:57:04.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.501+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2e4a800 con 0x559fa2ea7000 2024-09-13T23:57:04.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.505+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2ea7000 2024-09-13T23:57:04.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.505+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94144120610688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2e4ac00 con 0x559fa2ea7000 2024-09-13T23:57:04.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.505+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2e4b000 con 0x559fa2ea7400 2024-09-13T23:57:04.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.505+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94144120609536] v33'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f51200 con 0x559fa2ea7400 2024-09-13T23:57:04.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.505+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94144120610688] v33'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2ea7000 2024-09-13T23:57:04.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.505+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f51200 con 0x559fa2ea7400 2024-09-13T23:57:04.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.505+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94144120611840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2e4b400 con 0x559fa2ea7400 2024-09-13T23:57:04.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.505+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2e4b800 con 0x559fa2f64000 2024-09-13T23:57:04.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.509+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94144120611840] v33'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f51200 con 0x559fa2ea7400 2024-09-13T23:57:04.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.509+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2f64000 2024-09-13T23:57:04.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.509+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94144120612992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2e4bc00 con 0x559fa2f64000 2024-09-13T23:57:04.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.509+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2e4a800 con 0x559fa2ea7400 2024-09-13T23:57:04.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.513+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94144120612992] v33'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2f64000 2024-09-13T23:57:04.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.513+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f51200 con 0x559fa2ea7400 2024-09-13T23:57:04.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.513+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94144120614144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2e4a000 con 0x559fa2ea7400 2024-09-13T23:57:04.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.513+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2e4a400 con 0x559fa2ea7c00 2024-09-13T23:57:04.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.513+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f51440 con 0x559fa2ea7c00 2024-09-13T23:57:04.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.513+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94144120615296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2f64800 con 0x559fa2ea7c00 2024-09-13T23:57:04.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.513+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2f65000 con 0x559fa2ea7c00 2024-09-13T23:57:04.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.513+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94144120614144] v33'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f51200 con 0x559fa2ea7400 2024-09-13T23:57:04.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.517+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94144120615296] v33'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f51440 con 0x559fa2ea7c00 2024-09-13T23:57:04.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.517+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f51440 con 0x559fa2ea7c00 2024-09-13T23:57:04.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.517+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94144120616448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2f65400 con 0x559fa2ea7c00 2024-09-13T23:57:04.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.517+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2f64c00 con 0x559fa2f64000 2024-09-13T23:57:04.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.517+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94144120616448] v33'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f51440 con 0x559fa2ea7c00 2024-09-13T23:57:04.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.517+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2f64000 2024-09-13T23:57:04.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.517+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94144120617600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2f64000 2024-09-13T23:57:04.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.517+0000 7f3fc0399f40 20 add_watcher() i=0 2024-09-13T23:57:04.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.517+0000 7f3fc0399f40 20 add_watcher() i=1 2024-09-13T23:57:04.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.517+0000 7f3fc0399f40 20 add_watcher() i=2 2024-09-13T23:57:04.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.517+0000 7f3fc0399f40 20 add_watcher() i=3 2024-09-13T23:57:04.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.517+0000 7f3fc0399f40 20 add_watcher() i=4 2024-09-13T23:57:04.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.517+0000 7f3fc0399f40 20 add_watcher() i=5 2024-09-13T23:57:04.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.517+0000 7f3fc0399f40 20 add_watcher() i=6 2024-09-13T23:57:04.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.521+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94144120617600] v33'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2f64000 2024-09-13T23:57:04.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.521+0000 7f3fc0399f40 20 add_watcher() i=7 2024-09-13T23:57:04.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.521+0000 7f3fc0399f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:04.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.521+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2e4ac00 con 0x559fa2ea7000 2024-09-13T23:57:04.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.521+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2ea7000 2024-09-13T23:57:04.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.521+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94144122281984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2e4b800 con 0x559fa2ea7000 2024-09-13T23:57:04.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.525+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94144122281984] v33'110 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2ea7000 2024-09-13T23:57:04.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.525+0000 7f3fa5b20700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:04.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.525+0000 7f3fc0399f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:04.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.525+0000 7f3fc0399f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:04.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.525+0000 7f3fc0399f40 1 Processor -- start 2024-09-13T23:57:04.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.525+0000 7f3fc0399f40 1 -- start start 2024-09-13T23:57:04.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.525+0000 7f3fc0399f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2e4a400 0x559fa2de9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.525+0000 7f3fc0399f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fa2b8e3c0 con 0x559fa2e4a400 2024-09-13T23:57:04.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.525+0000 7f3fbe351700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2e4a400 0x559fa2de9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.525+0000 7f3fbe351700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2e4a400 0x559fa2de9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50116/0 (socket says 172.21.15.173:50116) 2024-09-13T23:57:04.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.525+0000 7f3fbe351700 1 -- 172.21.15.173:0/335881290 learned_addr learned my addr 172.21.15.173:0/335881290 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.525+0000 7f3fbe351700 1 -- 172.21.15.173:0/335881290 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559fa2b12b60 con 0x559fa2e4a400 2024-09-13T23:57:04.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.525+0000 7f3fbe351700 1 --2- 172.21.15.173:0/335881290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2e4a400 0x559fa2de9180 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x559fa2f03ec0 tx=0x559fa2c05980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43be52577927dfe1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.525+0000 7f3fa531f700 1 -- 172.21.15.173:0/335881290 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559fa2ba5760 con 0x559fa2e4a400 2024-09-13T23:57:04.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.525+0000 7f3fa531f700 1 -- 172.21.15.173:0/335881290 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559fa2ebe600 con 0x559fa2e4a400 2024-09-13T23:57:04.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.525+0000 7f3fa531f700 1 -- 172.21.15.173:0/335881290 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559fa2f86000 con 0x559fa2e4a400 2024-09-13T23:57:04.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.525+0000 7f3fc0399f40 1 -- 172.21.15.173:0/335881290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2e4a400 msgr2=0x559fa2de9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.525+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/335881290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2e4a400 0x559fa2de9180 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x559fa2f03ec0 tx=0x559fa2c05980 comp rx=0 tx=0).stop 2024-09-13T23:57:04.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.525+0000 7f3fc0399f40 1 -- 172.21.15.173:0/335881290 shutdown_connections 2024-09-13T23:57:04.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.525+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/335881290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2e4a400 0x559fa2de9180 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.525+0000 7f3fc0399f40 1 -- 172.21.15.173:0/335881290 >> 172.21.15.173:0/335881290 conn(0x559fa2e4bc00 msgr2=0x559fa2c02000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.525+0000 7f3fc0399f40 1 -- 172.21.15.173:0/335881290 shutdown_connections 2024-09-13T23:57:04.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.529+0000 7f3fc0399f40 1 -- 172.21.15.173:0/335881290 wait complete. 2024-09-13T23:57:04.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.529+0000 7f3fc0399f40 1 Processor -- start 2024-09-13T23:57:04.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.529+0000 7f3fc0399f40 1 -- start start 2024-09-13T23:57:04.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.529+0000 7f3fc0399f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2e4a400 0x559fa2de9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.529+0000 7f3fc0399f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fa2b8e500 con 0x559fa2e4a400 2024-09-13T23:57:04.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.529+0000 7f3fbe351700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2e4a400 0x559fa2de9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.529+0000 7f3fbe351700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2e4a400 0x559fa2de9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50124/0 (socket says 172.21.15.173:50124) 2024-09-13T23:57:04.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.529+0000 7f3fbe351700 1 -- 172.21.15.173:0/3423363965 learned_addr learned my addr 172.21.15.173:0/3423363965 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.529+0000 7f3fbe351700 1 -- 172.21.15.173:0/3423363965 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559fa2b12d00 con 0x559fa2e4a400 2024-09-13T23:57:04.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.529+0000 7f3fbe351700 1 --2- 172.21.15.173:0/3423363965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2e4a400 0x559fa2de9180 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x559fa2f88120 tx=0x559fa2e65c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.529+0000 7f3fa3b1c700 1 -- 172.21.15.173:0/3423363965 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559fa2f86160 con 0x559fa2e4a400 2024-09-13T23:57:04.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.529+0000 7f3fa3b1c700 1 -- 172.21.15.173:0/3423363965 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559fa2ebe300 con 0x559fa2e4a400 2024-09-13T23:57:04.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.529+0000 7f3fc0399f40 1 -- 172.21.15.173:0/3423363965 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559fa2b12340 con 0x559fa2e4a400 2024-09-13T23:57:04.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.529+0000 7f3fa3b1c700 1 -- 172.21.15.173:0/3423363965 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559fa2f862c0 con 0x559fa2e4a400 2024-09-13T23:57:04.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.529+0000 7f3fc0399f40 1 -- 172.21.15.173:0/3423363965 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559fa2b13d40 con 0x559fa2e4a400 2024-09-13T23:57:04.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.529+0000 7f3fa3b1c700 1 -- 172.21.15.173:0/3423363965 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x559fa2bfbb80 con 0x559fa2e4a400 2024-09-13T23:57:04.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.533+0000 7f3fa3b1c700 1 --2- 172.21.15.173:0/3423363965 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559fa2ffc000 0x559fa3002000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.533+0000 7f3fa3b1c700 1 -- 172.21.15.173:0/3423363965 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x559fa2b67500 con 0x559fa2e4a400 2024-09-13T23:57:04.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.533+0000 7f3fc0399f40 5 note: GC not initialized 2024-09-13T23:57:04.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.533+0000 7f3fbf353700 1 --2- 172.21.15.173:0/3423363965 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559fa2ffc000 0x559fa3002000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.533+0000 7f3fbf353700 1 --2- 172.21.15.173:0/3423363965 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559fa2ffc000 0x559fa3002000 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x559fa2f03860 tx=0x559fa2fc8ae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.533+0000 7f3fa1317700 20 reqs_thread_entry: start 2024-09-13T23:57:04.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.533+0000 7f3fc0399f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:04.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.533+0000 7f3fc0399f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:04.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.533+0000 7f3f9f313700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:34 2024 2024-09-13T23:57:04.540 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:04.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.533+0000 7f3f9eaf1700 20 reqs_thread_entry: start 2024-09-13T23:57:04.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.533+0000 7f3fc0399f40 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:57:04.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.533+0000 7f3fc0399f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.533+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2f65800 con 0x559fa2f64000 2024-09-13T23:57:04.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.533+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(62 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2f64000 2024-09-13T23:57:04.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.533+0000 7f3fc0399f40 20 rados_obj.operate() r=0 bl.length=346 2024-09-13T23:57:04.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.533+0000 7f3fc0399f40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T23:57:04.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.533+0000 7f3fc0399f40 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:57:04.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.537+0000 7f3fc0399f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:04.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.537+0000 7f3fc0399f40 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:57:04.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.537+0000 7f3fc0399f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.537+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2f65c00 con 0x559fa2f64000 2024-09-13T23:57:04.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.537+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2f64000 2024-09-13T23:57:04.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.537+0000 7f3fc0399f40 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:57:04.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.537+0000 7f3fc0399f40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:57:04.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.537+0000 7f3fc0399f40 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:57:04.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.537+0000 7f3fc0399f40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 : miss 2024-09-13T23:57:04.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.537+0000 7f3fc0399f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.537+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 8.17 8:ea49432e:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7400 2024-09-13T23:57:04.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.537+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(64 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x559fa2f51200 con 0x559fa2ea7400 2024-09-13T23:57:04.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.537+0000 7f3fc0399f40 20 rados_obj.operate() r=0 bl.length=352 2024-09-13T23:57:04.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.537+0000 7f3fc0399f40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 info.flags=0x17 2024-09-13T23:57:04.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.537+0000 7f3fc0399f40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 to cache LRU end 2024-09-13T23:57:04.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.537+0000 7f3fc0399f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:04.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.537+0000 7f3fc0399f40 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:57:04.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.537+0000 7f3fc0399f40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 2024-09-13T23:57:04.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.537+0000 7f3fc0399f40 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-13T23:57:04.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.537+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ffc400 con 0x559fa2f64000 2024-09-13T23:57:04.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.541+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(65 foo.buckets [call] v33'19 uv17 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2f64000 2024-09-13T23:57:04.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.541+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 8.17 8:ea49432e:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ffcc00 con 0x559fa2ea7400 2024-09-13T23:57:04.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.541+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(66 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v33'2 uv2 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x559fa2f51200 con 0x559fa2ea7400 2024-09-13T23:57:04.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.541+0000 7f3fc0399f40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 info.flags=0x17 2024-09-13T23:57:04.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.541+0000 7f3fc0399f40 10 moving default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 to cache LRU end 2024-09-13T23:57:04.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.541+0000 7f3fc0399f40 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:57:04.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.541+0000 7f3fc0399f40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1, ofs0, ns] 2024-09-13T23:57:04.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.541+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94144122284288 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ffd400 con 0x559fa2ea7400 2024-09-13T23:57:04.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.541+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== watch-notify(notify (1) cookie 94144120611840 notify 141733920787 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x559fa2e62820 con 0x559fa2ea7400 2024-09-13T23:57:04.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.541+0000 7f3fb9347700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920787 cookie 94144120611840 notifier 4544 bl.length()=725 2024-09-13T23:57:04.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.541+0000 7f3fb9347700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 info.flags=0x17 2024-09-13T23:57:04.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.541+0000 7f3fb9347700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 to cache LRU end 2024-09-13T23:57:04.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.541+0000 7f3fb9347700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:57:04.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.541+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(67 notify.2 [notify cookie 94144122284288 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x559fa2f51200 con 0x559fa2ea7400 2024-09-13T23:57:04.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.541+0000 7f3fb9347700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa3080000 con 0x559fa2ea7400 2024-09-13T23:57:04.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.545+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f51200 con 0x559fa2ea7400 2024-09-13T23:57:04.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.545+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== watch-notify(notify_complete (2) cookie 94144122284288 notify 141733920787 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x559fa2e629c0 con 0x559fa2ea7400 2024-09-13T23:57:04.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.545+0000 7f3fc0399f40 20 handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1]): orig_sources= new_sources= 2024-09-13T23:57:04.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.545+0000 7f3fc0399f40 20 handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1]): potential sources added=[] removed=[] 2024-09-13T23:57:04.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.545+0000 7f3fc0399f40 20 handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1]): orig_dests= new_dests= 2024-09-13T23:57:04.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.545+0000 7f3fc0399f40 20 handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1]): potential dests added=[] removed=[] 2024-09-13T23:57:04.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.545+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ffd800 con 0x559fa2ea7000 2024-09-13T23:57:04.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.545+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(69 fud.buckets [call] v33'1 uv1 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2ea7000 2024-09-13T23:57:04.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.545+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ffdc00 con 0x559fa2f64000 2024-09-13T23:57:04.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.549+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v33'20 uv20 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2f64000 2024-09-13T23:57:04.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.549+0000 7f3fc0399f40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T23:57:04.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.549+0000 7f3fc0399f40 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:57:04.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.549+0000 7f3fc0399f40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T23:57:04.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.549+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94144122284288 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ea7800 con 0x559fa2ea7c00 2024-09-13T23:57:04.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.549+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== watch-notify(notify (1) cookie 94144120616448 notify 141733920780 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x559fa2fc69c0 con 0x559fa2ea7c00 2024-09-13T23:57:04.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.549+0000 7f3fb9347700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920780 cookie 94144120616448 notifier 4544 bl.length()=314 2024-09-13T23:57:04.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.549+0000 7f3fb9347700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T23:57:04.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.549+0000 7f3fb9347700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:57:04.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.549+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(71 notify.6 [notify cookie 94144122284288 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x559fa2f51440 con 0x559fa2ea7c00 2024-09-13T23:57:04.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.549+0000 7f3fb9347700 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa3080400 con 0x559fa2ea7c00 2024-09-13T23:57:04.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.549+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== watch-notify(notify_complete (2) cookie 94144122284288 notify 141733920780 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x559fa2fc6b60 con 0x559fa2ea7c00 2024-09-13T23:57:04.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.549+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f51440 con 0x559fa2ea7c00 2024-09-13T23:57:04.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.553+0000 7f3fa5b20700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:04.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.553+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94144122281984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2e4b000 con 0x559fa2ea7000 2024-09-13T23:57:04.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.553+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94144122281984] v33'111 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2ea7000 2024-09-13T23:57:04.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.553+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94144120609536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2e4b400 con 0x559fa2ea7400 2024-09-13T23:57:04.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.557+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94144120609536] v33'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f51200 con 0x559fa2ea7400 2024-09-13T23:57:04.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.557+0000 7f3fc0399f40 20 remove_watcher() i=0 2024-09-13T23:57:04.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.557+0000 7f3fc0399f40 2 removed watcher, disabling cache 2024-09-13T23:57:04.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.557+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94144120610688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2e4a800 con 0x559fa2ea7000 2024-09-13T23:57:04.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.561+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94144120610688] v33'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2ea7000 2024-09-13T23:57:04.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.561+0000 7f3fc0399f40 20 remove_watcher() i=1 2024-09-13T23:57:04.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.561+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94144120611840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa3080000 con 0x559fa2ea7400 2024-09-13T23:57:04.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.561+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94144120611840] v33'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f51200 con 0x559fa2ea7400 2024-09-13T23:57:04.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.561+0000 7f3fc0399f40 20 remove_watcher() i=2 2024-09-13T23:57:04.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.561+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94144120612992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ffd000 con 0x559fa2f64000 2024-09-13T23:57:04.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.565+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94144120612992] v33'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2f64000 2024-09-13T23:57:04.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.565+0000 7f3fc0399f40 20 remove_watcher() i=3 2024-09-13T23:57:04.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.565+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94144120614144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ffc800 con 0x559fa2ea7400 2024-09-13T23:57:04.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.569+0000 7f3fbeb52700 1 -- 172.21.15.173:0/807012302 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94144120614144] v33'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f51200 con 0x559fa2ea7400 2024-09-13T23:57:04.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.569+0000 7f3fc0399f40 20 remove_watcher() i=4 2024-09-13T23:57:04.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.569+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94144120615296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ffcc00 con 0x559fa2ea7c00 2024-09-13T23:57:04.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.569+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94144120615296] v33'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f51440 con 0x559fa2ea7c00 2024-09-13T23:57:04.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.569+0000 7f3fc0399f40 20 remove_watcher() i=5 2024-09-13T23:57:04.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.569+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94144120616448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ffd400 con 0x559fa2ea7c00 2024-09-13T23:57:04.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.573+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 <== osd.3 v2:172.21.15.173:6800/4020038786 20 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94144120616448] v33'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f51440 con 0x559fa2ea7c00 2024-09-13T23:57:04.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.573+0000 7f3fc0399f40 20 remove_watcher() i=6 2024-09-13T23:57:04.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.573+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94144120617600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559fa2ffc400 con 0x559fa2f64000 2024-09-13T23:57:04.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.573+0000 7f3fbf353700 1 -- 172.21.15.173:0/807012302 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94144120617600] v33'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559fa2f50b40 con 0x559fa2f64000 2024-09-13T23:57:04.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.573+0000 7f3fc0399f40 20 remove_watcher() i=7 2024-09-13T23:57:04.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.573+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559fa2ea7400 msgr2=0x559fa2de7b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.573+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/807012302 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559fa2ea7400 0x559fa2de7b80 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.573+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559fa2ea7000 msgr2=0x559fa2de7600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.573+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/807012302 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559fa2ea7000 0x559fa2de7600 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.573+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559fa2f64000 msgr2=0x559fa2de6580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.573+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/807012302 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559fa2f64000 0x559fa2de6580 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.573+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559fa2ea7c00 msgr2=0x559fa2de8c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.573+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/807012302 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559fa2ea7c00 0x559fa2de8c00 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.573+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559fa2ea6c00 msgr2=0x559fa2de8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.573+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/807012302 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559fa2ea6c00 0x559fa2de8680 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x559fa2de1920 tx=0x559fa2c05800 comp rx=0 tx=0).stop 2024-09-13T23:57:04.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.573+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01c00 msgr2=0x559fa2de7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.573+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/807012302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01c00 0x559fa2de7080 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x559fa2e28150 tx=0x559fa2e64840 comp rx=0 tx=0).stop 2024-09-13T23:57:04.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.573+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 reap_dead start 2024-09-13T23:57:04.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.573+0000 7f3fbe351700 1 -- 172.21.15.173:0/807012302 reap_dead start 2024-09-13T23:57:04.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.573+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 shutdown_connections 2024-09-13T23:57:04.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.573+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 >> 172.21.15.173:0/807012302 conn(0x559fa2b01800 msgr2=0x559fa2c01800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.577+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 shutdown_connections 2024-09-13T23:57:04.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.577+0000 7f3fc0399f40 1 -- 172.21.15.173:0/807012302 wait complete. 2024-09-13T23:57:04.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.577+0000 7f3fc0399f40 1 -- 172.21.15.173:0/3423363965 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559fa2ffc000 msgr2=0x559fa3002000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.577+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/3423363965 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559fa2ffc000 0x559fa3002000 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x559fa2f03860 tx=0x559fa2fc8ae0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.577+0000 7f3fc0399f40 1 -- 172.21.15.173:0/3423363965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2e4a400 msgr2=0x559fa2de9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.577+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/3423363965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2e4a400 0x559fa2de9180 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x559fa2f88120 tx=0x559fa2e65c20 comp rx=0 tx=0).stop 2024-09-13T23:57:04.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.577+0000 7f3fc0399f40 1 -- 172.21.15.173:0/3423363965 shutdown_connections 2024-09-13T23:57:04.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.577+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/3423363965 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559fa2ffc000 0x559fa3002000 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.577+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/3423363965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2e4a400 0x559fa2de9180 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.577+0000 7f3fc0399f40 1 -- 172.21.15.173:0/3423363965 >> 172.21.15.173:0/3423363965 conn(0x559fa2e4bc00 msgr2=0x559fa2c02000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.577+0000 7f3fc0399f40 1 -- 172.21.15.173:0/3423363965 shutdown_connections 2024-09-13T23:57:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.577+0000 7f3fc0399f40 1 -- 172.21.15.173:0/3423363965 wait complete. 2024-09-13T23:57:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.577+0000 7f3fc0399f40 1 -- 172.21.15.173:0/477249629 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559fa2ea6000 msgr2=0x559fa2de8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.577+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/477249629 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559fa2ea6000 0x559fa2de8100 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x559fa2e29650 tx=0x559fa2e64240 comp rx=0 tx=0).stop 2024-09-13T23:57:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.577+0000 7f3fc0399f40 1 -- 172.21.15.173:0/477249629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01400 msgr2=0x559fa2de6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.577+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/477249629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01400 0x559fa2de6b00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x559fa2c5de00 tx=0x559fa2c05a40 comp rx=0 tx=0).stop 2024-09-13T23:57:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.577+0000 7f3fc0399f40 1 -- 172.21.15.173:0/477249629 shutdown_connections 2024-09-13T23:57:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.577+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/477249629 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559fa2ea6000 0x559fa2de8100 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.577+0000 7f3fc0399f40 1 --2- 172.21.15.173:0/477249629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559fa2b01400 0x559fa2de6b00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.577+0000 7f3fc0399f40 1 -- 172.21.15.173:0/477249629 >> 172.21.15.173:0/477249629 conn(0x559fa2b00c00 msgr2=0x559fa2c01000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.577+0000 7f3fc0399f40 1 -- 172.21.15.173:0/477249629 shutdown_connections 2024-09-13T23:57:04.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.577+0000 7f3fc0399f40 1 -- 172.21.15.173:0/477249629 wait complete. 2024-09-13T23:57:04.588 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-13T23:57:04.588 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-13T23:57:04.589 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-13T23:57:04.633 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:04.633 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:04.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.629+0000 7f38d7fa1f40 1 Processor -- start 2024-09-13T23:57:04.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.629+0000 7f38d7fa1f40 1 -- start start 2024-09-13T23:57:04.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.629+0000 7f38d7fa1f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55874e1f3400 0x55874e4d8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.629+0000 7f38d7fa1f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55874e2b7500 con 0x55874e1f3000 2024-09-13T23:57:04.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.629+0000 7f38d7fa1f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55874e280a00 con 0x55874e1f3400 2024-09-13T23:57:04.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.629+0000 7f38d5f59700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55874e1f3400 0x55874e4d8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.629+0000 7f38d675a700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55874e1f3000 0x55874e2f2800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47448/0 (socket says 172.21.15.173:47448) 2024-09-13T23:57:04.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.629+0000 7f38d675a700 1 -- 172.21.15.173:0/2649469746 learned_addr learned my addr 172.21.15.173:0/2649469746 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:04.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.629+0000 7f38d5f59700 1 -- 172.21.15.173:0/2649469746 >> v1:172.21.15.87:6789/0 conn(0x55874e1f3000 legacy=0x55874e2f2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.629+0000 7f38d5f59700 1 -- 172.21.15.173:0/2649469746 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55874e205d40 con 0x55874e1f3400 2024-09-13T23:57:04.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.629+0000 7f38d5f59700 1 --2- 172.21.15.173:0/2649469746 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3400 0x55874e4d8580 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x55874e4d3920 tx=0x55874e2f7920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227e62c0a515095 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.629+0000 7f38d5758700 1 -- 172.21.15.173:0/2649469746 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55874e2974a0 con 0x55874e1f3400 2024-09-13T23:57:04.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.629+0000 7f38d5758700 1 -- 172.21.15.173:0/2649469746 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55874e2b7800 con 0x55874e1f3400 2024-09-13T23:57:04.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.629+0000 7f38d5758700 1 -- 172.21.15.173:0/2649469746 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55874e297600 con 0x55874e1f3400 2024-09-13T23:57:04.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.629+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2649469746 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3400 msgr2=0x55874e4d8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.629+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/2649469746 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3400 0x55874e4d8580 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x55874e4d3920 tx=0x55874e2f7920 comp rx=0 tx=0).stop 2024-09-13T23:57:04.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.629+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2649469746 shutdown_connections 2024-09-13T23:57:04.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.629+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/2649469746 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3400 0x55874e4d8580 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.629+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2649469746 >> 172.21.15.173:0/2649469746 conn(0x55874e1f2c00 msgr2=0x55874e2f2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.629+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2649469746 shutdown_connections 2024-09-13T23:57:04.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.629+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2649469746 wait complete. 2024-09-13T23:57:04.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.633+0000 7f38d7fa1f40 1 Processor -- start 2024-09-13T23:57:04.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.633+0000 7f38d7fa1f40 1 -- start start 2024-09-13T23:57:04.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.633+0000 7f38d7fa1f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3000 0x55874e4d8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.633+0000 7f38d7fa1f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55874e280500 con 0x55874e1f3000 2024-09-13T23:57:04.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.633+0000 7f38d675a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3000 0x55874e4d8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.633+0000 7f38d675a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3000 0x55874e4d8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50150/0 (socket says 172.21.15.173:50150) 2024-09-13T23:57:04.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.633+0000 7f38d675a700 1 -- 172.21.15.173:0/3829147157 learned_addr learned my addr 172.21.15.173:0/3829147157 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.633+0000 7f38d675a700 1 -- 172.21.15.173:0/3829147157 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55874e205ba0 con 0x55874e1f3000 2024-09-13T23:57:04.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.633+0000 7f38d675a700 1 --2- 172.21.15.173:0/3829147157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3000 0x55874e4d8580 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x55874efbde60 tx=0x55874e2f7b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8fbfe126be4a05 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.633+0000 7f38d4f57700 1 -- 172.21.15.173:0/3829147157 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55874e2974a0 con 0x55874e1f3000 2024-09-13T23:57:04.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.633+0000 7f38d4f57700 1 -- 172.21.15.173:0/3829147157 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55874e2b7b00 con 0x55874e1f3000 2024-09-13T23:57:04.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.633+0000 7f38d4f57700 1 -- 172.21.15.173:0/3829147157 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55874e297600 con 0x55874e1f3000 2024-09-13T23:57:04.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.633+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/3829147157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3000 msgr2=0x55874e4d8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.633+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/3829147157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3000 0x55874e4d8580 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x55874efbde60 tx=0x55874e2f7b60 comp rx=0 tx=0).stop 2024-09-13T23:57:04.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.633+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/3829147157 shutdown_connections 2024-09-13T23:57:04.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.633+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/3829147157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3000 0x55874e4d8580 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.633+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/3829147157 >> 172.21.15.173:0/3829147157 conn(0x55874e1f2c00 msgr2=0x55874e2f3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.633+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/3829147157 shutdown_connections 2024-09-13T23:57:04.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.633+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/3829147157 wait complete. 2024-09-13T23:57:04.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.633+0000 7f38d7fa1f40 1 Processor -- start 2024-09-13T23:57:04.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.633+0000 7f38d7fa1f40 1 -- start start 2024-09-13T23:57:04.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.637+0000 7f38d7fa1f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3000 0x55874e4d8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.637+0000 7f38d7fa1f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55874e2803c0 con 0x55874e1f3000 2024-09-13T23:57:04.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.637+0000 7f38d675a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3000 0x55874e4d8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.637+0000 7f38d675a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3000 0x55874e4d8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50156/0 (socket says 172.21.15.173:50156) 2024-09-13T23:57:04.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.637+0000 7f38d675a700 1 -- 172.21.15.173:0/466892825 learned_addr learned my addr 172.21.15.173:0/466892825 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.637+0000 7f38d675a700 1 -- 172.21.15.173:0/466892825 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55874e205a00 con 0x55874e1f3000 2024-09-13T23:57:04.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.637+0000 7f38d675a700 1 --2- 172.21.15.173:0/466892825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3000 0x55874e4d8580 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x55874efbdef0 tx=0x55874e2f7a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.637+0000 7f38d3754700 1 -- 172.21.15.173:0/466892825 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55874e2978c0 con 0x55874e1f3000 2024-09-13T23:57:04.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.637+0000 7f38d3754700 1 -- 172.21.15.173:0/466892825 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55874e2b7c80 con 0x55874e1f3000 2024-09-13T23:57:04.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.637+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/466892825 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55874e205860 con 0x55874e1f3000 2024-09-13T23:57:04.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.637+0000 7f38d3754700 1 -- 172.21.15.173:0/466892825 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55874e2974a0 con 0x55874e1f3000 2024-09-13T23:57:04.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.637+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/466892825 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55874e2056c0 con 0x55874e1f3000 2024-09-13T23:57:04.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.637+0000 7f38d7fa1f40 1 Processor -- start 2024-09-13T23:57:04.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.637+0000 7f38d7fa1f40 1 -- start start 2024-09-13T23:57:04.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d7fa1f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3800 0x55874e4d8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d7fa1f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55874e218640 con 0x55874e1f3800 2024-09-13T23:57:04.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d3754700 1 -- 172.21.15.173:0/466892825 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55874e2ecb00 con 0x55874e1f3000 2024-09-13T23:57:04.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d6f5b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3800 0x55874e4d8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d6f5b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3800 0x55874e4d8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50160/0 (socket says 172.21.15.173:50160) 2024-09-13T23:57:04.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d6f5b700 1 -- 172.21.15.173:0/328598763 learned_addr learned my addr 172.21.15.173:0/328598763 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d3754700 1 --2- 172.21.15.173:0/466892825 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55874e592000 0x55874e4d9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d3754700 1 -- 172.21.15.173:0/466892825 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55874e259180 con 0x55874e1f3000 2024-09-13T23:57:04.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d675a700 1 --2- 172.21.15.173:0/466892825 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55874e592000 0x55874e4d9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d6f5b700 1 -- 172.21.15.173:0/328598763 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55874e204000 con 0x55874e1f3800 2024-09-13T23:57:04.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d6f5b700 1 --2- 172.21.15.173:0/328598763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3800 0x55874e4d8b00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x55874e56c720 tx=0x55874e556a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756fc58c24677f2c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d675a700 1 --2- 172.21.15.173:0/466892825 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55874e592000 0x55874e4d9080 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55874f06b650 tx=0x55874e556240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d0f4f700 1 -- 172.21.15.173:0/328598763 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55874e2978c0 con 0x55874e1f3800 2024-09-13T23:57:04.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d0f4f700 1 -- 172.21.15.173:0/328598763 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55874e5ac000 con 0x55874e1f3800 2024-09-13T23:57:04.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d0f4f700 1 -- 172.21.15.173:0/328598763 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55874e2974a0 con 0x55874e1f3800 2024-09-13T23:57:04.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/328598763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3800 msgr2=0x55874e4d8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/328598763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3800 0x55874e4d8b00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x55874e56c720 tx=0x55874e556a20 comp rx=0 tx=0).stop 2024-09-13T23:57:04.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/328598763 shutdown_connections 2024-09-13T23:57:04.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/328598763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3800 0x55874e4d8b00 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/328598763 >> 172.21.15.173:0/328598763 conn(0x55874e1f3400 msgr2=0x55874e2f3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/328598763 shutdown_connections 2024-09-13T23:57:04.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/328598763 wait complete. 2024-09-13T23:57:04.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d7fa1f40 1 Processor -- start 2024-09-13T23:57:04.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d7fa1f40 1 -- start start 2024-09-13T23:57:04.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d7fa1f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3800 0x55874e4d8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.641+0000 7f38d7fa1f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55874e2188c0 con 0x55874e1f3800 2024-09-13T23:57:04.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.645+0000 7f38d6f5b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3800 0x55874e4d8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.645+0000 7f38d6f5b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3800 0x55874e4d8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50172/0 (socket says 172.21.15.173:50172) 2024-09-13T23:57:04.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.645+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 learned_addr learned my addr 172.21.15.173:0/1272337479 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.645+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55874e204ea0 con 0x55874e1f3800 2024-09-13T23:57:04.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.645+0000 7f38d6f5b700 1 --2- 172.21.15.173:0/1272337479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3800 0x55874e4d8b00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x55874f06a720 tx=0x55874e556840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.645+0000 7f38cf74c700 1 -- 172.21.15.173:0/1272337479 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55874e297b80 con 0x55874e1f3800 2024-09-13T23:57:04.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.645+0000 7f38cf74c700 1 -- 172.21.15.173:0/1272337479 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55874e5ac180 con 0x55874e1f3800 2024-09-13T23:57:04.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.645+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55874e204820 con 0x55874e1f3800 2024-09-13T23:57:04.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.645+0000 7f38cf74c700 1 -- 172.21.15.173:0/1272337479 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55874e2978c0 con 0x55874e1f3800 2024-09-13T23:57:04.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.645+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55874e2049c0 con 0x55874e1f3800 2024-09-13T23:57:04.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.645+0000 7f38d7fa1f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.645+0000 7f38cf74c700 1 -- 172.21.15.173:0/1272337479 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55874e2ecdc0 con 0x55874e1f3800 2024-09-13T23:57:04.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.645+0000 7f38cf74c700 1 --2- 172.21.15.173:0/1272337479 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55874e592c00 0x55874e4d9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.649+0000 7f38cf74c700 1 -- 172.21.15.173:0/1272337479 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55874e259340 con 0x55874e1f3800 2024-09-13T23:57:04.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.649+0000 7f38d5f59700 1 --2- 172.21.15.173:0/1272337479 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55874e592c00 0x55874e4d9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.649+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/1272337479 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55874e593000 0x55874e4d9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.649+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593400 con 0x55874e593000 2024-09-13T23:57:04.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.649+0000 7f38d6f5b700 1 --2- 172.21.15.173:0/1272337479 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55874e593000 0x55874e4d9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.649+0000 7f38d5f59700 1 --2- 172.21.15.173:0/1272337479 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55874e592c00 0x55874e4d9600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55874e4d3920 tx=0x55874e2f7800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.649+0000 7f38d6f5b700 1 --2- 172.21.15.173:0/1272337479 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55874e593000 0x55874e4d9b80 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.649+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55874e606b40 con 0x55874e593000 2024-09-13T23:57:04.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.649+0000 7f38d7fa1f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.649+0000 7f38d7fa1f40 20 realm 2024-09-13T23:57:04.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.649+0000 7f38d7fa1f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.649+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593000 2024-09-13T23:57:04.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.649+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55874e606b40 con 0x55874e593000 2024-09-13T23:57:04.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.649+0000 7f38d7fa1f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.649+0000 7f38d7fa1f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:04.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.649+0000 7f38d7fa1f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.649+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593c00 con 0x55874e593000 2024-09-13T23:57:04.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.649+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55874e606b40 con 0x55874e593000 2024-09-13T23:57:04.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.649+0000 7f38d7fa1f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.649+0000 7f38d7fa1f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.649+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/1272337479 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55874e593400 0x55874e4da100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.649+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593400 2024-09-13T23:57:04.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.649+0000 7f38d675a700 1 --2- 172.21.15.173:0/1272337479 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55874e593400 0x55874e4da100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.649+0000 7f38d675a700 1 --2- 172.21.15.173:0/1272337479 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55874e593400 0x55874e4da100 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.653+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55874e607200 con 0x55874e593400 2024-09-13T23:57:04.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.653+0000 7f38d7fa1f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:04.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.653+0000 7f38d7fa1f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.653+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/1272337479 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55874e593c00 0x55874e4da680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.653+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e654000 con 0x55874e593c00 2024-09-13T23:57:04.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.653+0000 7f38d5f59700 1 --2- 172.21.15.173:0/1272337479 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55874e593c00 0x55874e4da680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.653+0000 7f38d5f59700 1 --2- 172.21.15.173:0/1272337479 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55874e593c00 0x55874e4da680 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.653+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55874e607440 con 0x55874e593c00 2024-09-13T23:57:04.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.653+0000 7f38d7fa1f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:04.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.653+0000 7f38d7fa1f40 20 searching for the correct realm 2024-09-13T23:57:04.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.653+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e654400 con 0x55874e593c00 2024-09-13T23:57:04.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.653+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55874e607440 con 0x55874e593c00 2024-09-13T23:57:04.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.653+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e654000 con 0x55874e593400 2024-09-13T23:57:04.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.653+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e607200 con 0x55874e593400 2024-09-13T23:57:04.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.653+0000 7f38d675a700 1 --2- 172.21.15.173:0/1272337479 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55874e654000 0x55874e4dac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.653+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e654000 2024-09-13T23:57:04.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.653+0000 7f38d6f5b700 1 --2- 172.21.15.173:0/1272337479 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55874e654000 0x55874e4dac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.657+0000 7f38d6f5b700 1 --2- 172.21.15.173:0/1272337479 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55874e654000 0x55874e4dac00 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.657+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e606b40 con 0x55874e654000 2024-09-13T23:57:04.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.657+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593000 2024-09-13T23:57:04.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.657+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55874e606b40 con 0x55874e593000 2024-09-13T23:57:04.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.657+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593000 2024-09-13T23:57:04.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.657+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e606b40 con 0x55874e593000 2024-09-13T23:57:04.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.657+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593c00 2024-09-13T23:57:04.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.657+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e607440 con 0x55874e593c00 2024-09-13T23:57:04.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.657+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593000 2024-09-13T23:57:04.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.657+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e606b40 con 0x55874e593000 2024-09-13T23:57:04.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.657+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593400 2024-09-13T23:57:04.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.657+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e607200 con 0x55874e593400 2024-09-13T23:57:04.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.661+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593400 2024-09-13T23:57:04.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.661+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e607200 con 0x55874e593400 2024-09-13T23:57:04.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.661+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593000 2024-09-13T23:57:04.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.661+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e606b40 con 0x55874e593000 2024-09-13T23:57:04.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.661+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e654000 2024-09-13T23:57:04.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.661+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e606b40 con 0x55874e654000 2024-09-13T23:57:04.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.661+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593000 2024-09-13T23:57:04.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.661+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e606b40 con 0x55874e593000 2024-09-13T23:57:04.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.661+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e654000 2024-09-13T23:57:04.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.661+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e606b40 con 0x55874e654000 2024-09-13T23:57:04.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.661+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593400 2024-09-13T23:57:04.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.661+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e607200 con 0x55874e593400 2024-09-13T23:57:04.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.661+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593c00 2024-09-13T23:57:04.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.665+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e607440 con 0x55874e593c00 2024-09-13T23:57:04.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.665+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593000 2024-09-13T23:57:04.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.665+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e606b40 con 0x55874e593000 2024-09-13T23:57:04.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.665+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593400 2024-09-13T23:57:04.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.665+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e607200 con 0x55874e593400 2024-09-13T23:57:04.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.665+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593c00 2024-09-13T23:57:04.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.665+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e607440 con 0x55874e593c00 2024-09-13T23:57:04.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.665+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593000 2024-09-13T23:57:04.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.665+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e606b40 con 0x55874e593000 2024-09-13T23:57:04.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.665+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593000 2024-09-13T23:57:04.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.665+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e606b40 con 0x55874e593000 2024-09-13T23:57:04.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.665+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593000 2024-09-13T23:57:04.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.665+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e606b40 con 0x55874e593000 2024-09-13T23:57:04.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.669+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593c00 2024-09-13T23:57:04.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.669+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e607440 con 0x55874e593c00 2024-09-13T23:57:04.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.669+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e654000 2024-09-13T23:57:04.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.669+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e606b40 con 0x55874e654000 2024-09-13T23:57:04.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.669+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593000 2024-09-13T23:57:04.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.669+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e606b40 con 0x55874e593000 2024-09-13T23:57:04.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.669+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e654000 2024-09-13T23:57:04.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.669+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e606b40 con 0x55874e654000 2024-09-13T23:57:04.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.669+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593c00 2024-09-13T23:57:04.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.669+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e607440 con 0x55874e593c00 2024-09-13T23:57:04.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.669+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e654000 2024-09-13T23:57:04.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.669+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e606b40 con 0x55874e654000 2024-09-13T23:57:04.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.669+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593400 2024-09-13T23:57:04.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.673+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e607200 con 0x55874e593400 2024-09-13T23:57:04.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.673+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593400 2024-09-13T23:57:04.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.673+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e607200 con 0x55874e593400 2024-09-13T23:57:04.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.673+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593c00 2024-09-13T23:57:04.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.673+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e607440 con 0x55874e593c00 2024-09-13T23:57:04.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.673+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593400 2024-09-13T23:57:04.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.673+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55874e607200 con 0x55874e593400 2024-09-13T23:57:04.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.673+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e593400 2024-09-13T23:57:04.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.673+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55874e607200 con 0x55874e593400 2024-09-13T23:57:04.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.673+0000 7f38d7fa1f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:04.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.673+0000 7f38d7fa1f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:04.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.673+0000 7f38d7fa1f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:04.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.673+0000 7f38d7fa1f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:04.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.673+0000 7f38d7fa1f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.673+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e654800 con 0x55874e593000 2024-09-13T23:57:04.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.673+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55874e606b40 con 0x55874e593000 2024-09-13T23:57:04.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d7fa1f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d7fa1f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e654c00 con 0x55874e593400 2024-09-13T23:57:04.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55874e607200 con 0x55874e593400 2024-09-13T23:57:04.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d7fa1f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:04.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d7fa1f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e655000 con 0x55874e593000 2024-09-13T23:57:04.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55874e606b40 con 0x55874e593000 2024-09-13T23:57:04.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d7fa1f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:04.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d7fa1f40 20 zone default found 2024-09-13T23:57:04.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d7fa1f40 4 Realm: () 2024-09-13T23:57:04.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d7fa1f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:04.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d7fa1f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:04.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d7fa1f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:04.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d7fa1f40 20 zonegroup default 2024-09-13T23:57:04.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d7fa1f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e655400 con 0x55874e654000 2024-09-13T23:57:04.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55874e606b40 con 0x55874e654000 2024-09-13T23:57:04.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d7fa1f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d7fa1f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e655800 con 0x55874e593c00 2024-09-13T23:57:04.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55874e607440 con 0x55874e593c00 2024-09-13T23:57:04.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d7fa1f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d7fa1f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e655c00 con 0x55874e593c00 2024-09-13T23:57:04.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.677+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55874e607440 con 0x55874e593c00 2024-09-13T23:57:04.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.681+0000 7f38d7fa1f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.681+0000 7f38d7fa1f40 20 started sync module instance, tier type = 2024-09-13T23:57:04.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.681+0000 7f38d7fa1f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:04.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.681+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e65e000 con 0x55874e593400 2024-09-13T23:57:04.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.681+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e593400 2024-09-13T23:57:04.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.681+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94039622613760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e65e400 con 0x55874e593400 2024-09-13T23:57:04.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.681+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e65e800 con 0x55874e593000 2024-09-13T23:57:04.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.685+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94039622613760] v33'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e593400 2024-09-13T23:57:04.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.685+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55874e606b40 con 0x55874e593000 2024-09-13T23:57:04.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.685+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94039622614912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e65ec00 con 0x55874e593000 2024-09-13T23:57:04.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.685+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e65f000 con 0x55874e593400 2024-09-13T23:57:04.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.689+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94039622614912] v33'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55874e606b40 con 0x55874e593000 2024-09-13T23:57:04.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.689+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e593400 2024-09-13T23:57:04.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.689+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94039622616064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e65f400 con 0x55874e593400 2024-09-13T23:57:04.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.689+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e65f800 con 0x55874e654000 2024-09-13T23:57:04.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.693+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94039622616064] v33'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e593400 2024-09-13T23:57:04.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.693+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55874e606b40 con 0x55874e654000 2024-09-13T23:57:04.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.693+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94039622617216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e65fc00 con 0x55874e654000 2024-09-13T23:57:04.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.693+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e65e800 con 0x55874e593400 2024-09-13T23:57:04.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.693+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94039622617216] v33'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55874e606b40 con 0x55874e654000 2024-09-13T23:57:04.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.693+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e593400 2024-09-13T23:57:04.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.693+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94039622618368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e65e000 con 0x55874e593400 2024-09-13T23:57:04.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.693+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e654800 con 0x55874e593c00 2024-09-13T23:57:04.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.697+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55874e607440 con 0x55874e593c00 2024-09-13T23:57:04.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.697+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94039622619520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e655000 con 0x55874e593c00 2024-09-13T23:57:04.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.697+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e655400 con 0x55874e593c00 2024-09-13T23:57:04.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.697+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94039622618368] v33'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e593400 2024-09-13T23:57:04.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.697+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94039622619520] v33'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55874e607440 con 0x55874e593c00 2024-09-13T23:57:04.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.697+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55874e607440 con 0x55874e593c00 2024-09-13T23:57:04.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.697+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94039622620672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e654c00 con 0x55874e593c00 2024-09-13T23:57:04.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.697+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e593800 con 0x55874e654000 2024-09-13T23:57:04.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.701+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94039622620672] v33'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55874e607440 con 0x55874e593c00 2024-09-13T23:57:04.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.701+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55874e606b40 con 0x55874e654000 2024-09-13T23:57:04.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.701+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94039622621824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e65e400 con 0x55874e654000 2024-09-13T23:57:04.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.701+0000 7f38d7fa1f40 20 add_watcher() i=0 2024-09-13T23:57:04.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.701+0000 7f38d7fa1f40 20 add_watcher() i=1 2024-09-13T23:57:04.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.701+0000 7f38d7fa1f40 20 add_watcher() i=2 2024-09-13T23:57:04.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.701+0000 7f38d7fa1f40 20 add_watcher() i=3 2024-09-13T23:57:04.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.701+0000 7f38d7fa1f40 20 add_watcher() i=4 2024-09-13T23:57:04.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.701+0000 7f38d7fa1f40 20 add_watcher() i=5 2024-09-13T23:57:04.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.701+0000 7f38d7fa1f40 20 add_watcher() i=6 2024-09-13T23:57:04.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.701+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94039622621824] v33'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55874e606b40 con 0x55874e654000 2024-09-13T23:57:04.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.701+0000 7f38d7fa1f40 20 add_watcher() i=7 2024-09-13T23:57:04.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.701+0000 7f38d7fa1f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:04.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.701+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e65f000 con 0x55874e593000 2024-09-13T23:57:04.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.705+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55874e606b40 con 0x55874e593000 2024-09-13T23:57:04.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.705+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94039624269824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e65f400 con 0x55874e593000 2024-09-13T23:57:04.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.705+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94039624269824] v33'112 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55874e606b40 con 0x55874e593000 2024-09-13T23:57:04.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.705+0000 7f38bd728700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:04.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.705+0000 7f38d7fa1f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:04.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.705+0000 7f38d7fa1f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:04.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.705+0000 7f38d7fa1f40 1 Processor -- start 2024-09-13T23:57:04.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.705+0000 7f38d7fa1f40 1 -- start start 2024-09-13T23:57:04.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.705+0000 7f38d7fa1f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e654400 0x55874e4db180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.705+0000 7f38d7fa1f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55874e2803c0 con 0x55874e654400 2024-09-13T23:57:04.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.705+0000 7f38d5f59700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e654400 0x55874e4db180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.705+0000 7f38d5f59700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e654400 0x55874e4db180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50184/0 (socket says 172.21.15.173:50184) 2024-09-13T23:57:04.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.705+0000 7f38d5f59700 1 -- 172.21.15.173:0/2634918189 learned_addr learned my addr 172.21.15.173:0/2634918189 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.709+0000 7f38d5f59700 1 -- 172.21.15.173:0/2634918189 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55874e204b60 con 0x55874e654400 2024-09-13T23:57:04.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.709+0000 7f38d5f59700 1 --2- 172.21.15.173:0/2634918189 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e654400 0x55874e4db180 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x55874e4d3f80 tx=0x55874e2f7980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9ec88ddc8859af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.709+0000 7f38bcf27700 1 -- 172.21.15.173:0/2634918189 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55874e297760 con 0x55874e654400 2024-09-13T23:57:04.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.709+0000 7f38bcf27700 1 -- 172.21.15.173:0/2634918189 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55874e5ac600 con 0x55874e654400 2024-09-13T23:57:04.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.709+0000 7f38bcf27700 1 -- 172.21.15.173:0/2634918189 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55874e676000 con 0x55874e654400 2024-09-13T23:57:04.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.709+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2634918189 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e654400 msgr2=0x55874e4db180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.709+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/2634918189 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e654400 0x55874e4db180 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x55874e4d3f80 tx=0x55874e2f7980 comp rx=0 tx=0).stop 2024-09-13T23:57:04.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.709+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2634918189 shutdown_connections 2024-09-13T23:57:04.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.709+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/2634918189 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e654400 0x55874e4db180 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.709+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2634918189 >> 172.21.15.173:0/2634918189 conn(0x55874e65e800 msgr2=0x55874e2f4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.709+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2634918189 shutdown_connections 2024-09-13T23:57:04.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.709+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2634918189 wait complete. 2024-09-13T23:57:04.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.709+0000 7f38d7fa1f40 1 Processor -- start 2024-09-13T23:57:04.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.709+0000 7f38d7fa1f40 1 -- start start 2024-09-13T23:57:04.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.709+0000 7f38d7fa1f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e654400 0x55874e4db180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.709+0000 7f38d7fa1f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55874e280500 con 0x55874e654400 2024-09-13T23:57:04.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.709+0000 7f38d5f59700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e654400 0x55874e4db180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.709+0000 7f38d5f59700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e654400 0x55874e4db180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50196/0 (socket says 172.21.15.173:50196) 2024-09-13T23:57:04.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.709+0000 7f38d5f59700 1 -- 172.21.15.173:0/2689518348 learned_addr learned my addr 172.21.15.173:0/2689518348 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.713+0000 7f38d5f59700 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55874e204d00 con 0x55874e654400 2024-09-13T23:57:04.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.713+0000 7f38d5f59700 1 --2- 172.21.15.173:0/2689518348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e654400 0x55874e4db180 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x55874e668780 tx=0x55874e557c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.713+0000 7f38bb724700 1 -- 172.21.15.173:0/2689518348 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55874e676160 con 0x55874e654400 2024-09-13T23:57:04.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.713+0000 7f38bb724700 1 -- 172.21.15.173:0/2689518348 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55874e5ac300 con 0x55874e654400 2024-09-13T23:57:04.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.713+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55874e204340 con 0x55874e654400 2024-09-13T23:57:04.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.713+0000 7f38bb724700 1 -- 172.21.15.173:0/2689518348 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55874e6762c0 con 0x55874e654400 2024-09-13T23:57:04.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.713+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55874e204b60 con 0x55874e654400 2024-09-13T23:57:04.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.713+0000 7f38bb724700 1 -- 172.21.15.173:0/2689518348 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55874e2edb80 con 0x55874e654400 2024-09-13T23:57:04.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.713+0000 7f38bb724700 1 --2- 172.21.15.173:0/2689518348 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55874e593800 0x55874e6ee000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.713+0000 7f38bb724700 1 -- 172.21.15.173:0/2689518348 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55874e259500 con 0x55874e654400 2024-09-13T23:57:04.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.713+0000 7f38d6f5b700 1 --2- 172.21.15.173:0/2689518348 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55874e593800 0x55874e6ee000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.713+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/2689518348 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55874e655800 0x55874e4db700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.713+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e655c00 con 0x55874e655800 2024-09-13T23:57:04.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.713+0000 7f38d675a700 1 --2- 172.21.15.173:0/2689518348 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55874e655800 0x55874e4db700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.713+0000 7f38d6f5b700 1 --2- 172.21.15.173:0/2689518348 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55874e593800 0x55874e6ee000 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55874e601d70 tx=0x55874e6b6ae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.713+0000 7f38d675a700 1 --2- 172.21.15.173:0/2689518348 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55874e655800 0x55874e4db700 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.717+0000 7f38d675a700 1 -- 172.21.15.173:0/2689518348 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v33'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e655800 2024-09-13T23:57:04.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.717+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/2689518348 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55874e654800 0x55874e6ee580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.717+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e65ec00 con 0x55874e654800 2024-09-13T23:57:04.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.717+0000 7f38d5f59700 1 --2- 172.21.15.173:0/2689518348 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55874e654800 0x55874e6ee580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.717+0000 7f38d5f59700 1 --2- 172.21.15.173:0/2689518348 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55874e654800 0x55874e6ee580 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.721+0000 7f38d5f59700 1 -- 172.21.15.173:0/2689518348 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v33'14 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55874e607440 con 0x55874e654800 2024-09-13T23:57:04.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.721+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/2689518348 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55874e65f800 0x55874e6eeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.721+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e65fc00 con 0x55874e65f800 2024-09-13T23:57:04.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.721+0000 7f38d6f5b700 1 --2- 172.21.15.173:0/2689518348 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55874e65f800 0x55874e6eeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.721+0000 7f38d6f5b700 1 --2- 172.21.15.173:0/2689518348 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55874e65f800 0x55874e6eeb00 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.725+0000 7f38d6f5b700 1 -- 172.21.15.173:0/2689518348 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v33'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55874e606b40 con 0x55874e65f800 2024-09-13T23:57:04.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.725+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/2689518348 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55874e65e400 0x55874e6ef080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.725+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e716000 con 0x55874e65e400 2024-09-13T23:57:04.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.725+0000 7f38d675a700 1 --2- 172.21.15.173:0/2689518348 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55874e65e400 0x55874e6ef080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.725+0000 7f38d675a700 1 --2- 172.21.15.173:0/2689518348 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55874e65e400 0x55874e6ef080 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.725+0000 7f38d675a700 1 -- 172.21.15.173:0/2689518348 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v33'113 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e65e400 2024-09-13T23:57:04.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.725+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e716400 con 0x55874e655800 2024-09-13T23:57:04.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.729+0000 7f38d675a700 1 -- 172.21.15.173:0/2689518348 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v33'32 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e655800 2024-09-13T23:57:04.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.729+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e716800 con 0x55874e65f800 2024-09-13T23:57:04.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.733+0000 7f38d6f5b700 1 -- 172.21.15.173:0/2689518348 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v33'21 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55874e606b40 con 0x55874e65f800 2024-09-13T23:57:04.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.733+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e716c00 con 0x55874e655800 2024-09-13T23:57:04.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.733+0000 7f38d675a700 1 -- 172.21.15.173:0/2689518348 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v33'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e655800 2024-09-13T23:57:04.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.733+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e717000 con 0x55874e65e400 2024-09-13T23:57:04.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.737+0000 7f38d675a700 1 -- 172.21.15.173:0/2689518348 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v33'21 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e65e400 2024-09-13T23:57:04.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.737+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e717400 con 0x55874e655800 2024-09-13T23:57:04.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.741+0000 7f38d675a700 1 -- 172.21.15.173:0/2689518348 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v33'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e655800 2024-09-13T23:57:04.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.741+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e717800 con 0x55874e655800 2024-09-13T23:57:04.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.741+0000 7f38d675a700 1 -- 172.21.15.173:0/2689518348 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v33'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e655800 2024-09-13T23:57:04.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.741+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e717c00 con 0x55874e655800 2024-09-13T23:57:04.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.745+0000 7f38d675a700 1 -- 172.21.15.173:0/2689518348 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v33'33 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e655800 2024-09-13T23:57:04.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.745+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e716000 con 0x55874e65f800 2024-09-13T23:57:04.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.745+0000 7f38d6f5b700 1 -- 172.21.15.173:0/2689518348 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55874e606b40 con 0x55874e65f800 2024-09-13T23:57:04.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.745+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e716400 con 0x55874e655800 2024-09-13T23:57:04.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.749+0000 7f38d675a700 1 -- 172.21.15.173:0/2689518348 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v33'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e655800 2024-09-13T23:57:04.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.749+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e716c00 con 0x55874e65e400 2024-09-13T23:57:04.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.753+0000 7f38d675a700 1 -- 172.21.15.173:0/2689518348 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v33'27 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e65e400 2024-09-13T23:57:04.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.753+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e655c00 con 0x55874e65e400 2024-09-13T23:57:04.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.753+0000 7f38d675a700 1 -- 172.21.15.173:0/2689518348 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v33'114 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e65e400 2024-09-13T23:57:04.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.753+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e65e000 con 0x55874e655800 2024-09-13T23:57:04.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.757+0000 7f38d675a700 1 -- 172.21.15.173:0/2689518348 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v33'26 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e655800 2024-09-13T23:57:04.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.757+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e717000 con 0x55874e655800 2024-09-13T23:57:04.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.761+0000 7f38d675a700 1 -- 172.21.15.173:0/2689518348 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v33'34 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e655800 2024-09-13T23:57:04.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.761+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e717400 con 0x55874e65f800 2024-09-13T23:57:04.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.761+0000 7f38d6f5b700 1 -- 172.21.15.173:0/2689518348 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v33'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55874e606b40 con 0x55874e65f800 2024-09-13T23:57:04.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.765+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e717800 con 0x55874e655800 2024-09-13T23:57:04.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.765+0000 7f38d675a700 1 -- 172.21.15.173:0/2689518348 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v33'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e655800 2024-09-13T23:57:04.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.765+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e717c00 con 0x55874e65e400 2024-09-13T23:57:04.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.769+0000 7f38d675a700 1 -- 172.21.15.173:0/2689518348 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v33'115 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e65e400 2024-09-13T23:57:04.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.769+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e716400 con 0x55874e655800 2024-09-13T23:57:04.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.773+0000 7f38d675a700 1 -- 172.21.15.173:0/2689518348 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v33'27 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e655800 2024-09-13T23:57:04.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.773+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e716c00 con 0x55874e655800 2024-09-13T23:57:04.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.773+0000 7f38d675a700 1 -- 172.21.15.173:0/2689518348 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v33'24 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e655800 2024-09-13T23:57:04.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.773+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e65e000 con 0x55874e65f800 2024-09-13T23:57:04.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.777+0000 7f38d6f5b700 1 -- 172.21.15.173:0/2689518348 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55874e606b40 con 0x55874e65f800 2024-09-13T23:57:04.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.777+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e65f000 con 0x55874e655800 2024-09-13T23:57:04.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.777+0000 7f38d675a700 1 -- 172.21.15.173:0/2689518348 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v33'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e655800 2024-09-13T23:57:04.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.781+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e65f400 con 0x55874e65f800 2024-09-13T23:57:04.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.781+0000 7f38d6f5b700 1 -- 172.21.15.173:0/2689518348 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v33'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55874e606b40 con 0x55874e65f800 2024-09-13T23:57:04.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.781+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e65fc00 con 0x55874e65f800 2024-09-13T23:57:04.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.785+0000 7f38d6f5b700 1 -- 172.21.15.173:0/2689518348 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v33'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55874e606b40 con 0x55874e65f800 2024-09-13T23:57:04.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.785+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e655c00 con 0x55874e65f800 2024-09-13T23:57:04.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.785+0000 7f38d6f5b700 1 -- 172.21.15.173:0/2689518348 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55874e606b40 con 0x55874e65f800 2024-09-13T23:57:04.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.789+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e732000 con 0x55874e655800 2024-09-13T23:57:04.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.789+0000 7f38d675a700 1 -- 172.21.15.173:0/2689518348 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v33'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e655800 2024-09-13T23:57:04.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.789+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e732400 con 0x55874e65e400 2024-09-13T23:57:04.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.793+0000 7f38d675a700 1 -- 172.21.15.173:0/2689518348 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v33'22 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e65e400 2024-09-13T23:57:04.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.793+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e732800 con 0x55874e655800 2024-09-13T23:57:04.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.797+0000 7f38d675a700 1 -- 172.21.15.173:0/2689518348 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v33'28 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e655800 2024-09-13T23:57:04.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.797+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e732c00 con 0x55874e65e400 2024-09-13T23:57:04.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.797+0000 7f38d675a700 1 -- 172.21.15.173:0/2689518348 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v33'28 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e65e400 2024-09-13T23:57:04.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.797+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e733000 con 0x55874e654800 2024-09-13T23:57:04.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.801+0000 7f38d5f59700 1 -- 172.21.15.173:0/2689518348 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v33'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55874e607440 con 0x55874e654800 2024-09-13T23:57:04.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.801+0000 7f38b8f1f700 20 reqs_thread_entry: start 2024-09-13T23:57:04.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.801+0000 7f38d7fa1f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:04.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.801+0000 7f38d7fa1f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:04.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.801+0000 7f38b6f1b700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:35 2024 2024-09-13T23:57:04.810 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:04.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.805+0000 7f38d7fa1f40 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:57:04.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.805+0000 7f38d7fa1f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.805+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e733c00 con 0x55874e654000 2024-09-13T23:57:04.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.805+0000 7f38b66f9700 20 reqs_thread_entry: start 2024-09-13T23:57:04.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.805+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(62 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x55874e606b40 con 0x55874e654000 2024-09-13T23:57:04.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.805+0000 7f38d7fa1f40 20 rados_obj.operate() r=0 bl.length=346 2024-09-13T23:57:04.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.805+0000 7f38d7fa1f40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T23:57:04.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.805+0000 7f38d7fa1f40 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:57:04.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.805+0000 7f38d7fa1f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:04.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.805+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e794000 con 0x55874e593000 2024-09-13T23:57:04.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.805+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(63 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x55874e606b40 con 0x55874e593000 2024-09-13T23:57:04.812 INFO:teuthology.orchestra.run.smithi173.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-13T23:57:04.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.805+0000 7f38bd728700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:04.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.805+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94039624269824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e795000 con 0x55874e593000 2024-09-13T23:57:04.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.809+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94039624269824] v33'116 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55874e606b40 con 0x55874e593000 2024-09-13T23:57:04.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.809+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94039622613760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e795400 con 0x55874e593400 2024-09-13T23:57:04.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.813+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94039622613760] v33'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e593400 2024-09-13T23:57:04.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.813+0000 7f38d7fa1f40 20 remove_watcher() i=0 2024-09-13T23:57:04.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.813+0000 7f38d7fa1f40 2 removed watcher, disabling cache 2024-09-13T23:57:04.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.813+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94039622614912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e795800 con 0x55874e593000 2024-09-13T23:57:04.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.813+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94039622614912] v33'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55874e606b40 con 0x55874e593000 2024-09-13T23:57:04.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.813+0000 7f38d7fa1f40 20 remove_watcher() i=1 2024-09-13T23:57:04.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.813+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94039622616064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e795c00 con 0x55874e593400 2024-09-13T23:57:04.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.817+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94039622616064] v33'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e593400 2024-09-13T23:57:04.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.817+0000 7f38d7fa1f40 20 remove_watcher() i=2 2024-09-13T23:57:04.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.817+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94039622617216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e794000 con 0x55874e654000 2024-09-13T23:57:04.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.821+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94039622617216] v33'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55874e606b40 con 0x55874e654000 2024-09-13T23:57:04.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.821+0000 7f38d7fa1f40 20 remove_watcher() i=3 2024-09-13T23:57:04.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.821+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94039622618368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e795000 con 0x55874e593400 2024-09-13T23:57:04.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.821+0000 7f38d675a700 1 -- 172.21.15.173:0/1272337479 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94039622618368] v33'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55874e607200 con 0x55874e593400 2024-09-13T23:57:04.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.821+0000 7f38d7fa1f40 20 remove_watcher() i=4 2024-09-13T23:57:04.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.821+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94039622619520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e794c00 con 0x55874e593c00 2024-09-13T23:57:04.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.825+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94039622619520] v33'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55874e607440 con 0x55874e593c00 2024-09-13T23:57:04.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.825+0000 7f38d7fa1f40 20 remove_watcher() i=5 2024-09-13T23:57:04.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.825+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94039622620672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e794800 con 0x55874e593c00 2024-09-13T23:57:04.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.825+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94039622620672] v33'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55874e607440 con 0x55874e593c00 2024-09-13T23:57:04.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.829+0000 7f38d7fa1f40 20 remove_watcher() i=6 2024-09-13T23:57:04.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.829+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94039622621824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55874e794400 con 0x55874e654000 2024-09-13T23:57:04.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.829+0000 7f38d6f5b700 1 -- 172.21.15.173:0/1272337479 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94039622621824] v33'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55874e606b40 con 0x55874e654000 2024-09-13T23:57:04.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.829+0000 7f38d7fa1f40 20 remove_watcher() i=7 2024-09-13T23:57:04.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.829+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55874e593400 msgr2=0x55874e4da100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.829+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/1272337479 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55874e593400 0x55874e4da100 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.829+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55874e593000 msgr2=0x55874e4d9b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.829+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/1272337479 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55874e593000 0x55874e4d9b80 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.829+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55874e654000 msgr2=0x55874e4dac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.829+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/1272337479 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55874e654000 0x55874e4dac00 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.829+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55874e593c00 msgr2=0x55874e4da680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.829+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/1272337479 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55874e593c00 0x55874e4da680 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.829+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55874e592c00 msgr2=0x55874e4d9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.829+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/1272337479 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55874e592c00 0x55874e4d9600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55874e4d3920 tx=0x55874e2f7800 comp rx=0 tx=0).stop 2024-09-13T23:57:04.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.829+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3800 msgr2=0x55874e4d8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.829+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/1272337479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3800 0x55874e4d8b00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x55874f06a720 tx=0x55874e556840 comp rx=0 tx=0).stop 2024-09-13T23:57:04.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.829+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 reap_dead start 2024-09-13T23:57:04.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.829+0000 7f38d5f59700 1 -- 172.21.15.173:0/1272337479 reap_dead start 2024-09-13T23:57:04.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.829+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 shutdown_connections 2024-09-13T23:57:04.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.829+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 >> 172.21.15.173:0/1272337479 conn(0x55874e1f3400 msgr2=0x55874e2f3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.829+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 shutdown_connections 2024-09-13T23:57:04.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.829+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/1272337479 wait complete. 2024-09-13T23:57:04.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.829+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55874e655800 msgr2=0x55874e4db700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.829+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/2689518348 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55874e655800 0x55874e4db700 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55874e65e400 msgr2=0x55874e6ef080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/2689518348 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55874e65e400 0x55874e6ef080 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55874e654800 msgr2=0x55874e6ee580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/2689518348 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55874e654800 0x55874e6ee580 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55874e65f800 msgr2=0x55874e6eeb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/2689518348 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55874e65f800 0x55874e6eeb00 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55874e593800 msgr2=0x55874e6ee000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/2689518348 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55874e593800 0x55874e6ee000 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55874e601d70 tx=0x55874e6b6ae0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e654400 msgr2=0x55874e4db180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d675a700 1 -- 172.21.15.173:0/2689518348 reap_dead start 2024-09-13T23:57:04.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/2689518348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e654400 0x55874e4db180 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x55874e668780 tx=0x55874e557c20 comp rx=0 tx=0).stop 2024-09-13T23:57:04.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 shutdown_connections 2024-09-13T23:57:04.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/2689518348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e654400 0x55874e4db180 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 >> 172.21.15.173:0/2689518348 conn(0x55874e65e800 msgr2=0x55874e2f4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 shutdown_connections 2024-09-13T23:57:04.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/2689518348 wait complete. 2024-09-13T23:57:04.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/466892825 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55874e592000 msgr2=0x55874e4d9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/466892825 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55874e592000 0x55874e4d9080 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55874f06b650 tx=0x55874e556240 comp rx=0 tx=0).stop 2024-09-13T23:57:04.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/466892825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3000 msgr2=0x55874e4d8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/466892825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3000 0x55874e4d8580 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x55874efbdef0 tx=0x55874e2f7a40 comp rx=0 tx=0).stop 2024-09-13T23:57:04.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/466892825 shutdown_connections 2024-09-13T23:57:04.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/466892825 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55874e592000 0x55874e4d9080 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 --2- 172.21.15.173:0/466892825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55874e1f3000 0x55874e4d8580 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/466892825 >> 172.21.15.173:0/466892825 conn(0x55874e1f2c00 msgr2=0x55874e2f3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/466892825 shutdown_connections 2024-09-13T23:57:04.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.833+0000 7f38d7fa1f40 1 -- 172.21.15.173:0/466892825 wait complete. 2024-09-13T23:57:04.844 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T23:57:04.844 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-13T23:57:04.844 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-13T23:57:04.844 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-13T23:57:04.890 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:04.890 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:04.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.885+0000 7f582f3eef40 1 Processor -- start 2024-09-13T23:57:04.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.885+0000 7f582f3eef40 1 -- start start 2024-09-13T23:57:04.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.885+0000 7f582f3eef40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x555f24ce9400 0x555f24fce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.885+0000 7f582f3eef40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555f24dad500 con 0x555f24ce9000 2024-09-13T23:57:04.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.885+0000 7f582f3eef40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x555f24d76a00 con 0x555f24ce9400 2024-09-13T23:57:04.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.885+0000 7f582d3a6700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x555f24ce9400 0x555f24fce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.885+0000 7f582dba7700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x555f24ce9000 0x555f24de8800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47460/0 (socket says 172.21.15.173:47460) 2024-09-13T23:57:04.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.885+0000 7f582dba7700 1 -- 172.21.15.173:0/1675968807 learned_addr learned my addr 172.21.15.173:0/1675968807 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:04.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.885+0000 7f582d3a6700 1 -- 172.21.15.173:0/1675968807 >> v1:172.21.15.87:6789/0 conn(0x555f24ce9000 legacy=0x555f24de8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.885+0000 7f582cba5700 1 -- 172.21.15.173:0/1675968807 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 7178486 0 0) 0x555f24e44000 con 0x555f24ce9000 2024-09-13T23:57:04.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.885+0000 7f582d3a6700 1 -- 172.21.15.173:0/1675968807 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f24cfbd40 con 0x555f24ce9400 2024-09-13T23:57:04.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.885+0000 7f582d3a6700 1 --2- 172.21.15.173:0/1675968807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9400 0x555f24fce580 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x555f24fc9920 tx=0x555f24ded920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4970cf6ff4eead4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.885+0000 7f582cba5700 1 -- 172.21.15.173:0/1675968807 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555f24d8d4a0 con 0x555f24ce9400 2024-09-13T23:57:04.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.885+0000 7f582cba5700 1 -- 172.21.15.173:0/1675968807 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f24dad800 con 0x555f24ce9400 2024-09-13T23:57:04.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.885+0000 7f582cba5700 1 -- 172.21.15.173:0/1675968807 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555f24d8d600 con 0x555f24ce9400 2024-09-13T23:57:04.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582f3eef40 1 -- 172.21.15.173:0/1675968807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9400 msgr2=0x555f24fce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582f3eef40 1 --2- 172.21.15.173:0/1675968807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9400 0x555f24fce580 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x555f24fc9920 tx=0x555f24ded920 comp rx=0 tx=0).stop 2024-09-13T23:57:04.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582f3eef40 1 -- 172.21.15.173:0/1675968807 shutdown_connections 2024-09-13T23:57:04.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582f3eef40 1 --2- 172.21.15.173:0/1675968807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9400 0x555f24fce580 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582f3eef40 1 -- 172.21.15.173:0/1675968807 >> 172.21.15.173:0/1675968807 conn(0x555f24ce8c00 msgr2=0x555f24de8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582f3eef40 1 -- 172.21.15.173:0/1675968807 shutdown_connections 2024-09-13T23:57:04.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582f3eef40 1 -- 172.21.15.173:0/1675968807 wait complete. 2024-09-13T23:57:04.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582f3eef40 1 Processor -- start 2024-09-13T23:57:04.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582f3eef40 1 -- start start 2024-09-13T23:57:04.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582f3eef40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9000 0x555f24fce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582f3eef40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f24d76500 con 0x555f24ce9000 2024-09-13T23:57:04.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582dba7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9000 0x555f24fce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582dba7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9000 0x555f24fce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50212/0 (socket says 172.21.15.173:50212) 2024-09-13T23:57:04.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582dba7700 1 -- 172.21.15.173:0/242285986 learned_addr learned my addr 172.21.15.173:0/242285986 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582dba7700 1 -- 172.21.15.173:0/242285986 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f24cfbba0 con 0x555f24ce9000 2024-09-13T23:57:04.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582dba7700 1 --2- 172.21.15.173:0/242285986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9000 0x555f24fce580 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x555f25ab3d70 tx=0x555f24dedb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e17b472743279c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582c3a4700 1 -- 172.21.15.173:0/242285986 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555f24d8d4a0 con 0x555f24ce9000 2024-09-13T23:57:04.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582c3a4700 1 -- 172.21.15.173:0/242285986 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f24dadb00 con 0x555f24ce9000 2024-09-13T23:57:04.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582c3a4700 1 -- 172.21.15.173:0/242285986 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555f24d8d600 con 0x555f24ce9000 2024-09-13T23:57:04.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582f3eef40 1 -- 172.21.15.173:0/242285986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9000 msgr2=0x555f24fce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582f3eef40 1 --2- 172.21.15.173:0/242285986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9000 0x555f24fce580 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x555f25ab3d70 tx=0x555f24dedb60 comp rx=0 tx=0).stop 2024-09-13T23:57:04.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582f3eef40 1 -- 172.21.15.173:0/242285986 shutdown_connections 2024-09-13T23:57:04.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582f3eef40 1 --2- 172.21.15.173:0/242285986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9000 0x555f24fce580 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582f3eef40 1 -- 172.21.15.173:0/242285986 >> 172.21.15.173:0/242285986 conn(0x555f24ce8c00 msgr2=0x555f24de9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582f3eef40 1 -- 172.21.15.173:0/242285986 shutdown_connections 2024-09-13T23:57:04.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.889+0000 7f582f3eef40 1 -- 172.21.15.173:0/242285986 wait complete. 2024-09-13T23:57:04.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.893+0000 7f582f3eef40 1 Processor -- start 2024-09-13T23:57:04.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.893+0000 7f582f3eef40 1 -- start start 2024-09-13T23:57:04.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.893+0000 7f582f3eef40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9000 0x555f24fce580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.893+0000 7f582f3eef40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f24d763c0 con 0x555f24ce9000 2024-09-13T23:57:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.893+0000 7f582dba7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9000 0x555f24fce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.893+0000 7f582dba7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9000 0x555f24fce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50224/0 (socket says 172.21.15.173:50224) 2024-09-13T23:57:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.893+0000 7f582dba7700 1 -- 172.21.15.173:0/1630511302 learned_addr learned my addr 172.21.15.173:0/1630511302 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.893+0000 7f582dba7700 1 -- 172.21.15.173:0/1630511302 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f24cfba00 con 0x555f24ce9000 2024-09-13T23:57:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.893+0000 7f582dba7700 1 --2- 172.21.15.173:0/1630511302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9000 0x555f24fce580 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x555f25ab3e60 tx=0x555f24deda40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.893+0000 7f582aba1700 1 -- 172.21.15.173:0/1630511302 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555f24d8d8c0 con 0x555f24ce9000 2024-09-13T23:57:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.893+0000 7f582f3eef40 1 -- 172.21.15.173:0/1630511302 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555f24cfb860 con 0x555f24ce9000 2024-09-13T23:57:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.893+0000 7f582aba1700 1 -- 172.21.15.173:0/1630511302 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f24dadc80 con 0x555f24ce9000 2024-09-13T23:57:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.893+0000 7f582aba1700 1 -- 172.21.15.173:0/1630511302 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555f24d8d4a0 con 0x555f24ce9000 2024-09-13T23:57:04.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.893+0000 7f582f3eef40 1 -- 172.21.15.173:0/1630511302 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f24cfb6c0 con 0x555f24ce9000 2024-09-13T23:57:04.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.893+0000 7f582f3eef40 1 Processor -- start 2024-09-13T23:57:04.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582f3eef40 1 -- start start 2024-09-13T23:57:04.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582f3eef40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9800 0x555f24fceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582f3eef40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f24d0e640 con 0x555f24ce9800 2024-09-13T23:57:04.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582aba1700 1 -- 172.21.15.173:0/1630511302 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x555f24de2b00 con 0x555f24ce9000 2024-09-13T23:57:04.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582e3a8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9800 0x555f24fceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582e3a8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9800 0x555f24fceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50226/0 (socket says 172.21.15.173:50226) 2024-09-13T23:57:04.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582e3a8700 1 -- 172.21.15.173:0/2435890500 learned_addr learned my addr 172.21.15.173:0/2435890500 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582aba1700 1 --2- 172.21.15.173:0/1630511302 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555f2508e000 0x555f24fcf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582aba1700 1 -- 172.21.15.173:0/1630511302 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x555f24d4f180 con 0x555f24ce9000 2024-09-13T23:57:04.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582dba7700 1 --2- 172.21.15.173:0/1630511302 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555f2508e000 0x555f24fcf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582e3a8700 1 -- 172.21.15.173:0/2435890500 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f24cfa000 con 0x555f24ce9800 2024-09-13T23:57:04.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582e3a8700 1 --2- 172.21.15.173:0/2435890500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9800 0x555f24fceb00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x555f25070510 tx=0x555f2504ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82afc98fbb2bd73 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582dba7700 1 --2- 172.21.15.173:0/1630511302 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555f2508e000 0x555f24fcf080 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x555f250154d0 tx=0x555f2504c240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582839c700 1 -- 172.21.15.173:0/2435890500 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555f24d8d8c0 con 0x555f24ce9800 2024-09-13T23:57:04.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582839c700 1 -- 172.21.15.173:0/2435890500 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f25094000 con 0x555f24ce9800 2024-09-13T23:57:04.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582839c700 1 -- 172.21.15.173:0/2435890500 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555f24d8d4a0 con 0x555f24ce9800 2024-09-13T23:57:04.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582f3eef40 1 -- 172.21.15.173:0/2435890500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9800 msgr2=0x555f24fceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582f3eef40 1 --2- 172.21.15.173:0/2435890500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9800 0x555f24fceb00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x555f25070510 tx=0x555f2504ca20 comp rx=0 tx=0).stop 2024-09-13T23:57:04.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582f3eef40 1 -- 172.21.15.173:0/2435890500 shutdown_connections 2024-09-13T23:57:04.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582f3eef40 1 --2- 172.21.15.173:0/2435890500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9800 0x555f24fceb00 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582f3eef40 1 -- 172.21.15.173:0/2435890500 >> 172.21.15.173:0/2435890500 conn(0x555f24ce9400 msgr2=0x555f24de9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582f3eef40 1 -- 172.21.15.173:0/2435890500 shutdown_connections 2024-09-13T23:57:04.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582f3eef40 1 -- 172.21.15.173:0/2435890500 wait complete. 2024-09-13T23:57:04.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582f3eef40 1 Processor -- start 2024-09-13T23:57:04.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.897+0000 7f582f3eef40 1 -- start start 2024-09-13T23:57:04.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.901+0000 7f582f3eef40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9800 0x555f24fceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.901+0000 7f582f3eef40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f24d0e8c0 con 0x555f24ce9800 2024-09-13T23:57:04.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.901+0000 7f582e3a8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9800 0x555f24fceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.901+0000 7f582e3a8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9800 0x555f24fceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50228/0 (socket says 172.21.15.173:50228) 2024-09-13T23:57:04.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.901+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 learned_addr learned my addr 172.21.15.173:0/3423468896 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.901+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f24cfaea0 con 0x555f24ce9800 2024-09-13T23:57:04.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.901+0000 7f582e3a8700 1 --2- 172.21.15.173:0/3423468896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9800 0x555f24fceb00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x555f25ab3f80 tx=0x555f2504c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.901+0000 7f5826b99700 1 -- 172.21.15.173:0/3423468896 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555f24d8db80 con 0x555f24ce9800 2024-09-13T23:57:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.901+0000 7f5826b99700 1 -- 172.21.15.173:0/3423468896 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f25094180 con 0x555f24ce9800 2024-09-13T23:57:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.901+0000 7f5826b99700 1 -- 172.21.15.173:0/3423468896 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555f24d8d8c0 con 0x555f24ce9800 2024-09-13T23:57:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.901+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555f24cfa820 con 0x555f24ce9800 2024-09-13T23:57:04.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.901+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f24cfa9c0 con 0x555f24ce9800 2024-09-13T23:57:04.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.901+0000 7f5826b99700 1 -- 172.21.15.173:0/3423468896 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x555f24de3080 con 0x555f24ce9800 2024-09-13T23:57:04.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.901+0000 7f5826b99700 1 --2- 172.21.15.173:0/3423468896 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555f2508ec00 0x555f24fcf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.901+0000 7f5826b99700 1 -- 172.21.15.173:0/3423468896 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x555f24d4f340 con 0x555f24ce9800 2024-09-13T23:57:04.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.905+0000 7f582d3a6700 1 --2- 172.21.15.173:0/3423468896 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555f2508ec00 0x555f24fcf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.905+0000 7f582f3eef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.905+0000 7f582f3eef40 1 --2- 172.21.15.173:0/3423468896 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x555f2508f000 0x555f24fcfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.905+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f400 con 0x555f2508f000 2024-09-13T23:57:04.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.905+0000 7f582e3a8700 1 --2- 172.21.15.173:0/3423468896 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x555f2508f000 0x555f24fcfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.905+0000 7f582d3a6700 1 --2- 172.21.15.173:0/3423468896 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555f2508ec00 0x555f24fcf600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x555f24fc9920 tx=0x555f24ded800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.905+0000 7f582e3a8700 1 --2- 172.21.15.173:0/3423468896 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x555f2508f000 0x555f24fcfb80 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.905+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x555f25136b40 con 0x555f2508f000 2024-09-13T23:57:04.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.905+0000 7f582f3eef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.905+0000 7f582f3eef40 20 realm 2024-09-13T23:57:04.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.905+0000 7f582f3eef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.905+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508f000 2024-09-13T23:57:04.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.905+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x555f25136b40 con 0x555f2508f000 2024-09-13T23:57:04.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.905+0000 7f582f3eef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.905+0000 7f582f3eef40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:04.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.905+0000 7f582f3eef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.905+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508fc00 con 0x555f2508f000 2024-09-13T23:57:04.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.905+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x555f25136b40 con 0x555f2508f000 2024-09-13T23:57:04.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.905+0000 7f582f3eef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.905+0000 7f582f3eef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.905+0000 7f582f3eef40 1 --2- 172.21.15.173:0/3423468896 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x555f2508f400 0x555f24fd0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.905+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508f400 2024-09-13T23:57:04.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.905+0000 7f582dba7700 1 --2- 172.21.15.173:0/3423468896 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x555f2508f400 0x555f24fd0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.905+0000 7f582dba7700 1 --2- 172.21.15.173:0/3423468896 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x555f2508f400 0x555f24fd0100 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.909+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x555f25137200 con 0x555f2508f400 2024-09-13T23:57:04.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.909+0000 7f582f3eef40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:04.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.909+0000 7f582f3eef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.909+0000 7f582f3eef40 1 --2- 172.21.15.173:0/3423468896 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x555f2508fc00 0x555f24fd0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.909+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f25142000 con 0x555f2508fc00 2024-09-13T23:57:04.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.909+0000 7f582d3a6700 1 --2- 172.21.15.173:0/3423468896 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x555f2508fc00 0x555f24fd0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.909+0000 7f582d3a6700 1 --2- 172.21.15.173:0/3423468896 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x555f2508fc00 0x555f24fd0680 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.909+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x555f25137440 con 0x555f2508fc00 2024-09-13T23:57:04.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.909+0000 7f582f3eef40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:04.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.909+0000 7f582f3eef40 20 searching for the correct realm 2024-09-13T23:57:04.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.909+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f25142400 con 0x555f2508fc00 2024-09-13T23:57:04.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.909+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x555f25137440 con 0x555f2508fc00 2024-09-13T23:57:04.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.909+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f25142000 con 0x555f2508f400 2024-09-13T23:57:04.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.909+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25137200 con 0x555f2508f400 2024-09-13T23:57:04.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.909+0000 7f582dba7700 1 --2- 172.21.15.173:0/3423468896 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x555f25142000 0x555f24fd0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.909+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f25142000 2024-09-13T23:57:04.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.909+0000 7f582e3a8700 1 --2- 172.21.15.173:0/3423468896 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x555f25142000 0x555f24fd0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.913+0000 7f582e3a8700 1 --2- 172.21.15.173:0/3423468896 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x555f25142000 0x555f24fd0c00 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.913+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25136b40 con 0x555f25142000 2024-09-13T23:57:04.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.913+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508f000 2024-09-13T23:57:04.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.913+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x555f25136b40 con 0x555f2508f000 2024-09-13T23:57:04.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.913+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508f000 2024-09-13T23:57:04.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.913+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25136b40 con 0x555f2508f000 2024-09-13T23:57:04.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.913+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508fc00 2024-09-13T23:57:04.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.913+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25137440 con 0x555f2508fc00 2024-09-13T23:57:04.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.913+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508f000 2024-09-13T23:57:04.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.913+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25136b40 con 0x555f2508f000 2024-09-13T23:57:04.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.913+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508f400 2024-09-13T23:57:04.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.913+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25137200 con 0x555f2508f400 2024-09-13T23:57:04.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.913+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508f400 2024-09-13T23:57:04.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.917+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25137200 con 0x555f2508f400 2024-09-13T23:57:04.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.917+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508f000 2024-09-13T23:57:04.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.917+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25136b40 con 0x555f2508f000 2024-09-13T23:57:04.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.917+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f25142000 2024-09-13T23:57:04.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.917+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25136b40 con 0x555f25142000 2024-09-13T23:57:04.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.917+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508f000 2024-09-13T23:57:04.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.917+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25136b40 con 0x555f2508f000 2024-09-13T23:57:04.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.917+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f25142000 2024-09-13T23:57:04.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.917+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25136b40 con 0x555f25142000 2024-09-13T23:57:04.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.917+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508f400 2024-09-13T23:57:04.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.917+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25137200 con 0x555f2508f400 2024-09-13T23:57:04.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.917+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508fc00 2024-09-13T23:57:04.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.917+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25137440 con 0x555f2508fc00 2024-09-13T23:57:04.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.917+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508f000 2024-09-13T23:57:04.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.921+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25136b40 con 0x555f2508f000 2024-09-13T23:57:04.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.921+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508f400 2024-09-13T23:57:04.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.921+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25137200 con 0x555f2508f400 2024-09-13T23:57:04.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.921+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508fc00 2024-09-13T23:57:04.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.921+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25137440 con 0x555f2508fc00 2024-09-13T23:57:04.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.921+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508f000 2024-09-13T23:57:04.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.921+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25136b40 con 0x555f2508f000 2024-09-13T23:57:04.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.921+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508f000 2024-09-13T23:57:04.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.921+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25136b40 con 0x555f2508f000 2024-09-13T23:57:04.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.921+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508f000 2024-09-13T23:57:04.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.921+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25136b40 con 0x555f2508f000 2024-09-13T23:57:04.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.921+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508fc00 2024-09-13T23:57:04.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.925+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25137440 con 0x555f2508fc00 2024-09-13T23:57:04.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.925+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f25142000 2024-09-13T23:57:04.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.925+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25136b40 con 0x555f25142000 2024-09-13T23:57:04.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.925+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508f000 2024-09-13T23:57:04.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.925+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25136b40 con 0x555f2508f000 2024-09-13T23:57:04.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.925+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f25142000 2024-09-13T23:57:04.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.925+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25136b40 con 0x555f25142000 2024-09-13T23:57:04.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.925+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508fc00 2024-09-13T23:57:04.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.925+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25137440 con 0x555f2508fc00 2024-09-13T23:57:04.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.925+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f25142000 2024-09-13T23:57:04.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.925+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25136b40 con 0x555f25142000 2024-09-13T23:57:04.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.925+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508f400 2024-09-13T23:57:04.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.929+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25137200 con 0x555f2508f400 2024-09-13T23:57:04.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.929+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508f400 2024-09-13T23:57:04.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.929+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25137200 con 0x555f2508f400 2024-09-13T23:57:04.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.929+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508fc00 2024-09-13T23:57:04.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.929+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25137440 con 0x555f2508fc00 2024-09-13T23:57:04.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.929+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508f400 2024-09-13T23:57:04.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.929+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x555f25137200 con 0x555f2508f400 2024-09-13T23:57:04.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.929+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f2508f400 2024-09-13T23:57:04.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.929+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555f25137200 con 0x555f2508f400 2024-09-13T23:57:04.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.929+0000 7f582f3eef40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:04.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.929+0000 7f582f3eef40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:04.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.929+0000 7f582f3eef40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:04.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.929+0000 7f582f3eef40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:04.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.929+0000 7f582f3eef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.929+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f25142800 con 0x555f2508f000 2024-09-13T23:57:04.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.929+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x555f25136b40 con 0x555f2508f000 2024-09-13T23:57:04.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.929+0000 7f582f3eef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.929+0000 7f582f3eef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.929+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f25142c00 con 0x555f2508f400 2024-09-13T23:57:04.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x555f25137200 con 0x555f2508f400 2024-09-13T23:57:04.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582f3eef40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:04.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582f3eef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f25143000 con 0x555f2508f000 2024-09-13T23:57:04.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x555f25136b40 con 0x555f2508f000 2024-09-13T23:57:04.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582f3eef40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:04.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582f3eef40 20 zone default found 2024-09-13T23:57:04.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582f3eef40 4 Realm: () 2024-09-13T23:57:04.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582f3eef40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:04.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582f3eef40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:04.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582f3eef40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:04.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582f3eef40 20 zonegroup default 2024-09-13T23:57:04.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582f3eef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f25143400 con 0x555f25142000 2024-09-13T23:57:04.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x555f25136b40 con 0x555f25142000 2024-09-13T23:57:04.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582f3eef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582f3eef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f25143800 con 0x555f2508fc00 2024-09-13T23:57:04.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x555f25137440 con 0x555f2508fc00 2024-09-13T23:57:04.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582f3eef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582f3eef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f25143c00 con 0x555f2508fc00 2024-09-13T23:57:04.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x555f25137440 con 0x555f2508fc00 2024-09-13T23:57:04.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582f3eef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:04.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582f3eef40 20 started sync module instance, tier type = 2024-09-13T23:57:04.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582f3eef40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:04.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.933+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2514e000 con 0x555f2508f400 2024-09-13T23:57:04.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.937+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25137200 con 0x555f2508f400 2024-09-13T23:57:04.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.937+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93867130772224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2514e400 con 0x555f2508f400 2024-09-13T23:57:04.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.937+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2514e800 con 0x555f2508f000 2024-09-13T23:57:04.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.941+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25136b40 con 0x555f2508f000 2024-09-13T23:57:04.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.941+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93867130773376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2514ec00 con 0x555f2508f000 2024-09-13T23:57:04.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.941+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2514f000 con 0x555f2508f400 2024-09-13T23:57:04.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.941+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93867130772224] v33'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25137200 con 0x555f2508f400 2024-09-13T23:57:04.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.941+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93867130773376] v33'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25136b40 con 0x555f2508f000 2024-09-13T23:57:04.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.941+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25137200 con 0x555f2508f400 2024-09-13T23:57:04.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.941+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93867130774528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2514f400 con 0x555f2508f400 2024-09-13T23:57:04.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.941+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2514f800 con 0x555f25142000 2024-09-13T23:57:04.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.945+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93867130774528] v33'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25137200 con 0x555f2508f400 2024-09-13T23:57:04.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.945+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25136b40 con 0x555f25142000 2024-09-13T23:57:04.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.945+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93867130775680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2514fc00 con 0x555f25142000 2024-09-13T23:57:04.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.945+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2514e800 con 0x555f2508f400 2024-09-13T23:57:04.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.949+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93867130775680] v33'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25136b40 con 0x555f25142000 2024-09-13T23:57:04.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.949+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25137200 con 0x555f2508f400 2024-09-13T23:57:04.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.949+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93867130776832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2514e000 con 0x555f2508f400 2024-09-13T23:57:04.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.949+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f25142800 con 0x555f2508fc00 2024-09-13T23:57:04.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.949+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25137440 con 0x555f2508fc00 2024-09-13T23:57:04.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.949+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93867130776832] v33'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25137200 con 0x555f2508f400 2024-09-13T23:57:04.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.949+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93867130777984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f25143000 con 0x555f2508fc00 2024-09-13T23:57:04.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.949+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f25143400 con 0x555f2508fc00 2024-09-13T23:57:04.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.953+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93867130777984] v33'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25137440 con 0x555f2508fc00 2024-09-13T23:57:04.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.953+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25137440 con 0x555f2508fc00 2024-09-13T23:57:04.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.953+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93867130779136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f25142c00 con 0x555f2508fc00 2024-09-13T23:57:04.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.953+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2508f800 con 0x555f25142000 2024-09-13T23:57:04.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.953+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93867130779136] v33'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25137440 con 0x555f2508fc00 2024-09-13T23:57:04.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.953+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25136b40 con 0x555f25142000 2024-09-13T23:57:04.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.953+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93867130780288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2514e400 con 0x555f25142000 2024-09-13T23:57:04.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.953+0000 7f582f3eef40 20 add_watcher() i=0 2024-09-13T23:57:04.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.953+0000 7f582f3eef40 20 add_watcher() i=1 2024-09-13T23:57:04.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.953+0000 7f582f3eef40 20 add_watcher() i=2 2024-09-13T23:57:04.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.953+0000 7f582f3eef40 20 add_watcher() i=3 2024-09-13T23:57:04.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.953+0000 7f582f3eef40 20 add_watcher() i=4 2024-09-13T23:57:04.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.953+0000 7f582f3eef40 20 add_watcher() i=5 2024-09-13T23:57:04.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.953+0000 7f582f3eef40 20 add_watcher() i=6 2024-09-13T23:57:04.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.957+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93867130780288] v33'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25136b40 con 0x555f25142000 2024-09-13T23:57:04.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.957+0000 7f582f3eef40 20 add_watcher() i=7 2024-09-13T23:57:04.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.957+0000 7f582f3eef40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:04.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.957+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2514f000 con 0x555f2508f000 2024-09-13T23:57:04.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.957+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x555f25136b40 con 0x555f2508f000 2024-09-13T23:57:04.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.957+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93867132403712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2514f400 con 0x555f2508f000 2024-09-13T23:57:04.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.961+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93867132403712] v33'117 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x555f25136b40 con 0x555f2508f000 2024-09-13T23:57:04.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.961+0000 7f582f3eef40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:04.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.961+0000 7f582f3eef40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:04.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.961+0000 7f582f3eef40 1 Processor -- start 2024-09-13T23:57:04.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.961+0000 7f5814b75700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:04.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.961+0000 7f582f3eef40 1 -- start start 2024-09-13T23:57:04.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.961+0000 7f582f3eef40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f25142400 0x555f24fd1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.961+0000 7f582f3eef40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f24d763c0 con 0x555f25142400 2024-09-13T23:57:04.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.961+0000 7f582d3a6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f25142400 0x555f24fd1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.961+0000 7f582d3a6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f25142400 0x555f24fd1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50232/0 (socket says 172.21.15.173:50232) 2024-09-13T23:57:04.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.961+0000 7f582d3a6700 1 -- 172.21.15.173:0/3978588994 learned_addr learned my addr 172.21.15.173:0/3978588994 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.961+0000 7f582d3a6700 1 -- 172.21.15.173:0/3978588994 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f24cfab60 con 0x555f25142400 2024-09-13T23:57:04.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.961+0000 7f582d3a6700 1 --2- 172.21.15.173:0/3978588994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f25142400 0x555f24fd1180 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x555f2515c0c0 tx=0x555f24ded980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66735516a1e2cd56 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.961+0000 7f5814374700 1 -- 172.21.15.173:0/3978588994 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555f24d8d760 con 0x555f25142400 2024-09-13T23:57:04.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.961+0000 7f5814374700 1 -- 172.21.15.173:0/3978588994 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f25094600 con 0x555f25142400 2024-09-13T23:57:04.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.961+0000 7f5814374700 1 -- 172.21.15.173:0/3978588994 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555f25164000 con 0x555f25142400 2024-09-13T23:57:04.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.965+0000 7f582f3eef40 1 -- 172.21.15.173:0/3978588994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f25142400 msgr2=0x555f24fd1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:04.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.965+0000 7f582f3eef40 1 --2- 172.21.15.173:0/3978588994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f25142400 0x555f24fd1180 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x555f2515c0c0 tx=0x555f24ded980 comp rx=0 tx=0).stop 2024-09-13T23:57:04.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.965+0000 7f582f3eef40 1 -- 172.21.15.173:0/3978588994 shutdown_connections 2024-09-13T23:57:04.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.965+0000 7f582f3eef40 1 --2- 172.21.15.173:0/3978588994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f25142400 0x555f24fd1180 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:04.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.965+0000 7f582f3eef40 1 -- 172.21.15.173:0/3978588994 >> 172.21.15.173:0/3978588994 conn(0x555f2514e800 msgr2=0x555f24dea000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:04.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.965+0000 7f582f3eef40 1 -- 172.21.15.173:0/3978588994 shutdown_connections 2024-09-13T23:57:04.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.965+0000 7f582f3eef40 1 -- 172.21.15.173:0/3978588994 wait complete. 2024-09-13T23:57:04.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.965+0000 7f582f3eef40 1 Processor -- start 2024-09-13T23:57:04.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.965+0000 7f582f3eef40 1 -- start start 2024-09-13T23:57:04.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.965+0000 7f582f3eef40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f25142400 0x555f24fd1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.965+0000 7f582f3eef40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f24d76500 con 0x555f25142400 2024-09-13T23:57:04.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.965+0000 7f582d3a6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f25142400 0x555f24fd1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.965+0000 7f582d3a6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f25142400 0x555f24fd1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50238/0 (socket says 172.21.15.173:50238) 2024-09-13T23:57:04.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.965+0000 7f582d3a6700 1 -- 172.21.15.173:0/1295572521 learned_addr learned my addr 172.21.15.173:0/1295572521 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:04.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.965+0000 7f582d3a6700 1 -- 172.21.15.173:0/1295572521 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f24cfad00 con 0x555f25142400 2024-09-13T23:57:04.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.965+0000 7f582d3a6700 1 --2- 172.21.15.173:0/1295572521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f25142400 0x555f24fd1180 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x555f2515c2d0 tx=0x555f2504dc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.965+0000 7f5812b71700 1 -- 172.21.15.173:0/1295572521 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555f25164160 con 0x555f25142400 2024-09-13T23:57:04.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.965+0000 7f5812b71700 1 -- 172.21.15.173:0/1295572521 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f25094300 con 0x555f25142400 2024-09-13T23:57:04.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.965+0000 7f582f3eef40 1 -- 172.21.15.173:0/1295572521 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555f24cfa340 con 0x555f25142400 2024-09-13T23:57:04.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.965+0000 7f5812b71700 1 -- 172.21.15.173:0/1295572521 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555f251642c0 con 0x555f25142400 2024-09-13T23:57:04.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.965+0000 7f582f3eef40 1 -- 172.21.15.173:0/1295572521 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f24cfbd40 con 0x555f25142400 2024-09-13T23:57:04.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.969+0000 7f5812b71700 1 -- 172.21.15.173:0/1295572521 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x555f24de3b80 con 0x555f25142400 2024-09-13T23:57:04.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.969+0000 7f5812b71700 1 --2- 172.21.15.173:0/1295572521 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555f2508f800 0x555f251e2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:04.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.969+0000 7f5812b71700 1 -- 172.21.15.173:0/1295572521 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x555f24d4f500 con 0x555f25142400 2024-09-13T23:57:04.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.969+0000 7f582f3eef40 5 note: GC not initialized 2024-09-13T23:57:04.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.969+0000 7f582e3a8700 1 --2- 172.21.15.173:0/1295572521 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555f2508f800 0x555f251e2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:04.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.969+0000 7f582e3a8700 1 --2- 172.21.15.173:0/1295572521 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555f2508f800 0x555f251e2000 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x555f250e57d0 tx=0x555f251a6ae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:04.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.969+0000 7f581036c700 20 reqs_thread_entry: start 2024-09-13T23:57:04.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.969+0000 7f582f3eef40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:04.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.969+0000 7f582f3eef40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:04.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.969+0000 7f580e368700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:35 2024 2024-09-13T23:57:04.977 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:04.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.969+0000 7f580db46700 20 reqs_thread_entry: start 2024-09-13T23:57:04.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.969+0000 7f582f3eef40 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:57:04.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.969+0000 7f582f3eef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.969+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f25142800 con 0x555f25142000 2024-09-13T23:57:04.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.973+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(62 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x555f25136b40 con 0x555f25142000 2024-09-13T23:57:04.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.973+0000 7f582f3eef40 20 rados_obj.operate() r=0 bl.length=346 2024-09-13T23:57:04.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.973+0000 7f582f3eef40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T23:57:04.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.973+0000 7f582f3eef40 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:57:04.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.973+0000 7f582f3eef40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:04.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.973+0000 7f582f3eef40 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:57:04.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.973+0000 7f582f3eef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.973+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2514ec00 con 0x555f25142000 2024-09-13T23:57:04.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.973+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x555f25136b40 con 0x555f25142000 2024-09-13T23:57:04.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.973+0000 7f582f3eef40 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:57:04.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.973+0000 7f582f3eef40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:57:04.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.973+0000 7f582f3eef40 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:57:04.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.973+0000 7f582f3eef40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 : miss 2024-09-13T23:57:04.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.973+0000 7f582f3eef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.973+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 8.17 8:ea49432e:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2514f800 con 0x555f2508f400 2024-09-13T23:57:04.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.973+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(64 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x555f25137200 con 0x555f2508f400 2024-09-13T23:57:04.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.973+0000 7f582f3eef40 20 rados_obj.operate() r=0 bl.length=352 2024-09-13T23:57:04.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.973+0000 7f582f3eef40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 info.flags=0x17 2024-09-13T23:57:04.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.973+0000 7f582f3eef40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 to cache LRU end 2024-09-13T23:57:04.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.973+0000 7f582f3eef40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:04.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.973+0000 7f582f3eef40 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:57:04.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.973+0000 7f582f3eef40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 2024-09-13T23:57:04.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.973+0000 7f582f3eef40 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-13T23:57:04.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.973+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2514fc00 con 0x555f2508f000 2024-09-13T23:57:04.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.977+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(65 fud.buckets [call] v33'2 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x555f25136b40 con 0x555f2508f000 2024-09-13T23:57:04.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.977+0000 7f582f3eef40 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-13T23:57:04.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.977+0000 7f582f3eef40 20 rados->read ofs=0 len=0 2024-09-13T23:57:04.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.977+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2514e400 con 0x555f25142000 2024-09-13T23:57:04.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.977+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) v8 ==== 233+0+288 (crc 0 0 0) 0x555f25136b40 con 0x555f25142000 2024-09-13T23:57:04.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.977+0000 7f582f3eef40 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:57:04.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.977+0000 7f582f3eef40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-13T23:57:04.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.977+0000 7f582f3eef40 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:57:04.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.977+0000 7f582f3eef40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:04.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.977+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2514f400 con 0x555f25142000 2024-09-13T23:57:04.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.981+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v33'21 uv21 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x555f25136b40 con 0x555f25142000 2024-09-13T23:57:04.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.981+0000 7f582f3eef40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T23:57:04.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.981+0000 7f582f3eef40 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:57:04.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.981+0000 7f582f3eef40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T23:57:04.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.981+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93867132406016 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2514ec00 con 0x555f2508fc00 2024-09-13T23:57:04.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.981+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== watch-notify(notify (1) cookie 93867130779136 notify 141733920781 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x555f251a49c0 con 0x555f2508fc00 2024-09-13T23:57:04.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.981+0000 7f582839c700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920781 cookie 93867130779136 notifier 4560 bl.length()=338 2024-09-13T23:57:04.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.981+0000 7f582839c700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T23:57:04.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.981+0000 7f582839c700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:57:04.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.981+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(68 notify.6 [notify cookie 93867132406016 out=8b] v0'0 uv120 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x555f25137440 con 0x555f2508fc00 2024-09-13T23:57:04.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.981+0000 7f582839c700 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f25254000 con 0x555f2508fc00 2024-09-13T23:57:04.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.981+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25137440 con 0x555f2508fc00 2024-09-13T23:57:04.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.981+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== watch-notify(notify_complete (2) cookie 93867132406016 notify 141733920781 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x555f251a4b60 con 0x555f2508fc00 2024-09-13T23:57:04.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.981+0000 7f5814b75700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:04.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.981+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93867132403712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2514fc00 con 0x555f2508f000 2024-09-13T23:57:04.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.985+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93867132403712] v33'118 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x555f25136b40 con 0x555f2508f000 2024-09-13T23:57:04.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.985+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93867130772224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f2514e400 con 0x555f2508f400 2024-09-13T23:57:04.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.989+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93867130772224] v33'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25137200 con 0x555f2508f400 2024-09-13T23:57:04.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.989+0000 7f582f3eef40 20 remove_watcher() i=0 2024-09-13T23:57:04.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.989+0000 7f582f3eef40 2 removed watcher, disabling cache 2024-09-13T23:57:04.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.989+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93867130773376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f25142800 con 0x555f2508f000 2024-09-13T23:57:04.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.989+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93867130773376] v33'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25136b40 con 0x555f2508f000 2024-09-13T23:57:04.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.989+0000 7f582f3eef40 20 remove_watcher() i=1 2024-09-13T23:57:04.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.989+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93867130774528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f25254800 con 0x555f2508f400 2024-09-13T23:57:04.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.993+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93867130774528] v33'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25137200 con 0x555f2508f400 2024-09-13T23:57:04.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.993+0000 7f582f3eef40 20 remove_watcher() i=2 2024-09-13T23:57:04.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.993+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93867130775680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f25254c00 con 0x555f25142000 2024-09-13T23:57:05.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.993+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93867130775680] v33'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25136b40 con 0x555f25142000 2024-09-13T23:57:05.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.993+0000 7f582f3eef40 20 remove_watcher() i=3 2024-09-13T23:57:05.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.993+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93867130776832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f25255000 con 0x555f2508f400 2024-09-13T23:57:05.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.997+0000 7f582dba7700 1 -- 172.21.15.173:0/3423468896 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93867130776832] v33'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25137200 con 0x555f2508f400 2024-09-13T23:57:05.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.997+0000 7f582f3eef40 20 remove_watcher() i=4 2024-09-13T23:57:05.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:04.997+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93867130777984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f25255400 con 0x555f2508fc00 2024-09-13T23:57:05.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.001+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93867130777984] v33'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25137440 con 0x555f2508fc00 2024-09-13T23:57:05.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.001+0000 7f582f3eef40 20 remove_watcher() i=5 2024-09-13T23:57:05.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.001+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93867130779136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f25255800 con 0x555f2508fc00 2024-09-13T23:57:05.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.001+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 <== osd.3 v2:172.21.15.173:6800/4020038786 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93867130779136] v33'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25137440 con 0x555f2508fc00 2024-09-13T23:57:05.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.001+0000 7f582f3eef40 20 remove_watcher() i=6 2024-09-13T23:57:05.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.001+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93867130780288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555f25255c00 con 0x555f25142000 2024-09-13T23:57:05.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582e3a8700 1 -- 172.21.15.173:0/3423468896 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93867130780288] v33'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555f25136b40 con 0x555f25142000 2024-09-13T23:57:05.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 20 remove_watcher() i=7 2024-09-13T23:57:05.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x555f2508f400 msgr2=0x555f24fd0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 --2- 172.21.15.173:0/3423468896 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x555f2508f400 0x555f24fd0100 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x555f2508f000 msgr2=0x555f24fcfb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 --2- 172.21.15.173:0/3423468896 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x555f2508f000 0x555f24fcfb80 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x555f25142000 msgr2=0x555f24fd0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 --2- 172.21.15.173:0/3423468896 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x555f25142000 0x555f24fd0c00 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x555f2508fc00 msgr2=0x555f24fd0680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 --2- 172.21.15.173:0/3423468896 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x555f2508fc00 0x555f24fd0680 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555f2508ec00 msgr2=0x555f24fcf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 --2- 172.21.15.173:0/3423468896 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555f2508ec00 0x555f24fcf600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x555f24fc9920 tx=0x555f24ded800 comp rx=0 tx=0).stop 2024-09-13T23:57:05.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9800 msgr2=0x555f24fceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 --2- 172.21.15.173:0/3423468896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9800 0x555f24fceb00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x555f25ab3f80 tx=0x555f2504c840 comp rx=0 tx=0).stop 2024-09-13T23:57:05.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 reap_dead start 2024-09-13T23:57:05.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582d3a6700 1 -- 172.21.15.173:0/3423468896 reap_dead start 2024-09-13T23:57:05.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 shutdown_connections 2024-09-13T23:57:05.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 >> 172.21.15.173:0/3423468896 conn(0x555f24ce9400 msgr2=0x555f24de9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 shutdown_connections 2024-09-13T23:57:05.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 -- 172.21.15.173:0/3423468896 wait complete. 2024-09-13T23:57:05.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 -- 172.21.15.173:0/1295572521 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555f2508f800 msgr2=0x555f251e2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 --2- 172.21.15.173:0/1295572521 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555f2508f800 0x555f251e2000 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x555f250e57d0 tx=0x555f251a6ae0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 -- 172.21.15.173:0/1295572521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f25142400 msgr2=0x555f24fd1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 --2- 172.21.15.173:0/1295572521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f25142400 0x555f24fd1180 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x555f2515c2d0 tx=0x555f2504dc20 comp rx=0 tx=0).stop 2024-09-13T23:57:05.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 -- 172.21.15.173:0/1295572521 shutdown_connections 2024-09-13T23:57:05.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 --2- 172.21.15.173:0/1295572521 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555f2508f800 0x555f251e2000 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 --2- 172.21.15.173:0/1295572521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f25142400 0x555f24fd1180 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 -- 172.21.15.173:0/1295572521 >> 172.21.15.173:0/1295572521 conn(0x555f2514e800 msgr2=0x555f24dea000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 -- 172.21.15.173:0/1295572521 shutdown_connections 2024-09-13T23:57:05.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 -- 172.21.15.173:0/1295572521 wait complete. 2024-09-13T23:57:05.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 -- 172.21.15.173:0/1630511302 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555f2508e000 msgr2=0x555f24fcf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 --2- 172.21.15.173:0/1630511302 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555f2508e000 0x555f24fcf080 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x555f250154d0 tx=0x555f2504c240 comp rx=0 tx=0).stop 2024-09-13T23:57:05.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 -- 172.21.15.173:0/1630511302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9000 msgr2=0x555f24fce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.005+0000 7f582f3eef40 1 --2- 172.21.15.173:0/1630511302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9000 0x555f24fce580 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x555f25ab3e60 tx=0x555f24deda40 comp rx=0 tx=0).stop 2024-09-13T23:57:05.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.009+0000 7f582f3eef40 1 -- 172.21.15.173:0/1630511302 shutdown_connections 2024-09-13T23:57:05.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.009+0000 7f582f3eef40 1 --2- 172.21.15.173:0/1630511302 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555f2508e000 0x555f24fcf080 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.009+0000 7f582f3eef40 1 --2- 172.21.15.173:0/1630511302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555f24ce9000 0x555f24fce580 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.009+0000 7f582f3eef40 1 -- 172.21.15.173:0/1630511302 >> 172.21.15.173:0/1630511302 conn(0x555f24ce8c00 msgr2=0x555f24de9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.009+0000 7f582f3eef40 1 -- 172.21.15.173:0/1630511302 shutdown_connections 2024-09-13T23:57:05.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.009+0000 7f582f3eef40 1 -- 172.21.15.173:0/1630511302 wait complete. 2024-09-13T23:57:05.019 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.1'] 2024-09-13T23:57:05.019 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.1'] 2024-09-13T23:57:05.019 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 2024-09-13T23:57:05.063 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:05.063 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:05.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.057+0000 7f5a688e9f40 1 Processor -- start 2024-09-13T23:57:05.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.057+0000 7f5a688e9f40 1 -- start start 2024-09-13T23:57:05.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.057+0000 7f5a688e9f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x558320a6b400 0x558320d50580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.057+0000 7f5a688e9f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558320b2f500 con 0x558320a6b000 2024-09-13T23:57:05.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.057+0000 7f5a688e9f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x558320af8a00 con 0x558320a6b400 2024-09-13T23:57:05.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.057+0000 7f5a668a1700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x558320a6b400 0x558320d50580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.057+0000 7f5a670a2700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x558320a6b000 0x558320b6a800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47470/0 (socket says 172.21.15.173:47470) 2024-09-13T23:57:05.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.057+0000 7f5a670a2700 1 -- 172.21.15.173:0/388201383 learned_addr learned my addr 172.21.15.173:0/388201383 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:05.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.061+0000 7f5a668a1700 1 -- 172.21.15.173:0/388201383 >> v1:172.21.15.87:6789/0 conn(0x558320a6b000 legacy=0x558320b6a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.061+0000 7f5a668a1700 1 -- 172.21.15.173:0/388201383 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558320a7dd40 con 0x558320a6b400 2024-09-13T23:57:05.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.061+0000 7f5a668a1700 1 --2- 172.21.15.173:0/388201383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b400 0x558320d50580 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x558320d4b920 tx=0x558320b6f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a145d19758858de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.061+0000 7f5a660a0700 1 -- 172.21.15.173:0/388201383 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558320b0f4a0 con 0x558320a6b400 2024-09-13T23:57:05.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.061+0000 7f5a660a0700 1 -- 172.21.15.173:0/388201383 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558320b2f800 con 0x558320a6b400 2024-09-13T23:57:05.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.061+0000 7f5a660a0700 1 -- 172.21.15.173:0/388201383 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558320b0f600 con 0x558320a6b400 2024-09-13T23:57:05.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.061+0000 7f5a688e9f40 1 -- 172.21.15.173:0/388201383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b400 msgr2=0x558320d50580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.061+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/388201383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b400 0x558320d50580 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x558320d4b920 tx=0x558320b6f920 comp rx=0 tx=0).stop 2024-09-13T23:57:05.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.061+0000 7f5a688e9f40 1 -- 172.21.15.173:0/388201383 shutdown_connections 2024-09-13T23:57:05.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.061+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/388201383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b400 0x558320d50580 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.061+0000 7f5a688e9f40 1 -- 172.21.15.173:0/388201383 >> 172.21.15.173:0/388201383 conn(0x558320a6ac00 msgr2=0x558320b6a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.061+0000 7f5a688e9f40 1 -- 172.21.15.173:0/388201383 shutdown_connections 2024-09-13T23:57:05.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.061+0000 7f5a688e9f40 1 -- 172.21.15.173:0/388201383 wait complete. 2024-09-13T23:57:05.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.061+0000 7f5a688e9f40 1 Processor -- start 2024-09-13T23:57:05.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.061+0000 7f5a688e9f40 1 -- start start 2024-09-13T23:57:05.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.061+0000 7f5a688e9f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b000 0x558320d50580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.061+0000 7f5a688e9f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558320af8500 con 0x558320a6b000 2024-09-13T23:57:05.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.061+0000 7f5a670a2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b000 0x558320d50580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.061+0000 7f5a670a2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b000 0x558320d50580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50256/0 (socket says 172.21.15.173:50256) 2024-09-13T23:57:05.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.061+0000 7f5a670a2700 1 -- 172.21.15.173:0/3317090362 learned_addr learned my addr 172.21.15.173:0/3317090362 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.061+0000 7f5a670a2700 1 -- 172.21.15.173:0/3317090362 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558320a7dba0 con 0x558320a6b000 2024-09-13T23:57:05.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.065+0000 7f5a670a2700 1 --2- 172.21.15.173:0/3317090362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b000 0x558320d50580 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x558320bc7e00 tx=0x558320b6fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8708fb562137feea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.065+0000 7f5a6589f700 1 -- 172.21.15.173:0/3317090362 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558320b0f4a0 con 0x558320a6b000 2024-09-13T23:57:05.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.065+0000 7f5a6589f700 1 -- 172.21.15.173:0/3317090362 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558320b2fb00 con 0x558320a6b000 2024-09-13T23:57:05.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.065+0000 7f5a6589f700 1 -- 172.21.15.173:0/3317090362 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558320b0f600 con 0x558320a6b000 2024-09-13T23:57:05.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.065+0000 7f5a688e9f40 1 -- 172.21.15.173:0/3317090362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b000 msgr2=0x558320d50580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.065+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/3317090362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b000 0x558320d50580 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x558320bc7e00 tx=0x558320b6fb60 comp rx=0 tx=0).stop 2024-09-13T23:57:05.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.065+0000 7f5a688e9f40 1 -- 172.21.15.173:0/3317090362 shutdown_connections 2024-09-13T23:57:05.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.065+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/3317090362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b000 0x558320d50580 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.065+0000 7f5a688e9f40 1 -- 172.21.15.173:0/3317090362 >> 172.21.15.173:0/3317090362 conn(0x558320a6ac00 msgr2=0x558320b6b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.065+0000 7f5a688e9f40 1 -- 172.21.15.173:0/3317090362 shutdown_connections 2024-09-13T23:57:05.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.065+0000 7f5a688e9f40 1 -- 172.21.15.173:0/3317090362 wait complete. 2024-09-13T23:57:05.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.065+0000 7f5a688e9f40 1 Processor -- start 2024-09-13T23:57:05.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.065+0000 7f5a688e9f40 1 -- start start 2024-09-13T23:57:05.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.065+0000 7f5a688e9f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b000 0x558320d50580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.065+0000 7f5a688e9f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558320af83c0 con 0x558320a6b000 2024-09-13T23:57:05.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.065+0000 7f5a670a2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b000 0x558320d50580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.065+0000 7f5a670a2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b000 0x558320d50580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50266/0 (socket says 172.21.15.173:50266) 2024-09-13T23:57:05.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.065+0000 7f5a670a2700 1 -- 172.21.15.173:0/3520507922 learned_addr learned my addr 172.21.15.173:0/3520507922 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.065+0000 7f5a670a2700 1 -- 172.21.15.173:0/3520507922 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558320a7da00 con 0x558320a6b000 2024-09-13T23:57:05.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.065+0000 7f5a670a2700 1 --2- 172.21.15.173:0/3520507922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b000 0x558320d50580 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x558320bc7ef0 tx=0x558320b6fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.065+0000 7f5a6409c700 1 -- 172.21.15.173:0/3520507922 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558320b0f8c0 con 0x558320a6b000 2024-09-13T23:57:05.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.065+0000 7f5a6409c700 1 -- 172.21.15.173:0/3520507922 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558320b2fc80 con 0x558320a6b000 2024-09-13T23:57:05.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.065+0000 7f5a688e9f40 1 -- 172.21.15.173:0/3520507922 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558320a7d860 con 0x558320a6b000 2024-09-13T23:57:05.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.065+0000 7f5a6409c700 1 -- 172.21.15.173:0/3520507922 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558320b0f4a0 con 0x558320a6b000 2024-09-13T23:57:05.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.069+0000 7f5a688e9f40 1 -- 172.21.15.173:0/3520507922 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558320a7d6c0 con 0x558320a6b000 2024-09-13T23:57:05.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.069+0000 7f5a688e9f40 1 Processor -- start 2024-09-13T23:57:05.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.069+0000 7f5a6409c700 1 -- 172.21.15.173:0/3520507922 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x558320b64b00 con 0x558320a6b000 2024-09-13T23:57:05.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.069+0000 7f5a688e9f40 1 -- start start 2024-09-13T23:57:05.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.069+0000 7f5a6409c700 1 --2- 172.21.15.173:0/3520507922 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558320e06000 0x558320d51080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.069+0000 7f5a688e9f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b800 0x558320d50b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.069+0000 7f5a688e9f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558320a90640 con 0x558320a6b800 2024-09-13T23:57:05.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.069+0000 7f5a6409c700 1 -- 172.21.15.173:0/3520507922 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x558320ad1180 con 0x558320a6b000 2024-09-13T23:57:05.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.069+0000 7f5a678a3700 1 --2- 172.21.15.173:0/3520507922 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558320e06000 0x558320d51080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.069+0000 7f5a670a2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b800 0x558320d50b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.069+0000 7f5a670a2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b800 0x558320d50b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50280/0 (socket says 172.21.15.173:50280) 2024-09-13T23:57:05.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.069+0000 7f5a670a2700 1 -- 172.21.15.173:0/294041384 learned_addr learned my addr 172.21.15.173:0/294041384 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.069+0000 7f5a678a3700 1 --2- 172.21.15.173:0/3520507922 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558320e06000 0x558320d51080 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x558320bc7fb0 tx=0x558320dcaa20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.069+0000 7f5a670a2700 1 -- 172.21.15.173:0/294041384 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558320a7c000 con 0x558320a6b800 2024-09-13T23:57:05.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.069+0000 7f5a670a2700 1 --2- 172.21.15.173:0/294041384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b800 0x558320d50b00 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x5583218e3020 tx=0x558320dca240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402e4cb43ea39076 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.069+0000 7f5a61897700 1 -- 172.21.15.173:0/294041384 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558320b0f600 con 0x558320a6b800 2024-09-13T23:57:05.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.073+0000 7f5a61897700 1 -- 172.21.15.173:0/294041384 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558320b2fc80 con 0x558320a6b800 2024-09-13T23:57:05.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.073+0000 7f5a61897700 1 -- 172.21.15.173:0/294041384 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558320b0fa20 con 0x558320a6b800 2024-09-13T23:57:05.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.073+0000 7f5a688e9f40 1 -- 172.21.15.173:0/294041384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b800 msgr2=0x558320d50b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.073+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/294041384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b800 0x558320d50b00 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x5583218e3020 tx=0x558320dca240 comp rx=0 tx=0).stop 2024-09-13T23:57:05.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.073+0000 7f5a688e9f40 1 -- 172.21.15.173:0/294041384 shutdown_connections 2024-09-13T23:57:05.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.073+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/294041384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b800 0x558320d50b00 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.073+0000 7f5a688e9f40 1 -- 172.21.15.173:0/294041384 >> 172.21.15.173:0/294041384 conn(0x558320a6b400 msgr2=0x558320b6b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.073+0000 7f5a688e9f40 1 -- 172.21.15.173:0/294041384 shutdown_connections 2024-09-13T23:57:05.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.073+0000 7f5a688e9f40 1 -- 172.21.15.173:0/294041384 wait complete. 2024-09-13T23:57:05.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.073+0000 7f5a688e9f40 1 Processor -- start 2024-09-13T23:57:05.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.073+0000 7f5a688e9f40 1 -- start start 2024-09-13T23:57:05.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.073+0000 7f5a688e9f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b800 0x558320d50b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.073+0000 7f5a688e9f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558320a908c0 con 0x558320a6b800 2024-09-13T23:57:05.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.073+0000 7f5a670a2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b800 0x558320d50b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.073+0000 7f5a670a2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b800 0x558320d50b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50282/0 (socket says 172.21.15.173:50282) 2024-09-13T23:57:05.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.073+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 learned_addr learned my addr 172.21.15.173:0/1875020170 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.073+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558320a7cea0 con 0x558320a6b800 2024-09-13T23:57:05.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.073+0000 7f5a670a2700 1 --2- 172.21.15.173:0/1875020170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b800 0x558320d50b00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x5583218e2780 tx=0x558320dcac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.073+0000 7f5a60094700 1 -- 172.21.15.173:0/1875020170 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558320b0f600 con 0x558320a6b800 2024-09-13T23:57:05.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.073+0000 7f5a60094700 1 -- 172.21.15.173:0/1875020170 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558320e2a000 con 0x558320a6b800 2024-09-13T23:57:05.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.073+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558320a7c820 con 0x558320a6b800 2024-09-13T23:57:05.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.073+0000 7f5a60094700 1 -- 172.21.15.173:0/1875020170 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558320b0fa20 con 0x558320a6b800 2024-09-13T23:57:05.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.073+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558320a7c9c0 con 0x558320a6b800 2024-09-13T23:57:05.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.077+0000 7f5a60094700 1 -- 172.21.15.173:0/1875020170 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x558320b64dc0 con 0x558320a6b800 2024-09-13T23:57:05.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.077+0000 7f5a60094700 1 --2- 172.21.15.173:0/1875020170 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558320e07000 0x558320d51600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.077+0000 7f5a60094700 1 -- 172.21.15.173:0/1875020170 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x558320ad1340 con 0x558320a6b800 2024-09-13T23:57:05.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.077+0000 7f5a668a1700 1 --2- 172.21.15.173:0/1875020170 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558320e07000 0x558320d51600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.077+0000 7f5a688e9f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.077+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/1875020170 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x558320e07400 0x558320d51b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.077+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e07800 con 0x558320e07400 2024-09-13T23:57:05.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.077+0000 7f5a678a3700 1 --2- 172.21.15.173:0/1875020170 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x558320e07400 0x558320d51b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.077+0000 7f5a668a1700 1 --2- 172.21.15.173:0/1875020170 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558320e07000 0x558320d51600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x558320d4b920 tx=0x558320b6f800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.077+0000 7f5a678a3700 1 --2- 172.21.15.173:0/1875020170 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x558320e07400 0x558320d51b80 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.077+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x558320e98b40 con 0x558320e07400 2024-09-13T23:57:05.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.077+0000 7f5a688e9f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.077+0000 7f5a688e9f40 20 realm 2024-09-13T23:57:05.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.077+0000 7f5a688e9f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.077+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e07c00 con 0x558320e07400 2024-09-13T23:57:05.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.081+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x558320e98b40 con 0x558320e07400 2024-09-13T23:57:05.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.081+0000 7f5a688e9f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.081+0000 7f5a688e9f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:05.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.081+0000 7f5a688e9f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.081+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e07800 con 0x558320e07400 2024-09-13T23:57:05.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.081+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x558320e98b40 con 0x558320e07400 2024-09-13T23:57:05.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.081+0000 7f5a688e9f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.081+0000 7f5a688e9f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.081+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/1875020170 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558320e07c00 0x558320d52100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.081+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e07c00 2024-09-13T23:57:05.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.081+0000 7f5a670a2700 1 --2- 172.21.15.173:0/1875020170 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558320e07c00 0x558320d52100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.081+0000 7f5a670a2700 1 --2- 172.21.15.173:0/1875020170 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558320e07c00 0x558320d52100 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.081+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x558320e99200 con 0x558320e07c00 2024-09-13T23:57:05.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.081+0000 7f5a688e9f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:05.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.081+0000 7f5a688e9f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.081+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/1875020170 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558320e9e400 0x558320d52680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.081+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e800 con 0x558320e9e400 2024-09-13T23:57:05.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.081+0000 7f5a668a1700 1 --2- 172.21.15.173:0/1875020170 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558320e9e400 0x558320d52680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.081+0000 7f5a668a1700 1 --2- 172.21.15.173:0/1875020170 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558320e9e400 0x558320d52680 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.081+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x558320e99440 con 0x558320e9e400 2024-09-13T23:57:05.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.081+0000 7f5a688e9f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:05.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.085+0000 7f5a688e9f40 20 searching for the correct realm 2024-09-13T23:57:05.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.085+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9ec00 con 0x558320e9e400 2024-09-13T23:57:05.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.085+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x558320e99440 con 0x558320e9e400 2024-09-13T23:57:05.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.085+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e800 con 0x558320e07c00 2024-09-13T23:57:05.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.085+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e99200 con 0x558320e07c00 2024-09-13T23:57:05.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.085+0000 7f5a670a2700 1 --2- 172.21.15.173:0/1875020170 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x558320e9e800 0x558320d52c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.085+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e9e800 2024-09-13T23:57:05.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.085+0000 7f5a678a3700 1 --2- 172.21.15.173:0/1875020170 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x558320e9e800 0x558320d52c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.085+0000 7f5a678a3700 1 --2- 172.21.15.173:0/1875020170 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x558320e9e800 0x558320d52c00 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.085+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e98b40 con 0x558320e9e800 2024-09-13T23:57:05.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.085+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e07400 2024-09-13T23:57:05.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.085+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x558320e98b40 con 0x558320e07400 2024-09-13T23:57:05.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.085+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e07400 2024-09-13T23:57:05.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.085+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e98b40 con 0x558320e07400 2024-09-13T23:57:05.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.085+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e9e400 2024-09-13T23:57:05.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.089+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e99440 con 0x558320e9e400 2024-09-13T23:57:05.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.089+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e07400 2024-09-13T23:57:05.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.089+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e98b40 con 0x558320e07400 2024-09-13T23:57:05.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.089+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e07c00 2024-09-13T23:57:05.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.089+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e99200 con 0x558320e07c00 2024-09-13T23:57:05.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.089+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e07c00 2024-09-13T23:57:05.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.089+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e99200 con 0x558320e07c00 2024-09-13T23:57:05.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.089+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e07400 2024-09-13T23:57:05.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.089+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e98b40 con 0x558320e07400 2024-09-13T23:57:05.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.089+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e9e800 2024-09-13T23:57:05.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.089+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e98b40 con 0x558320e9e800 2024-09-13T23:57:05.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.089+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e07400 2024-09-13T23:57:05.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.089+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e98b40 con 0x558320e07400 2024-09-13T23:57:05.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.089+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e9e800 2024-09-13T23:57:05.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.093+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e98b40 con 0x558320e9e800 2024-09-13T23:57:05.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.093+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e07c00 2024-09-13T23:57:05.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.093+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e99200 con 0x558320e07c00 2024-09-13T23:57:05.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.093+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e9e400 2024-09-13T23:57:05.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.093+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e99440 con 0x558320e9e400 2024-09-13T23:57:05.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.093+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e07400 2024-09-13T23:57:05.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.093+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e98b40 con 0x558320e07400 2024-09-13T23:57:05.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.093+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e07c00 2024-09-13T23:57:05.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.093+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e99200 con 0x558320e07c00 2024-09-13T23:57:05.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.093+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e9e400 2024-09-13T23:57:05.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.093+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e99440 con 0x558320e9e400 2024-09-13T23:57:05.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.093+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e07400 2024-09-13T23:57:05.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.097+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e98b40 con 0x558320e07400 2024-09-13T23:57:05.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.097+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e07400 2024-09-13T23:57:05.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.097+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e98b40 con 0x558320e07400 2024-09-13T23:57:05.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.097+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e07400 2024-09-13T23:57:05.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.097+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e98b40 con 0x558320e07400 2024-09-13T23:57:05.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.097+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e9e400 2024-09-13T23:57:05.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.097+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e99440 con 0x558320e9e400 2024-09-13T23:57:05.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.097+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e9e800 2024-09-13T23:57:05.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.097+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e98b40 con 0x558320e9e800 2024-09-13T23:57:05.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.097+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e07400 2024-09-13T23:57:05.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.097+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e98b40 con 0x558320e07400 2024-09-13T23:57:05.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.097+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e9e800 2024-09-13T23:57:05.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.097+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e98b40 con 0x558320e9e800 2024-09-13T23:57:05.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.097+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e9e400 2024-09-13T23:57:05.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.101+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e99440 con 0x558320e9e400 2024-09-13T23:57:05.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.101+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e9e800 2024-09-13T23:57:05.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.101+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e98b40 con 0x558320e9e800 2024-09-13T23:57:05.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.101+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e07c00 2024-09-13T23:57:05.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.101+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e99200 con 0x558320e07c00 2024-09-13T23:57:05.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.101+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e07c00 2024-09-13T23:57:05.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.101+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e99200 con 0x558320e07c00 2024-09-13T23:57:05.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.101+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e9e400 2024-09-13T23:57:05.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.101+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e99440 con 0x558320e9e400 2024-09-13T23:57:05.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.101+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e07c00 2024-09-13T23:57:05.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x558320e99200 con 0x558320e07c00 2024-09-13T23:57:05.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e07c00 2024-09-13T23:57:05.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558320e99200 con 0x558320e07c00 2024-09-13T23:57:05.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a688e9f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:05.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a688e9f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:05.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a688e9f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:05.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a688e9f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:05.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a688e9f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9f000 con 0x558320e07400 2024-09-13T23:57:05.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x558320e98b40 con 0x558320e07400 2024-09-13T23:57:05.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a688e9f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a688e9f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9f400 con 0x558320e07c00 2024-09-13T23:57:05.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x558320e99200 con 0x558320e07c00 2024-09-13T23:57:05.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a688e9f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:05.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a688e9f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9f800 con 0x558320e07400 2024-09-13T23:57:05.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x558320e98b40 con 0x558320e07400 2024-09-13T23:57:05.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a688e9f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:05.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a688e9f40 20 zone default found 2024-09-13T23:57:05.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a688e9f40 4 Realm: () 2024-09-13T23:57:05.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a688e9f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:05.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a688e9f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:05.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a688e9f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:05.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a688e9f40 20 zonegroup default 2024-09-13T23:57:05.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a688e9f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.105+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9fc00 con 0x558320e9e800 2024-09-13T23:57:05.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.109+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x558320e98b40 con 0x558320e9e800 2024-09-13T23:57:05.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.109+0000 7f5a688e9f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.109+0000 7f5a688e9f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.109+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9f000 con 0x558320e9e400 2024-09-13T23:57:05.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.109+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x558320e99440 con 0x558320e9e400 2024-09-13T23:57:05.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.109+0000 7f5a688e9f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.109+0000 7f5a688e9f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.109+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9f800 con 0x558320e9e400 2024-09-13T23:57:05.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.109+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x558320e99440 con 0x558320e9e400 2024-09-13T23:57:05.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.109+0000 7f5a688e9f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.109+0000 7f5a688e9f40 20 started sync module instance, tier type = 2024-09-13T23:57:05.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.109+0000 7f5a688e9f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:05.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.109+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e07800 con 0x558320e07c00 2024-09-13T23:57:05.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.113+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e99200 con 0x558320e07c00 2024-09-13T23:57:05.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.113+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94021679872768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e06800 con 0x558320e07c00 2024-09-13T23:57:05.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.113+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e07800 con 0x558320e07400 2024-09-13T23:57:05.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.113+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e98b40 con 0x558320e07400 2024-09-13T23:57:05.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.113+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94021679872768] v33'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e99200 con 0x558320e07c00 2024-09-13T23:57:05.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.113+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94021679873920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9e000 con 0x558320e07400 2024-09-13T23:57:05.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.113+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9f400 con 0x558320e07c00 2024-09-13T23:57:05.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.117+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94021679873920] v33'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e98b40 con 0x558320e07400 2024-09-13T23:57:05.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.117+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e99200 con 0x558320e07c00 2024-09-13T23:57:05.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.117+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94021679875072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320ea6000 con 0x558320e07c00 2024-09-13T23:57:05.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.117+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320ea6400 con 0x558320e9e800 2024-09-13T23:57:05.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.121+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e98b40 con 0x558320e9e800 2024-09-13T23:57:05.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.121+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94021679876224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320ea6800 con 0x558320e9e800 2024-09-13T23:57:05.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.121+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320ea6c00 con 0x558320e07c00 2024-09-13T23:57:05.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.121+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94021679875072] v33'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e99200 con 0x558320e07c00 2024-09-13T23:57:05.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.121+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e99200 con 0x558320e07c00 2024-09-13T23:57:05.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.121+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94021679877376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320ea7000 con 0x558320e07c00 2024-09-13T23:57:05.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.121+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320ea7400 con 0x558320e9e400 2024-09-13T23:57:05.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.121+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94021679876224] v33'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e98b40 con 0x558320e9e800 2024-09-13T23:57:05.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.125+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e99440 con 0x558320e9e400 2024-09-13T23:57:05.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.125+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94021679878528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320ea7800 con 0x558320e9e400 2024-09-13T23:57:05.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.125+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320ea7c00 con 0x558320e9e400 2024-09-13T23:57:05.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.125+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94021679877376] v33'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e99200 con 0x558320e07c00 2024-09-13T23:57:05.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.125+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v33'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e99440 con 0x558320e9e400 2024-09-13T23:57:05.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.125+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94021679879680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320ea6000 con 0x558320e9e400 2024-09-13T23:57:05.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.125+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320ea6c00 con 0x558320e9e800 2024-09-13T23:57:05.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.125+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94021679878528] v33'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e99440 con 0x558320e9e400 2024-09-13T23:57:05.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.129+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94021679879680] v33'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e99440 con 0x558320e9e400 2024-09-13T23:57:05.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.129+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e98b40 con 0x558320e9e800 2024-09-13T23:57:05.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.129+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94021679880832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320ea7000 con 0x558320e9e800 2024-09-13T23:57:05.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.129+0000 7f5a688e9f40 20 add_watcher() i=0 2024-09-13T23:57:05.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.129+0000 7f5a688e9f40 20 add_watcher() i=1 2024-09-13T23:57:05.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.129+0000 7f5a688e9f40 20 add_watcher() i=2 2024-09-13T23:57:05.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.129+0000 7f5a688e9f40 20 add_watcher() i=3 2024-09-13T23:57:05.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.129+0000 7f5a688e9f40 20 add_watcher() i=4 2024-09-13T23:57:05.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.129+0000 7f5a688e9f40 20 add_watcher() i=5 2024-09-13T23:57:05.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.129+0000 7f5a688e9f40 20 add_watcher() i=6 2024-09-13T23:57:05.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.129+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94021679880832] v33'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e98b40 con 0x558320e9e800 2024-09-13T23:57:05.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.129+0000 7f5a688e9f40 20 add_watcher() i=7 2024-09-13T23:57:05.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.129+0000 7f5a688e9f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:05.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.129+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9f400 con 0x558320e07400 2024-09-13T23:57:05.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.129+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x558320e98b40 con 0x558320e07400 2024-09-13T23:57:05.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.129+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94021681348608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9ec00 con 0x558320e07400 2024-09-13T23:57:05.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.133+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94021681348608] v33'119 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x558320e98b40 con 0x558320e07400 2024-09-13T23:57:05.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.133+0000 7f5a4e070700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:05.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.133+0000 7f5a688e9f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:05.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.133+0000 7f5a688e9f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:05.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.133+0000 7f5a688e9f40 1 Processor -- start 2024-09-13T23:57:05.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.133+0000 7f5a688e9f40 1 -- start start 2024-09-13T23:57:05.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.133+0000 7f5a688e9f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320e9f800 0x558320d53180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.133+0000 7f5a688e9f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558320af83c0 con 0x558320e9f800 2024-09-13T23:57:05.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.133+0000 7f5a668a1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320e9f800 0x558320d53180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.133+0000 7f5a668a1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320e9f800 0x558320d53180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50290/0 (socket says 172.21.15.173:50290) 2024-09-13T23:57:05.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.133+0000 7f5a668a1700 1 -- 172.21.15.173:0/2879681393 learned_addr learned my addr 172.21.15.173:0/2879681393 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.133+0000 7f5a668a1700 1 -- 172.21.15.173:0/2879681393 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558320a7cb60 con 0x558320e9f800 2024-09-13T23:57:05.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.133+0000 7f5a668a1700 1 --2- 172.21.15.173:0/2879681393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320e9f800 0x558320d53180 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x558320e47f50 tx=0x558320b6f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb906fc020f29cbb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.133+0000 7f5a4d86f700 1 -- 172.21.15.173:0/2879681393 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558320b0f760 con 0x558320e9f800 2024-09-13T23:57:05.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.137+0000 7f5a4d86f700 1 -- 172.21.15.173:0/2879681393 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558320e2a900 con 0x558320e9f800 2024-09-13T23:57:05.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.137+0000 7f5a4d86f700 1 -- 172.21.15.173:0/2879681393 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558320eae160 con 0x558320e9f800 2024-09-13T23:57:05.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.137+0000 7f5a688e9f40 1 -- 172.21.15.173:0/2879681393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320e9f800 msgr2=0x558320d53180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.137+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/2879681393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320e9f800 0x558320d53180 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x558320e47f50 tx=0x558320b6f980 comp rx=0 tx=0).stop 2024-09-13T23:57:05.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.137+0000 7f5a688e9f40 1 -- 172.21.15.173:0/2879681393 shutdown_connections 2024-09-13T23:57:05.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.137+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/2879681393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320e9f800 0x558320d53180 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.137+0000 7f5a688e9f40 1 -- 172.21.15.173:0/2879681393 >> 172.21.15.173:0/2879681393 conn(0x558320e9f000 msgr2=0x558320b6c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.137+0000 7f5a688e9f40 1 -- 172.21.15.173:0/2879681393 shutdown_connections 2024-09-13T23:57:05.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.137+0000 7f5a688e9f40 1 -- 172.21.15.173:0/2879681393 wait complete. 2024-09-13T23:57:05.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.137+0000 7f5a688e9f40 1 Processor -- start 2024-09-13T23:57:05.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.137+0000 7f5a688e9f40 1 -- start start 2024-09-13T23:57:05.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.137+0000 7f5a688e9f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320e9f800 0x558320d53180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.137+0000 7f5a688e9f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558320af8500 con 0x558320e9f800 2024-09-13T23:57:05.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.137+0000 7f5a668a1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320e9f800 0x558320d53180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.137+0000 7f5a668a1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320e9f800 0x558320d53180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50298/0 (socket says 172.21.15.173:50298) 2024-09-13T23:57:05.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.137+0000 7f5a668a1700 1 -- 172.21.15.173:0/1047048280 learned_addr learned my addr 172.21.15.173:0/1047048280 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.137+0000 7f5a668a1700 1 -- 172.21.15.173:0/1047048280 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558320a7cd00 con 0x558320e9f800 2024-09-13T23:57:05.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.137+0000 7f5a668a1700 1 --2- 172.21.15.173:0/1047048280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320e9f800 0x558320d53180 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x558320eb8210 tx=0x558320dcbc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.137+0000 7f5a4c06c700 1 -- 172.21.15.173:0/1047048280 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558320eae2c0 con 0x558320e9f800 2024-09-13T23:57:05.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.137+0000 7f5a4c06c700 1 -- 172.21.15.173:0/1047048280 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558320e2a600 con 0x558320e9f800 2024-09-13T23:57:05.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.137+0000 7f5a4c06c700 1 -- 172.21.15.173:0/1047048280 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558320eae420 con 0x558320e9f800 2024-09-13T23:57:05.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.137+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1047048280 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558320a7c340 con 0x558320e9f800 2024-09-13T23:57:05.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.137+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1047048280 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558320a7dd40 con 0x558320e9f800 2024-09-13T23:57:05.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.141+0000 7f5a4c06c700 1 -- 172.21.15.173:0/1047048280 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x558320b65b80 con 0x558320e9f800 2024-09-13T23:57:05.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.141+0000 7f5a4c06c700 1 --2- 172.21.15.173:0/1047048280 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558320e9f400 0x558320f40000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.141+0000 7f5a4c06c700 1 -- 172.21.15.173:0/1047048280 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x558320ad16c0 con 0x558320e9f800 2024-09-13T23:57:05.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.141+0000 7f5a688e9f40 5 note: GC not initialized 2024-09-13T23:57:05.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.141+0000 7f5a678a3700 1 --2- 172.21.15.173:0/1047048280 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558320e9f400 0x558320f40000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.141+0000 7f5a678a3700 1 --2- 172.21.15.173:0/1047048280 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558320e9f400 0x558320f40000 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x558320e47860 tx=0x558320b6fda0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.141+0000 7f5a49867700 20 reqs_thread_entry: start 2024-09-13T23:57:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.141+0000 7f5a688e9f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.141+0000 7f5a688e9f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.141+0000 7f5a47863700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:35 2024 2024-09-13T23:57:05.149 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.141+0000 7f5a47041700 20 reqs_thread_entry: start 2024-09-13T23:57:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.141+0000 7f5a688e9f40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:57:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.141+0000 7f5a688e9f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.141+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e06800 con 0x558320e07400 2024-09-13T23:57:05.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.145+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x558320e98b40 con 0x558320e07400 2024-09-13T23:57:05.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.145+0000 7f5a688e9f40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:57:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.145+0000 7f5a688e9f40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:57:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.145+0000 7f5a688e9f40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.145+0000 7f5a688e9f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.145+0000 7f5a688e9f40 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:57:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.145+0000 7f5a688e9f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.145+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e07800 con 0x558320e9e800 2024-09-13T23:57:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.145+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x558320e98b40 con 0x558320e9e800 2024-09-13T23:57:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.145+0000 7f5a688e9f40 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:57:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.145+0000 7f5a688e9f40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:57:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.145+0000 7f5a688e9f40 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:57:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.145+0000 7f5a688e9f40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 : miss 2024-09-13T23:57:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.145+0000 7f5a688e9f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.145+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 8.17 8:ea49432e:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320ea6800 con 0x558320e07c00 2024-09-13T23:57:05.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.145+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(64 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x558320e99200 con 0x558320e07c00 2024-09-13T23:57:05.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.145+0000 7f5a688e9f40 20 rados_obj.operate() r=0 bl.length=352 2024-09-13T23:57:05.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.145+0000 7f5a688e9f40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 info.flags=0x17 2024-09-13T23:57:05.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.145+0000 7f5a688e9f40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 to cache LRU end 2024-09-13T23:57:05.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.145+0000 7f5a688e9f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:05.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.145+0000 7f5a688e9f40 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:57:05.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.145+0000 7f5a688e9f40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 2024-09-13T23:57:05.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.145+0000 7f5a688e9f40 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-13T23:57:05.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.145+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320ea6c00 con 0x558320e07400 2024-09-13T23:57:05.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.149+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(65 fud.buckets [call] v33'3 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x558320e98b40 con 0x558320e07400 2024-09-13T23:57:05.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.149+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 8.17 8:ea49432e:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320ea7400 con 0x558320e07c00 2024-09-13T23:57:05.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.149+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(66 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v33'3 uv3 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x558320e99200 con 0x558320e07c00 2024-09-13T23:57:05.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.149+0000 7f5a688e9f40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 info.flags=0x17 2024-09-13T23:57:05.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.149+0000 7f5a688e9f40 10 moving default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 to cache LRU end 2024-09-13T23:57:05.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.149+0000 7f5a688e9f40 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:57:05.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.149+0000 7f5a688e9f40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1, ofs0, ns] 2024-09-13T23:57:05.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.149+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94021681350912 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320e9ec00 con 0x558320e07c00 2024-09-13T23:57:05.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.153+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== watch-notify(notify (1) cookie 94021679875072 notify 141733920788 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x558320a7da00 con 0x558320e07c00 2024-09-13T23:57:05.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.153+0000 7f5a61897700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920788 cookie 94021679875072 notifier 4568 bl.length()=725 2024-09-13T23:57:05.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.153+0000 7f5a61897700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 info.flags=0x17 2024-09-13T23:57:05.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.153+0000 7f5a61897700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 to cache LRU end 2024-09-13T23:57:05.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.153+0000 7f5a61897700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:57:05.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.153+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(67 notify.2 [notify cookie 94021681350912 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x558320e99200 con 0x558320e07c00 2024-09-13T23:57:05.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.153+0000 7f5a61897700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320fb0000 con 0x558320e07c00 2024-09-13T23:57:05.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.153+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e99200 con 0x558320e07c00 2024-09-13T23:57:05.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.153+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== watch-notify(notify_complete (2) cookie 94021681350912 notify 141733920788 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x558320d92000 con 0x558320e07c00 2024-09-13T23:57:05.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.153+0000 7f5a688e9f40 20 handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1]): orig_sources= new_sources= 2024-09-13T23:57:05.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.153+0000 7f5a688e9f40 20 handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1]): potential sources added=[] removed=[] 2024-09-13T23:57:05.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.153+0000 7f5a688e9f40 20 handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1]): orig_dests= new_dests= 2024-09-13T23:57:05.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.153+0000 7f5a688e9f40 20 handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1]): potential dests added=[] removed=[] 2024-09-13T23:57:05.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.153+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320fb0000 con 0x558320e9e800 2024-09-13T23:57:05.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.153+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(69 foo.buckets [call] v33'22 uv22 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x558320e98b40 con 0x558320e9e800 2024-09-13T23:57:05.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.153+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320fb0800 con 0x558320e9e800 2024-09-13T23:57:05.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.157+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v33'23 uv23 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x558320e98b40 con 0x558320e9e800 2024-09-13T23:57:05.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.157+0000 7f5a688e9f40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T23:57:05.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.157+0000 7f5a688e9f40 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:57:05.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.157+0000 7f5a688e9f40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T23:57:05.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.157+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94021681350912 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320fb0c00 con 0x558320e9e400 2024-09-13T23:57:05.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.157+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== watch-notify(notify (1) cookie 94021679879680 notify 141733920782 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x558320f009c0 con 0x558320e9e400 2024-09-13T23:57:05.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.157+0000 7f5a61897700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920782 cookie 94021679879680 notifier 4568 bl.length()=314 2024-09-13T23:57:05.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.157+0000 7f5a61897700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T23:57:05.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.157+0000 7f5a61897700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:57:05.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.157+0000 7f5a61897700 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320fb0400 con 0x558320e9e400 2024-09-13T23:57:05.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.157+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(71 notify.6 [notify cookie 94021681350912 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x558320e99440 con 0x558320e9e400 2024-09-13T23:57:05.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.157+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== watch-notify(notify_complete (2) cookie 94021681350912 notify 141733920782 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x558320f00b60 con 0x558320e9e400 2024-09-13T23:57:05.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.157+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e99440 con 0x558320e9e400 2024-09-13T23:57:05.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.161+0000 7f5a4e070700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:05.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.161+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94021681348608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320fb1000 con 0x558320e07400 2024-09-13T23:57:05.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.161+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94021681348608] v33'120 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x558320e98b40 con 0x558320e07400 2024-09-13T23:57:05.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.161+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94021679872768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320fb1400 con 0x558320e07c00 2024-09-13T23:57:05.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.165+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94021679872768] v33'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e99200 con 0x558320e07c00 2024-09-13T23:57:05.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.165+0000 7f5a688e9f40 20 remove_watcher() i=0 2024-09-13T23:57:05.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.165+0000 7f5a688e9f40 2 removed watcher, disabling cache 2024-09-13T23:57:05.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.165+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94021679873920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320ea6800 con 0x558320e07400 2024-09-13T23:57:05.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.169+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94021679873920] v33'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e98b40 con 0x558320e07400 2024-09-13T23:57:05.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.169+0000 7f5a688e9f40 20 remove_watcher() i=1 2024-09-13T23:57:05.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.169+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94021679875072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320ea6400 con 0x558320e07c00 2024-09-13T23:57:05.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.169+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94021679875072] v33'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e99200 con 0x558320e07c00 2024-09-13T23:57:05.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.169+0000 7f5a688e9f40 20 remove_watcher() i=2 2024-09-13T23:57:05.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.169+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94021679876224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320ea7000 con 0x558320e9e800 2024-09-13T23:57:05.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.173+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94021679876224] v33'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e98b40 con 0x558320e9e800 2024-09-13T23:57:05.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.173+0000 7f5a688e9f40 20 remove_watcher() i=3 2024-09-13T23:57:05.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.173+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94021679877376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320ea7400 con 0x558320e07c00 2024-09-13T23:57:05.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.173+0000 7f5a670a2700 1 -- 172.21.15.173:0/1875020170 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94021679877376] v33'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e99200 con 0x558320e07c00 2024-09-13T23:57:05.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.173+0000 7f5a688e9f40 20 remove_watcher() i=4 2024-09-13T23:57:05.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.173+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94021679878528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320fb1c00 con 0x558320e9e400 2024-09-13T23:57:05.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.177+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94021679878528] v33'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e99440 con 0x558320e9e400 2024-09-13T23:57:05.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.177+0000 7f5a688e9f40 20 remove_watcher() i=5 2024-09-13T23:57:05.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.177+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94021679879680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320fb1800 con 0x558320e9e400 2024-09-13T23:57:05.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.181+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 <== osd.3 v2:172.21.15.173:6800/4020038786 20 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94021679879680] v33'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e99440 con 0x558320e9e400 2024-09-13T23:57:05.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.181+0000 7f5a688e9f40 20 remove_watcher() i=6 2024-09-13T23:57:05.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.181+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94021679880832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558320fb0000 con 0x558320e9e800 2024-09-13T23:57:05.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.181+0000 7f5a678a3700 1 -- 172.21.15.173:0/1875020170 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94021679880832] v33'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558320e98b40 con 0x558320e9e800 2024-09-13T23:57:05.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.181+0000 7f5a688e9f40 20 remove_watcher() i=7 2024-09-13T23:57:05.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.181+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558320e07c00 msgr2=0x558320d52100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.181+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/1875020170 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558320e07c00 0x558320d52100 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.181+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x558320e07400 msgr2=0x558320d51b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.181+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/1875020170 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x558320e07400 0x558320d51b80 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.181+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x558320e9e800 msgr2=0x558320d52c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.181+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/1875020170 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x558320e9e800 0x558320d52c00 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.181+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558320e9e400 msgr2=0x558320d52680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.181+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/1875020170 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558320e9e400 0x558320d52680 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.181+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558320e07000 msgr2=0x558320d51600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.181+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/1875020170 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558320e07000 0x558320d51600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x558320d4b920 tx=0x558320b6f800 comp rx=0 tx=0).stop 2024-09-13T23:57:05.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.181+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b800 msgr2=0x558320d50b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.181+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/1875020170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b800 0x558320d50b00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x5583218e2780 tx=0x558320dcac00 comp rx=0 tx=0).stop 2024-09-13T23:57:05.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.181+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 reap_dead start 2024-09-13T23:57:05.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.181+0000 7f5a668a1700 1 -- 172.21.15.173:0/1875020170 reap_dead start 2024-09-13T23:57:05.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.181+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 shutdown_connections 2024-09-13T23:57:05.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.181+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 >> 172.21.15.173:0/1875020170 conn(0x558320a6b400 msgr2=0x558320b6b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.181+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 shutdown_connections 2024-09-13T23:57:05.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.181+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1875020170 wait complete. 2024-09-13T23:57:05.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.185+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1047048280 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558320e9f400 msgr2=0x558320f40000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.185+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/1047048280 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558320e9f400 0x558320f40000 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x558320e47860 tx=0x558320b6fda0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.185+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1047048280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320e9f800 msgr2=0x558320d53180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.185+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/1047048280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320e9f800 0x558320d53180 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x558320eb8210 tx=0x558320dcbc20 comp rx=0 tx=0).stop 2024-09-13T23:57:05.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.185+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1047048280 shutdown_connections 2024-09-13T23:57:05.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.185+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/1047048280 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558320e9f400 0x558320f40000 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.185+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/1047048280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320e9f800 0x558320d53180 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.185+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1047048280 >> 172.21.15.173:0/1047048280 conn(0x558320e9f000 msgr2=0x558320b6c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.185+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1047048280 shutdown_connections 2024-09-13T23:57:05.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.185+0000 7f5a688e9f40 1 -- 172.21.15.173:0/1047048280 wait complete. 2024-09-13T23:57:05.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.185+0000 7f5a688e9f40 1 -- 172.21.15.173:0/3520507922 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558320e06000 msgr2=0x558320d51080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.185+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/3520507922 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558320e06000 0x558320d51080 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x558320bc7fb0 tx=0x558320dcaa20 comp rx=0 tx=0).stop 2024-09-13T23:57:05.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.185+0000 7f5a688e9f40 1 -- 172.21.15.173:0/3520507922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b000 msgr2=0x558320d50580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.185+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/3520507922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b000 0x558320d50580 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x558320bc7ef0 tx=0x558320b6fa40 comp rx=0 tx=0).stop 2024-09-13T23:57:05.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.185+0000 7f5a688e9f40 1 -- 172.21.15.173:0/3520507922 shutdown_connections 2024-09-13T23:57:05.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.185+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/3520507922 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558320e06000 0x558320d51080 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.185+0000 7f5a688e9f40 1 --2- 172.21.15.173:0/3520507922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558320a6b000 0x558320d50580 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.185+0000 7f5a688e9f40 1 -- 172.21.15.173:0/3520507922 >> 172.21.15.173:0/3520507922 conn(0x558320a6ac00 msgr2=0x558320b6b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.185+0000 7f5a688e9f40 1 -- 172.21.15.173:0/3520507922 shutdown_connections 2024-09-13T23:57:05.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.185+0000 7f5a688e9f40 1 -- 172.21.15.173:0/3520507922 wait complete. 2024-09-13T23:57:05.196 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-13T23:57:05.197 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-13T23:57:05.197 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-13T23:57:05.235 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:05.235 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:05.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.229+0000 7f0e08785f40 1 Processor -- start 2024-09-13T23:57:05.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.229+0000 7f0e08785f40 1 -- start start 2024-09-13T23:57:05.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.229+0000 7f0e08785f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55fef835d000 0x55fef8642580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.229+0000 7f0e08785f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55fef8421500 con 0x55fef835d400 2024-09-13T23:57:05.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.229+0000 7f0e08785f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55fef83eaa00 con 0x55fef835d000 2024-09-13T23:57:05.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.229+0000 7f0e06f3e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55fef835d000 0x55fef8642580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.229+0000 7f0e0673d700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55fef835d400 0x55fef845c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47480/0 (socket says 172.21.15.173:47480) 2024-09-13T23:57:05.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.229+0000 7f0e0673d700 1 -- 172.21.15.173:0/2058188786 learned_addr learned my addr 172.21.15.173:0/2058188786 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:05.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.233+0000 7f0e05f3c700 1 -- 172.21.15.173:0/2058188786 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 632825499 0 0) 0x55fef84b8000 con 0x55fef835d400 2024-09-13T23:57:05.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.233+0000 7f0e05f3c700 1 -- 172.21.15.173:0/2058188786 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x55fef8421680 con 0x55fef835d400 2024-09-13T23:57:05.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.233+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2058188786 >> v1:172.21.15.87:6789/0 conn(0x55fef835d400 legacy=0x55fef845c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.233+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2058188786 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fef836fd40 con 0x55fef835d000 2024-09-13T23:57:05.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.233+0000 7f0e06f3e700 1 --2- 172.21.15.173:0/2058188786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d000 0x55fef8642580 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x55fef863da70 tx=0x55fef8461980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc865d8440b5aaf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.233+0000 7f0e05f3c700 1 -- 172.21.15.173:0/2058188786 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fef84014a0 con 0x55fef835d000 2024-09-13T23:57:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.233+0000 7f0e05f3c700 1 -- 172.21.15.173:0/2058188786 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fef8421680 con 0x55fef835d000 2024-09-13T23:57:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.233+0000 7f0e05f3c700 1 -- 172.21.15.173:0/2058188786 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fef8401600 con 0x55fef835d000 2024-09-13T23:57:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.233+0000 7f0e08785f40 1 -- 172.21.15.173:0/2058188786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d000 msgr2=0x55fef8642580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.233+0000 7f0e08785f40 1 --2- 172.21.15.173:0/2058188786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d000 0x55fef8642580 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x55fef863da70 tx=0x55fef8461980 comp rx=0 tx=0).stop 2024-09-13T23:57:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.233+0000 7f0e08785f40 1 -- 172.21.15.173:0/2058188786 shutdown_connections 2024-09-13T23:57:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.233+0000 7f0e08785f40 1 --2- 172.21.15.173:0/2058188786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d000 0x55fef8642580 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.233+0000 7f0e08785f40 1 -- 172.21.15.173:0/2058188786 >> 172.21.15.173:0/2058188786 conn(0x55fef835cc00 msgr2=0x55fef845c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.233+0000 7f0e08785f40 1 -- 172.21.15.173:0/2058188786 shutdown_connections 2024-09-13T23:57:05.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.233+0000 7f0e08785f40 1 -- 172.21.15.173:0/2058188786 wait complete. 2024-09-13T23:57:05.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.233+0000 7f0e08785f40 1 Processor -- start 2024-09-13T23:57:05.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.233+0000 7f0e08785f40 1 -- start start 2024-09-13T23:57:05.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.233+0000 7f0e08785f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d000 0x55fef8642580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.233+0000 7f0e08785f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fef83ea500 con 0x55fef835d000 2024-09-13T23:57:05.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.233+0000 7f0e06f3e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d000 0x55fef8642580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.233+0000 7f0e06f3e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d000 0x55fef8642580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50304/0 (socket says 172.21.15.173:50304) 2024-09-13T23:57:05.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.233+0000 7f0e06f3e700 1 -- 172.21.15.173:0/537090738 learned_addr learned my addr 172.21.15.173:0/537090738 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e06f3e700 1 -- 172.21.15.173:0/537090738 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fef836fba0 con 0x55fef835d000 2024-09-13T23:57:05.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e06f3e700 1 --2- 172.21.15.173:0/537090738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d000 0x55fef8642580 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x55fef9131e00 tx=0x55fef8461800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b527822d150b6f04 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e0573b700 1 -- 172.21.15.173:0/537090738 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fef8401760 con 0x55fef835d000 2024-09-13T23:57:05.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e0573b700 1 -- 172.21.15.173:0/537090738 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fef8421980 con 0x55fef835d000 2024-09-13T23:57:05.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e0573b700 1 -- 172.21.15.173:0/537090738 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fef84011e0 con 0x55fef835d000 2024-09-13T23:57:05.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e08785f40 1 -- 172.21.15.173:0/537090738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d000 msgr2=0x55fef8642580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e08785f40 1 --2- 172.21.15.173:0/537090738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d000 0x55fef8642580 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x55fef9131e00 tx=0x55fef8461800 comp rx=0 tx=0).stop 2024-09-13T23:57:05.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e08785f40 1 -- 172.21.15.173:0/537090738 shutdown_connections 2024-09-13T23:57:05.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e08785f40 1 --2- 172.21.15.173:0/537090738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d000 0x55fef8642580 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e08785f40 1 -- 172.21.15.173:0/537090738 >> 172.21.15.173:0/537090738 conn(0x55fef835cc00 msgr2=0x55fef845d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e08785f40 1 -- 172.21.15.173:0/537090738 shutdown_connections 2024-09-13T23:57:05.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e08785f40 1 -- 172.21.15.173:0/537090738 wait complete. 2024-09-13T23:57:05.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e08785f40 1 Processor -- start 2024-09-13T23:57:05.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e08785f40 1 -- start start 2024-09-13T23:57:05.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e08785f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d000 0x55fef8642580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e08785f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fef83ea3c0 con 0x55fef835d000 2024-09-13T23:57:05.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e06f3e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d000 0x55fef8642580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e06f3e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d000 0x55fef8642580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50316/0 (socket says 172.21.15.173:50316) 2024-09-13T23:57:05.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e06f3e700 1 -- 172.21.15.173:0/850942126 learned_addr learned my addr 172.21.15.173:0/850942126 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e06f3e700 1 -- 172.21.15.173:0/850942126 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fef836fa00 con 0x55fef835d000 2024-09-13T23:57:05.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e06f3e700 1 --2- 172.21.15.173:0/850942126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d000 0x55fef8642580 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x55fef9131ef0 tx=0x55fef8461980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e03f38700 1 -- 172.21.15.173:0/850942126 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fef84014a0 con 0x55fef835d000 2024-09-13T23:57:05.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e03f38700 1 -- 172.21.15.173:0/850942126 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fef8421b00 con 0x55fef835d000 2024-09-13T23:57:05.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e08785f40 1 -- 172.21.15.173:0/850942126 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fef836f860 con 0x55fef835d000 2024-09-13T23:57:05.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e03f38700 1 -- 172.21.15.173:0/850942126 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fef8401600 con 0x55fef835d000 2024-09-13T23:57:05.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.237+0000 7f0e08785f40 1 -- 172.21.15.173:0/850942126 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fef836f6c0 con 0x55fef835d000 2024-09-13T23:57:05.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e08785f40 1 Processor -- start 2024-09-13T23:57:05.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e08785f40 1 -- start start 2024-09-13T23:57:05.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e08785f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d800 0x55fef8642b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e08785f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fef8382640 con 0x55fef835d800 2024-09-13T23:57:05.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e0773f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d800 0x55fef8642b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e0773f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d800 0x55fef8642b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50320/0 (socket says 172.21.15.173:50320) 2024-09-13T23:57:05.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e0773f700 1 -- 172.21.15.173:0/25105661 learned_addr learned my addr 172.21.15.173:0/25105661 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e03f38700 1 -- 172.21.15.173:0/850942126 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55fef8456b00 con 0x55fef835d000 2024-09-13T23:57:05.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e0773f700 1 -- 172.21.15.173:0/25105661 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fef836e000 con 0x55fef835d800 2024-09-13T23:57:05.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e03f38700 1 --2- 172.21.15.173:0/850942126 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fef8714000 0x55fef8643080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e03f38700 1 -- 172.21.15.173:0/850942126 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55fef83c3180 con 0x55fef835d000 2024-09-13T23:57:05.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e0773f700 1 --2- 172.21.15.173:0/25105661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d800 0x55fef8642b00 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x55fef8699500 tx=0x55fef86d28a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c915155eea0b2936 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e06f3e700 1 --2- 172.21.15.173:0/850942126 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fef8714000 0x55fef8643080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e01733700 1 -- 172.21.15.173:0/25105661 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fef84014a0 con 0x55fef835d800 2024-09-13T23:57:05.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e01733700 1 -- 172.21.15.173:0/25105661 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fef8421b00 con 0x55fef835d800 2024-09-13T23:57:05.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e01733700 1 -- 172.21.15.173:0/25105661 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fef8401600 con 0x55fef835d800 2024-09-13T23:57:05.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e08785f40 1 -- 172.21.15.173:0/25105661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d800 msgr2=0x55fef8642b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e08785f40 1 --2- 172.21.15.173:0/25105661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d800 0x55fef8642b00 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x55fef8699500 tx=0x55fef86d28a0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e06f3e700 1 --2- 172.21.15.173:0/850942126 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fef8714000 0x55fef8643080 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x55fef86996b0 tx=0x55fef86d2120 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e08785f40 1 -- 172.21.15.173:0/25105661 shutdown_connections 2024-09-13T23:57:05.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e08785f40 1 --2- 172.21.15.173:0/25105661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d800 0x55fef8642b00 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e08785f40 1 -- 172.21.15.173:0/25105661 >> 172.21.15.173:0/25105661 conn(0x55fef835d400 msgr2=0x55fef845d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e08785f40 1 -- 172.21.15.173:0/25105661 shutdown_connections 2024-09-13T23:57:05.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e08785f40 1 -- 172.21.15.173:0/25105661 wait complete. 2024-09-13T23:57:05.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e08785f40 1 Processor -- start 2024-09-13T23:57:05.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e08785f40 1 -- start start 2024-09-13T23:57:05.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e08785f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d800 0x55fef8642b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.241+0000 7f0e08785f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fef83828c0 con 0x55fef835d800 2024-09-13T23:57:05.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.245+0000 7f0e0773f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d800 0x55fef8642b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.245+0000 7f0e0773f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d800 0x55fef8642b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50332/0 (socket says 172.21.15.173:50332) 2024-09-13T23:57:05.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.245+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 learned_addr learned my addr 172.21.15.173:0/2771966894 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.245+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fef836eea0 con 0x55fef835d800 2024-09-13T23:57:05.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.245+0000 7f0e0773f700 1 --2- 172.21.15.173:0/2771966894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d800 0x55fef8642b00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x55fef86988a0 tx=0x55fef8461e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.245+0000 7f0dfff30700 1 -- 172.21.15.173:0/2771966894 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fef8401760 con 0x55fef835d800 2024-09-13T23:57:05.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.245+0000 7f0dfff30700 1 -- 172.21.15.173:0/2771966894 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fef872a000 con 0x55fef835d800 2024-09-13T23:57:05.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.245+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fef836e820 con 0x55fef835d800 2024-09-13T23:57:05.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.245+0000 7f0dfff30700 1 -- 172.21.15.173:0/2771966894 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fef84014a0 con 0x55fef835d800 2024-09-13T23:57:05.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.245+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fef836e9c0 con 0x55fef835d800 2024-09-13T23:57:05.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.245+0000 7f0dfff30700 1 -- 172.21.15.173:0/2771966894 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55fef8456dc0 con 0x55fef835d800 2024-09-13T23:57:05.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.245+0000 7f0dfff30700 1 --2- 172.21.15.173:0/2771966894 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fef8714c00 0x55fef8643600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.245+0000 7f0dfff30700 1 -- 172.21.15.173:0/2771966894 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55fef83c3340 con 0x55fef835d800 2024-09-13T23:57:05.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e0673d700 1 --2- 172.21.15.173:0/2771966894 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fef8714c00 0x55fef8643600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e08785f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e08785f40 1 --2- 172.21.15.173:0/2771966894 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55fef8715000 0x55fef8643b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715400 con 0x55fef8715000 2024-09-13T23:57:05.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e0773f700 1 --2- 172.21.15.173:0/2771966894 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55fef8715000 0x55fef8643b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e0673d700 1 --2- 172.21.15.173:0/2771966894 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fef8714c00 0x55fef8643600 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55fef9130030 tx=0x55fef86d3800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e0773f700 1 --2- 172.21.15.173:0/2771966894 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55fef8715000 0x55fef8643b80 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef8715000 2024-09-13T23:57:05.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e08785f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e08785f40 20 realm 2024-09-13T23:57:05.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e08785f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715000 2024-09-13T23:57:05.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef8715000 2024-09-13T23:57:05.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e08785f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e08785f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:05.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e08785f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715c00 con 0x55fef8715000 2024-09-13T23:57:05.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef8715000 2024-09-13T23:57:05.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e08785f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e08785f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e08785f40 1 --2- 172.21.15.173:0/2771966894 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55fef8715400 0x55fef8644100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715400 2024-09-13T23:57:05.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e06f3e700 1 --2- 172.21.15.173:0/2771966894 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55fef8715400 0x55fef8644100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e06f3e700 1 --2- 172.21.15.173:0/2771966894 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55fef8715400 0x55fef8644100 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55fef87bd200 con 0x55fef8715400 2024-09-13T23:57:05.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e08785f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:05.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e08785f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e08785f40 1 --2- 172.21.15.173:0/2771966894 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55fef8715c00 0x55fef8644680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.249+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87c0000 con 0x55fef8715c00 2024-09-13T23:57:05.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.253+0000 7f0e0673d700 1 --2- 172.21.15.173:0/2771966894 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55fef8715c00 0x55fef8644680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.253+0000 7f0e0673d700 1 --2- 172.21.15.173:0/2771966894 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55fef8715c00 0x55fef8644680 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.253+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55fef87bd440 con 0x55fef8715c00 2024-09-13T23:57:05.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.253+0000 7f0e08785f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:05.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.253+0000 7f0e08785f40 20 searching for the correct realm 2024-09-13T23:57:05.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.253+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87c0400 con 0x55fef8715c00 2024-09-13T23:57:05.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.253+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55fef87bd440 con 0x55fef8715c00 2024-09-13T23:57:05.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.253+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87c0000 con 0x55fef8715400 2024-09-13T23:57:05.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.253+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bd200 con 0x55fef8715400 2024-09-13T23:57:05.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.253+0000 7f0e06f3e700 1 --2- 172.21.15.173:0/2771966894 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55fef87c0000 0x55fef8644c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.253+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef87c0000 2024-09-13T23:57:05.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.253+0000 7f0e0773f700 1 --2- 172.21.15.173:0/2771966894 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55fef87c0000 0x55fef8644c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.253+0000 7f0e0773f700 1 --2- 172.21.15.173:0/2771966894 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55fef87c0000 0x55fef8644c00 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.253+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef87c0000 2024-09-13T23:57:05.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.253+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715000 2024-09-13T23:57:05.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.253+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef8715000 2024-09-13T23:57:05.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.253+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715000 2024-09-13T23:57:05.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.257+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef8715000 2024-09-13T23:57:05.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.257+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715c00 2024-09-13T23:57:05.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.257+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bd440 con 0x55fef8715c00 2024-09-13T23:57:05.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.257+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715000 2024-09-13T23:57:05.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.257+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef8715000 2024-09-13T23:57:05.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.257+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715400 2024-09-13T23:57:05.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.257+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bd200 con 0x55fef8715400 2024-09-13T23:57:05.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.257+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715400 2024-09-13T23:57:05.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.257+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bd200 con 0x55fef8715400 2024-09-13T23:57:05.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.257+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715000 2024-09-13T23:57:05.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.257+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef8715000 2024-09-13T23:57:05.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.257+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef87c0000 2024-09-13T23:57:05.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.257+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef87c0000 2024-09-13T23:57:05.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.257+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715000 2024-09-13T23:57:05.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.257+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef8715000 2024-09-13T23:57:05.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.257+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef87c0000 2024-09-13T23:57:05.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.257+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef87c0000 2024-09-13T23:57:05.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.257+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715400 2024-09-13T23:57:05.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.261+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bd200 con 0x55fef8715400 2024-09-13T23:57:05.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.261+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715c00 2024-09-13T23:57:05.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.261+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bd440 con 0x55fef8715c00 2024-09-13T23:57:05.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.261+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715000 2024-09-13T23:57:05.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.261+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef8715000 2024-09-13T23:57:05.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.261+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715400 2024-09-13T23:57:05.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.261+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bd200 con 0x55fef8715400 2024-09-13T23:57:05.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.261+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715c00 2024-09-13T23:57:05.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.261+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bd440 con 0x55fef8715c00 2024-09-13T23:57:05.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.261+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715000 2024-09-13T23:57:05.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.261+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef8715000 2024-09-13T23:57:05.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.261+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715000 2024-09-13T23:57:05.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.261+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef8715000 2024-09-13T23:57:05.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.261+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715000 2024-09-13T23:57:05.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.265+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef8715000 2024-09-13T23:57:05.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.265+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715c00 2024-09-13T23:57:05.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.265+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bd440 con 0x55fef8715c00 2024-09-13T23:57:05.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.265+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef87c0000 2024-09-13T23:57:05.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.265+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef87c0000 2024-09-13T23:57:05.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.265+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715000 2024-09-13T23:57:05.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.265+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef8715000 2024-09-13T23:57:05.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.265+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef87c0000 2024-09-13T23:57:05.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.265+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef87c0000 2024-09-13T23:57:05.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.265+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715c00 2024-09-13T23:57:05.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.265+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bd440 con 0x55fef8715c00 2024-09-13T23:57:05.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.265+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef87c0000 2024-09-13T23:57:05.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.265+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef87c0000 2024-09-13T23:57:05.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.265+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715400 2024-09-13T23:57:05.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.269+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bd200 con 0x55fef8715400 2024-09-13T23:57:05.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.269+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715400 2024-09-13T23:57:05.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.269+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bd200 con 0x55fef8715400 2024-09-13T23:57:05.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.269+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715c00 2024-09-13T23:57:05.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.269+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bd440 con 0x55fef8715c00 2024-09-13T23:57:05.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.269+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715400 2024-09-13T23:57:05.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.269+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55fef87bd200 con 0x55fef8715400 2024-09-13T23:57:05.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.269+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef8715400 2024-09-13T23:57:05.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.269+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fef87bd200 con 0x55fef8715400 2024-09-13T23:57:05.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.269+0000 7f0e08785f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:05.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.269+0000 7f0e08785f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:05.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.269+0000 7f0e08785f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:05.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.269+0000 7f0e08785f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:05.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.269+0000 7f0e08785f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.269+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87c0800 con 0x55fef8715000 2024-09-13T23:57:05.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.269+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef8715000 2024-09-13T23:57:05.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.269+0000 7f0e08785f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.269+0000 7f0e08785f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.269+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87c0c00 con 0x55fef8715400 2024-09-13T23:57:05.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55fef87bd200 con 0x55fef8715400 2024-09-13T23:57:05.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e08785f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:05.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e08785f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87c1000 con 0x55fef8715000 2024-09-13T23:57:05.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef8715000 2024-09-13T23:57:05.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e08785f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:05.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e08785f40 20 zone default found 2024-09-13T23:57:05.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e08785f40 4 Realm: () 2024-09-13T23:57:05.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e08785f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:05.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e08785f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:05.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e08785f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:05.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e08785f40 20 zonegroup default 2024-09-13T23:57:05.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e08785f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87c1400 con 0x55fef87c0000 2024-09-13T23:57:05.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef87c0000 2024-09-13T23:57:05.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e08785f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e08785f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87c1800 con 0x55fef8715c00 2024-09-13T23:57:05.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55fef87bd440 con 0x55fef8715c00 2024-09-13T23:57:05.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e08785f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e08785f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87c1c00 con 0x55fef8715c00 2024-09-13T23:57:05.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55fef87bd440 con 0x55fef8715c00 2024-09-13T23:57:05.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e08785f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e08785f40 20 started sync module instance, tier type = 2024-09-13T23:57:05.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e08785f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:05.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.273+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87ca000 con 0x55fef8715400 2024-09-13T23:57:05.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.277+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef8715400 2024-09-13T23:57:05.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.277+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94553577331456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87ca400 con 0x55fef8715400 2024-09-13T23:57:05.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.277+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87ca800 con 0x55fef8715000 2024-09-13T23:57:05.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.281+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef8715000 2024-09-13T23:57:05.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.281+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94553577332608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87cac00 con 0x55fef8715000 2024-09-13T23:57:05.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.281+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94553577331456] v33'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef8715400 2024-09-13T23:57:05.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.281+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87cb000 con 0x55fef8715400 2024-09-13T23:57:05.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.281+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94553577332608] v33'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef8715000 2024-09-13T23:57:05.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.281+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef8715400 2024-09-13T23:57:05.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.281+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94553577333760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87cb400 con 0x55fef8715400 2024-09-13T23:57:05.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.281+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87cb800 con 0x55fef87c0000 2024-09-13T23:57:05.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.285+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94553577333760] v33'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef8715400 2024-09-13T23:57:05.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.285+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef87c0000 2024-09-13T23:57:05.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.285+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94553577334912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87cbc00 con 0x55fef87c0000 2024-09-13T23:57:05.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.285+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87ca800 con 0x55fef8715400 2024-09-13T23:57:05.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.289+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94553577334912] v33'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef87c0000 2024-09-13T23:57:05.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.289+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef8715400 2024-09-13T23:57:05.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.289+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94553577336064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87ca000 con 0x55fef8715400 2024-09-13T23:57:05.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.289+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87c0800 con 0x55fef8715c00 2024-09-13T23:57:05.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.289+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bd440 con 0x55fef8715c00 2024-09-13T23:57:05.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.289+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94553577337216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87c1000 con 0x55fef8715c00 2024-09-13T23:57:05.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.289+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87c1400 con 0x55fef8715c00 2024-09-13T23:57:05.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.289+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94553577336064] v33'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef8715400 2024-09-13T23:57:05.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.293+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94553577337216] v33'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bd440 con 0x55fef8715c00 2024-09-13T23:57:05.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.293+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bd440 con 0x55fef8715c00 2024-09-13T23:57:05.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.293+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94553577338368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87c0c00 con 0x55fef8715c00 2024-09-13T23:57:05.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.293+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8715800 con 0x55fef87c0000 2024-09-13T23:57:05.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.293+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94553577338368] v33'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bd440 con 0x55fef8715c00 2024-09-13T23:57:05.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.293+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef87c0000 2024-09-13T23:57:05.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.293+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94553577339520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87ca400 con 0x55fef87c0000 2024-09-13T23:57:05.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.293+0000 7f0e08785f40 20 add_watcher() i=0 2024-09-13T23:57:05.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.293+0000 7f0e08785f40 20 add_watcher() i=1 2024-09-13T23:57:05.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.293+0000 7f0e08785f40 20 add_watcher() i=2 2024-09-13T23:57:05.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.293+0000 7f0e08785f40 20 add_watcher() i=3 2024-09-13T23:57:05.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.293+0000 7f0e08785f40 20 add_watcher() i=4 2024-09-13T23:57:05.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.293+0000 7f0e08785f40 20 add_watcher() i=5 2024-09-13T23:57:05.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.293+0000 7f0e08785f40 20 add_watcher() i=6 2024-09-13T23:57:05.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.297+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94553577339520] v33'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef87c0000 2024-09-13T23:57:05.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.297+0000 7f0e08785f40 20 add_watcher() i=7 2024-09-13T23:57:05.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.297+0000 7f0e08785f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:05.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.297+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87cb000 con 0x55fef8715000 2024-09-13T23:57:05.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.297+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef8715000 2024-09-13T23:57:05.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.297+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94553578995712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87cb400 con 0x55fef8715000 2024-09-13T23:57:05.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.301+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94553578995712] v33'121 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef8715000 2024-09-13T23:57:05.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.301+0000 7f0dedf0c700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:05.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.301+0000 7f0e08785f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:05.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.301+0000 7f0e08785f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:05.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.301+0000 7f0e08785f40 1 Processor -- start 2024-09-13T23:57:05.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.301+0000 7f0e08785f40 1 -- start start 2024-09-13T23:57:05.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.301+0000 7f0e08785f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef87c0400 0x55fef8645180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.301+0000 7f0e08785f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fef83ea3c0 con 0x55fef87c0400 2024-09-13T23:57:05.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.301+0000 7f0e0673d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef87c0400 0x55fef8645180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.301+0000 7f0e0673d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef87c0400 0x55fef8645180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50334/0 (socket says 172.21.15.173:50334) 2024-09-13T23:57:05.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.301+0000 7f0e0673d700 1 -- 172.21.15.173:0/21459688 learned_addr learned my addr 172.21.15.173:0/21459688 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.301+0000 7f0e0673d700 1 -- 172.21.15.173:0/21459688 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fef836eb60 con 0x55fef87c0400 2024-09-13T23:57:05.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.301+0000 7f0e0673d700 1 --2- 172.21.15.173:0/21459688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef87c0400 0x55fef8645180 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x55fef87d46c0 tx=0x55fef86d37a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c993400d1e5a8a03 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.301+0000 7f0ded70b700 1 -- 172.21.15.173:0/21459688 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fef87dc000 con 0x55fef87c0400 2024-09-13T23:57:05.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.301+0000 7f0ded70b700 1 -- 172.21.15.173:0/21459688 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fef872a480 con 0x55fef87c0400 2024-09-13T23:57:05.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.301+0000 7f0ded70b700 1 -- 172.21.15.173:0/21459688 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fef87dc160 con 0x55fef87c0400 2024-09-13T23:57:05.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.301+0000 7f0e08785f40 1 -- 172.21.15.173:0/21459688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef87c0400 msgr2=0x55fef8645180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.301+0000 7f0e08785f40 1 --2- 172.21.15.173:0/21459688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef87c0400 0x55fef8645180 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x55fef87d46c0 tx=0x55fef86d37a0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.301+0000 7f0e08785f40 1 -- 172.21.15.173:0/21459688 shutdown_connections 2024-09-13T23:57:05.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.301+0000 7f0e08785f40 1 --2- 172.21.15.173:0/21459688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef87c0400 0x55fef8645180 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.305+0000 7f0e08785f40 1 -- 172.21.15.173:0/21459688 >> 172.21.15.173:0/21459688 conn(0x55fef87ca800 msgr2=0x55fef845e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.305+0000 7f0e08785f40 1 -- 172.21.15.173:0/21459688 shutdown_connections 2024-09-13T23:57:05.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.305+0000 7f0e08785f40 1 -- 172.21.15.173:0/21459688 wait complete. 2024-09-13T23:57:05.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.305+0000 7f0e08785f40 1 Processor -- start 2024-09-13T23:57:05.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.305+0000 7f0e08785f40 1 -- start start 2024-09-13T23:57:05.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.305+0000 7f0e08785f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef87c0400 0x55fef8645180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.305+0000 7f0e08785f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fef83ea500 con 0x55fef87c0400 2024-09-13T23:57:05.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.305+0000 7f0e0673d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef87c0400 0x55fef8645180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.305+0000 7f0e0673d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef87c0400 0x55fef8645180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50336/0 (socket says 172.21.15.173:50336) 2024-09-13T23:57:05.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.305+0000 7f0e0673d700 1 -- 172.21.15.173:0/1904754383 learned_addr learned my addr 172.21.15.173:0/1904754383 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.305+0000 7f0e0673d700 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fef836ed00 con 0x55fef87c0400 2024-09-13T23:57:05.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.305+0000 7f0e0673d700 1 --2- 172.21.15.173:0/1904754383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef87c0400 0x55fef8645180 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x55fef87d48d0 tx=0x55fef86d3920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.305+0000 7f0debf08700 1 -- 172.21.15.173:0/1904754383 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fef87dc2c0 con 0x55fef87c0400 2024-09-13T23:57:05.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.305+0000 7f0debf08700 1 -- 172.21.15.173:0/1904754383 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fef872a600 con 0x55fef87c0400 2024-09-13T23:57:05.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.305+0000 7f0debf08700 1 -- 172.21.15.173:0/1904754383 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fef87dc000 con 0x55fef87c0400 2024-09-13T23:57:05.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.305+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fef836e340 con 0x55fef87c0400 2024-09-13T23:57:05.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.305+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fef87ec000 con 0x55fef87c0400 2024-09-13T23:57:05.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.305+0000 7f0debf08700 1 -- 172.21.15.173:0/1904754383 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55fef8457b80 con 0x55fef87c0400 2024-09-13T23:57:05.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.309+0000 7f0debf08700 1 --2- 172.21.15.173:0/1904754383 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fef8715800 0x55fef8862000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.309+0000 7f0debf08700 1 -- 172.21.15.173:0/1904754383 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55fef83c3500 con 0x55fef87c0400 2024-09-13T23:57:05.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.309+0000 7f0e0773f700 1 --2- 172.21.15.173:0/1904754383 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fef8715800 0x55fef8862000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.309+0000 7f0e08785f40 1 --2- 172.21.15.173:0/1904754383 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55fef87c1800 0x55fef8645700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.309+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87c1c00 con 0x55fef87c1800 2024-09-13T23:57:05.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.309+0000 7f0e06f3e700 1 --2- 172.21.15.173:0/1904754383 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55fef87c1800 0x55fef8645700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.309+0000 7f0e0773f700 1 --2- 172.21.15.173:0/1904754383 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fef8715800 0x55fef8862000 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55fef875f7a0 tx=0x55fef8828660 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.309+0000 7f0e06f3e700 1 --2- 172.21.15.173:0/1904754383 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55fef87c1800 0x55fef8645700 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.313+0000 7f0e06f3e700 1 -- 172.21.15.173:0/1904754383 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef87c1800 2024-09-13T23:57:05.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.313+0000 7f0e08785f40 1 --2- 172.21.15.173:0/1904754383 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55fef87c0800 0x55fef8862580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.313+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87cac00 con 0x55fef87c0800 2024-09-13T23:57:05.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.313+0000 7f0e0673d700 1 --2- 172.21.15.173:0/1904754383 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55fef87c0800 0x55fef8862580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.313+0000 7f0e0673d700 1 --2- 172.21.15.173:0/1904754383 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55fef87c0800 0x55fef8862580 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.313+0000 7f0e0673d700 1 -- 172.21.15.173:0/1904754383 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v33'15 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55fef87bd440 con 0x55fef87c0800 2024-09-13T23:57:05.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.313+0000 7f0e08785f40 1 --2- 172.21.15.173:0/1904754383 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55fef87cb800 0x55fef8862b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.313+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87cbc00 con 0x55fef87cb800 2024-09-13T23:57:05.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.313+0000 7f0e0773f700 1 --2- 172.21.15.173:0/1904754383 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55fef87cb800 0x55fef8862b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.313+0000 7f0e0773f700 1 --2- 172.21.15.173:0/1904754383 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55fef87cb800 0x55fef8862b00 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.317+0000 7f0e0773f700 1 -- 172.21.15.173:0/1904754383 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v33'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef87cb800 2024-09-13T23:57:05.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.317+0000 7f0e08785f40 1 --2- 172.21.15.173:0/1904754383 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55fef87ca400 0x55fef8863080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.317+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8894000 con 0x55fef87ca400 2024-09-13T23:57:05.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.317+0000 7f0e06f3e700 1 --2- 172.21.15.173:0/1904754383 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55fef87ca400 0x55fef8863080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.317+0000 7f0e06f3e700 1 --2- 172.21.15.173:0/1904754383 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55fef87ca400 0x55fef8863080 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.321+0000 7f0e06f3e700 1 -- 172.21.15.173:0/1904754383 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v33'122 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef87ca400 2024-09-13T23:57:05.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.321+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8894400 con 0x55fef87c1800 2024-09-13T23:57:05.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.321+0000 7f0e06f3e700 1 -- 172.21.15.173:0/1904754383 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v33'35 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef87c1800 2024-09-13T23:57:05.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.321+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8894800 con 0x55fef87cb800 2024-09-13T23:57:05.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.325+0000 7f0e0773f700 1 -- 172.21.15.173:0/1904754383 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v33'23 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef87cb800 2024-09-13T23:57:05.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.325+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8894c00 con 0x55fef87c1800 2024-09-13T23:57:05.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.325+0000 7f0e06f3e700 1 -- 172.21.15.173:0/1904754383 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v33'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef87c1800 2024-09-13T23:57:05.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.325+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8895000 con 0x55fef87ca400 2024-09-13T23:57:05.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.329+0000 7f0e06f3e700 1 -- 172.21.15.173:0/1904754383 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v33'23 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef87ca400 2024-09-13T23:57:05.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.329+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8895400 con 0x55fef87c1800 2024-09-13T23:57:05.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.333+0000 7f0e06f3e700 1 -- 172.21.15.173:0/1904754383 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef87c1800 2024-09-13T23:57:05.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.333+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8895800 con 0x55fef87c1800 2024-09-13T23:57:05.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.333+0000 7f0e06f3e700 1 -- 172.21.15.173:0/1904754383 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v33'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef87c1800 2024-09-13T23:57:05.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.333+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8895c00 con 0x55fef87c1800 2024-09-13T23:57:05.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.337+0000 7f0e06f3e700 1 -- 172.21.15.173:0/1904754383 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v33'36 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef87c1800 2024-09-13T23:57:05.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.337+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8894000 con 0x55fef87cb800 2024-09-13T23:57:05.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.337+0000 7f0e0773f700 1 -- 172.21.15.173:0/1904754383 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef87cb800 2024-09-13T23:57:05.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.337+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8894400 con 0x55fef87c1800 2024-09-13T23:57:05.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.341+0000 7f0e06f3e700 1 -- 172.21.15.173:0/1904754383 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef87c1800 2024-09-13T23:57:05.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.341+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8894c00 con 0x55fef87ca400 2024-09-13T23:57:05.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.345+0000 7f0e06f3e700 1 -- 172.21.15.173:0/1904754383 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v33'29 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef87ca400 2024-09-13T23:57:05.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.345+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87c1c00 con 0x55fef87ca400 2024-09-13T23:57:05.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.345+0000 7f0e06f3e700 1 -- 172.21.15.173:0/1904754383 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v33'123 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef87ca400 2024-09-13T23:57:05.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.345+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87ca000 con 0x55fef87c1800 2024-09-13T23:57:05.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.349+0000 7f0e06f3e700 1 -- 172.21.15.173:0/1904754383 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v33'29 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef87c1800 2024-09-13T23:57:05.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.349+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8895000 con 0x55fef87c1800 2024-09-13T23:57:05.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.353+0000 7f0e06f3e700 1 -- 172.21.15.173:0/1904754383 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v33'37 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef87c1800 2024-09-13T23:57:05.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.353+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8895400 con 0x55fef87cb800 2024-09-13T23:57:05.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.353+0000 7f0e0773f700 1 -- 172.21.15.173:0/1904754383 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v33'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef87cb800 2024-09-13T23:57:05.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.353+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8895800 con 0x55fef87c1800 2024-09-13T23:57:05.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.357+0000 7f0e06f3e700 1 -- 172.21.15.173:0/1904754383 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v33'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef87c1800 2024-09-13T23:57:05.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.357+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8895c00 con 0x55fef87ca400 2024-09-13T23:57:05.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.361+0000 7f0e06f3e700 1 -- 172.21.15.173:0/1904754383 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v33'124 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef87ca400 2024-09-13T23:57:05.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.361+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8894400 con 0x55fef87c1800 2024-09-13T23:57:05.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.365+0000 7f0e06f3e700 1 -- 172.21.15.173:0/1904754383 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v33'30 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef87c1800 2024-09-13T23:57:05.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.365+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8894c00 con 0x55fef87c1800 2024-09-13T23:57:05.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.365+0000 7f0e06f3e700 1 -- 172.21.15.173:0/1904754383 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v33'25 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef87c1800 2024-09-13T23:57:05.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.365+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87ca000 con 0x55fef87cb800 2024-09-13T23:57:05.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.369+0000 7f0e0773f700 1 -- 172.21.15.173:0/1904754383 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef87cb800 2024-09-13T23:57:05.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.369+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87cb000 con 0x55fef87c1800 2024-09-13T23:57:05.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.373+0000 7f0e06f3e700 1 -- 172.21.15.173:0/1904754383 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v33'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef87c1800 2024-09-13T23:57:05.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.373+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87cb400 con 0x55fef87cb800 2024-09-13T23:57:05.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.373+0000 7f0e0773f700 1 -- 172.21.15.173:0/1904754383 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v33'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef87cb800 2024-09-13T23:57:05.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.373+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87cbc00 con 0x55fef87cb800 2024-09-13T23:57:05.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.377+0000 7f0e0773f700 1 -- 172.21.15.173:0/1904754383 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v33'24 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef87cb800 2024-09-13T23:57:05.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.377+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87c1c00 con 0x55fef87cb800 2024-09-13T23:57:05.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.381+0000 7f0e0773f700 1 -- 172.21.15.173:0/1904754383 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef87cb800 2024-09-13T23:57:05.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.381+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef88a4000 con 0x55fef87c1800 2024-09-13T23:57:05.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.381+0000 7f0e06f3e700 1 -- 172.21.15.173:0/1904754383 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef87c1800 2024-09-13T23:57:05.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.381+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef88a4400 con 0x55fef87ca400 2024-09-13T23:57:05.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.385+0000 7f0e06f3e700 1 -- 172.21.15.173:0/1904754383 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v33'24 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef87ca400 2024-09-13T23:57:05.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.385+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef88a4800 con 0x55fef87c1800 2024-09-13T23:57:05.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.389+0000 7f0e06f3e700 1 -- 172.21.15.173:0/1904754383 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v33'31 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef87c1800 2024-09-13T23:57:05.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.389+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef88a4c00 con 0x55fef87ca400 2024-09-13T23:57:05.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.389+0000 7f0e06f3e700 1 -- 172.21.15.173:0/1904754383 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v33'30 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef87ca400 2024-09-13T23:57:05.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.389+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef88a5000 con 0x55fef87c0800 2024-09-13T23:57:05.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.393+0000 7f0e0673d700 1 -- 172.21.15.173:0/1904754383 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v33'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55fef87bd440 con 0x55fef87c0800 2024-09-13T23:57:05.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.397+0000 7f0de9703700 20 reqs_thread_entry: start 2024-09-13T23:57:05.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.397+0000 7f0e08785f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:05.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.397+0000 7f0e08785f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:05.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.397+0000 7f0de76ff700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:35 2024 2024-09-13T23:57:05.402 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:05.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.397+0000 7f0de6edd700 20 reqs_thread_entry: start 2024-09-13T23:57:05.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.397+0000 7f0e08785f40 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:57:05.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.397+0000 7f0e08785f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.397+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef88a5c00 con 0x55fef87c0000 2024-09-13T23:57:05.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.397+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(62 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef87c0000 2024-09-13T23:57:05.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.397+0000 7f0e08785f40 20 rados_obj.operate() r=0 bl.length=346 2024-09-13T23:57:05.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.397+0000 7f0e08785f40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T23:57:05.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.397+0000 7f0e08785f40 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:57:05.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.397+0000 7f0e08785f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:05.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.397+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8914000 con 0x55fef8715000 2024-09-13T23:57:05.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.397+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(63 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) v8 ==== 155+0+15 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef8715000 2024-09-13T23:57:05.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.397+0000 7f0e08785f40 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-13T23:57:05.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.397+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:64 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8914400 con 0x55fef8715c00 2024-09-13T23:57:05.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.401+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(64 p5YnriCv1nAtykxBrupQ [delete] v33'4 uv4 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55fef87bd440 con 0x55fef8715c00 2024-09-13T23:57:05.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.401+0000 7f0e08785f40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T23:57:05.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.401+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94553578999168 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8914800 con 0x55fef8715400 2024-09-13T23:57:05.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.401+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== watch-notify(notify (1) cookie 94553577333760 notify 141733920789 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x55fef86d11e0 con 0x55fef8715400 2024-09-13T23:57:05.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.401+0000 7f0e01733700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920789 cookie 94553577333760 notifier 4576 bl.length()=170 2024-09-13T23:57:05.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.401+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(65 notify.2 [notify cookie 94553578999168 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55fef87bd200 con 0x55fef8715400 2024-09-13T23:57:05.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.401+0000 7f0e01733700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87c1000 con 0x55fef8715400 2024-09-13T23:57:05.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.401+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef8715400 2024-09-13T23:57:05.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.401+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== watch-notify(notify_complete (2) cookie 94553578999168 notify 141733920789 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55fef86d1380 con 0x55fef8715400 2024-09-13T23:57:05.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.401+0000 7f0e08785f40 10 removing email index: 2024-09-13T23:57:05.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.401+0000 7f0e08785f40 10 removing user buckets index 2024-09-13T23:57:05.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.401+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:67 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8914c00 con 0x55fef8715000 2024-09-13T23:57:05.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.405+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(67 fud.buckets [delete] v33'4 uv4 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef8715000 2024-09-13T23:57:05.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.405+0000 7f0e08785f40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-13T23:57:05.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.405+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94553578999168 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8915000 con 0x55fef8715c00 2024-09-13T23:57:05.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.405+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== watch-notify(notify (1) cookie 94553577338368 notify 141733920783 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x55fef8827d40 con 0x55fef8715c00 2024-09-13T23:57:05.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.405+0000 7f0e01733700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920783 cookie 94553577338368 notifier 4576 bl.length()=160 2024-09-13T23:57:05.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.405+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(68 notify.6 [notify cookie 94553578999168 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55fef87bd440 con 0x55fef8715c00 2024-09-13T23:57:05.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.405+0000 7f0e01733700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87c1400 con 0x55fef8715c00 2024-09-13T23:57:05.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.405+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bd440 con 0x55fef8715c00 2024-09-13T23:57:05.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.405+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== watch-notify(notify_complete (2) cookie 94553578999168 notify 141733920783 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55fef86d11e0 con 0x55fef8715c00 2024-09-13T23:57:05.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.405+0000 7f0e08785f40 10 removing user index: fud 2024-09-13T23:57:05.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.405+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:70 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8915400 con 0x55fef87c0000 2024-09-13T23:57:05.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.409+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(70 fud [call,call,delete] v33'2 uv2 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef87c0000 2024-09-13T23:57:05.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.409+0000 7f0e08785f40 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-13T23:57:05.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.409+0000 7f0e08785f40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T23:57:05.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.409+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [notify cookie 94553578999168 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8915800 con 0x55fef8715c00 2024-09-13T23:57:05.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.409+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 20 ==== watch-notify(notify (1) cookie 94553577337216 notify 141733920784 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x55fef86d11e0 con 0x55fef8715c00 2024-09-13T23:57:05.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.409+0000 7f0e00f32700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920784 cookie 94553577337216 notifier 4576 bl.length()=152 2024-09-13T23:57:05.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.409+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 21 ==== osd_op_reply(71 notify.5 [notify cookie 94553578999168 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55fef87bd440 con 0x55fef8715c00 2024-09-13T23:57:05.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.409+0000 7f0e00f32700 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87c1c00 con 0x55fef8715c00 2024-09-13T23:57:05.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.409+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 22 ==== osd_op_reply(72 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bd440 con 0x55fef8715c00 2024-09-13T23:57:05.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.409+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 23 ==== watch-notify(notify_complete (2) cookie 94553578999168 notify 141733920784 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55fef86d1040 con 0x55fef8715c00 2024-09-13T23:57:05.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.413+0000 7f0dedf0c700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:05.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.413+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94553578995712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8915c00 con 0x55fef8715000 2024-09-13T23:57:05.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.413+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94553578995712] v33'125 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef8715000 2024-09-13T23:57:05.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.413+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94553577331456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8914000 con 0x55fef8715400 2024-09-13T23:57:05.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.417+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94553577331456] v33'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef8715400 2024-09-13T23:57:05.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.417+0000 7f0e08785f40 20 remove_watcher() i=0 2024-09-13T23:57:05.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.417+0000 7f0e08785f40 2 removed watcher, disabling cache 2024-09-13T23:57:05.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.417+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94553577332608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8914c00 con 0x55fef8715000 2024-09-13T23:57:05.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.417+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94553577332608] v33'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef8715000 2024-09-13T23:57:05.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.417+0000 7f0e08785f40 20 remove_watcher() i=1 2024-09-13T23:57:05.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.417+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94553577333760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef8914400 con 0x55fef8715400 2024-09-13T23:57:05.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.421+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94553577333760] v33'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef8715400 2024-09-13T23:57:05.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.421+0000 7f0e08785f40 20 remove_watcher() i=2 2024-09-13T23:57:05.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.421+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94553577334912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef88a5c00 con 0x55fef87c0000 2024-09-13T23:57:05.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.425+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94553577334912] v33'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef87c0000 2024-09-13T23:57:05.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.425+0000 7f0e08785f40 20 remove_watcher() i=3 2024-09-13T23:57:05.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.425+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94553577336064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef88a5000 con 0x55fef8715400 2024-09-13T23:57:05.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.425+0000 7f0e06f3e700 1 -- 172.21.15.173:0/2771966894 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94553577336064] v33'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bd200 con 0x55fef8715400 2024-09-13T23:57:05.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.425+0000 7f0e08785f40 20 remove_watcher() i=4 2024-09-13T23:57:05.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.425+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94553577337216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87ca000 con 0x55fef8715c00 2024-09-13T23:57:05.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.429+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 24 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94553577337216] v33'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bd440 con 0x55fef8715c00 2024-09-13T23:57:05.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.429+0000 7f0e08785f40 20 remove_watcher() i=5 2024-09-13T23:57:05.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.429+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94553577338368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87cb400 con 0x55fef8715c00 2024-09-13T23:57:05.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.429+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 <== osd.3 v2:172.21.15.173:6800/4020038786 25 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94553577338368] v33'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bd440 con 0x55fef8715c00 2024-09-13T23:57:05.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.429+0000 7f0e08785f40 20 remove_watcher() i=6 2024-09-13T23:57:05.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.429+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94553577339520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fef87cbc00 con 0x55fef87c0000 2024-09-13T23:57:05.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e0773f700 1 -- 172.21.15.173:0/2771966894 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94553577339520] v33'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fef87bcb40 con 0x55fef87c0000 2024-09-13T23:57:05.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 20 remove_watcher() i=7 2024-09-13T23:57:05.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55fef8715400 msgr2=0x55fef8644100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 --2- 172.21.15.173:0/2771966894 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55fef8715400 0x55fef8644100 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55fef8715000 msgr2=0x55fef8643b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 --2- 172.21.15.173:0/2771966894 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55fef8715000 0x55fef8643b80 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55fef87c0000 msgr2=0x55fef8644c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 --2- 172.21.15.173:0/2771966894 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55fef87c0000 0x55fef8644c00 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55fef8715c00 msgr2=0x55fef8644680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 --2- 172.21.15.173:0/2771966894 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55fef8715c00 0x55fef8644680 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fef8714c00 msgr2=0x55fef8643600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 --2- 172.21.15.173:0/2771966894 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fef8714c00 0x55fef8643600 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55fef9130030 tx=0x55fef86d3800 comp rx=0 tx=0).stop 2024-09-13T23:57:05.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d800 msgr2=0x55fef8642b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 --2- 172.21.15.173:0/2771966894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d800 0x55fef8642b00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x55fef86988a0 tx=0x55fef8461e60 comp rx=0 tx=0).stop 2024-09-13T23:57:05.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 reap_dead start 2024-09-13T23:57:05.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e0673d700 1 -- 172.21.15.173:0/2771966894 reap_dead start 2024-09-13T23:57:05.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 shutdown_connections 2024-09-13T23:57:05.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 >> 172.21.15.173:0/2771966894 conn(0x55fef835d400 msgr2=0x55fef845d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 shutdown_connections 2024-09-13T23:57:05.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 -- 172.21.15.173:0/2771966894 wait complete. 2024-09-13T23:57:05.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55fef87c1800 msgr2=0x55fef8645700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 --2- 172.21.15.173:0/1904754383 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55fef87c1800 0x55fef8645700 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55fef87ca400 msgr2=0x55fef8863080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 --2- 172.21.15.173:0/1904754383 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55fef87ca400 0x55fef8863080 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55fef87c0800 msgr2=0x55fef8862580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 --2- 172.21.15.173:0/1904754383 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55fef87c0800 0x55fef8862580 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55fef87cb800 msgr2=0x55fef8862b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 --2- 172.21.15.173:0/1904754383 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55fef87cb800 0x55fef8862b00 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fef8715800 msgr2=0x55fef8862000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 --2- 172.21.15.173:0/1904754383 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fef8715800 0x55fef8862000 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55fef875f7a0 tx=0x55fef8828660 comp rx=0 tx=0).stop 2024-09-13T23:57:05.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef87c0400 msgr2=0x55fef8645180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e08785f40 1 --2- 172.21.15.173:0/1904754383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef87c0400 0x55fef8645180 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x55fef87d48d0 tx=0x55fef86d3920 comp rx=0 tx=0).stop 2024-09-13T23:57:05.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.433+0000 7f0e06f3e700 1 -- 172.21.15.173:0/1904754383 reap_dead start 2024-09-13T23:57:05.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.437+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 shutdown_connections 2024-09-13T23:57:05.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.437+0000 7f0e08785f40 1 --2- 172.21.15.173:0/1904754383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef87c0400 0x55fef8645180 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.437+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 >> 172.21.15.173:0/1904754383 conn(0x55fef87ca800 msgr2=0x55fef845e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.437+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 shutdown_connections 2024-09-13T23:57:05.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.437+0000 7f0e08785f40 1 -- 172.21.15.173:0/1904754383 wait complete. 2024-09-13T23:57:05.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.437+0000 7f0e08785f40 1 -- 172.21.15.173:0/850942126 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fef8714000 msgr2=0x55fef8643080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.437+0000 7f0e08785f40 1 --2- 172.21.15.173:0/850942126 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fef8714000 0x55fef8643080 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x55fef86996b0 tx=0x55fef86d2120 comp rx=0 tx=0).stop 2024-09-13T23:57:05.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.437+0000 7f0e08785f40 1 -- 172.21.15.173:0/850942126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d000 msgr2=0x55fef8642580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.437+0000 7f0e08785f40 1 --2- 172.21.15.173:0/850942126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d000 0x55fef8642580 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x55fef9131ef0 tx=0x55fef8461980 comp rx=0 tx=0).stop 2024-09-13T23:57:05.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.437+0000 7f0e08785f40 1 -- 172.21.15.173:0/850942126 shutdown_connections 2024-09-13T23:57:05.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.437+0000 7f0e08785f40 1 --2- 172.21.15.173:0/850942126 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fef8714000 0x55fef8643080 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.437+0000 7f0e08785f40 1 --2- 172.21.15.173:0/850942126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fef835d000 0x55fef8642580 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.437+0000 7f0e08785f40 1 -- 172.21.15.173:0/850942126 >> 172.21.15.173:0/850942126 conn(0x55fef835cc00 msgr2=0x55fef845d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.437+0000 7f0e08785f40 1 -- 172.21.15.173:0/850942126 shutdown_connections 2024-09-13T23:57:05.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.437+0000 7f0e08785f40 1 -- 172.21.15.173:0/850942126 wait complete. 2024-09-13T23:57:05.448 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T23:57:05.449 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T23:57:05.449 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-13T23:57:05.500 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:05.501 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:05.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c6fb2f40 1 Processor -- start 2024-09-13T23:57:05.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c6fb2f40 1 -- start start 2024-09-13T23:57:05.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c6fb2f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x555ee05c5000 0x555ee08aa580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c6fb2f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555ee0689500 con 0x555ee05c5400 2024-09-13T23:57:05.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c6fb2f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x555ee0652a00 con 0x555ee05c5000 2024-09-13T23:57:05.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c4f6a700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x555ee05c5400 0x555ee06c4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47488/0 (socket says 172.21.15.173:47488) 2024-09-13T23:57:05.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c576b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x555ee05c5000 0x555ee08aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c4f6a700 1 -- 172.21.15.173:0/1887260413 learned_addr learned my addr 172.21.15.173:0/1887260413 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:05.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c4769700 1 -- 172.21.15.173:0/1887260413 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1863588071 0 0) 0x555ee0720000 con 0x555ee05c5400 2024-09-13T23:57:05.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c4769700 1 -- 172.21.15.173:0/1887260413 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x555ee0689680 con 0x555ee05c5400 2024-09-13T23:57:05.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c576b700 1 -- 172.21.15.173:0/1887260413 >> v1:172.21.15.87:6789/0 conn(0x555ee05c5400 legacy=0x555ee06c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c576b700 1 -- 172.21.15.173:0/1887260413 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ee05d7d40 con 0x555ee05c5000 2024-09-13T23:57:05.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c576b700 1 --2- 172.21.15.173:0/1887260413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5000 0x555ee08aa580 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x555ee08a5a70 tx=0x555ee06c9980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84452ff7a3c2aae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c4769700 1 -- 172.21.15.173:0/1887260413 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ee06694a0 con 0x555ee05c5000 2024-09-13T23:57:05.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c4769700 1 -- 172.21.15.173:0/1887260413 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555ee0689680 con 0x555ee05c5000 2024-09-13T23:57:05.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c4769700 1 -- 172.21.15.173:0/1887260413 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ee0669600 con 0x555ee05c5000 2024-09-13T23:57:05.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/1887260413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5000 msgr2=0x555ee08aa580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/1887260413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5000 0x555ee08aa580 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x555ee08a5a70 tx=0x555ee06c9980 comp rx=0 tx=0).stop 2024-09-13T23:57:05.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/1887260413 shutdown_connections 2024-09-13T23:57:05.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/1887260413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5000 0x555ee08aa580 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/1887260413 >> 172.21.15.173:0/1887260413 conn(0x555ee05c4c00 msgr2=0x555ee06c4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/1887260413 shutdown_connections 2024-09-13T23:57:05.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/1887260413 wait complete. 2024-09-13T23:57:05.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c6fb2f40 1 Processor -- start 2024-09-13T23:57:05.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.497+0000 7f35c6fb2f40 1 -- start start 2024-09-13T23:57:05.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.501+0000 7f35c6fb2f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5000 0x555ee08aa580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.501+0000 7f35c6fb2f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ee0652500 con 0x555ee05c5000 2024-09-13T23:57:05.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.501+0000 7f35c576b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5000 0x555ee08aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.501+0000 7f35c576b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5000 0x555ee08aa580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50352/0 (socket says 172.21.15.173:50352) 2024-09-13T23:57:05.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.501+0000 7f35c576b700 1 -- 172.21.15.173:0/1878496833 learned_addr learned my addr 172.21.15.173:0/1878496833 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.501+0000 7f35c576b700 1 -- 172.21.15.173:0/1878496833 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ee05d7ba0 con 0x555ee05c5000 2024-09-13T23:57:05.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.501+0000 7f35c576b700 1 --2- 172.21.15.173:0/1878496833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5000 0x555ee08aa580 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x555ee138fe00 tx=0x555ee06c9800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c388378139ca6758 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.501+0000 7f35c3f68700 1 -- 172.21.15.173:0/1878496833 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ee0669760 con 0x555ee05c5000 2024-09-13T23:57:05.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.501+0000 7f35c3f68700 1 -- 172.21.15.173:0/1878496833 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555ee0689980 con 0x555ee05c5000 2024-09-13T23:57:05.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.501+0000 7f35c3f68700 1 -- 172.21.15.173:0/1878496833 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ee06694a0 con 0x555ee05c5000 2024-09-13T23:57:05.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.501+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/1878496833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5000 msgr2=0x555ee08aa580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.501+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/1878496833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5000 0x555ee08aa580 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x555ee138fe00 tx=0x555ee06c9800 comp rx=0 tx=0).stop 2024-09-13T23:57:05.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.501+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/1878496833 shutdown_connections 2024-09-13T23:57:05.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.501+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/1878496833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5000 0x555ee08aa580 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.501+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/1878496833 >> 172.21.15.173:0/1878496833 conn(0x555ee05c4c00 msgr2=0x555ee06c5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.501+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/1878496833 shutdown_connections 2024-09-13T23:57:05.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.501+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/1878496833 wait complete. 2024-09-13T23:57:05.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.501+0000 7f35c6fb2f40 1 Processor -- start 2024-09-13T23:57:05.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.501+0000 7f35c6fb2f40 1 -- start start 2024-09-13T23:57:05.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.501+0000 7f35c6fb2f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5000 0x555ee08aa580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.501+0000 7f35c6fb2f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ee06523c0 con 0x555ee05c5000 2024-09-13T23:57:05.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.501+0000 7f35c576b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5000 0x555ee08aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.501+0000 7f35c576b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5000 0x555ee08aa580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50354/0 (socket says 172.21.15.173:50354) 2024-09-13T23:57:05.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.501+0000 7f35c576b700 1 -- 172.21.15.173:0/3166514913 learned_addr learned my addr 172.21.15.173:0/3166514913 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.505+0000 7f35c576b700 1 -- 172.21.15.173:0/3166514913 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ee05d7a00 con 0x555ee05c5000 2024-09-13T23:57:05.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.505+0000 7f35c576b700 1 --2- 172.21.15.173:0/3166514913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5000 0x555ee08aa580 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x555ee08a5f80 tx=0x555ee06c9980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.505+0000 7f35c2765700 1 -- 172.21.15.173:0/3166514913 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ee0669600 con 0x555ee05c5000 2024-09-13T23:57:05.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.505+0000 7f35c2765700 1 -- 172.21.15.173:0/3166514913 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555ee0689b00 con 0x555ee05c5000 2024-09-13T23:57:05.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.505+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/3166514913 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555ee05d7860 con 0x555ee05c5000 2024-09-13T23:57:05.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.505+0000 7f35c2765700 1 -- 172.21.15.173:0/3166514913 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ee06698c0 con 0x555ee05c5000 2024-09-13T23:57:05.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.505+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/3166514913 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555ee05d76c0 con 0x555ee05c5000 2024-09-13T23:57:05.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.505+0000 7f35c6fb2f40 1 Processor -- start 2024-09-13T23:57:05.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.505+0000 7f35c2765700 1 -- 172.21.15.173:0/3166514913 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x555ee06beb00 con 0x555ee05c5000 2024-09-13T23:57:05.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.505+0000 7f35c6fb2f40 1 -- start start 2024-09-13T23:57:05.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.505+0000 7f35c2765700 1 --2- 172.21.15.173:0/3166514913 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ee0958000 0x555ee08ab080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.505+0000 7f35c2765700 1 -- 172.21.15.173:0/3166514913 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x555ee062b180 con 0x555ee05c5000 2024-09-13T23:57:05.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.505+0000 7f35c5f6c700 1 --2- 172.21.15.173:0/3166514913 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ee0958000 0x555ee08ab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.505+0000 7f35c6fb2f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5800 0x555ee08aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.505+0000 7f35c6fb2f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ee05ea640 con 0x555ee05c5800 2024-09-13T23:57:05.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.509+0000 7f35c576b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5800 0x555ee08aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.509+0000 7f35c576b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5800 0x555ee08aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50358/0 (socket says 172.21.15.173:50358) 2024-09-13T23:57:05.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.509+0000 7f35c576b700 1 -- 172.21.15.173:0/143490709 learned_addr learned my addr 172.21.15.173:0/143490709 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.509+0000 7f35c5f6c700 1 --2- 172.21.15.173:0/3166514913 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ee0958000 0x555ee08ab080 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x555ee138ff80 tx=0x555ee091e780 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.509+0000 7f35c576b700 1 -- 172.21.15.173:0/143490709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ee05d6000 con 0x555ee05c5800 2024-09-13T23:57:05.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.509+0000 7f35c576b700 1 --2- 172.21.15.173:0/143490709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5800 0x555ee08aab00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x555ee1438330 tx=0x555ee091e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305931541e06f32c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.509+0000 7f35bff60700 1 -- 172.21.15.173:0/143490709 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ee0669600 con 0x555ee05c5800 2024-09-13T23:57:05.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.509+0000 7f35bff60700 1 -- 172.21.15.173:0/143490709 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555ee0689e00 con 0x555ee05c5800 2024-09-13T23:57:05.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.509+0000 7f35bff60700 1 -- 172.21.15.173:0/143490709 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ee06698c0 con 0x555ee05c5800 2024-09-13T23:57:05.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.509+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/143490709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5800 msgr2=0x555ee08aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.509+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/143490709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5800 0x555ee08aab00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x555ee1438330 tx=0x555ee091e8a0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.509+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/143490709 shutdown_connections 2024-09-13T23:57:05.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.509+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/143490709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5800 0x555ee08aab00 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.509+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/143490709 >> 172.21.15.173:0/143490709 conn(0x555ee05c5400 msgr2=0x555ee06c5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.509+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/143490709 shutdown_connections 2024-09-13T23:57:05.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.509+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/143490709 wait complete. 2024-09-13T23:57:05.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.509+0000 7f35c6fb2f40 1 Processor -- start 2024-09-13T23:57:05.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.509+0000 7f35c6fb2f40 1 -- start start 2024-09-13T23:57:05.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.509+0000 7f35c6fb2f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5800 0x555ee08aab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.509+0000 7f35c6fb2f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ee05ea8c0 con 0x555ee05c5800 2024-09-13T23:57:05.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.509+0000 7f35c576b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5800 0x555ee08aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.509+0000 7f35c576b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5800 0x555ee08aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50374/0 (socket says 172.21.15.173:50374) 2024-09-13T23:57:05.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.509+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 learned_addr learned my addr 172.21.15.173:0/2398098210 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.513+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ee05d6ea0 con 0x555ee05c5800 2024-09-13T23:57:05.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.513+0000 7f35c576b700 1 --2- 172.21.15.173:0/2398098210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5800 0x555ee08aab00 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x555ee1438630 tx=0x555ee091ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.513+0000 7f35be75d700 1 -- 172.21.15.173:0/2398098210 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ee0669760 con 0x555ee05c5800 2024-09-13T23:57:05.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.513+0000 7f35be75d700 1 -- 172.21.15.173:0/2398098210 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555ee0689b00 con 0x555ee05c5800 2024-09-13T23:57:05.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.513+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555ee05d6820 con 0x555ee05c5800 2024-09-13T23:57:05.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.513+0000 7f35be75d700 1 -- 172.21.15.173:0/2398098210 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ee06694a0 con 0x555ee05c5800 2024-09-13T23:57:05.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.513+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555ee05d69c0 con 0x555ee05c5800 2024-09-13T23:57:05.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.513+0000 7f35be75d700 1 -- 172.21.15.173:0/2398098210 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x555ee06bedc0 con 0x555ee05c5800 2024-09-13T23:57:05.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.513+0000 7f35c6fb2f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.513+0000 7f35be75d700 1 --2- 172.21.15.173:0/2398098210 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ee0959000 0x555ee08ab600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.513+0000 7f35be75d700 1 -- 172.21.15.173:0/2398098210 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x555ee062b340 con 0x555ee05c5800 2024-09-13T23:57:05.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.513+0000 7f35c4f6a700 1 --2- 172.21.15.173:0/2398098210 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ee0959000 0x555ee08ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.513+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/2398098210 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x555ee0959400 0x555ee08abb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.513+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee0959800 con 0x555ee0959400 2024-09-13T23:57:05.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.513+0000 7f35c5f6c700 1 --2- 172.21.15.173:0/2398098210 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x555ee0959400 0x555ee08abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.513+0000 7f35c5f6c700 1 --2- 172.21.15.173:0/2398098210 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x555ee0959400 0x555ee08abb80 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c4f6a700 1 --2- 172.21.15.173:0/2398098210 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ee0959000 0x555ee08ab600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x555ee138e030 tx=0x555ee091f860 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee0959400 2024-09-13T23:57:05.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c6fb2f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c6fb2f40 20 realm 2024-09-13T23:57:05.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c6fb2f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee0959c00 con 0x555ee0959400 2024-09-13T23:57:05.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee0959400 2024-09-13T23:57:05.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c6fb2f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c6fb2f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:05.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c6fb2f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee0959800 con 0x555ee0959400 2024-09-13T23:57:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee0959400 2024-09-13T23:57:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c6fb2f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c6fb2f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/2398098210 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x555ee0959c00 0x555ee08ac100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee0959c00 2024-09-13T23:57:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c576b700 1 --2- 172.21.15.173:0/2398098210 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x555ee0959c00 0x555ee08ac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c576b700 1 --2- 172.21.15.173:0/2398098210 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x555ee0959c00 0x555ee08ac100 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x555ee09d1200 con 0x555ee0959c00 2024-09-13T23:57:05.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c6fb2f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:05.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c6fb2f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/2398098210 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x555ee09f6400 0x555ee08ac680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6800 con 0x555ee09f6400 2024-09-13T23:57:05.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c4f6a700 1 --2- 172.21.15.173:0/2398098210 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x555ee09f6400 0x555ee08ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.517+0000 7f35c4f6a700 1 --2- 172.21.15.173:0/2398098210 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x555ee09f6400 0x555ee08ac680 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.521+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x555ee09d1440 con 0x555ee09f6400 2024-09-13T23:57:05.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.521+0000 7f35c6fb2f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:05.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.521+0000 7f35c6fb2f40 20 searching for the correct realm 2024-09-13T23:57:05.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.521+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6c00 con 0x555ee09f6400 2024-09-13T23:57:05.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.521+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x555ee09d1440 con 0x555ee09f6400 2024-09-13T23:57:05.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.521+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6800 con 0x555ee0959c00 2024-09-13T23:57:05.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.521+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d1200 con 0x555ee0959c00 2024-09-13T23:57:05.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.521+0000 7f35c576b700 1 --2- 172.21.15.173:0/2398098210 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x555ee09f6800 0x555ee08acc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.521+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee09f6800 2024-09-13T23:57:05.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.521+0000 7f35c5f6c700 1 --2- 172.21.15.173:0/2398098210 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x555ee09f6800 0x555ee08acc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.521+0000 7f35c5f6c700 1 --2- 172.21.15.173:0/2398098210 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x555ee09f6800 0x555ee08acc00 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.521+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee09f6800 2024-09-13T23:57:05.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.521+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee0959400 2024-09-13T23:57:05.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.521+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee0959400 2024-09-13T23:57:05.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.521+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee0959400 2024-09-13T23:57:05.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.525+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee0959400 2024-09-13T23:57:05.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.525+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee09f6400 2024-09-13T23:57:05.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.525+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d1440 con 0x555ee09f6400 2024-09-13T23:57:05.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.525+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee0959400 2024-09-13T23:57:05.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.525+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee0959400 2024-09-13T23:57:05.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.525+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee0959c00 2024-09-13T23:57:05.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.525+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d1200 con 0x555ee0959c00 2024-09-13T23:57:05.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.525+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee0959c00 2024-09-13T23:57:05.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.525+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d1200 con 0x555ee0959c00 2024-09-13T23:57:05.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.525+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee0959400 2024-09-13T23:57:05.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.525+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee0959400 2024-09-13T23:57:05.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.525+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee09f6800 2024-09-13T23:57:05.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.525+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee09f6800 2024-09-13T23:57:05.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.525+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee0959400 2024-09-13T23:57:05.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.529+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee0959400 2024-09-13T23:57:05.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.529+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee09f6800 2024-09-13T23:57:05.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.529+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee09f6800 2024-09-13T23:57:05.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.529+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee0959c00 2024-09-13T23:57:05.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.529+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d1200 con 0x555ee0959c00 2024-09-13T23:57:05.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.529+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee09f6400 2024-09-13T23:57:05.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.529+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d1440 con 0x555ee09f6400 2024-09-13T23:57:05.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.529+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee0959400 2024-09-13T23:57:05.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.529+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee0959400 2024-09-13T23:57:05.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.529+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee0959c00 2024-09-13T23:57:05.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.529+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d1200 con 0x555ee0959c00 2024-09-13T23:57:05.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.529+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee09f6400 2024-09-13T23:57:05.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.529+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d1440 con 0x555ee09f6400 2024-09-13T23:57:05.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.529+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee0959400 2024-09-13T23:57:05.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.529+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee0959400 2024-09-13T23:57:05.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.529+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee0959400 2024-09-13T23:57:05.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.533+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee0959400 2024-09-13T23:57:05.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.533+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee0959400 2024-09-13T23:57:05.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.533+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee0959400 2024-09-13T23:57:05.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.533+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee09f6400 2024-09-13T23:57:05.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.533+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d1440 con 0x555ee09f6400 2024-09-13T23:57:05.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.533+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee09f6800 2024-09-13T23:57:05.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.533+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee09f6800 2024-09-13T23:57:05.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.533+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee0959400 2024-09-13T23:57:05.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.533+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee0959400 2024-09-13T23:57:05.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.533+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee09f6800 2024-09-13T23:57:05.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.533+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee09f6800 2024-09-13T23:57:05.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.533+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee09f6400 2024-09-13T23:57:05.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.533+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d1440 con 0x555ee09f6400 2024-09-13T23:57:05.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.533+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee09f6800 2024-09-13T23:57:05.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.537+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee09f6800 2024-09-13T23:57:05.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.537+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee0959c00 2024-09-13T23:57:05.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.537+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d1200 con 0x555ee0959c00 2024-09-13T23:57:05.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.537+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee0959c00 2024-09-13T23:57:05.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.537+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d1200 con 0x555ee0959c00 2024-09-13T23:57:05.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.537+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee09f6400 2024-09-13T23:57:05.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.537+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d1440 con 0x555ee09f6400 2024-09-13T23:57:05.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.537+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee0959c00 2024-09-13T23:57:05.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.537+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x555ee09d1200 con 0x555ee0959c00 2024-09-13T23:57:05.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.537+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee0959c00 2024-09-13T23:57:05.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.537+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555ee09d1200 con 0x555ee0959c00 2024-09-13T23:57:05.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.537+0000 7f35c6fb2f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:05.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.537+0000 7f35c6fb2f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:05.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.537+0000 7f35c6fb2f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:05.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.537+0000 7f35c6fb2f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:05.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.537+0000 7f35c6fb2f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.537+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f7000 con 0x555ee0959400 2024-09-13T23:57:05.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee0959400 2024-09-13T23:57:05.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f7400 con 0x555ee0959c00 2024-09-13T23:57:05.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x555ee09d1200 con 0x555ee0959c00 2024-09-13T23:57:05.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:05.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f7800 con 0x555ee0959400 2024-09-13T23:57:05.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee0959400 2024-09-13T23:57:05.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:05.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 20 zone default found 2024-09-13T23:57:05.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 4 Realm: () 2024-09-13T23:57:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 20 zonegroup default 2024-09-13T23:57:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f7c00 con 0x555ee09f6800 2024-09-13T23:57:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee09f6800 2024-09-13T23:57:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f7000 con 0x555ee09f6400 2024-09-13T23:57:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x555ee09d1440 con 0x555ee09f6400 2024-09-13T23:57:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f7800 con 0x555ee09f6400 2024-09-13T23:57:05.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x555ee09d1440 con 0x555ee09f6400 2024-09-13T23:57:05.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 20 started sync module instance, tier type = 2024-09-13T23:57:05.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:05.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.541+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee0959800 con 0x555ee0959c00 2024-09-13T23:57:05.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.545+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d1200 con 0x555ee0959c00 2024-09-13T23:57:05.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.545+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93865982434048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee0958800 con 0x555ee0959c00 2024-09-13T23:57:05.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.545+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee0959800 con 0x555ee0959400 2024-09-13T23:57:05.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.549+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee0959400 2024-09-13T23:57:05.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.549+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93865982435200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6000 con 0x555ee0959400 2024-09-13T23:57:05.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.549+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f7400 con 0x555ee0959c00 2024-09-13T23:57:05.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.549+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93865982434048] v33'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d1200 con 0x555ee0959c00 2024-09-13T23:57:05.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.549+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93865982435200] v33'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee0959400 2024-09-13T23:57:05.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.553+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d1200 con 0x555ee0959c00 2024-09-13T23:57:05.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.553+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93865982436352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09fa000 con 0x555ee0959c00 2024-09-13T23:57:05.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.553+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09fa400 con 0x555ee09f6800 2024-09-13T23:57:05.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.553+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93865982436352] v33'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d1200 con 0x555ee0959c00 2024-09-13T23:57:05.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.553+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee09f6800 2024-09-13T23:57:05.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.553+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93865982437504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09fa800 con 0x555ee09f6800 2024-09-13T23:57:05.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.553+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09fac00 con 0x555ee0959c00 2024-09-13T23:57:05.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.557+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d1200 con 0x555ee0959c00 2024-09-13T23:57:05.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.557+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93865982438656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09fb000 con 0x555ee0959c00 2024-09-13T23:57:05.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.557+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09fb400 con 0x555ee09f6400 2024-09-13T23:57:05.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.557+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93865982437504] v33'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee09f6800 2024-09-13T23:57:05.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.557+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93865982438656] v33'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d1200 con 0x555ee0959c00 2024-09-13T23:57:05.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.561+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d1440 con 0x555ee09f6400 2024-09-13T23:57:05.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.561+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93865982439808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09fb800 con 0x555ee09f6400 2024-09-13T23:57:05.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.561+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09fbc00 con 0x555ee09f6400 2024-09-13T23:57:05.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.561+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v33'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d1440 con 0x555ee09f6400 2024-09-13T23:57:05.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.561+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93865982440960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09fb400 con 0x555ee09f6400 2024-09-13T23:57:05.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.561+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09fa000 con 0x555ee09f6800 2024-09-13T23:57:05.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.561+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93865982439808] v33'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d1440 con 0x555ee09f6400 2024-09-13T23:57:05.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.565+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee09f6800 2024-09-13T23:57:05.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.565+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93865982442112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09fac00 con 0x555ee09f6800 2024-09-13T23:57:05.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.565+0000 7f35c6fb2f40 20 add_watcher() i=0 2024-09-13T23:57:05.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.565+0000 7f35c6fb2f40 20 add_watcher() i=1 2024-09-13T23:57:05.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.565+0000 7f35c6fb2f40 20 add_watcher() i=2 2024-09-13T23:57:05.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.565+0000 7f35c6fb2f40 20 add_watcher() i=3 2024-09-13T23:57:05.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.565+0000 7f35c6fb2f40 20 add_watcher() i=4 2024-09-13T23:57:05.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.565+0000 7f35c6fb2f40 20 add_watcher() i=5 2024-09-13T23:57:05.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.565+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93865982440960] v33'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d1440 con 0x555ee09f6400 2024-09-13T23:57:05.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.565+0000 7f35c6fb2f40 20 add_watcher() i=6 2024-09-13T23:57:05.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.565+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93865982442112] v33'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee09f6800 2024-09-13T23:57:05.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.565+0000 7f35c6fb2f40 20 add_watcher() i=7 2024-09-13T23:57:05.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.565+0000 7f35c6fb2f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:05.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.565+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f6c00 con 0x555ee0959400 2024-09-13T23:57:05.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.565+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee0959400 2024-09-13T23:57:05.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.565+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93865983885312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f7000 con 0x555ee0959400 2024-09-13T23:57:05.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.569+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93865983885312] v33'126 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee0959400 2024-09-13T23:57:05.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.569+0000 7f35ac739700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:05.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.569+0000 7f35c6fb2f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:05.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.569+0000 7f35c6fb2f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:05.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.569+0000 7f35c6fb2f40 1 Processor -- start 2024-09-13T23:57:05.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.569+0000 7f35c6fb2f40 1 -- start start 2024-09-13T23:57:05.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.569+0000 7f35c6fb2f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee09f7400 0x555ee08ad180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.569+0000 7f35c6fb2f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ee06523c0 con 0x555ee09f7400 2024-09-13T23:57:05.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.569+0000 7f35c4f6a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee09f7400 0x555ee08ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.569+0000 7f35c4f6a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee09f7400 0x555ee08ad180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50390/0 (socket says 172.21.15.173:50390) 2024-09-13T23:57:05.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.569+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2911056872 learned_addr learned my addr 172.21.15.173:0/2911056872 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.569+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2911056872 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ee05d6b60 con 0x555ee09f7400 2024-09-13T23:57:05.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.569+0000 7f35c4f6a700 1 --2- 172.21.15.173:0/2911056872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee09f7400 0x555ee08ad180 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x555ee0a0c0c0 tx=0x555ee091f800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68649f65aacfb1c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.569+0000 7f35abf38700 1 -- 172.21.15.173:0/2911056872 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ee0a02160 con 0x555ee09f7400 2024-09-13T23:57:05.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.573+0000 7f35abf38700 1 -- 172.21.15.173:0/2911056872 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555ee0a12180 con 0x555ee09f7400 2024-09-13T23:57:05.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.573+0000 7f35abf38700 1 -- 172.21.15.173:0/2911056872 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ee0a022c0 con 0x555ee09f7400 2024-09-13T23:57:05.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.573+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2911056872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee09f7400 msgr2=0x555ee08ad180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.573+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/2911056872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee09f7400 0x555ee08ad180 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x555ee0a0c0c0 tx=0x555ee091f800 comp rx=0 tx=0).stop 2024-09-13T23:57:05.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.573+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2911056872 shutdown_connections 2024-09-13T23:57:05.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.573+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/2911056872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee09f7400 0x555ee08ad180 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.573+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2911056872 >> 172.21.15.173:0/2911056872 conn(0x555ee09f7800 msgr2=0x555ee06c6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.573+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2911056872 shutdown_connections 2024-09-13T23:57:05.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.573+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2911056872 wait complete. 2024-09-13T23:57:05.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.573+0000 7f35c6fb2f40 1 Processor -- start 2024-09-13T23:57:05.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.573+0000 7f35c6fb2f40 1 -- start start 2024-09-13T23:57:05.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.573+0000 7f35c6fb2f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee09f7400 0x555ee08ad180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.573+0000 7f35c6fb2f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ee0652500 con 0x555ee09f7400 2024-09-13T23:57:05.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.573+0000 7f35c4f6a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee09f7400 0x555ee08ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.573+0000 7f35c4f6a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee09f7400 0x555ee08ad180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50394/0 (socket says 172.21.15.173:50394) 2024-09-13T23:57:05.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.573+0000 7f35c4f6a700 1 -- 172.21.15.173:0/681779539 learned_addr learned my addr 172.21.15.173:0/681779539 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.573+0000 7f35c4f6a700 1 -- 172.21.15.173:0/681779539 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ee05d6d00 con 0x555ee09f7400 2024-09-13T23:57:05.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.573+0000 7f35c4f6a700 1 --2- 172.21.15.173:0/681779539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee09f7400 0x555ee08ad180 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x555ee0a0c2d0 tx=0x555ee091f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.573+0000 7f35aa735700 1 -- 172.21.15.173:0/681779539 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ee0a02420 con 0x555ee09f7400 2024-09-13T23:57:05.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.573+0000 7f35aa735700 1 -- 172.21.15.173:0/681779539 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555ee0a12300 con 0x555ee09f7400 2024-09-13T23:57:05.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.573+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/681779539 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555ee05d6340 con 0x555ee09f7400 2024-09-13T23:57:05.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.573+0000 7f35aa735700 1 -- 172.21.15.173:0/681779539 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x555ee0a02160 con 0x555ee09f7400 2024-09-13T23:57:05.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.573+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/681779539 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555ee05d6b60 con 0x555ee09f7400 2024-09-13T23:57:05.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.577+0000 7f35aa735700 1 -- 172.21.15.173:0/681779539 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x555ee06bfb80 con 0x555ee09f7400 2024-09-13T23:57:05.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.577+0000 7f35aa735700 1 --2- 172.21.15.173:0/681779539 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ee09f6c00 0x555ee0a9e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.577+0000 7f35aa735700 1 -- 172.21.15.173:0/681779539 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x555ee062b6c0 con 0x555ee09f7400 2024-09-13T23:57:05.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.577+0000 7f35c6fb2f40 5 note: GC not initialized 2024-09-13T23:57:05.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.577+0000 7f35c5f6c700 1 --2- 172.21.15.173:0/681779539 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ee09f6c00 0x555ee0a9e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.577+0000 7f35c5f6c700 1 --2- 172.21.15.173:0/681779539 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ee09f6c00 0x555ee0a9e000 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x555ee0981dd0 tx=0x555ee091e720 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.577+0000 7f35a7f30700 20 reqs_thread_entry: start 2024-09-13T23:57:05.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.577+0000 7f35c6fb2f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:05.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.581+0000 7f35c6fb2f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:05.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.581+0000 7f35a5f2c700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:35 2024 2024-09-13T23:57:05.586 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:05.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.581+0000 7f35a570a700 20 reqs_thread_entry: start 2024-09-13T23:57:05.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.581+0000 7f35c6fb2f40 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-13T23:57:05.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.581+0000 7f35c6fb2f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.581+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee0958800 con 0x555ee09f6400 2024-09-13T23:57:05.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.581+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 246+0+0 (crc 0 0 0) 0x555ee09d1440 con 0x555ee09f6400 2024-09-13T23:57:05.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.581+0000 7f35c6fb2f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.581+0000 7f35c6fb2f40 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-13T23:57:05.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.581+0000 7f35c6fb2f40 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T23:57:05.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.581+0000 7f35c6fb2f40 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T23:57:05.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.581+0000 7f35c6fb2f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.581+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee0959800 con 0x555ee09f6400 2024-09-13T23:57:05.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.581+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x555ee09d1440 con 0x555ee09f6400 2024-09-13T23:57:05.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.581+0000 7f35c6fb2f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.581+0000 7f35c6fb2f40 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T23:57:05.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.581+0000 7f35c6fb2f40 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:57:05.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.581+0000 7f35c6fb2f40 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T23:57:05.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.581+0000 7f35c6fb2f40 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T23:57:05.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.581+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~385 in=385b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09fa800 con 0x555ee09f6400 2024-09-13T23:57:05.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.585+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~385] v33'5 uv5 ondisk = 0) v8 ==== 288+0+0 (crc 0 0 0) 0x555ee09d1440 con 0x555ee09f6400 2024-09-13T23:57:05.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.585+0000 7f35c6fb2f40 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-13T23:57:05.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.585+0000 7f35c6fb2f40 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T23:57:05.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.585+0000 7f35c6fb2f40 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-13T23:57:05.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.585+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 93865983887616 in=588b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09fa000 con 0x555ee09f6800 2024-09-13T23:57:05.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.585+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== watch-notify(notify (1) cookie 93865982437504 notify 141733920776 ret 0) v3 ==== 618+0+0 (crc 0 0 0) 0x555ee0a0e000 con 0x555ee09f6800 2024-09-13T23:57:05.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.585+0000 7f35bff60700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920776 cookie 93865982437504 notifier 4584 bl.length()=576 2024-09-13T23:57:05.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.585+0000 7f35bff60700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-13T23:57:05.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.585+0000 7f35bff60700 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T23:57:05.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.585+0000 7f35bff60700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee0958800 con 0x555ee09f6800 2024-09-13T23:57:05.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.585+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(65 notify.3 [notify cookie 93865983887616 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee09f6800 2024-09-13T23:57:05.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.585+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee09f6800 2024-09-13T23:57:05.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.585+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== watch-notify(notify_complete (2) cookie 93865983887616 notify 141733920776 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x555ee0a0e1a0 con 0x555ee09f6800 2024-09-13T23:57:05.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.585+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09fac00 con 0x555ee09f6400 2024-09-13T23:57:05.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.589+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v33'6 uv6 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x555ee09d1440 con 0x555ee09f6400 2024-09-13T23:57:05.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.589+0000 7f35c6fb2f40 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T23:57:05.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.589+0000 7f35c6fb2f40 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:57:05.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.589+0000 7f35c6fb2f40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T23:57:05.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.589+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93865983887616 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09fb000 con 0x555ee0959c00 2024-09-13T23:57:05.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.589+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== watch-notify(notify (1) cookie 93865982436352 notify 141733920790 ret 0) v3 ==== 234+0+0 (crc 0 0 0) 0x555ee05d76c0 con 0x555ee0959c00 2024-09-13T23:57:05.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.589+0000 7f35bf75f700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920790 cookie 93865982436352 notifier 4584 bl.length()=192 2024-09-13T23:57:05.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.589+0000 7f35bf75f700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T23:57:05.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.589+0000 7f35bf75f700 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:57:05.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.589+0000 7f35bf75f700 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09fb800 con 0x555ee0959c00 2024-09-13T23:57:05.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.589+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(68 notify.2 [notify cookie 93865983887616 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x555ee09d1200 con 0x555ee0959c00 2024-09-13T23:57:05.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.589+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d1200 con 0x555ee0959c00 2024-09-13T23:57:05.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.589+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== watch-notify(notify_complete (2) cookie 93865983887616 notify 141733920790 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x555ee05d7d40 con 0x555ee0959c00 2024-09-13T23:57:05.596 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:05.596 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "testx$tenanteduser", 2024-09-13T23:57:05.596 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "tenanted-user", 2024-09-13T23:57:05.597 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "", 2024-09-13T23:57:05.597 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:57:05.597 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 1, 2024-09-13T23:57:05.597 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [], 2024-09-13T23:57:05.597 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:57:05.597 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:05.597 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "testx$tenanteduser", 2024-09-13T23:57:05.597 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "p5YnriCv1nAtykxBrupQ", 2024-09-13T23:57:05.597 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh" 2024-09-13T23:57:05.597 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:05.597 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:05.598 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [], 2024-09-13T23:57:05.598 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:57:05.598 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:57:05.598 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:57:05.598 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:57:05.598 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:57:05.598 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:57:05.598 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:05.598 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:05.598 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:05.598 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:05.598 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:05.598 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:05.598 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:57:05.599 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:05.599 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:05.599 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:05.599 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:05.599 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:05.599 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:05.599 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:57:05.599 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:57:05.599 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:57:05.599 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:05.599 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:57:05.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.593+0000 7f35ac739700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:05.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.593+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93865983885312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09fa400 con 0x555ee0959400 2024-09-13T23:57:05.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.593+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93865983885312] v33'127 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee0959400 2024-09-13T23:57:05.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.593+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93865982434048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09f7000 con 0x555ee0959c00 2024-09-13T23:57:05.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.597+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93865982434048] v33'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d1200 con 0x555ee0959c00 2024-09-13T23:57:05.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.597+0000 7f35c6fb2f40 20 remove_watcher() i=0 2024-09-13T23:57:05.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.597+0000 7f35c6fb2f40 2 removed watcher, disabling cache 2024-09-13T23:57:05.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.597+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93865982435200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09fbc00 con 0x555ee0959400 2024-09-13T23:57:05.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.601+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93865982435200] v33'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee0959400 2024-09-13T23:57:05.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.601+0000 7f35c6fb2f40 20 remove_watcher() i=1 2024-09-13T23:57:05.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.601+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93865982436352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09fa800 con 0x555ee0959c00 2024-09-13T23:57:05.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.601+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93865982436352] v33'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d1200 con 0x555ee0959c00 2024-09-13T23:57:05.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.601+0000 7f35c6fb2f40 20 remove_watcher() i=2 2024-09-13T23:57:05.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.601+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93865982437504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09be000 con 0x555ee09f6800 2024-09-13T23:57:05.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.605+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93865982437504] v33'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee09f6800 2024-09-13T23:57:05.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.605+0000 7f35c6fb2f40 20 remove_watcher() i=3 2024-09-13T23:57:05.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.605+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93865982438656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09be400 con 0x555ee0959c00 2024-09-13T23:57:05.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.605+0000 7f35c576b700 1 -- 172.21.15.173:0/2398098210 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93865982438656] v33'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d1200 con 0x555ee0959c00 2024-09-13T23:57:05.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.605+0000 7f35c6fb2f40 20 remove_watcher() i=4 2024-09-13T23:57:05.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.605+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93865982439808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09be800 con 0x555ee09f6400 2024-09-13T23:57:05.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.609+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93865982439808] v33'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d1440 con 0x555ee09f6400 2024-09-13T23:57:05.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.609+0000 7f35c6fb2f40 20 remove_watcher() i=5 2024-09-13T23:57:05.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.609+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93865982440960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09bec00 con 0x555ee09f6400 2024-09-13T23:57:05.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.613+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 <== osd.3 v2:172.21.15.173:6800/4020038786 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93865982440960] v33'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d1440 con 0x555ee09f6400 2024-09-13T23:57:05.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.613+0000 7f35c6fb2f40 20 remove_watcher() i=6 2024-09-13T23:57:05.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.613+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93865982442112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555ee09bf000 con 0x555ee09f6800 2024-09-13T23:57:05.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.613+0000 7f35c5f6c700 1 -- 172.21.15.173:0/2398098210 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93865982442112] v33'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x555ee09d0b40 con 0x555ee09f6800 2024-09-13T23:57:05.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.613+0000 7f35c6fb2f40 20 remove_watcher() i=7 2024-09-13T23:57:05.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.613+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x555ee0959c00 msgr2=0x555ee08ac100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.613+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/2398098210 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x555ee0959c00 0x555ee08ac100 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.613+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x555ee0959400 msgr2=0x555ee08abb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.613+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/2398098210 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x555ee0959400 0x555ee08abb80 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.613+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x555ee09f6800 msgr2=0x555ee08acc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.613+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/2398098210 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x555ee09f6800 0x555ee08acc00 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.613+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x555ee09f6400 msgr2=0x555ee08ac680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.613+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/2398098210 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x555ee09f6400 0x555ee08ac680 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.613+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ee0959000 msgr2=0x555ee08ab600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.613+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/2398098210 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ee0959000 0x555ee08ab600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x555ee138e030 tx=0x555ee091f860 comp rx=0 tx=0).stop 2024-09-13T23:57:05.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.613+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5800 msgr2=0x555ee08aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.613+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/2398098210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5800 0x555ee08aab00 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x555ee1438630 tx=0x555ee091ea80 comp rx=0 tx=0).stop 2024-09-13T23:57:05.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.613+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 reap_dead start 2024-09-13T23:57:05.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.613+0000 7f35c4f6a700 1 -- 172.21.15.173:0/2398098210 reap_dead start 2024-09-13T23:57:05.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.613+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 shutdown_connections 2024-09-13T23:57:05.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.613+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 >> 172.21.15.173:0/2398098210 conn(0x555ee05c5400 msgr2=0x555ee06c5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.617+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 shutdown_connections 2024-09-13T23:57:05.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.617+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/2398098210 wait complete. 2024-09-13T23:57:05.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.617+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/681779539 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ee09f6c00 msgr2=0x555ee0a9e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.617+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/681779539 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ee09f6c00 0x555ee0a9e000 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x555ee0981dd0 tx=0x555ee091e720 comp rx=0 tx=0).stop 2024-09-13T23:57:05.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.617+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/681779539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee09f7400 msgr2=0x555ee08ad180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.617+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/681779539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee09f7400 0x555ee08ad180 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x555ee0a0c2d0 tx=0x555ee091f980 comp rx=0 tx=0).stop 2024-09-13T23:57:05.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.617+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/681779539 shutdown_connections 2024-09-13T23:57:05.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.617+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/681779539 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ee09f6c00 0x555ee0a9e000 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.617+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/681779539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee09f7400 0x555ee08ad180 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.617+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/681779539 >> 172.21.15.173:0/681779539 conn(0x555ee09f7800 msgr2=0x555ee06c6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.617+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/681779539 shutdown_connections 2024-09-13T23:57:05.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.617+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/681779539 wait complete. 2024-09-13T23:57:05.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.617+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/3166514913 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ee0958000 msgr2=0x555ee08ab080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.617+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/3166514913 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ee0958000 0x555ee08ab080 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x555ee138ff80 tx=0x555ee091e780 comp rx=0 tx=0).stop 2024-09-13T23:57:05.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.617+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/3166514913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5000 msgr2=0x555ee08aa580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.617+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/3166514913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5000 0x555ee08aa580 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x555ee08a5f80 tx=0x555ee06c9980 comp rx=0 tx=0).stop 2024-09-13T23:57:05.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.617+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/3166514913 shutdown_connections 2024-09-13T23:57:05.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.617+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/3166514913 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x555ee0958000 0x555ee08ab080 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.617+0000 7f35c6fb2f40 1 --2- 172.21.15.173:0/3166514913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555ee05c5000 0x555ee08aa580 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.617+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/3166514913 >> 172.21.15.173:0/3166514913 conn(0x555ee05c4c00 msgr2=0x555ee06c5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.617+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/3166514913 shutdown_connections 2024-09-13T23:57:05.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.617+0000 7f35c6fb2f40 1 -- 172.21.15.173:0/3166514913 wait complete. 2024-09-13T23:57:05.630 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:57:05.630 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T23:57:05.630 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T23:57:05.630 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-13T23:57:05.677 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:05.680 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:05.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f813153af40 1 Processor -- start 2024-09-13T23:57:05.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f813153af40 1 -- start start 2024-09-13T23:57:05.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f813153af40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x5610d803f400 0x5610d8324580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f813153af40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5610d8103500 con 0x5610d803f000 2024-09-13T23:57:05.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f813153af40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x5610d80cca00 con 0x5610d803f400 2024-09-13T23:57:05.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f812fcf3700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x5610d803f000 0x5610d813e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47504/0 (socket says 172.21.15.173:47504) 2024-09-13T23:57:05.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f812fcf3700 1 -- 172.21.15.173:0/2697198075 learned_addr learned my addr 172.21.15.173:0/2697198075 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:05.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f812f4f2700 1 --2- 172.21.15.173:0/2697198075 >> v2:172.21.15.87:3300/0 conn(0x5610d803f400 0x5610d8324580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f812ecf1700 1 -- 172.21.15.173:0/2697198075 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2405151502 0 0) 0x5610d819a000 con 0x5610d803f000 2024-09-13T23:57:05.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f812ecf1700 1 -- 172.21.15.173:0/2697198075 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x5610d8103680 con 0x5610d803f000 2024-09-13T23:57:05.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f812f4f2700 1 -- 172.21.15.173:0/2697198075 >> v1:172.21.15.87:6789/0 conn(0x5610d803f000 legacy=0x5610d813e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f812f4f2700 1 -- 172.21.15.173:0/2697198075 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610d8051d40 con 0x5610d803f400 2024-09-13T23:57:05.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f812f4f2700 1 --2- 172.21.15.173:0/2697198075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f400 0x5610d8324580 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x5610d831f920 tx=0x5610d8143980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4747a763c55f9cf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f812ecf1700 1 -- 172.21.15.173:0/2697198075 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610d80e34a0 con 0x5610d803f400 2024-09-13T23:57:05.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f812ecf1700 1 -- 172.21.15.173:0/2697198075 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610d8103680 con 0x5610d803f400 2024-09-13T23:57:05.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f812ecf1700 1 -- 172.21.15.173:0/2697198075 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610d80e3600 con 0x5610d803f400 2024-09-13T23:57:05.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f813153af40 1 -- 172.21.15.173:0/2697198075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f400 msgr2=0x5610d8324580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f813153af40 1 --2- 172.21.15.173:0/2697198075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f400 0x5610d8324580 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x5610d831f920 tx=0x5610d8143980 comp rx=0 tx=0).stop 2024-09-13T23:57:05.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f813153af40 1 -- 172.21.15.173:0/2697198075 shutdown_connections 2024-09-13T23:57:05.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f813153af40 1 --2- 172.21.15.173:0/2697198075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f400 0x5610d8324580 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f813153af40 1 -- 172.21.15.173:0/2697198075 >> 172.21.15.173:0/2697198075 conn(0x5610d803ec00 msgr2=0x5610d813e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f813153af40 1 -- 172.21.15.173:0/2697198075 shutdown_connections 2024-09-13T23:57:05.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f813153af40 1 -- 172.21.15.173:0/2697198075 wait complete. 2024-09-13T23:57:05.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f813153af40 1 Processor -- start 2024-09-13T23:57:05.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.673+0000 7f813153af40 1 -- start start 2024-09-13T23:57:05.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.677+0000 7f813153af40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f000 0x5610d8324580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.677+0000 7f813153af40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d80cc500 con 0x5610d803f000 2024-09-13T23:57:05.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.677+0000 7f812fcf3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f000 0x5610d8324580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.677+0000 7f812fcf3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f000 0x5610d8324580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50426/0 (socket says 172.21.15.173:50426) 2024-09-13T23:57:05.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.677+0000 7f812fcf3700 1 -- 172.21.15.173:0/4140660235 learned_addr learned my addr 172.21.15.173:0/4140660235 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.677+0000 7f812fcf3700 1 -- 172.21.15.173:0/4140660235 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610d8051ba0 con 0x5610d803f000 2024-09-13T23:57:05.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.677+0000 7f812fcf3700 1 --2- 172.21.15.173:0/4140660235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f000 0x5610d8324580 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x5610d8e09d70 tx=0x5610d8143b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae0246eb773288f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.677+0000 7f812e4f0700 1 -- 172.21.15.173:0/4140660235 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610d80e34a0 con 0x5610d803f000 2024-09-13T23:57:05.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.677+0000 7f812e4f0700 1 -- 172.21.15.173:0/4140660235 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610d8103b00 con 0x5610d803f000 2024-09-13T23:57:05.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.677+0000 7f812e4f0700 1 -- 172.21.15.173:0/4140660235 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610d80e3600 con 0x5610d803f000 2024-09-13T23:57:05.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.677+0000 7f813153af40 1 -- 172.21.15.173:0/4140660235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f000 msgr2=0x5610d8324580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.677+0000 7f813153af40 1 --2- 172.21.15.173:0/4140660235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f000 0x5610d8324580 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x5610d8e09d70 tx=0x5610d8143b60 comp rx=0 tx=0).stop 2024-09-13T23:57:05.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.677+0000 7f813153af40 1 -- 172.21.15.173:0/4140660235 shutdown_connections 2024-09-13T23:57:05.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.677+0000 7f813153af40 1 --2- 172.21.15.173:0/4140660235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f000 0x5610d8324580 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.677+0000 7f813153af40 1 -- 172.21.15.173:0/4140660235 >> 172.21.15.173:0/4140660235 conn(0x5610d803ec00 msgr2=0x5610d813f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.677+0000 7f813153af40 1 -- 172.21.15.173:0/4140660235 shutdown_connections 2024-09-13T23:57:05.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.677+0000 7f813153af40 1 -- 172.21.15.173:0/4140660235 wait complete. 2024-09-13T23:57:05.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.681+0000 7f813153af40 1 Processor -- start 2024-09-13T23:57:05.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.681+0000 7f813153af40 1 -- start start 2024-09-13T23:57:05.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.681+0000 7f813153af40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f000 0x5610d8324580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.681+0000 7f813153af40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d80cc3c0 con 0x5610d803f000 2024-09-13T23:57:05.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.681+0000 7f812fcf3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f000 0x5610d8324580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.681+0000 7f812fcf3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f000 0x5610d8324580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50434/0 (socket says 172.21.15.173:50434) 2024-09-13T23:57:05.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.681+0000 7f812fcf3700 1 -- 172.21.15.173:0/1456208112 learned_addr learned my addr 172.21.15.173:0/1456208112 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.681+0000 7f812fcf3700 1 -- 172.21.15.173:0/1456208112 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610d8051a00 con 0x5610d803f000 2024-09-13T23:57:05.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.681+0000 7f812fcf3700 1 --2- 172.21.15.173:0/1456208112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f000 0x5610d8324580 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x5610d8e09e60 tx=0x5610d8143920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.681+0000 7f812cced700 1 -- 172.21.15.173:0/1456208112 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610d80e38c0 con 0x5610d803f000 2024-09-13T23:57:05.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.681+0000 7f812cced700 1 -- 172.21.15.173:0/1456208112 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610d8103c80 con 0x5610d803f000 2024-09-13T23:57:05.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.681+0000 7f813153af40 1 -- 172.21.15.173:0/1456208112 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5610d8051860 con 0x5610d803f000 2024-09-13T23:57:05.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.681+0000 7f812cced700 1 -- 172.21.15.173:0/1456208112 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610d80e34a0 con 0x5610d803f000 2024-09-13T23:57:05.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.681+0000 7f813153af40 1 -- 172.21.15.173:0/1456208112 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610d80516c0 con 0x5610d803f000 2024-09-13T23:57:05.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.685+0000 7f813153af40 1 Processor -- start 2024-09-13T23:57:05.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.685+0000 7f813153af40 1 -- start start 2024-09-13T23:57:05.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.685+0000 7f812cced700 1 -- 172.21.15.173:0/1456208112 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x5610d8138b00 con 0x5610d803f000 2024-09-13T23:57:05.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.685+0000 7f813153af40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f800 0x5610d8324b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.685+0000 7f813153af40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d8064640 con 0x5610d803f800 2024-09-13T23:57:05.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.685+0000 7f812cced700 1 --2- 172.21.15.173:0/1456208112 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5610d83d6000 0x5610d8325080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.685+0000 7f812cced700 1 -- 172.21.15.173:0/1456208112 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5610d80a5180 con 0x5610d803f000 2024-09-13T23:57:05.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.685+0000 7f81304f4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f800 0x5610d8324b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.685+0000 7f81304f4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f800 0x5610d8324b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50442/0 (socket says 172.21.15.173:50442) 2024-09-13T23:57:05.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.685+0000 7f81304f4700 1 -- 172.21.15.173:0/2854282786 learned_addr learned my addr 172.21.15.173:0/2854282786 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.685+0000 7f812fcf3700 1 --2- 172.21.15.173:0/1456208112 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5610d83d6000 0x5610d8325080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.685+0000 7f81304f4700 1 -- 172.21.15.173:0/2854282786 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610d8050000 con 0x5610d803f800 2024-09-13T23:57:05.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.685+0000 7f812fcf3700 1 --2- 172.21.15.173:0/1456208112 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5610d83d6000 0x5610d8325080 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x5610d8362ed0 tx=0x5610d839a240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.685+0000 7f81304f4700 1 --2- 172.21.15.173:0/2854282786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f800 0x5610d8324b00 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x5610d8362810 tx=0x5610d839ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55642b29f10c5654 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.685+0000 7f812a4e8700 1 -- 172.21.15.173:0/2854282786 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610d80e38c0 con 0x5610d803f800 2024-09-13T23:57:05.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.685+0000 7f812a4e8700 1 -- 172.21.15.173:0/2854282786 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610d83ea000 con 0x5610d803f800 2024-09-13T23:57:05.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.685+0000 7f812a4e8700 1 -- 172.21.15.173:0/2854282786 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610d80e34a0 con 0x5610d803f800 2024-09-13T23:57:05.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.685+0000 7f813153af40 1 -- 172.21.15.173:0/2854282786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f800 msgr2=0x5610d8324b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.685+0000 7f813153af40 1 --2- 172.21.15.173:0/2854282786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f800 0x5610d8324b00 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x5610d8362810 tx=0x5610d839ad20 comp rx=0 tx=0).stop 2024-09-13T23:57:05.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.685+0000 7f813153af40 1 -- 172.21.15.173:0/2854282786 shutdown_connections 2024-09-13T23:57:05.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.685+0000 7f813153af40 1 --2- 172.21.15.173:0/2854282786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f800 0x5610d8324b00 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.685+0000 7f813153af40 1 -- 172.21.15.173:0/2854282786 >> 172.21.15.173:0/2854282786 conn(0x5610d803f400 msgr2=0x5610d813f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.685+0000 7f813153af40 1 -- 172.21.15.173:0/2854282786 shutdown_connections 2024-09-13T23:57:05.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.685+0000 7f813153af40 1 -- 172.21.15.173:0/2854282786 wait complete. 2024-09-13T23:57:05.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.689+0000 7f813153af40 1 Processor -- start 2024-09-13T23:57:05.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.689+0000 7f813153af40 1 -- start start 2024-09-13T23:57:05.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.689+0000 7f813153af40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f800 0x5610d8324b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.689+0000 7f813153af40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d80648c0 con 0x5610d803f800 2024-09-13T23:57:05.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.689+0000 7f81304f4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f800 0x5610d8324b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.689+0000 7f81304f4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f800 0x5610d8324b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50456/0 (socket says 172.21.15.173:50456) 2024-09-13T23:57:05.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.689+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 learned_addr learned my addr 172.21.15.173:0/1326361373 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.689+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610d8050ea0 con 0x5610d803f800 2024-09-13T23:57:05.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.689+0000 7f81304f4700 1 --2- 172.21.15.173:0/1326361373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f800 0x5610d8324b00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x5610d83620f0 tx=0x5610d839a960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.689+0000 7f8128ce5700 1 -- 172.21.15.173:0/1326361373 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610d80e3b80 con 0x5610d803f800 2024-09-13T23:57:05.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.689+0000 7f8128ce5700 1 -- 172.21.15.173:0/1326361373 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610d83ea180 con 0x5610d803f800 2024-09-13T23:57:05.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.689+0000 7f8128ce5700 1 -- 172.21.15.173:0/1326361373 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610d80e38c0 con 0x5610d803f800 2024-09-13T23:57:05.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.689+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5610d8050820 con 0x5610d803f800 2024-09-13T23:57:05.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.689+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610d80509c0 con 0x5610d803f800 2024-09-13T23:57:05.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.689+0000 7f8128ce5700 1 -- 172.21.15.173:0/1326361373 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x5610d8138dc0 con 0x5610d803f800 2024-09-13T23:57:05.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.693+0000 7f813153af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.693+0000 7f8128ce5700 1 --2- 172.21.15.173:0/1326361373 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5610d83d6c00 0x5610d8325600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.693+0000 7f8128ce5700 1 -- 172.21.15.173:0/1326361373 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5610d80a5340 con 0x5610d803f800 2024-09-13T23:57:05.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.693+0000 7f812f4f2700 1 --2- 172.21.15.173:0/1326361373 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5610d83d6c00 0x5610d8325600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.693+0000 7f813153af40 1 --2- 172.21.15.173:0/1326361373 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5610d83d7000 0x5610d8325b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.693+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7400 con 0x5610d83d7000 2024-09-13T23:57:05.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.693+0000 7f81304f4700 1 --2- 172.21.15.173:0/1326361373 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5610d83d7000 0x5610d8325b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.693+0000 7f812f4f2700 1 --2- 172.21.15.173:0/1326361373 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5610d83d6c00 0x5610d8325600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x5610d831f920 tx=0x5610d8143800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.693+0000 7f81304f4700 1 --2- 172.21.15.173:0/1326361373 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5610d83d7000 0x5610d8325b80 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.693+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.693+0000 7f813153af40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.693+0000 7f813153af40 20 realm 2024-09-13T23:57:05.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.693+0000 7f813153af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.693+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7000 2024-09-13T23:57:05.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.693+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.693+0000 7f813153af40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.693+0000 7f813153af40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:05.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.693+0000 7f813153af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.693+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7c00 con 0x5610d83d7000 2024-09-13T23:57:05.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.693+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.693+0000 7f813153af40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.693+0000 7f813153af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.693+0000 7f813153af40 1 --2- 172.21.15.173:0/1326361373 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5610d83d7400 0x5610d8326100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.693+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7400 2024-09-13T23:57:05.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.697+0000 7f812fcf3700 1 --2- 172.21.15.173:0/1326361373 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5610d83d7400 0x5610d8326100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.697+0000 7f812fcf3700 1 --2- 172.21.15.173:0/1326361373 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5610d83d7400 0x5610d8326100 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.697+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.697+0000 7f813153af40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:05.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.697+0000 7f813153af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.697+0000 7f813153af40 1 --2- 172.21.15.173:0/1326361373 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5610d83d7c00 0x5610d8326680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.697+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d849e000 con 0x5610d83d7c00 2024-09-13T23:57:05.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.697+0000 7f812f4f2700 1 --2- 172.21.15.173:0/1326361373 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5610d83d7c00 0x5610d8326680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.697+0000 7f812f4f2700 1 --2- 172.21.15.173:0/1326361373 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5610d83d7c00 0x5610d8326680 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.697+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5610d8485440 con 0x5610d83d7c00 2024-09-13T23:57:05.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.697+0000 7f813153af40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:05.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.697+0000 7f813153af40 20 searching for the correct realm 2024-09-13T23:57:05.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.697+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d849e400 con 0x5610d83d7c00 2024-09-13T23:57:05.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.697+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5610d8485440 con 0x5610d83d7c00 2024-09-13T23:57:05.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.701+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d849e000 con 0x5610d83d7400 2024-09-13T23:57:05.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.701+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.701+0000 7f812fcf3700 1 --2- 172.21.15.173:0/1326361373 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5610d849e000 0x5610d8326c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.701+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d849e000 2024-09-13T23:57:05.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.701+0000 7f81304f4700 1 --2- 172.21.15.173:0/1326361373 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5610d849e000 0x5610d8326c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.701+0000 7f81304f4700 1 --2- 172.21.15.173:0/1326361373 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5610d849e000 0x5610d8326c00 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.701+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8484b40 con 0x5610d849e000 2024-09-13T23:57:05.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.701+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7000 2024-09-13T23:57:05.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.701+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.701+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7000 2024-09-13T23:57:05.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.701+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.701+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7c00 2024-09-13T23:57:05.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.701+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8485440 con 0x5610d83d7c00 2024-09-13T23:57:05.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.701+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7000 2024-09-13T23:57:05.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.705+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.705+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7400 2024-09-13T23:57:05.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.705+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.705+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7400 2024-09-13T23:57:05.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.705+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.705+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7000 2024-09-13T23:57:05.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.705+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.705+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d849e000 2024-09-13T23:57:05.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.705+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8484b40 con 0x5610d849e000 2024-09-13T23:57:05.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.705+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7000 2024-09-13T23:57:05.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.705+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.705+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d849e000 2024-09-13T23:57:05.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.705+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8484b40 con 0x5610d849e000 2024-09-13T23:57:05.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.705+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7400 2024-09-13T23:57:05.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.709+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.709+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7c00 2024-09-13T23:57:05.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.709+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8485440 con 0x5610d83d7c00 2024-09-13T23:57:05.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.709+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7000 2024-09-13T23:57:05.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.709+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.709+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7400 2024-09-13T23:57:05.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.709+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.709+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7c00 2024-09-13T23:57:05.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.709+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8485440 con 0x5610d83d7c00 2024-09-13T23:57:05.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.709+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7000 2024-09-13T23:57:05.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.709+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.709+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7000 2024-09-13T23:57:05.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.709+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.709+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7000 2024-09-13T23:57:05.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.709+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.709+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7c00 2024-09-13T23:57:05.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.709+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8485440 con 0x5610d83d7c00 2024-09-13T23:57:05.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.709+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d849e000 2024-09-13T23:57:05.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.713+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8484b40 con 0x5610d849e000 2024-09-13T23:57:05.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.713+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7000 2024-09-13T23:57:05.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.713+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.713+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d849e000 2024-09-13T23:57:05.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.713+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8484b40 con 0x5610d849e000 2024-09-13T23:57:05.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.713+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7c00 2024-09-13T23:57:05.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.713+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8485440 con 0x5610d83d7c00 2024-09-13T23:57:05.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.713+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d849e000 2024-09-13T23:57:05.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.713+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8484b40 con 0x5610d849e000 2024-09-13T23:57:05.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.713+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7400 2024-09-13T23:57:05.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.713+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.713+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7400 2024-09-13T23:57:05.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.713+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.713+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7c00 2024-09-13T23:57:05.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.713+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8485440 con 0x5610d83d7c00 2024-09-13T23:57:05.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.713+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7400 2024-09-13T23:57:05.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d83d7400 2024-09-13T23:57:05.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f813153af40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:05.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f813153af40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:05.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f813153af40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:05.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f813153af40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:05.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f813153af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d849e800 con 0x5610d83d7000 2024-09-13T23:57:05.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f813153af40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f813153af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d849ec00 con 0x5610d83d7400 2024-09-13T23:57:05.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f813153af40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:05.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f813153af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d849f000 con 0x5610d83d7000 2024-09-13T23:57:05.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f813153af40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:05.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f813153af40 20 zone default found 2024-09-13T23:57:05.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f813153af40 4 Realm: () 2024-09-13T23:57:05.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f813153af40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:05.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f813153af40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:05.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f813153af40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:05.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f813153af40 20 zonegroup default 2024-09-13T23:57:05.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f813153af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d849f400 con 0x5610d849e000 2024-09-13T23:57:05.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5610d8484b40 con 0x5610d849e000 2024-09-13T23:57:05.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f813153af40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f813153af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.717+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d849f800 con 0x5610d83d7c00 2024-09-13T23:57:05.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.721+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5610d8485440 con 0x5610d83d7c00 2024-09-13T23:57:05.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.721+0000 7f813153af40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.721+0000 7f813153af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.721+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d849fc00 con 0x5610d83d7c00 2024-09-13T23:57:05.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.721+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5610d8485440 con 0x5610d83d7c00 2024-09-13T23:57:05.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.721+0000 7f813153af40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.721+0000 7f813153af40 20 started sync module instance, tier type = 2024-09-13T23:57:05.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.721+0000 7f813153af40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:05.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.721+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d84a4000 con 0x5610d83d7400 2024-09-13T23:57:05.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.721+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.721+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94630346603264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d84a4400 con 0x5610d83d7400 2024-09-13T23:57:05.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.721+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d84a4800 con 0x5610d83d7000 2024-09-13T23:57:05.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.725+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.725+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94630346604416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d84a4c00 con 0x5610d83d7000 2024-09-13T23:57:05.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.725+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d84a5000 con 0x5610d83d7400 2024-09-13T23:57:05.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.725+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94630346603264] v33'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.725+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94630346604416] v33'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.729+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.729+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94630346605568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d84a5400 con 0x5610d83d7400 2024-09-13T23:57:05.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.729+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d84a5800 con 0x5610d849e000 2024-09-13T23:57:05.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.729+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8484b40 con 0x5610d849e000 2024-09-13T23:57:05.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.729+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94630346606720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d84a5c00 con 0x5610d849e000 2024-09-13T23:57:05.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.729+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94630346605568] v33'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.729+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d84a4800 con 0x5610d83d7400 2024-09-13T23:57:05.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.733+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94630346606720] v33'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8484b40 con 0x5610d849e000 2024-09-13T23:57:05.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.733+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.733+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94630346607872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d84a4000 con 0x5610d83d7400 2024-09-13T23:57:05.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.733+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d849e800 con 0x5610d83d7c00 2024-09-13T23:57:05.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.737+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8485440 con 0x5610d83d7c00 2024-09-13T23:57:05.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.737+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94630346609024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d849f000 con 0x5610d83d7c00 2024-09-13T23:57:05.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.737+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d849f400 con 0x5610d83d7c00 2024-09-13T23:57:05.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.737+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94630346607872] v33'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.737+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94630346609024] v33'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8485440 con 0x5610d83d7c00 2024-09-13T23:57:05.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.737+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8485440 con 0x5610d83d7c00 2024-09-13T23:57:05.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.737+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94630346610176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d849ec00 con 0x5610d83d7c00 2024-09-13T23:57:05.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.737+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d83d7800 con 0x5610d849e000 2024-09-13T23:57:05.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.741+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8484b40 con 0x5610d849e000 2024-09-13T23:57:05.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.741+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94630346611328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d84a4400 con 0x5610d849e000 2024-09-13T23:57:05.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.741+0000 7f813153af40 20 add_watcher() i=0 2024-09-13T23:57:05.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.741+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94630346610176] v33'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8485440 con 0x5610d83d7c00 2024-09-13T23:57:05.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.741+0000 7f813153af40 20 add_watcher() i=1 2024-09-13T23:57:05.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.741+0000 7f813153af40 20 add_watcher() i=2 2024-09-13T23:57:05.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.741+0000 7f813153af40 20 add_watcher() i=3 2024-09-13T23:57:05.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.741+0000 7f813153af40 20 add_watcher() i=4 2024-09-13T23:57:05.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.741+0000 7f813153af40 20 add_watcher() i=5 2024-09-13T23:57:05.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.741+0000 7f813153af40 20 add_watcher() i=6 2024-09-13T23:57:05.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.741+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94630346611328] v33'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8484b40 con 0x5610d849e000 2024-09-13T23:57:05.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.741+0000 7f813153af40 20 add_watcher() i=7 2024-09-13T23:57:05.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.741+0000 7f813153af40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:05.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.741+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d84a5000 con 0x5610d83d7000 2024-09-13T23:57:05.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.741+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.741+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94630348234752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d84a5400 con 0x5610d83d7000 2024-09-13T23:57:05.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.745+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94630348234752] v33'128 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.745+0000 7f8116cc1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:05.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.745+0000 7f813153af40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:05.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.745+0000 7f813153af40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:05.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.745+0000 7f813153af40 1 Processor -- start 2024-09-13T23:57:05.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.745+0000 7f813153af40 1 -- start start 2024-09-13T23:57:05.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.745+0000 7f813153af40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d849e400 0x5610d8327180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.745+0000 7f813153af40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d80cc3c0 con 0x5610d849e400 2024-09-13T23:57:05.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.745+0000 7f812f4f2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d849e400 0x5610d8327180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.745+0000 7f812f4f2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d849e400 0x5610d8327180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50460/0 (socket says 172.21.15.173:50460) 2024-09-13T23:57:05.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.745+0000 7f812f4f2700 1 -- 172.21.15.173:0/2274356365 learned_addr learned my addr 172.21.15.173:0/2274356365 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.745+0000 7f812f4f2700 1 -- 172.21.15.173:0/2274356365 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610d8050b60 con 0x5610d849e400 2024-09-13T23:57:05.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.745+0000 7f812f4f2700 1 --2- 172.21.15.173:0/2274356365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d849e400 0x5610d8327180 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x5610d84b20c0 tx=0x5610d81439e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a83b418ef3c2d42 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.749+0000 7f81164c0700 1 -- 172.21.15.173:0/2274356365 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610d80e3760 con 0x5610d849e400 2024-09-13T23:57:05.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.749+0000 7f81164c0700 1 -- 172.21.15.173:0/2274356365 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610d83ea600 con 0x5610d849e400 2024-09-13T23:57:05.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.749+0000 7f81164c0700 1 -- 172.21.15.173:0/2274356365 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610d84ba000 con 0x5610d849e400 2024-09-13T23:57:05.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.749+0000 7f813153af40 1 -- 172.21.15.173:0/2274356365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d849e400 msgr2=0x5610d8327180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.749+0000 7f813153af40 1 --2- 172.21.15.173:0/2274356365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d849e400 0x5610d8327180 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x5610d84b20c0 tx=0x5610d81439e0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.749+0000 7f813153af40 1 -- 172.21.15.173:0/2274356365 shutdown_connections 2024-09-13T23:57:05.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.749+0000 7f813153af40 1 --2- 172.21.15.173:0/2274356365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d849e400 0x5610d8327180 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.749+0000 7f813153af40 1 -- 172.21.15.173:0/2274356365 >> 172.21.15.173:0/2274356365 conn(0x5610d84a4800 msgr2=0x5610d8140000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.749+0000 7f813153af40 1 -- 172.21.15.173:0/2274356365 shutdown_connections 2024-09-13T23:57:05.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.749+0000 7f813153af40 1 -- 172.21.15.173:0/2274356365 wait complete. 2024-09-13T23:57:05.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.749+0000 7f813153af40 1 Processor -- start 2024-09-13T23:57:05.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.749+0000 7f813153af40 1 -- start start 2024-09-13T23:57:05.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.749+0000 7f813153af40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d849e400 0x5610d8327180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.749+0000 7f813153af40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610d80cc500 con 0x5610d849e400 2024-09-13T23:57:05.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.749+0000 7f812f4f2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d849e400 0x5610d8327180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.749+0000 7f812f4f2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d849e400 0x5610d8327180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50464/0 (socket says 172.21.15.173:50464) 2024-09-13T23:57:05.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.749+0000 7f812f4f2700 1 -- 172.21.15.173:0/1493217596 learned_addr learned my addr 172.21.15.173:0/1493217596 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.749+0000 7f812f4f2700 1 -- 172.21.15.173:0/1493217596 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610d8050d00 con 0x5610d849e400 2024-09-13T23:57:05.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.749+0000 7f812f4f2700 1 --2- 172.21.15.173:0/1493217596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d849e400 0x5610d8327180 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x5610d84b2300 tx=0x5610d839bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.749+0000 7f8114cbd700 1 -- 172.21.15.173:0/1493217596 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610d84ba160 con 0x5610d849e400 2024-09-13T23:57:05.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.749+0000 7f8114cbd700 1 -- 172.21.15.173:0/1493217596 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610d83ea300 con 0x5610d849e400 2024-09-13T23:57:05.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.749+0000 7f813153af40 1 -- 172.21.15.173:0/1493217596 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5610d8050340 con 0x5610d849e400 2024-09-13T23:57:05.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.749+0000 7f8114cbd700 1 -- 172.21.15.173:0/1493217596 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5610d84ba2c0 con 0x5610d849e400 2024-09-13T23:57:05.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.749+0000 7f813153af40 1 -- 172.21.15.173:0/1493217596 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610d8051d40 con 0x5610d849e400 2024-09-13T23:57:05.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.753+0000 7f8114cbd700 1 -- 172.21.15.173:0/1493217596 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x5610d8139b80 con 0x5610d849e400 2024-09-13T23:57:05.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.753+0000 7f8114cbd700 1 --2- 172.21.15.173:0/1493217596 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5610d83d7800 0x5610d8538000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.753+0000 7f8114cbd700 1 -- 172.21.15.173:0/1493217596 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5610d80a5500 con 0x5610d849e400 2024-09-13T23:57:05.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.753+0000 7f813153af40 5 note: GC not initialized 2024-09-13T23:57:05.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.753+0000 7f81304f4700 1 --2- 172.21.15.173:0/1493217596 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5610d83d7800 0x5610d8538000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.753+0000 7f81304f4700 1 --2- 172.21.15.173:0/1493217596 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5610d83d7800 0x5610d8538000 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x5610d84337d0 tx=0x5610d84fcae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.753+0000 7f81124b8700 20 reqs_thread_entry: start 2024-09-13T23:57:05.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.753+0000 7f813153af40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:05.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.757+0000 7f813153af40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:05.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.757+0000 7f810fcb3700 20 reqs_thread_entry: start 2024-09-13T23:57:05.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.757+0000 7f813153af40 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-13T23:57:05.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.757+0000 7f813153af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.757+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d849e800 con 0x5610d83d7c00 2024-09-13T23:57:05.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.757+0000 7f81104b4700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:35 2024 2024-09-13T23:57:05.762 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:05.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.757+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~385 out=385b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 246+0+508 (crc 0 0 0) 0x5610d8485440 con 0x5610d83d7c00 2024-09-13T23:57:05.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.757+0000 7f813153af40 20 rados_obj.operate() r=0 bl.length=385 2024-09-13T23:57:05.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.757+0000 7f813153af40 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-13T23:57:05.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.757+0000 7f813153af40 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T23:57:05.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.757+0000 7f813153af40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:05.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.757+0000 7f813153af40 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:57:05.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.757+0000 7f813153af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.757+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d84a4c00 con 0x5610d849e000 2024-09-13T23:57:05.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.757+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x5610d8484b40 con 0x5610d849e000 2024-09-13T23:57:05.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.757+0000 7f813153af40 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:57:05.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.757+0000 7f813153af40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:57:05.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.757+0000 7f813153af40 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:57:05.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.757+0000 7f813153af40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 : miss 2024-09-13T23:57:05.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.757+0000 7f813153af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.757+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 8.17 8:ea49432e:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d84a5800 con 0x5610d83d7400 2024-09-13T23:57:05.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.757+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(64 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.761+0000 7f813153af40 20 rados_obj.operate() r=0 bl.length=352 2024-09-13T23:57:05.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.761+0000 7f813153af40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 info.flags=0x17 2024-09-13T23:57:05.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.761+0000 7f813153af40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 to cache LRU end 2024-09-13T23:57:05.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.761+0000 7f813153af40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:05.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.761+0000 7f813153af40 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:57:05.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.761+0000 7f813153af40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 2024-09-13T23:57:05.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.761+0000 7f813153af40 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-13T23:57:05.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.761+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d84a5c00 con 0x5610d849e000 2024-09-13T23:57:05.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.761+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(65 foo.buckets [call] v33'24 uv24 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x5610d8484b40 con 0x5610d849e000 2024-09-13T23:57:05.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.761+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:66 8.15 8:af528289:root::.bucket.meta.testx%3amyfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [create,call version.inc in=38b,writefull 0~371 in=371b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d84a4400 con 0x5610d83d7c00 2024-09-13T23:57:05.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.765+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [create,call,writefull 0~371,setxattr (203)] v33'3 uv3 ondisk = 0) v8 ==== 338+0+0 (crc 0 0 0) 0x5610d8485440 con 0x5610d83d7c00 2024-09-13T23:57:05.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.765+0000 7f813153af40 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 info.flags=0x7 2024-09-13T23:57:05.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.765+0000 7f813153af40 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 to cache LRU end 2024-09-13T23:57:05.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.765+0000 7f813153af40 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-13T23:57:05.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.765+0000 7f813153af40 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1, ofs0, ns] 2024-09-13T23:57:05.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.765+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94630348237056 in=818b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d85b4000 con 0x5610d83d7000 2024-09-13T23:57:05.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.765+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== watch-notify(notify (1) cookie 94630346604416 notify 141733920768 ret 0) v3 ==== 848+0+0 (crc 0 0 0) 0x5610d843e820 con 0x5610d83d7000 2024-09-13T23:57:05.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.765+0000 7f812a4e8700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920768 cookie 94630346604416 notifier 4592 bl.length()=806 2024-09-13T23:57:05.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.765+0000 7f812a4e8700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 info.flags=0x7 2024-09-13T23:57:05.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.765+0000 7f812a4e8700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 to cache LRU end 2024-09-13T23:57:05.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.765+0000 7f812a4e8700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-13T23:57:05.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.765+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(67 notify.1 [notify cookie 94630348237056 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.765+0000 7f812a4e8700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d85ba000 con 0x5610d83d7000 2024-09-13T23:57:05.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.765+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== watch-notify(notify_complete (2) cookie 94630348237056 notify 141733920768 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5610d843e9c0 con 0x5610d83d7000 2024-09-13T23:57:05.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.765+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.765+0000 7f813153af40 20 handle_bi_update(): bucket=testx:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1]): orig_sources= new_sources= 2024-09-13T23:57:05.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.765+0000 7f813153af40 20 handle_bi_update(): bucket=testx:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1]): potential sources added=[] removed=[] 2024-09-13T23:57:05.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.765+0000 7f813153af40 20 handle_bi_update(): bucket=testx:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1]): orig_dests= new_dests= 2024-09-13T23:57:05.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.765+0000 7f813153af40 20 handle_bi_update(): bucket=testx:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1]): potential dests added=[] removed=[] 2024-09-13T23:57:05.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.765+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d85b4400 con 0x5610d83d7000 2024-09-13T23:57:05.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.769+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 24 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v33'1 uv1 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.769+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d85b4800 con 0x5610d83d7000 2024-09-13T23:57:05.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.769+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 25 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v33'1 uv1 ondisk = 0) v8 ==== 281+0+0 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.769+0000 7f813153af40 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-13T23:57:05.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.769+0000 7f813153af40 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-13T23:57:05.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.769+0000 7f813153af40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-13T23:57:05.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.769+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94630348237056 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d85b4c00 con 0x5610d83d7400 2024-09-13T23:57:05.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.773+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== watch-notify(notify (1) cookie 94630346607872 notify 141733920791 ret 0) v3 ==== 390+0+0 (crc 0 0 0) 0x5610d8398820 con 0x5610d83d7400 2024-09-13T23:57:05.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.773+0000 7f812a4e8700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920791 cookie 94630346607872 notifier 4592 bl.length()=348 2024-09-13T23:57:05.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.773+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(71 notify.4 [notify cookie 94630348237056 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.773+0000 7f812a4e8700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-13T23:57:05.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.773+0000 7f812a4e8700 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-13T23:57:05.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.773+0000 7f812a4e8700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d85ba400 con 0x5610d83d7400 2024-09-13T23:57:05.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.773+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.773+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== watch-notify(notify_complete (2) cookie 94630348237056 notify 141733920791 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5610d83989c0 con 0x5610d83d7400 2024-09-13T23:57:05.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.773+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d85b5000 con 0x5610d849e000 2024-09-13T23:57:05.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.777+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(73 myfoo [call,delete] v33'25 uv25 ondisk = 0) v8 ==== 191+0+0 (crc 0 0 0) 0x5610d8484b40 con 0x5610d849e000 2024-09-13T23:57:05.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.777+0000 7f813153af40 10 removing default.rgw.meta+root+myfoo from cache 2024-09-13T23:57:05.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.777+0000 7f813153af40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T23:57:05.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.777+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94630348237056 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d85b5400 con 0x5610d83d7c00 2024-09-13T23:57:05.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.777+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== watch-notify(notify (1) cookie 94630346610176 notify 141733920785 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x5610d84fa9c0 con 0x5610d83d7c00 2024-09-13T23:57:05.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.777+0000 7f812a4e8700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920785 cookie 94630346610176 notifier 4592 bl.length()=149 2024-09-13T23:57:05.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.777+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(74 notify.6 [notify cookie 94630348237056 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x5610d8485440 con 0x5610d83d7c00 2024-09-13T23:57:05.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.777+0000 7f812a4e8700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d849f000 con 0x5610d83d7c00 2024-09-13T23:57:05.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.777+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== watch-notify(notify_complete (2) cookie 94630348237056 notify 141733920785 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5610d84fab60 con 0x5610d83d7c00 2024-09-13T23:57:05.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.777+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 <== osd.3 v2:172.21.15.173:6800/4020038786 20 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8485440 con 0x5610d83d7c00 2024-09-13T23:57:05.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.777+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:76 8.17 8:ea49432e:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d85b5800 con 0x5610d83d7400 2024-09-13T23:57:05.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.781+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(76 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [call,delete] v33'4 uv4 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.781+0000 7f813153af40 10 removing default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 from cache 2024-09-13T23:57:05.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.781+0000 7f813153af40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1, ofs0, ns] 2024-09-13T23:57:05.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.781+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [notify cookie 94630348237056 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d85b5c00 con 0x5610d83d7400 2024-09-13T23:57:05.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.781+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== watch-notify(notify (1) cookie 94630346605568 notify 141733920792 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x5610d83989c0 con 0x5610d83d7400 2024-09-13T23:57:05.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.781+0000 7f812a4e8700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920792 cookie 94630346605568 notifier 4592 bl.length()=206 2024-09-13T23:57:05.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.781+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== osd_op_reply(77 notify.2 [notify cookie 94630348237056 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.781+0000 7f812a4e8700 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:78 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d849f400 con 0x5610d83d7400 2024-09-13T23:57:05.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.781+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== watch-notify(notify_complete (2) cookie 94630348237056 notify 141733920792 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5610d8398b60 con 0x5610d83d7400 2024-09-13T23:57:05.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.781+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 27 ==== osd_op_reply(78 notify.2 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.781+0000 7f8116cc1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:05.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.781+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94630348234752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d85b4c00 con 0x5610d83d7000 2024-09-13T23:57:05.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.785+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 26 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94630348234752] v33'129 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.785+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94630346603264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d85b5800 con 0x5610d83d7400 2024-09-13T23:57:05.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.789+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 28 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94630346603264] v33'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.789+0000 7f813153af40 20 remove_watcher() i=0 2024-09-13T23:57:05.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.789+0000 7f813153af40 2 removed watcher, disabling cache 2024-09-13T23:57:05.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.789+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94630346604416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d85b4000 con 0x5610d83d7000 2024-09-13T23:57:05.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.789+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.1 v2:172.21.15.173:6808/3256211813 27 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94630346604416] v33'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8484b40 con 0x5610d83d7000 2024-09-13T23:57:05.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.789+0000 7f813153af40 20 remove_watcher() i=1 2024-09-13T23:57:05.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.789+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94630346605568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d85b5400 con 0x5610d83d7400 2024-09-13T23:57:05.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.793+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 29 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94630346605568] v33'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.793+0000 7f813153af40 20 remove_watcher() i=2 2024-09-13T23:57:05.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.793+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94630346606720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d85b4400 con 0x5610d849e000 2024-09-13T23:57:05.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.793+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94630346606720] v33'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8484b40 con 0x5610d849e000 2024-09-13T23:57:05.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.797+0000 7f813153af40 20 remove_watcher() i=3 2024-09-13T23:57:05.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.797+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94630346607872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d84a4000 con 0x5610d83d7400 2024-09-13T23:57:05.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.797+0000 7f812fcf3700 1 -- 172.21.15.173:0/1326361373 <== osd.0 v2:172.21.15.87:6800/3507919120 30 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94630346607872] v33'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8485200 con 0x5610d83d7400 2024-09-13T23:57:05.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.797+0000 7f813153af40 20 remove_watcher() i=4 2024-09-13T23:57:05.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.797+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94630346609024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d84a5800 con 0x5610d83d7c00 2024-09-13T23:57:05.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.801+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 <== osd.3 v2:172.21.15.173:6800/4020038786 21 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94630346609024] v33'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8485440 con 0x5610d83d7c00 2024-09-13T23:57:05.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.801+0000 7f813153af40 20 remove_watcher() i=5 2024-09-13T23:57:05.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.801+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94630346610176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d84a4400 con 0x5610d83d7c00 2024-09-13T23:57:05.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.801+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 <== osd.3 v2:172.21.15.173:6800/4020038786 22 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94630346610176] v33'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8485440 con 0x5610d83d7c00 2024-09-13T23:57:05.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.801+0000 7f813153af40 20 remove_watcher() i=6 2024-09-13T23:57:05.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.801+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94630346611328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5610d84a5000 con 0x5610d849e000 2024-09-13T23:57:05.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f81304f4700 1 -- 172.21.15.173:0/1326361373 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94630346611328] v33'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5610d8484b40 con 0x5610d849e000 2024-09-13T23:57:05.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 20 remove_watcher() i=7 2024-09-13T23:57:05.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5610d83d7400 msgr2=0x5610d8326100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 1 --2- 172.21.15.173:0/1326361373 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5610d83d7400 0x5610d8326100 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5610d83d7000 msgr2=0x5610d8325b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 1 --2- 172.21.15.173:0/1326361373 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5610d83d7000 0x5610d8325b80 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5610d849e000 msgr2=0x5610d8326c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 1 --2- 172.21.15.173:0/1326361373 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5610d849e000 0x5610d8326c00 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5610d83d7c00 msgr2=0x5610d8326680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 1 --2- 172.21.15.173:0/1326361373 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5610d83d7c00 0x5610d8326680 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5610d83d6c00 msgr2=0x5610d8325600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 1 --2- 172.21.15.173:0/1326361373 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5610d83d6c00 0x5610d8325600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x5610d831f920 tx=0x5610d8143800 comp rx=0 tx=0).stop 2024-09-13T23:57:05.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f800 msgr2=0x5610d8324b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 1 --2- 172.21.15.173:0/1326361373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f800 0x5610d8324b00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x5610d83620f0 tx=0x5610d839a960 comp rx=0 tx=0).stop 2024-09-13T23:57:05.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 reap_dead start 2024-09-13T23:57:05.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f812f4f2700 1 -- 172.21.15.173:0/1326361373 reap_dead start 2024-09-13T23:57:05.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 shutdown_connections 2024-09-13T23:57:05.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 >> 172.21.15.173:0/1326361373 conn(0x5610d803f400 msgr2=0x5610d813f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 shutdown_connections 2024-09-13T23:57:05.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 1 -- 172.21.15.173:0/1326361373 wait complete. 2024-09-13T23:57:05.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 1 -- 172.21.15.173:0/1493217596 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5610d83d7800 msgr2=0x5610d8538000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 1 --2- 172.21.15.173:0/1493217596 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5610d83d7800 0x5610d8538000 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x5610d84337d0 tx=0x5610d84fcae0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 1 -- 172.21.15.173:0/1493217596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d849e400 msgr2=0x5610d8327180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 1 --2- 172.21.15.173:0/1493217596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d849e400 0x5610d8327180 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x5610d84b2300 tx=0x5610d839bc20 comp rx=0 tx=0).stop 2024-09-13T23:57:05.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 1 -- 172.21.15.173:0/1493217596 shutdown_connections 2024-09-13T23:57:05.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 1 --2- 172.21.15.173:0/1493217596 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5610d83d7800 0x5610d8538000 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 1 --2- 172.21.15.173:0/1493217596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d849e400 0x5610d8327180 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.805+0000 7f813153af40 1 -- 172.21.15.173:0/1493217596 >> 172.21.15.173:0/1493217596 conn(0x5610d84a4800 msgr2=0x5610d8140000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.809+0000 7f813153af40 1 -- 172.21.15.173:0/1493217596 shutdown_connections 2024-09-13T23:57:05.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.809+0000 7f813153af40 1 -- 172.21.15.173:0/1493217596 wait complete. 2024-09-13T23:57:05.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.809+0000 7f813153af40 1 -- 172.21.15.173:0/1456208112 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5610d83d6000 msgr2=0x5610d8325080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.809+0000 7f813153af40 1 --2- 172.21.15.173:0/1456208112 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5610d83d6000 0x5610d8325080 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x5610d8362ed0 tx=0x5610d839a240 comp rx=0 tx=0).stop 2024-09-13T23:57:05.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.809+0000 7f813153af40 1 -- 172.21.15.173:0/1456208112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f000 msgr2=0x5610d8324580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.809+0000 7f813153af40 1 --2- 172.21.15.173:0/1456208112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f000 0x5610d8324580 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x5610d8e09e60 tx=0x5610d8143920 comp rx=0 tx=0).stop 2024-09-13T23:57:05.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.809+0000 7f813153af40 1 -- 172.21.15.173:0/1456208112 shutdown_connections 2024-09-13T23:57:05.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.809+0000 7f813153af40 1 --2- 172.21.15.173:0/1456208112 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5610d83d6000 0x5610d8325080 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.809+0000 7f813153af40 1 --2- 172.21.15.173:0/1456208112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5610d803f000 0x5610d8324580 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.809+0000 7f813153af40 1 -- 172.21.15.173:0/1456208112 >> 172.21.15.173:0/1456208112 conn(0x5610d803ec00 msgr2=0x5610d813f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.809+0000 7f813153af40 1 -- 172.21.15.173:0/1456208112 shutdown_connections 2024-09-13T23:57:05.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.809+0000 7f813153af40 1 -- 172.21.15.173:0/1456208112 wait complete. 2024-09-13T23:57:05.819 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-13T23:57:05.820 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-13T23:57:05.820 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-13T23:57:05.860 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:05.860 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:05.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.853+0000 7ff3cb1b4f40 1 Processor -- start 2024-09-13T23:57:05.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.853+0000 7ff3cb1b4f40 1 -- start start 2024-09-13T23:57:05.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.853+0000 7ff3cb1b4f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55a6efd07400 0x55a6effec580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.853+0000 7ff3cb1b4f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a6efdcb500 con 0x55a6efd07000 2024-09-13T23:57:05.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.853+0000 7ff3cb1b4f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a6efd94a00 con 0x55a6efd07400 2024-09-13T23:57:05.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.857+0000 7ff3c916c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55a6efd07400 0x55a6effec580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.857+0000 7ff3c996d700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55a6efd07000 0x55a6efe06800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47514/0 (socket says 172.21.15.173:47514) 2024-09-13T23:57:05.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.857+0000 7ff3c916c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55a6efd07400 0x55a6effec580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50474/0 (socket says 172.21.15.173:50474) 2024-09-13T23:57:05.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.857+0000 7ff3c996d700 1 -- 172.21.15.173:0/837666115 learned_addr learned my addr 172.21.15.173:0/837666115 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:05.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.857+0000 7ff3c916c700 1 -- 172.21.15.173:0/837666115 >> v1:172.21.15.87:6789/0 conn(0x55a6efd07000 legacy=0x55a6efe06800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.857+0000 7ff3c916c700 1 -- 172.21.15.173:0/837666115 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6efd19d40 con 0x55a6efd07400 2024-09-13T23:57:05.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.857+0000 7ff3c896b700 1 -- 172.21.15.173:0/837666115 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3608422481 0 0) 0x55a6efe62000 con 0x55a6efd07000 2024-09-13T23:57:05.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.857+0000 7ff3c916c700 1 --2- 172.21.15.173:0/837666115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07400 0x55a6effec580 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x55a6effe7920 tx=0x55a6efe0b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ebd7f803b102f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.857+0000 7ff3c896b700 1 -- 172.21.15.173:0/837666115 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a6efdab4a0 con 0x55a6efd07400 2024-09-13T23:57:05.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.857+0000 7ff3c896b700 1 -- 172.21.15.173:0/837666115 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a6efdcb800 con 0x55a6efd07400 2024-09-13T23:57:05.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.857+0000 7ff3c896b700 1 -- 172.21.15.173:0/837666115 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a6efdab600 con 0x55a6efd07400 2024-09-13T23:57:05.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.857+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/837666115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07400 msgr2=0x55a6effec580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.857+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/837666115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07400 0x55a6effec580 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x55a6effe7920 tx=0x55a6efe0b920 comp rx=0 tx=0).stop 2024-09-13T23:57:05.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.857+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/837666115 shutdown_connections 2024-09-13T23:57:05.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.857+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/837666115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07400 0x55a6effec580 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.857+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/837666115 >> 172.21.15.173:0/837666115 conn(0x55a6efd06c00 msgr2=0x55a6efe06000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.857+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/837666115 shutdown_connections 2024-09-13T23:57:05.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.857+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/837666115 wait complete. 2024-09-13T23:57:05.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.857+0000 7ff3cb1b4f40 1 Processor -- start 2024-09-13T23:57:05.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.857+0000 7ff3cb1b4f40 1 -- start start 2024-09-13T23:57:05.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.857+0000 7ff3cb1b4f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07000 0x55a6effec580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.857+0000 7ff3cb1b4f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6efd94500 con 0x55a6efd07000 2024-09-13T23:57:05.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.857+0000 7ff3c996d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07000 0x55a6effec580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.861+0000 7ff3c996d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07000 0x55a6effec580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50476/0 (socket says 172.21.15.173:50476) 2024-09-13T23:57:05.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.861+0000 7ff3c996d700 1 -- 172.21.15.173:0/3113036942 learned_addr learned my addr 172.21.15.173:0/3113036942 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.861+0000 7ff3c996d700 1 -- 172.21.15.173:0/3113036942 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6efd19ba0 con 0x55a6efd07000 2024-09-13T23:57:05.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.861+0000 7ff3c996d700 1 --2- 172.21.15.173:0/3113036942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07000 0x55a6effec580 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x55a6f0ad1d70 tx=0x55a6efe0bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c641f6f51077318 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.861+0000 7ff3c816a700 1 -- 172.21.15.173:0/3113036942 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a6efdab4a0 con 0x55a6efd07000 2024-09-13T23:57:05.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.861+0000 7ff3c816a700 1 -- 172.21.15.173:0/3113036942 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a6efdcbb00 con 0x55a6efd07000 2024-09-13T23:57:05.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.861+0000 7ff3c816a700 1 -- 172.21.15.173:0/3113036942 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a6efdab600 con 0x55a6efd07000 2024-09-13T23:57:05.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.861+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/3113036942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07000 msgr2=0x55a6effec580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.861+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/3113036942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07000 0x55a6effec580 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x55a6f0ad1d70 tx=0x55a6efe0bb60 comp rx=0 tx=0).stop 2024-09-13T23:57:05.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.861+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/3113036942 shutdown_connections 2024-09-13T23:57:05.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.861+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/3113036942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07000 0x55a6effec580 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.861+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/3113036942 >> 172.21.15.173:0/3113036942 conn(0x55a6efd06c00 msgr2=0x55a6efe07000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.861+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/3113036942 shutdown_connections 2024-09-13T23:57:05.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.861+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/3113036942 wait complete. 2024-09-13T23:57:05.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.861+0000 7ff3cb1b4f40 1 Processor -- start 2024-09-13T23:57:05.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.861+0000 7ff3cb1b4f40 1 -- start start 2024-09-13T23:57:05.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.861+0000 7ff3cb1b4f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07000 0x55a6effec580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.861+0000 7ff3cb1b4f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6efd943c0 con 0x55a6efd07000 2024-09-13T23:57:05.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.861+0000 7ff3c996d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07000 0x55a6effec580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.861+0000 7ff3c996d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07000 0x55a6effec580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50478/0 (socket says 172.21.15.173:50478) 2024-09-13T23:57:05.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.861+0000 7ff3c996d700 1 -- 172.21.15.173:0/2787723696 learned_addr learned my addr 172.21.15.173:0/2787723696 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.861+0000 7ff3c996d700 1 -- 172.21.15.173:0/2787723696 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6efd19a00 con 0x55a6efd07000 2024-09-13T23:57:05.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.865+0000 7ff3c996d700 1 --2- 172.21.15.173:0/2787723696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07000 0x55a6effec580 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x55a6f0ad1e00 tx=0x55a6efe0ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.865+0000 7ff3c6967700 1 -- 172.21.15.173:0/2787723696 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a6efdab8c0 con 0x55a6efd07000 2024-09-13T23:57:05.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.865+0000 7ff3c6967700 1 -- 172.21.15.173:0/2787723696 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a6efdcbc80 con 0x55a6efd07000 2024-09-13T23:57:05.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.865+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/2787723696 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a6efd19860 con 0x55a6efd07000 2024-09-13T23:57:05.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.865+0000 7ff3c6967700 1 -- 172.21.15.173:0/2787723696 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a6efdab4a0 con 0x55a6efd07000 2024-09-13T23:57:05.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.865+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/2787723696 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a6efd196c0 con 0x55a6efd07000 2024-09-13T23:57:05.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.865+0000 7ff3cb1b4f40 1 Processor -- start 2024-09-13T23:57:05.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.865+0000 7ff3cb1b4f40 1 -- start start 2024-09-13T23:57:05.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.865+0000 7ff3cb1b4f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07800 0x55a6effecb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.865+0000 7ff3cb1b4f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6efd94000 con 0x55a6efd07800 2024-09-13T23:57:05.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.865+0000 7ff3c6967700 1 -- 172.21.15.173:0/2787723696 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55a6efe00b00 con 0x55a6efd07000 2024-09-13T23:57:05.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.865+0000 7ff3ca16e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07800 0x55a6effecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.865+0000 7ff3ca16e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07800 0x55a6effecb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50492/0 (socket says 172.21.15.173:50492) 2024-09-13T23:57:05.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.865+0000 7ff3ca16e700 1 -- 172.21.15.173:0/2518416412 learned_addr learned my addr 172.21.15.173:0/2518416412 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.865+0000 7ff3c6967700 1 --2- 172.21.15.173:0/2787723696 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a6f00a8000 0x55a6effed080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.865+0000 7ff3c6967700 1 -- 172.21.15.173:0/2787723696 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55a6efd6d180 con 0x55a6efd07000 2024-09-13T23:57:05.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.865+0000 7ff3c996d700 1 --2- 172.21.15.173:0/2787723696 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a6f00a8000 0x55a6effed080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.865+0000 7ff3ca16e700 1 -- 172.21.15.173:0/2518416412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6efd18000 con 0x55a6efd07800 2024-09-13T23:57:05.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.865+0000 7ff3ca16e700 1 --2- 172.21.15.173:0/2518416412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07800 0x55a6effecb00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x55a6f00862a0 tx=0x55a6f0066a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd9370f9bf726c82 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.869+0000 7ff3c996d700 1 --2- 172.21.15.173:0/2787723696 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a6f00a8000 0x55a6effed080 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55a6f00334d0 tx=0x55a6f0066240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.869+0000 7ff3c4162700 1 -- 172.21.15.173:0/2518416412 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a6efdab8c0 con 0x55a6efd07800 2024-09-13T23:57:05.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.869+0000 7ff3c4162700 1 -- 172.21.15.173:0/2518416412 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a6f00c0000 con 0x55a6efd07800 2024-09-13T23:57:05.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.869+0000 7ff3c4162700 1 -- 172.21.15.173:0/2518416412 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a6efdab4a0 con 0x55a6efd07800 2024-09-13T23:57:05.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.869+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/2518416412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07800 msgr2=0x55a6effecb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.869+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/2518416412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07800 0x55a6effecb00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x55a6f00862a0 tx=0x55a6f0066a20 comp rx=0 tx=0).stop 2024-09-13T23:57:05.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.869+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/2518416412 shutdown_connections 2024-09-13T23:57:05.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.869+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/2518416412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07800 0x55a6effecb00 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.869+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/2518416412 >> 172.21.15.173:0/2518416412 conn(0x55a6efd07400 msgr2=0x55a6efe07800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.869+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/2518416412 shutdown_connections 2024-09-13T23:57:05.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.869+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/2518416412 wait complete. 2024-09-13T23:57:05.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.869+0000 7ff3cb1b4f40 1 Processor -- start 2024-09-13T23:57:05.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.869+0000 7ff3cb1b4f40 1 -- start start 2024-09-13T23:57:05.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.869+0000 7ff3cb1b4f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07800 0x55a6effecb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.869+0000 7ff3cb1b4f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6efd2c640 con 0x55a6efd07800 2024-09-13T23:57:05.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.869+0000 7ff3ca16e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07800 0x55a6effecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.869+0000 7ff3ca16e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07800 0x55a6effecb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50498/0 (socket says 172.21.15.173:50498) 2024-09-13T23:57:05.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.869+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 learned_addr learned my addr 172.21.15.173:0/4078734814 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.869+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6efd18ea0 con 0x55a6efd07800 2024-09-13T23:57:05.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.869+0000 7ff3ca16e700 1 --2- 172.21.15.173:0/4078734814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07800 0x55a6effecb00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x55a6f0ad1f50 tx=0x55a6f0066840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.869+0000 7ff3c295f700 1 -- 172.21.15.173:0/4078734814 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a6efdabb80 con 0x55a6efd07800 2024-09-13T23:57:05.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.869+0000 7ff3c295f700 1 -- 172.21.15.173:0/4078734814 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a6f00c0180 con 0x55a6efd07800 2024-09-13T23:57:05.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.869+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a6efd18820 con 0x55a6efd07800 2024-09-13T23:57:05.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.873+0000 7ff3c295f700 1 -- 172.21.15.173:0/4078734814 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a6efdab8c0 con 0x55a6efd07800 2024-09-13T23:57:05.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.873+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a6efd189c0 con 0x55a6efd07800 2024-09-13T23:57:05.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.873+0000 7ff3c295f700 1 -- 172.21.15.173:0/4078734814 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55a6efe01080 con 0x55a6efd07800 2024-09-13T23:57:05.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.873+0000 7ff3c295f700 1 --2- 172.21.15.173:0/4078734814 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a6f00a8c00 0x55a6effed600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.873+0000 7ff3c295f700 1 -- 172.21.15.173:0/4078734814 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55a6efd6d340 con 0x55a6efd07800 2024-09-13T23:57:05.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.873+0000 7ff3cb1b4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.873+0000 7ff3c916c700 1 --2- 172.21.15.173:0/4078734814 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a6f00a8c00 0x55a6effed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.873+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/4078734814 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a6f00a9000 0x55a6effedb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.873+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9400 con 0x55a6f00a9000 2024-09-13T23:57:05.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.873+0000 7ff3ca16e700 1 --2- 172.21.15.173:0/4078734814 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a6f00a9000 0x55a6effedb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.873+0000 7ff3c916c700 1 --2- 172.21.15.173:0/4078734814 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a6f00a8c00 0x55a6effed600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55a6effe7920 tx=0x55a6efe0b800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.873+0000 7ff3ca16e700 1 --2- 172.21.15.173:0/4078734814 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a6f00a9000 0x55a6effedb80 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.873+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f00a9000 2024-09-13T23:57:05.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.873+0000 7ff3cb1b4f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.873+0000 7ff3cb1b4f40 20 realm 2024-09-13T23:57:05.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.873+0000 7ff3cb1b4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.873+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9000 2024-09-13T23:57:05.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.877+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f00a9000 2024-09-13T23:57:05.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.877+0000 7ff3cb1b4f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.877+0000 7ff3cb1b4f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:05.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.877+0000 7ff3cb1b4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.877+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9c00 con 0x55a6f00a9000 2024-09-13T23:57:05.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.877+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f00a9000 2024-09-13T23:57:05.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.877+0000 7ff3cb1b4f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.877+0000 7ff3cb1b4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.877+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/4078734814 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a6f00a9400 0x55a6effee100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.877+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9400 2024-09-13T23:57:05.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.877+0000 7ff3c996d700 1 --2- 172.21.15.173:0/4078734814 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a6f00a9400 0x55a6effee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.877+0000 7ff3c996d700 1 --2- 172.21.15.173:0/4078734814 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a6f00a9400 0x55a6effee100 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.877+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55a6f015f200 con 0x55a6f00a9400 2024-09-13T23:57:05.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.877+0000 7ff3cb1b4f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:05.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.877+0000 7ff3cb1b4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.877+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/4078734814 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a6f00a9c00 0x55a6effee680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.877+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0166000 con 0x55a6f00a9c00 2024-09-13T23:57:05.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.877+0000 7ff3c916c700 1 --2- 172.21.15.173:0/4078734814 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a6f00a9c00 0x55a6effee680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.877+0000 7ff3c916c700 1 --2- 172.21.15.173:0/4078734814 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a6f00a9c00 0x55a6effee680 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.877+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55a6f015f440 con 0x55a6f00a9c00 2024-09-13T23:57:05.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.877+0000 7ff3cb1b4f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:05.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.877+0000 7ff3cb1b4f40 20 searching for the correct realm 2024-09-13T23:57:05.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.877+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0166400 con 0x55a6f00a9c00 2024-09-13T23:57:05.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.881+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55a6f015f440 con 0x55a6f00a9c00 2024-09-13T23:57:05.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.881+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0166000 con 0x55a6f00a9400 2024-09-13T23:57:05.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.881+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015f200 con 0x55a6f00a9400 2024-09-13T23:57:05.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.881+0000 7ff3c996d700 1 --2- 172.21.15.173:0/4078734814 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a6f0166000 0x55a6effeec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.881+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f0166000 2024-09-13T23:57:05.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.881+0000 7ff3ca16e700 1 --2- 172.21.15.173:0/4078734814 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a6f0166000 0x55a6effeec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.881+0000 7ff3ca16e700 1 --2- 172.21.15.173:0/4078734814 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a6f0166000 0x55a6effeec00 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.881+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f0166000 2024-09-13T23:57:05.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.881+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9000 2024-09-13T23:57:05.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.881+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f00a9000 2024-09-13T23:57:05.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.881+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9000 2024-09-13T23:57:05.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.881+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f00a9000 2024-09-13T23:57:05.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.881+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9c00 2024-09-13T23:57:05.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.881+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015f440 con 0x55a6f00a9c00 2024-09-13T23:57:05.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.881+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9000 2024-09-13T23:57:05.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.885+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f00a9000 2024-09-13T23:57:05.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.885+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9400 2024-09-13T23:57:05.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.885+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015f200 con 0x55a6f00a9400 2024-09-13T23:57:05.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.885+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9400 2024-09-13T23:57:05.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.885+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015f200 con 0x55a6f00a9400 2024-09-13T23:57:05.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.885+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9000 2024-09-13T23:57:05.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.885+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f00a9000 2024-09-13T23:57:05.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.885+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f0166000 2024-09-13T23:57:05.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.885+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f0166000 2024-09-13T23:57:05.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.885+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9000 2024-09-13T23:57:05.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.885+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f00a9000 2024-09-13T23:57:05.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.885+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f0166000 2024-09-13T23:57:05.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.885+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f0166000 2024-09-13T23:57:05.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.885+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9400 2024-09-13T23:57:05.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.889+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015f200 con 0x55a6f00a9400 2024-09-13T23:57:05.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.889+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9c00 2024-09-13T23:57:05.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.889+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015f440 con 0x55a6f00a9c00 2024-09-13T23:57:05.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.889+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9000 2024-09-13T23:57:05.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.889+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f00a9000 2024-09-13T23:57:05.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.889+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9400 2024-09-13T23:57:05.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.889+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015f200 con 0x55a6f00a9400 2024-09-13T23:57:05.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.889+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9c00 2024-09-13T23:57:05.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.889+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015f440 con 0x55a6f00a9c00 2024-09-13T23:57:05.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.889+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9000 2024-09-13T23:57:05.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.889+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f00a9000 2024-09-13T23:57:05.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.889+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9000 2024-09-13T23:57:05.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.889+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f00a9000 2024-09-13T23:57:05.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.889+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9000 2024-09-13T23:57:05.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.893+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f00a9000 2024-09-13T23:57:05.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.893+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9c00 2024-09-13T23:57:05.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.893+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015f440 con 0x55a6f00a9c00 2024-09-13T23:57:05.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.893+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f0166000 2024-09-13T23:57:05.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.893+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f0166000 2024-09-13T23:57:05.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.893+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9000 2024-09-13T23:57:05.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.893+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f00a9000 2024-09-13T23:57:05.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.893+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f0166000 2024-09-13T23:57:05.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.893+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f0166000 2024-09-13T23:57:05.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.893+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9c00 2024-09-13T23:57:05.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.893+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015f440 con 0x55a6f00a9c00 2024-09-13T23:57:05.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.893+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f0166000 2024-09-13T23:57:05.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.893+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f0166000 2024-09-13T23:57:05.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.893+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9400 2024-09-13T23:57:05.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.897+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015f200 con 0x55a6f00a9400 2024-09-13T23:57:05.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.897+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9400 2024-09-13T23:57:05.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.897+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015f200 con 0x55a6f00a9400 2024-09-13T23:57:05.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.897+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9c00 2024-09-13T23:57:05.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.897+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015f440 con 0x55a6f00a9c00 2024-09-13T23:57:05.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.897+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9400 2024-09-13T23:57:05.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.897+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55a6f015f200 con 0x55a6f00a9400 2024-09-13T23:57:05.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.897+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f00a9400 2024-09-13T23:57:05.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.897+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55a6f015f200 con 0x55a6f00a9400 2024-09-13T23:57:05.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.897+0000 7ff3cb1b4f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:05.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.897+0000 7ff3cb1b4f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:05.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.897+0000 7ff3cb1b4f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:05.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.897+0000 7ff3cb1b4f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:05.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.897+0000 7ff3cb1b4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.897+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0166800 con 0x55a6f00a9000 2024-09-13T23:57:05.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.897+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f00a9000 2024-09-13T23:57:05.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.897+0000 7ff3cb1b4f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.897+0000 7ff3cb1b4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.897+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0166c00 con 0x55a6f00a9400 2024-09-13T23:57:05.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55a6f015f200 con 0x55a6f00a9400 2024-09-13T23:57:05.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3cb1b4f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:05.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3cb1b4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0167000 con 0x55a6f00a9000 2024-09-13T23:57:05.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f00a9000 2024-09-13T23:57:05.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3cb1b4f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:05.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3cb1b4f40 20 zone default found 2024-09-13T23:57:05.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3cb1b4f40 4 Realm: () 2024-09-13T23:57:05.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3cb1b4f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:05.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3cb1b4f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:05.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3cb1b4f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:05.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3cb1b4f40 20 zonegroup default 2024-09-13T23:57:05.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3cb1b4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0167400 con 0x55a6f0166000 2024-09-13T23:57:05.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f0166000 2024-09-13T23:57:05.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3cb1b4f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3cb1b4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0167800 con 0x55a6f00a9c00 2024-09-13T23:57:05.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55a6f015f440 con 0x55a6f00a9c00 2024-09-13T23:57:05.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3cb1b4f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3cb1b4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0167c00 con 0x55a6f00a9c00 2024-09-13T23:57:05.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55a6f015f440 con 0x55a6f00a9c00 2024-09-13T23:57:05.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3cb1b4f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:05.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3cb1b4f40 20 started sync module instance, tier type = 2024-09-13T23:57:05.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3cb1b4f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:05.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.901+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0170000 con 0x55a6f00a9400 2024-09-13T23:57:05.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.905+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a6f015f200 con 0x55a6f00a9400 2024-09-13T23:57:05.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.905+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94175479347968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0170400 con 0x55a6f00a9400 2024-09-13T23:57:05.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.905+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0170800 con 0x55a6f00a9000 2024-09-13T23:57:05.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.909+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f00a9000 2024-09-13T23:57:05.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.909+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94175479349120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0170c00 con 0x55a6f00a9000 2024-09-13T23:57:05.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.909+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0171000 con 0x55a6f00a9400 2024-09-13T23:57:05.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.909+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94175479347968] v33'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a6f015f200 con 0x55a6f00a9400 2024-09-13T23:57:05.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.909+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94175479349120] v33'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f00a9000 2024-09-13T23:57:05.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.909+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a6f015f200 con 0x55a6f00a9400 2024-09-13T23:57:05.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.909+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94175479350272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0171400 con 0x55a6f00a9400 2024-09-13T23:57:05.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.909+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0171800 con 0x55a6f0166000 2024-09-13T23:57:05.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.913+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f0166000 2024-09-13T23:57:05.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.913+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94175479351424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0171c00 con 0x55a6f0166000 2024-09-13T23:57:05.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.913+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0170800 con 0x55a6f00a9400 2024-09-13T23:57:05.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.913+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94175479350272] v33'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a6f015f200 con 0x55a6f00a9400 2024-09-13T23:57:05.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.917+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94175479351424] v33'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f0166000 2024-09-13T23:57:05.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.917+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a6f015f200 con 0x55a6f00a9400 2024-09-13T23:57:05.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.917+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94175479352576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0170000 con 0x55a6f00a9400 2024-09-13T23:57:05.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.917+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0166800 con 0x55a6f00a9c00 2024-09-13T23:57:05.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.917+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a6f015f440 con 0x55a6f00a9c00 2024-09-13T23:57:05.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.917+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94175479352576] v33'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a6f015f200 con 0x55a6f00a9400 2024-09-13T23:57:05.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.917+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94175479353728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0167000 con 0x55a6f00a9c00 2024-09-13T23:57:05.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.917+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0167400 con 0x55a6f00a9c00 2024-09-13T23:57:05.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.921+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94175479353728] v33'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a6f015f440 con 0x55a6f00a9c00 2024-09-13T23:57:05.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.921+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a6f015f440 con 0x55a6f00a9c00 2024-09-13T23:57:05.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.921+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94175479354880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0166c00 con 0x55a6f00a9c00 2024-09-13T23:57:05.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.921+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00a9800 con 0x55a6f0166000 2024-09-13T23:57:05.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.921+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94175479354880] v33'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a6f015f440 con 0x55a6f00a9c00 2024-09-13T23:57:05.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.921+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f0166000 2024-09-13T23:57:05.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.921+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94175479356032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0170400 con 0x55a6f0166000 2024-09-13T23:57:05.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.921+0000 7ff3cb1b4f40 20 add_watcher() i=0 2024-09-13T23:57:05.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.921+0000 7ff3cb1b4f40 20 add_watcher() i=1 2024-09-13T23:57:05.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.921+0000 7ff3cb1b4f40 20 add_watcher() i=2 2024-09-13T23:57:05.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.921+0000 7ff3cb1b4f40 20 add_watcher() i=3 2024-09-13T23:57:05.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.921+0000 7ff3cb1b4f40 20 add_watcher() i=4 2024-09-13T23:57:05.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.921+0000 7ff3cb1b4f40 20 add_watcher() i=5 2024-09-13T23:57:05.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.921+0000 7ff3cb1b4f40 20 add_watcher() i=6 2024-09-13T23:57:05.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.925+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94175479356032] v33'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f0166000 2024-09-13T23:57:05.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.925+0000 7ff3cb1b4f40 20 add_watcher() i=7 2024-09-13T23:57:05.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.925+0000 7ff3cb1b4f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:05.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.925+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0171000 con 0x55a6f00a9000 2024-09-13T23:57:05.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.925+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f00a9000 2024-09-13T23:57:05.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.925+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94175480995840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0171400 con 0x55a6f00a9000 2024-09-13T23:57:05.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94175480995840] v33'130 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f00a9000 2024-09-13T23:57:05.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3b093b700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:05.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3cb1b4f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:05.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3cb1b4f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:05.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3cb1b4f40 1 Processor -- start 2024-09-13T23:57:05.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3cb1b4f40 1 -- start start 2024-09-13T23:57:05.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3cb1b4f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6f0166400 0x55a6effef180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3cb1b4f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6efd2c780 con 0x55a6f0166400 2024-09-13T23:57:05.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3c916c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6f0166400 0x55a6effef180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3c916c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6f0166400 0x55a6effef180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50506/0 (socket says 172.21.15.173:50506) 2024-09-13T23:57:05.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3c916c700 1 -- 172.21.15.173:0/2080719194 learned_addr learned my addr 172.21.15.173:0/2080719194 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3c916c700 1 -- 172.21.15.173:0/2080719194 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6efd18b60 con 0x55a6f0166400 2024-09-13T23:57:05.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3c916c700 1 --2- 172.21.15.173:0/2080719194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6f0166400 0x55a6effef180 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x55a6f017e0c0 tx=0x55a6efe0b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f68cbf454e2727 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3b013a700 1 -- 172.21.15.173:0/2080719194 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a6efdab760 con 0x55a6f0166400 2024-09-13T23:57:05.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3b013a700 1 -- 172.21.15.173:0/2080719194 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a6f00c0600 con 0x55a6f0166400 2024-09-13T23:57:05.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3b013a700 1 -- 172.21.15.173:0/2080719194 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a6f0186000 con 0x55a6f0166400 2024-09-13T23:57:05.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/2080719194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6f0166400 msgr2=0x55a6effef180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/2080719194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6f0166400 0x55a6effef180 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x55a6f017e0c0 tx=0x55a6efe0b980 comp rx=0 tx=0).stop 2024-09-13T23:57:05.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/2080719194 shutdown_connections 2024-09-13T23:57:05.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/2080719194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6f0166400 0x55a6effef180 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/2080719194 >> 172.21.15.173:0/2080719194 conn(0x55a6f0170800 msgr2=0x55a6efe08000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/2080719194 shutdown_connections 2024-09-13T23:57:05.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/2080719194 wait complete. 2024-09-13T23:57:05.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3cb1b4f40 1 Processor -- start 2024-09-13T23:57:05.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.929+0000 7ff3cb1b4f40 1 -- start start 2024-09-13T23:57:05.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.933+0000 7ff3cb1b4f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6f0166400 0x55a6effef180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.933+0000 7ff3cb1b4f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6efd94000 con 0x55a6f0166400 2024-09-13T23:57:05.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.933+0000 7ff3c916c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6f0166400 0x55a6effef180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.933+0000 7ff3c916c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6f0166400 0x55a6effef180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50522/0 (socket says 172.21.15.173:50522) 2024-09-13T23:57:05.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.933+0000 7ff3c916c700 1 -- 172.21.15.173:0/1531035335 learned_addr learned my addr 172.21.15.173:0/1531035335 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:05.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.933+0000 7ff3c916c700 1 -- 172.21.15.173:0/1531035335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6efd18d00 con 0x55a6f0166400 2024-09-13T23:57:05.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.933+0000 7ff3c916c700 1 --2- 172.21.15.173:0/1531035335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6f0166400 0x55a6effef180 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x55a6f017e2d0 tx=0x55a6f0067c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.933+0000 7ff3ae937700 1 -- 172.21.15.173:0/1531035335 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a6f0186160 con 0x55a6f0166400 2024-09-13T23:57:05.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.933+0000 7ff3ae937700 1 -- 172.21.15.173:0/1531035335 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a6f00c0300 con 0x55a6f0166400 2024-09-13T23:57:05.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.933+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/1531035335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a6efd18340 con 0x55a6f0166400 2024-09-13T23:57:05.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.933+0000 7ff3ae937700 1 -- 172.21.15.173:0/1531035335 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55a6f01862c0 con 0x55a6f0166400 2024-09-13T23:57:05.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.933+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/1531035335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a6efd19d40 con 0x55a6f0166400 2024-09-13T23:57:05.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.933+0000 7ff3ae937700 1 -- 172.21.15.173:0/1531035335 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55a6efe01b80 con 0x55a6f0166400 2024-09-13T23:57:05.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.933+0000 7ff3ae937700 1 --2- 172.21.15.173:0/1531035335 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a6f00a9800 0x55a6f0204000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:05.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.933+0000 7ff3ae937700 1 -- 172.21.15.173:0/1531035335 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55a6efd6d500 con 0x55a6f0166400 2024-09-13T23:57:05.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.933+0000 7ff3cb1b4f40 5 note: GC not initialized 2024-09-13T23:57:05.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.933+0000 7ff3ca16e700 1 --2- 172.21.15.173:0/1531035335 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a6f00a9800 0x55a6f0204000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:05.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.937+0000 7ff3ca16e700 1 --2- 172.21.15.173:0/1531035335 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a6f00a9800 0x55a6f0204000 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55a6f01037a0 tx=0x55a6f01caae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:05.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.937+0000 7ff3ac132700 20 reqs_thread_entry: start 2024-09-13T23:57:05.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.937+0000 7ff3cb1b4f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:05.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.937+0000 7ff3cb1b4f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:05.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.937+0000 7ff3aa12e700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:36 2024 2024-09-13T23:57:05.943 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:05.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.937+0000 7ff3a990c700 20 reqs_thread_entry: start 2024-09-13T23:57:05.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.937+0000 7ff3cb1b4f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:05.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.937+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0166800 con 0x55a6f00a9000 2024-09-13T23:57:05.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.937+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 281+0+332 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f00a9000 2024-09-13T23:57:05.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.937+0000 7ff3cb1b4f40 20 rados_obj.operate() r=0 bl.length=193 2024-09-13T23:57:05.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.941+0000 7ff3b093b700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:05.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.941+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94175480995840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0170c00 con 0x55a6f00a9000 2024-09-13T23:57:05.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.941+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94175480995840] v33'131 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f00a9000 2024-09-13T23:57:05.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.941+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94175479347968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0171800 con 0x55a6f00a9400 2024-09-13T23:57:05.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.945+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94175479347968] v33'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a6f015f200 con 0x55a6f00a9400 2024-09-13T23:57:05.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.945+0000 7ff3cb1b4f40 20 remove_watcher() i=0 2024-09-13T23:57:05.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.945+0000 7ff3cb1b4f40 2 removed watcher, disabling cache 2024-09-13T23:57:05.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.945+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94175479349120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0171c00 con 0x55a6f00a9000 2024-09-13T23:57:05.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.945+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94175479349120] v33'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f00a9000 2024-09-13T23:57:05.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.945+0000 7ff3cb1b4f40 20 remove_watcher() i=1 2024-09-13T23:57:05.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.945+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94175479350272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f0170400 con 0x55a6f00a9400 2024-09-13T23:57:05.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.949+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94175479350272] v33'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a6f015f200 con 0x55a6f00a9400 2024-09-13T23:57:05.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.949+0000 7ff3cb1b4f40 20 remove_watcher() i=2 2024-09-13T23:57:05.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.949+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94175479351424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00ce000 con 0x55a6f0166000 2024-09-13T23:57:05.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.953+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94175479351424] v33'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f0166000 2024-09-13T23:57:05.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.953+0000 7ff3cb1b4f40 20 remove_watcher() i=3 2024-09-13T23:57:05.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.953+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94175479352576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00ce400 con 0x55a6f00a9400 2024-09-13T23:57:05.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.953+0000 7ff3c996d700 1 -- 172.21.15.173:0/4078734814 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94175479352576] v33'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a6f015f200 con 0x55a6f00a9400 2024-09-13T23:57:05.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.953+0000 7ff3cb1b4f40 20 remove_watcher() i=4 2024-09-13T23:57:05.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.953+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94175479353728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00ce800 con 0x55a6f00a9c00 2024-09-13T23:57:05.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.957+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94175479353728] v33'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a6f015f440 con 0x55a6f00a9c00 2024-09-13T23:57:05.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.957+0000 7ff3cb1b4f40 20 remove_watcher() i=5 2024-09-13T23:57:05.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.957+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94175479354880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00cec00 con 0x55a6f00a9c00 2024-09-13T23:57:05.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.965+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94175479354880] v33'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a6f015f440 con 0x55a6f00a9c00 2024-09-13T23:57:05.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.965+0000 7ff3cb1b4f40 20 remove_watcher() i=6 2024-09-13T23:57:05.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.965+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94175479356032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a6f00cf000 con 0x55a6f0166000 2024-09-13T23:57:05.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.965+0000 7ff3ca16e700 1 -- 172.21.15.173:0/4078734814 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94175479356032] v33'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55a6f015eb40 con 0x55a6f0166000 2024-09-13T23:57:05.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.965+0000 7ff3cb1b4f40 20 remove_watcher() i=7 2024-09-13T23:57:05.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.965+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a6f00a9400 msgr2=0x55a6effee100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.965+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/4078734814 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55a6f00a9400 0x55a6effee100 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.965+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a6f00a9000 msgr2=0x55a6effedb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.965+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/4078734814 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55a6f00a9000 0x55a6effedb80 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.965+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a6f0166000 msgr2=0x55a6effeec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.965+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/4078734814 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55a6f0166000 0x55a6effeec00 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.965+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a6f00a9c00 msgr2=0x55a6effee680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.965+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/4078734814 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55a6f00a9c00 0x55a6effee680 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.965+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a6f00a8c00 msgr2=0x55a6effed600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.965+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/4078734814 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a6f00a8c00 0x55a6effed600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55a6effe7920 tx=0x55a6efe0b800 comp rx=0 tx=0).stop 2024-09-13T23:57:05.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.965+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07800 msgr2=0x55a6effecb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.965+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/4078734814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07800 0x55a6effecb00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x55a6f0ad1f50 tx=0x55a6f0066840 comp rx=0 tx=0).stop 2024-09-13T23:57:05.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.965+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 reap_dead start 2024-09-13T23:57:05.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.965+0000 7ff3c916c700 1 -- 172.21.15.173:0/4078734814 reap_dead start 2024-09-13T23:57:05.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.969+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 shutdown_connections 2024-09-13T23:57:05.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.969+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 >> 172.21.15.173:0/4078734814 conn(0x55a6efd07400 msgr2=0x55a6efe07800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.969+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 shutdown_connections 2024-09-13T23:57:05.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.969+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/4078734814 wait complete. 2024-09-13T23:57:05.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.969+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/1531035335 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a6f00a9800 msgr2=0x55a6f0204000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.969+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/1531035335 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a6f00a9800 0x55a6f0204000 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55a6f01037a0 tx=0x55a6f01caae0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.969+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/1531035335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6f0166400 msgr2=0x55a6effef180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.969+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/1531035335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6f0166400 0x55a6effef180 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x55a6f017e2d0 tx=0x55a6f0067c20 comp rx=0 tx=0).stop 2024-09-13T23:57:05.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.969+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/1531035335 shutdown_connections 2024-09-13T23:57:05.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.969+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/1531035335 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a6f00a9800 0x55a6f0204000 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.969+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/1531035335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6f0166400 0x55a6effef180 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.969+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/1531035335 >> 172.21.15.173:0/1531035335 conn(0x55a6f0170800 msgr2=0x55a6efe08000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.969+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/1531035335 shutdown_connections 2024-09-13T23:57:05.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.969+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/1531035335 wait complete. 2024-09-13T23:57:05.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.969+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/2787723696 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a6f00a8000 msgr2=0x55a6effed080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.969+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/2787723696 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a6f00a8000 0x55a6effed080 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55a6f00334d0 tx=0x55a6f0066240 comp rx=0 tx=0).stop 2024-09-13T23:57:05.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.969+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/2787723696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07000 msgr2=0x55a6effec580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:05.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.969+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/2787723696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07000 0x55a6effec580 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x55a6f0ad1e00 tx=0x55a6efe0ba40 comp rx=0 tx=0).stop 2024-09-13T23:57:05.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.969+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/2787723696 shutdown_connections 2024-09-13T23:57:05.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.969+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/2787723696 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55a6f00a8000 0x55a6effed080 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.969+0000 7ff3cb1b4f40 1 --2- 172.21.15.173:0/2787723696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55a6efd07000 0x55a6effec580 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:05.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.969+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/2787723696 >> 172.21.15.173:0/2787723696 conn(0x55a6efd06c00 msgr2=0x55a6efe07000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:05.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.969+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/2787723696 shutdown_connections 2024-09-13T23:57:05.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:05.969+0000 7ff3cb1b4f40 1 -- 172.21.15.173:0/2787723696 wait complete. 2024-09-13T23:57:05.978 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:05.978 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "bucket:testx/myfoo", 2024-09-13T23:57:05.978 INFO:teuthology.orchestra.run.smithi173.stdout: "ver": { 2024-09-13T23:57:05.978 INFO:teuthology.orchestra.run.smithi173.stdout: "tag": "Org6g07mKrxoJLfWjip8J1+F", 2024-09-13T23:57:05.979 INFO:teuthology.orchestra.run.smithi173.stdout: "ver": 2 2024-09-13T23:57:05.979 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:05.979 INFO:teuthology.orchestra.run.smithi173.stdout: "mtime": "2024-09-13T23:57:05.774275Z", 2024-09-13T23:57:05.979 INFO:teuthology.orchestra.run.smithi173.stdout: "data": { 2024-09-13T23:57:05.979 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": { 2024-09-13T23:57:05.979 INFO:teuthology.orchestra.run.smithi173.stdout: "name": "myfoo", 2024-09-13T23:57:05.979 INFO:teuthology.orchestra.run.smithi173.stdout: "marker": "d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1", 2024-09-13T23:57:05.979 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_id": "d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1", 2024-09-13T23:57:05.979 INFO:teuthology.orchestra.run.smithi173.stdout: "tenant": "testx", 2024-09-13T23:57:05.979 INFO:teuthology.orchestra.run.smithi173.stdout: "explicit_placement": { 2024-09-13T23:57:05.979 INFO:teuthology.orchestra.run.smithi173.stdout: "data_pool": "", 2024-09-13T23:57:05.979 INFO:teuthology.orchestra.run.smithi173.stdout: "data_extra_pool": "", 2024-09-13T23:57:05.979 INFO:teuthology.orchestra.run.smithi173.stdout: "index_pool": "" 2024-09-13T23:57:05.980 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:05.980 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:05.980 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "testx$tenanteduser", 2024-09-13T23:57:05.980 INFO:teuthology.orchestra.run.smithi173.stdout: "creation_time": "2024-09-13T23:57:02.413869Z", 2024-09-13T23:57:05.980 INFO:teuthology.orchestra.run.smithi173.stdout: "linked": true, 2024-09-13T23:57:05.980 INFO:teuthology.orchestra.run.smithi173.stdout: "has_bucket_info": false 2024-09-13T23:57:05.980 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:05.980 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:05.982 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'Org6g07mKrxoJLfWjip8J1+F', 'ver': 2}, 'mtime': '2024-09-13T23:57:05.774275Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.1', 'bucket_id': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-13T23:57:02.413869Z', 'linked': True, 'has_bucket_info': False}} 2024-09-13T23:57:05.982 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-13T23:57:05.982 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-13T23:57:05.983 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-13T23:57:06.072 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:06.073 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:06.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.065+0000 7f8e5fadbf40 1 Processor -- start 2024-09-13T23:57:06.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.069+0000 7f8e5fadbf40 1 -- start start 2024-09-13T23:57:06.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.069+0000 7f8e5fadbf40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55fc2539f400 0x55fc25684580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.069+0000 7f8e5fadbf40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55fc25463500 con 0x55fc2539f000 2024-09-13T23:57:06.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.069+0000 7f8e5fadbf40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55fc2542ca00 con 0x55fc2539f400 2024-09-13T23:57:06.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.069+0000 7f8e5da93700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55fc2539f400 0x55fc25684580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.069+0000 7f8e5e294700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55fc2539f000 0x55fc2549e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47526/0 (socket says 172.21.15.173:47526) 2024-09-13T23:57:06.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.069+0000 7f8e5e294700 1 -- 172.21.15.173:0/2394277598 learned_addr learned my addr 172.21.15.173:0/2394277598 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:06.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.069+0000 7f8e5d292700 1 -- 172.21.15.173:0/2394277598 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984369507 0 0) 0x55fc254fa000 con 0x55fc2539f000 2024-09-13T23:57:06.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.069+0000 7f8e5d292700 1 -- 172.21.15.173:0/2394277598 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x55fc25463680 con 0x55fc2539f000 2024-09-13T23:57:06.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.069+0000 7f8e5da93700 1 -- 172.21.15.173:0/2394277598 >> v1:172.21.15.87:6789/0 conn(0x55fc2539f000 legacy=0x55fc2549e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.069+0000 7f8e5da93700 1 -- 172.21.15.173:0/2394277598 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc253b1d40 con 0x55fc2539f400 2024-09-13T23:57:06.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.069+0000 7f8e5da93700 1 --2- 172.21.15.173:0/2394277598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f400 0x55fc25684580 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x55fc2567f920 tx=0x55fc254a3980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d00f1b43e2efbf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.069+0000 7f8e5d292700 1 -- 172.21.15.173:0/2394277598 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fc254434a0 con 0x55fc2539f400 2024-09-13T23:57:06.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.069+0000 7f8e5d292700 1 -- 172.21.15.173:0/2394277598 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc25463500 con 0x55fc2539f400 2024-09-13T23:57:06.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.069+0000 7f8e5d292700 1 -- 172.21.15.173:0/2394277598 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fc25443600 con 0x55fc2539f400 2024-09-13T23:57:06.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.069+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/2394277598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f400 msgr2=0x55fc25684580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.069+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/2394277598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f400 0x55fc25684580 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x55fc2567f920 tx=0x55fc254a3980 comp rx=0 tx=0).stop 2024-09-13T23:57:06.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.069+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/2394277598 shutdown_connections 2024-09-13T23:57:06.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.069+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/2394277598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f400 0x55fc25684580 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.069+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/2394277598 >> 172.21.15.173:0/2394277598 conn(0x55fc2539ec00 msgr2=0x55fc2549e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.069+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/2394277598 shutdown_connections 2024-09-13T23:57:06.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.069+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/2394277598 wait complete. 2024-09-13T23:57:06.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.073+0000 7f8e5fadbf40 1 Processor -- start 2024-09-13T23:57:06.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.073+0000 7f8e5fadbf40 1 -- start start 2024-09-13T23:57:06.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.073+0000 7f8e5fadbf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f000 0x55fc25684580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.073+0000 7f8e5fadbf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc2542c500 con 0x55fc2539f000 2024-09-13T23:57:06.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.073+0000 7f8e5e294700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f000 0x55fc25684580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.073+0000 7f8e5e294700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f000 0x55fc25684580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50542/0 (socket says 172.21.15.173:50542) 2024-09-13T23:57:06.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.073+0000 7f8e5e294700 1 -- 172.21.15.173:0/916082172 learned_addr learned my addr 172.21.15.173:0/916082172 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.073+0000 7f8e5e294700 1 -- 172.21.15.173:0/916082172 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc253b1ba0 con 0x55fc2539f000 2024-09-13T23:57:06.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.073+0000 7f8e5e294700 1 --2- 172.21.15.173:0/916082172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f000 0x55fc25684580 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x55fc26169d70 tx=0x55fc254a3b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad2708b106ee8f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.073+0000 7f8e5ca91700 1 -- 172.21.15.173:0/916082172 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fc254434a0 con 0x55fc2539f000 2024-09-13T23:57:06.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.073+0000 7f8e5ca91700 1 -- 172.21.15.173:0/916082172 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc25463b00 con 0x55fc2539f000 2024-09-13T23:57:06.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.073+0000 7f8e5ca91700 1 -- 172.21.15.173:0/916082172 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fc25443600 con 0x55fc2539f000 2024-09-13T23:57:06.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.077+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/916082172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f000 msgr2=0x55fc25684580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.077+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/916082172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f000 0x55fc25684580 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x55fc26169d70 tx=0x55fc254a3b60 comp rx=0 tx=0).stop 2024-09-13T23:57:06.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.077+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/916082172 shutdown_connections 2024-09-13T23:57:06.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.077+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/916082172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f000 0x55fc25684580 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.077+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/916082172 >> 172.21.15.173:0/916082172 conn(0x55fc2539ec00 msgr2=0x55fc2549f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.077+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/916082172 shutdown_connections 2024-09-13T23:57:06.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.077+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/916082172 wait complete. 2024-09-13T23:57:06.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.077+0000 7f8e5fadbf40 1 Processor -- start 2024-09-13T23:57:06.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.077+0000 7f8e5fadbf40 1 -- start start 2024-09-13T23:57:06.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.077+0000 7f8e5fadbf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f000 0x55fc25684580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.077+0000 7f8e5fadbf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc2542c3c0 con 0x55fc2539f000 2024-09-13T23:57:06.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.077+0000 7f8e5e294700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f000 0x55fc25684580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.077+0000 7f8e5e294700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f000 0x55fc25684580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50552/0 (socket says 172.21.15.173:50552) 2024-09-13T23:57:06.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.077+0000 7f8e5e294700 1 -- 172.21.15.173:0/1203102622 learned_addr learned my addr 172.21.15.173:0/1203102622 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.077+0000 7f8e5e294700 1 -- 172.21.15.173:0/1203102622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc253b1a00 con 0x55fc2539f000 2024-09-13T23:57:06.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.081+0000 7f8e5e294700 1 --2- 172.21.15.173:0/1203102622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f000 0x55fc25684580 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x55fc26169e00 tx=0x55fc254a3920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.081+0000 7f8e5b28e700 1 -- 172.21.15.173:0/1203102622 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fc254438c0 con 0x55fc2539f000 2024-09-13T23:57:06.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.081+0000 7f8e5b28e700 1 -- 172.21.15.173:0/1203102622 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc25463c80 con 0x55fc2539f000 2024-09-13T23:57:06.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.081+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/1203102622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fc253b1860 con 0x55fc2539f000 2024-09-13T23:57:06.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.081+0000 7f8e5b28e700 1 -- 172.21.15.173:0/1203102622 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fc254434a0 con 0x55fc2539f000 2024-09-13T23:57:06.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.081+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/1203102622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc253b16c0 con 0x55fc2539f000 2024-09-13T23:57:06.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.081+0000 7f8e5fadbf40 1 Processor -- start 2024-09-13T23:57:06.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.081+0000 7f8e5b28e700 1 -- 172.21.15.173:0/1203102622 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55fc25498b00 con 0x55fc2539f000 2024-09-13T23:57:06.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.081+0000 7f8e5fadbf40 1 -- start start 2024-09-13T23:57:06.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.081+0000 7f8e5b28e700 1 --2- 172.21.15.173:0/1203102622 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fc25736000 0x55fc25685080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.081+0000 7f8e5b28e700 1 -- 172.21.15.173:0/1203102622 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55fc25405180 con 0x55fc2539f000 2024-09-13T23:57:06.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.081+0000 7f8e5fadbf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f800 0x55fc25684b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.081+0000 7f8e5fadbf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc253c4640 con 0x55fc2539f800 2024-09-13T23:57:06.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.081+0000 7f8e5ea95700 1 --2- 172.21.15.173:0/1203102622 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fc25736000 0x55fc25685080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.081+0000 7f8e5e294700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f800 0x55fc25684b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.081+0000 7f8e5e294700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f800 0x55fc25684b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50568/0 (socket says 172.21.15.173:50568) 2024-09-13T23:57:06.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.081+0000 7f8e5e294700 1 -- 172.21.15.173:0/2535625877 learned_addr learned my addr 172.21.15.173:0/2535625877 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.081+0000 7f8e5e294700 1 -- 172.21.15.173:0/2535625877 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc253b0000 con 0x55fc2539f800 2024-09-13T23:57:06.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.081+0000 7f8e5ea95700 1 --2- 172.21.15.173:0/1203102622 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fc25736000 0x55fc25685080 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55fc256c2e10 tx=0x55fc256faa20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.081+0000 7f8e5e294700 1 --2- 172.21.15.173:0/2535625877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f800 0x55fc25684b00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x55fc256c2360 tx=0x55fc256fa240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bddab0c0c9acaab9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.085+0000 7f8e58a89700 1 -- 172.21.15.173:0/2535625877 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fc25443600 con 0x55fc2539f800 2024-09-13T23:57:06.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.085+0000 7f8e58a89700 1 -- 172.21.15.173:0/2535625877 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc25463c80 con 0x55fc2539f800 2024-09-13T23:57:06.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.085+0000 7f8e58a89700 1 -- 172.21.15.173:0/2535625877 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fc25443a20 con 0x55fc2539f800 2024-09-13T23:57:06.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.085+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/2535625877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f800 msgr2=0x55fc25684b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.085+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/2535625877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f800 0x55fc25684b00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x55fc256c2360 tx=0x55fc256fa240 comp rx=0 tx=0).stop 2024-09-13T23:57:06.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.085+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/2535625877 shutdown_connections 2024-09-13T23:57:06.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.085+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/2535625877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f800 0x55fc25684b00 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.085+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/2535625877 >> 172.21.15.173:0/2535625877 conn(0x55fc2539f400 msgr2=0x55fc2549f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.085+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/2535625877 shutdown_connections 2024-09-13T23:57:06.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.085+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/2535625877 wait complete. 2024-09-13T23:57:06.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.085+0000 7f8e5fadbf40 1 Processor -- start 2024-09-13T23:57:06.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.085+0000 7f8e5fadbf40 1 -- start start 2024-09-13T23:57:06.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.085+0000 7f8e5fadbf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f800 0x55fc25684b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.085+0000 7f8e5fadbf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc253c48c0 con 0x55fc2539f800 2024-09-13T23:57:06.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.085+0000 7f8e5e294700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f800 0x55fc25684b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.085+0000 7f8e5e294700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f800 0x55fc25684b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50580/0 (socket says 172.21.15.173:50580) 2024-09-13T23:57:06.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.085+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 learned_addr learned my addr 172.21.15.173:0/3199391417 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.085+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc253b0ea0 con 0x55fc2539f800 2024-09-13T23:57:06.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.085+0000 7f8e5e294700 1 --2- 172.21.15.173:0/3199391417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f800 0x55fc25684b00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x55fc25724a50 tx=0x55fc256fac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.085+0000 7f8e57286700 1 -- 172.21.15.173:0/3199391417 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fc25443600 con 0x55fc2539f800 2024-09-13T23:57:06.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.089+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fc253b0820 con 0x55fc2539f800 2024-09-13T23:57:06.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.089+0000 7f8e57286700 1 -- 172.21.15.173:0/3199391417 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc25754000 con 0x55fc2539f800 2024-09-13T23:57:06.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.089+0000 7f8e57286700 1 -- 172.21.15.173:0/3199391417 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fc25443a20 con 0x55fc2539f800 2024-09-13T23:57:06.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.089+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc253b09c0 con 0x55fc2539f800 2024-09-13T23:57:06.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.089+0000 7f8e5fadbf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.089+0000 7f8e57286700 1 -- 172.21.15.173:0/3199391417 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55fc25498dc0 con 0x55fc2539f800 2024-09-13T23:57:06.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.089+0000 7f8e57286700 1 --2- 172.21.15.173:0/3199391417 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fc25737000 0x55fc25685600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.089+0000 7f8e57286700 1 -- 172.21.15.173:0/3199391417 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55fc25405340 con 0x55fc2539f800 2024-09-13T23:57:06.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.089+0000 7f8e5da93700 1 --2- 172.21.15.173:0/3199391417 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fc25737000 0x55fc25685600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.089+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/3199391417 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55fc25737400 0x55fc25685b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.089+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc25737800 con 0x55fc25737400 2024-09-13T23:57:06.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.089+0000 7f8e5ea95700 1 --2- 172.21.15.173:0/3199391417 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55fc25737400 0x55fc25685b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.089+0000 7f8e5da93700 1 --2- 172.21.15.173:0/3199391417 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fc25737000 0x55fc25685600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55fc2567f920 tx=0x55fc254a3800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.089+0000 7f8e5ea95700 1 --2- 172.21.15.173:0/3199391417 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55fc25737400 0x55fc25685b80 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.089+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.089+0000 7f8e5fadbf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.089+0000 7f8e5fadbf40 20 realm 2024-09-13T23:57:06.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.089+0000 7f8e5fadbf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.089+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc25737c00 con 0x55fc25737400 2024-09-13T23:57:06.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.093+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.093+0000 7f8e5fadbf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.093+0000 7f8e5fadbf40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:06.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.093+0000 7f8e5fadbf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.093+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc25737800 con 0x55fc25737400 2024-09-13T23:57:06.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.093+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.093+0000 7f8e5fadbf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.093+0000 7f8e5fadbf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.093+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/3199391417 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55fc25737c00 0x55fc25686100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.093+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc25737c00 2024-09-13T23:57:06.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.093+0000 7f8e5e294700 1 --2- 172.21.15.173:0/3199391417 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55fc25737c00 0x55fc25686100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.093+0000 7f8e5e294700 1 --2- 172.21.15.173:0/3199391417 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55fc25737c00 0x55fc25686100 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.093+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.093+0000 7f8e5fadbf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:06.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.093+0000 7f8e5fadbf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.093+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/3199391417 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55fc257ca400 0x55fc25686680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.093+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca800 con 0x55fc257ca400 2024-09-13T23:57:06.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.093+0000 7f8e5da93700 1 --2- 172.21.15.173:0/3199391417 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55fc257ca400 0x55fc25686680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.093+0000 7f8e5da93700 1 --2- 172.21.15.173:0/3199391417 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55fc257ca400 0x55fc25686680 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.093+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55fc257ab440 con 0x55fc257ca400 2024-09-13T23:57:06.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.093+0000 7f8e5fadbf40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:06.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.093+0000 7f8e5fadbf40 20 searching for the correct realm 2024-09-13T23:57:06.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.093+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257cac00 con 0x55fc257ca400 2024-09-13T23:57:06.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.097+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55fc257ab440 con 0x55fc257ca400 2024-09-13T23:57:06.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.097+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca800 con 0x55fc25737c00 2024-09-13T23:57:06.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.097+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.097+0000 7f8e5e294700 1 --2- 172.21.15.173:0/3199391417 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55fc257ca800 0x55fc25686c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.097+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc257ca800 2024-09-13T23:57:06.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.097+0000 7f8e5ea95700 1 --2- 172.21.15.173:0/3199391417 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55fc257ca800 0x55fc25686c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.097+0000 7f8e5ea95700 1 --2- 172.21.15.173:0/3199391417 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55fc257ca800 0x55fc25686c00 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.097+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257aab40 con 0x55fc257ca800 2024-09-13T23:57:06.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.097+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc25737400 2024-09-13T23:57:06.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.097+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.097+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc25737400 2024-09-13T23:57:06.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.097+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.097+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc257ca400 2024-09-13T23:57:06.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.097+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257ab440 con 0x55fc257ca400 2024-09-13T23:57:06.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.097+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc25737400 2024-09-13T23:57:06.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.101+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.101+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc25737c00 2024-09-13T23:57:06.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.101+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.101+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc25737c00 2024-09-13T23:57:06.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.101+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.101+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc25737400 2024-09-13T23:57:06.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.101+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.101+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc257ca800 2024-09-13T23:57:06.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.101+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257aab40 con 0x55fc257ca800 2024-09-13T23:57:06.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.101+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc25737400 2024-09-13T23:57:06.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.101+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.101+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc257ca800 2024-09-13T23:57:06.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.101+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257aab40 con 0x55fc257ca800 2024-09-13T23:57:06.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.101+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc25737c00 2024-09-13T23:57:06.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.105+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.105+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc257ca400 2024-09-13T23:57:06.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.105+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257ab440 con 0x55fc257ca400 2024-09-13T23:57:06.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.105+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc25737400 2024-09-13T23:57:06.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.105+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.105+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc25737c00 2024-09-13T23:57:06.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.105+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.105+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc257ca400 2024-09-13T23:57:06.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.105+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257ab440 con 0x55fc257ca400 2024-09-13T23:57:06.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.105+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc25737400 2024-09-13T23:57:06.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.105+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.105+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc25737400 2024-09-13T23:57:06.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.109+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.109+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc25737400 2024-09-13T23:57:06.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.109+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.109+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc257ca400 2024-09-13T23:57:06.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.109+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257ab440 con 0x55fc257ca400 2024-09-13T23:57:06.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.109+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc257ca800 2024-09-13T23:57:06.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.109+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257aab40 con 0x55fc257ca800 2024-09-13T23:57:06.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.109+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc25737400 2024-09-13T23:57:06.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.109+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.109+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc257ca800 2024-09-13T23:57:06.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.109+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257aab40 con 0x55fc257ca800 2024-09-13T23:57:06.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.109+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc257ca400 2024-09-13T23:57:06.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.109+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257ab440 con 0x55fc257ca400 2024-09-13T23:57:06.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.109+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc257ca800 2024-09-13T23:57:06.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.113+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257aab40 con 0x55fc257ca800 2024-09-13T23:57:06.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.113+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc25737c00 2024-09-13T23:57:06.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.113+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.113+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc25737c00 2024-09-13T23:57:06.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.113+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.113+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc257ca400 2024-09-13T23:57:06.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.113+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257ab440 con 0x55fc257ca400 2024-09-13T23:57:06.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.113+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc25737c00 2024-09-13T23:57:06.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.113+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.113+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc25737c00 2024-09-13T23:57:06.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.113+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.113+0000 7f8e5fadbf40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:06.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.113+0000 7f8e5fadbf40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:06.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.113+0000 7f8e5fadbf40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:06.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.113+0000 7f8e5fadbf40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:06.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.113+0000 7f8e5fadbf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.113+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257cb000 con 0x55fc25737400 2024-09-13T23:57:06.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5fadbf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5fadbf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257cb400 con 0x55fc25737c00 2024-09-13T23:57:06.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5fadbf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:06.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5fadbf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257cb800 con 0x55fc25737400 2024-09-13T23:57:06.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5fadbf40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:06.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5fadbf40 20 zone default found 2024-09-13T23:57:06.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5fadbf40 4 Realm: () 2024-09-13T23:57:06.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5fadbf40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:06.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5fadbf40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:06.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5fadbf40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:06.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5fadbf40 20 zonegroup default 2024-09-13T23:57:06.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5fadbf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257cbc00 con 0x55fc257ca800 2024-09-13T23:57:06.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55fc257aab40 con 0x55fc257ca800 2024-09-13T23:57:06.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5fadbf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5fadbf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257cb000 con 0x55fc257ca400 2024-09-13T23:57:06.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55fc257ab440 con 0x55fc257ca400 2024-09-13T23:57:06.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5fadbf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5fadbf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257cb800 con 0x55fc257ca400 2024-09-13T23:57:06.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55fc257ab440 con 0x55fc257ca400 2024-09-13T23:57:06.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5fadbf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5fadbf40 20 started sync module instance, tier type = 2024-09-13T23:57:06.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.117+0000 7f8e5fadbf40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:06.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.121+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc25737800 con 0x55fc25737c00 2024-09-13T23:57:06.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.121+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.121+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94541447674624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc25736800 con 0x55fc25737c00 2024-09-13T23:57:06.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.121+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc25737800 con 0x55fc25737400 2024-09-13T23:57:06.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.125+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.125+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94541447675776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257ca000 con 0x55fc25737400 2024-09-13T23:57:06.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.125+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257cb400 con 0x55fc25737c00 2024-09-13T23:57:06.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.125+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94541447674624] v33'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.129+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94541447675776] v33'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.129+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.129+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94541447676928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257d6000 con 0x55fc25737c00 2024-09-13T23:57:06.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.129+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257d6400 con 0x55fc257ca800 2024-09-13T23:57:06.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.129+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94541447676928] v33'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.129+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257aab40 con 0x55fc257ca800 2024-09-13T23:57:06.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.129+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94541447678080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257d6800 con 0x55fc257ca800 2024-09-13T23:57:06.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.129+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257d6c00 con 0x55fc25737c00 2024-09-13T23:57:06.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.133+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.133+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94541447679232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257d7000 con 0x55fc25737c00 2024-09-13T23:57:06.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.133+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257d7400 con 0x55fc257ca400 2024-09-13T23:57:06.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.133+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94541447678080] v33'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257aab40 con 0x55fc257ca800 2024-09-13T23:57:06.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.133+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94541447679232] v33'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.137+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257ab440 con 0x55fc257ca400 2024-09-13T23:57:06.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.137+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94541447680384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257d7800 con 0x55fc257ca400 2024-09-13T23:57:06.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.137+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257d7c00 con 0x55fc257ca400 2024-09-13T23:57:06.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.137+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94541447680384] v33'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257ab440 con 0x55fc257ca400 2024-09-13T23:57:06.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.137+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257ab440 con 0x55fc257ca400 2024-09-13T23:57:06.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.137+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94541447681536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257d7400 con 0x55fc257ca400 2024-09-13T23:57:06.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.137+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257d6000 con 0x55fc257ca800 2024-09-13T23:57:06.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.141+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94541447681536] v33'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257ab440 con 0x55fc257ca400 2024-09-13T23:57:06.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.141+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257aab40 con 0x55fc257ca800 2024-09-13T23:57:06.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.141+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94541447682688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257d6c00 con 0x55fc257ca800 2024-09-13T23:57:06.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.141+0000 7f8e5fadbf40 20 add_watcher() i=0 2024-09-13T23:57:06.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.141+0000 7f8e5fadbf40 20 add_watcher() i=1 2024-09-13T23:57:06.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.141+0000 7f8e5fadbf40 20 add_watcher() i=2 2024-09-13T23:57:06.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.141+0000 7f8e5fadbf40 20 add_watcher() i=3 2024-09-13T23:57:06.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.141+0000 7f8e5fadbf40 20 add_watcher() i=4 2024-09-13T23:57:06.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.141+0000 7f8e5fadbf40 20 add_watcher() i=5 2024-09-13T23:57:06.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.141+0000 7f8e5fadbf40 20 add_watcher() i=6 2024-09-13T23:57:06.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.141+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94541447682688] v33'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257aab40 con 0x55fc257ca800 2024-09-13T23:57:06.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.141+0000 7f8e5fadbf40 20 add_watcher() i=7 2024-09-13T23:57:06.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.141+0000 7f8e5fadbf40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:06.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.141+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257cac00 con 0x55fc25737400 2024-09-13T23:57:06.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.141+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.141+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94541449134080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257cb000 con 0x55fc25737400 2024-09-13T23:57:06.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.145+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94541449134080] v33'132 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.145+0000 7f8e45262700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:06.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.145+0000 7f8e5fadbf40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:06.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.145+0000 7f8e5fadbf40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:06.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.145+0000 7f8e5fadbf40 1 Processor -- start 2024-09-13T23:57:06.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.145+0000 7f8e5fadbf40 1 -- start start 2024-09-13T23:57:06.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.145+0000 7f8e5fadbf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc257cb400 0x55fc25687180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.145+0000 7f8e5fadbf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc2542c3c0 con 0x55fc257cb400 2024-09-13T23:57:06.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.145+0000 7f8e5da93700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc257cb400 0x55fc25687180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.145+0000 7f8e5da93700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc257cb400 0x55fc25687180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50588/0 (socket says 172.21.15.173:50588) 2024-09-13T23:57:06.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.145+0000 7f8e5da93700 1 -- 172.21.15.173:0/2584481411 learned_addr learned my addr 172.21.15.173:0/2584481411 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.145+0000 7f8e5da93700 1 -- 172.21.15.173:0/2584481411 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc253b0b60 con 0x55fc257cb400 2024-09-13T23:57:06.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.145+0000 7f8e5da93700 1 --2- 172.21.15.173:0/2584481411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc257cb400 0x55fc25687180 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x55fc257e86c0 tx=0x55fc254a39e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e016074a8c1cf307 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.145+0000 7f8e44a61700 1 -- 172.21.15.173:0/2584481411 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fc25443760 con 0x55fc257cb400 2024-09-13T23:57:06.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.149+0000 7f8e44a61700 1 -- 172.21.15.173:0/2584481411 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc25754a80 con 0x55fc257cb400 2024-09-13T23:57:06.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.149+0000 7f8e44a61700 1 -- 172.21.15.173:0/2584481411 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fc257de160 con 0x55fc257cb400 2024-09-13T23:57:06.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.149+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/2584481411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc257cb400 msgr2=0x55fc25687180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.149+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/2584481411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc257cb400 0x55fc25687180 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x55fc257e86c0 tx=0x55fc254a39e0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.149+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/2584481411 shutdown_connections 2024-09-13T23:57:06.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.149+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/2584481411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc257cb400 0x55fc25687180 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.149+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/2584481411 >> 172.21.15.173:0/2584481411 conn(0x55fc257cb800 msgr2=0x55fc254a0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.149+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/2584481411 shutdown_connections 2024-09-13T23:57:06.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.149+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/2584481411 wait complete. 2024-09-13T23:57:06.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.149+0000 7f8e5fadbf40 1 Processor -- start 2024-09-13T23:57:06.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.149+0000 7f8e5fadbf40 1 -- start start 2024-09-13T23:57:06.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.149+0000 7f8e5fadbf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc257cb400 0x55fc25687180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.149+0000 7f8e5fadbf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc2542c500 con 0x55fc257cb400 2024-09-13T23:57:06.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.149+0000 7f8e5da93700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc257cb400 0x55fc25687180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.149+0000 7f8e5da93700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc257cb400 0x55fc25687180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50602/0 (socket says 172.21.15.173:50602) 2024-09-13T23:57:06.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.149+0000 7f8e5da93700 1 -- 172.21.15.173:0/1620316042 learned_addr learned my addr 172.21.15.173:0/1620316042 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.149+0000 7f8e5da93700 1 -- 172.21.15.173:0/1620316042 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc253b0d00 con 0x55fc257cb400 2024-09-13T23:57:06.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.149+0000 7f8e5da93700 1 --2- 172.21.15.173:0/1620316042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc257cb400 0x55fc25687180 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x55fc257e88d0 tx=0x55fc256fbc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.149+0000 7f8e4325e700 1 -- 172.21.15.173:0/1620316042 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fc257de2c0 con 0x55fc257cb400 2024-09-13T23:57:06.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.149+0000 7f8e4325e700 1 -- 172.21.15.173:0/1620316042 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc25754780 con 0x55fc257cb400 2024-09-13T23:57:06.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.149+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/1620316042 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fc253b0340 con 0x55fc257cb400 2024-09-13T23:57:06.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.149+0000 7f8e4325e700 1 -- 172.21.15.173:0/1620316042 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55fc257de420 con 0x55fc257cb400 2024-09-13T23:57:06.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.149+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/1620316042 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc253b1d40 con 0x55fc257cb400 2024-09-13T23:57:06.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.153+0000 7f8e4325e700 1 -- 172.21.15.173:0/1620316042 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55fc25499b80 con 0x55fc257cb400 2024-09-13T23:57:06.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.153+0000 7f8e4325e700 1 --2- 172.21.15.173:0/1620316042 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fc257cac00 0x55fc25872000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.153+0000 7f8e4325e700 1 -- 172.21.15.173:0/1620316042 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55fc254056c0 con 0x55fc257cb400 2024-09-13T23:57:06.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.153+0000 7f8e5fadbf40 5 note: GC not initialized 2024-09-13T23:57:06.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.153+0000 7f8e5ea95700 1 --2- 172.21.15.173:0/1620316042 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fc257cac00 0x55fc25872000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.153+0000 7f8e5ea95700 1 --2- 172.21.15.173:0/1620316042 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fc257cac00 0x55fc25872000 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55fc25725ec0 tx=0x55fc256fa9c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.153+0000 7f8e40a59700 20 reqs_thread_entry: start 2024-09-13T23:57:06.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.153+0000 7f8e5fadbf40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:06.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.153+0000 7f8e5fadbf40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:06.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.153+0000 7f8e3ea55700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:36 2024 2024-09-13T23:57:06.162 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:06.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5fadbf40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:57:06.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5fadbf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc25736800 con 0x55fc25737400 2024-09-13T23:57:06.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e3e233700 20 reqs_thread_entry: start 2024-09-13T23:57:06.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5fadbf40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:57:06.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5fadbf40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:57:06.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5fadbf40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:06.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5fadbf40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:06.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5fadbf40 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-13T23:57:06.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5fadbf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc25737800 con 0x55fc25737400 2024-09-13T23:57:06.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) v8 ==== 197+0+241 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5fadbf40 20 rados_obj.operate() r=0 bl.length=193 2024-09-13T23:57:06.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5fadbf40 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-13T23:57:06.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5fadbf40 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-13T23:57:06.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5fadbf40 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 : miss 2024-09-13T23:57:06.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5fadbf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:64 8.15 8:af528289:root::.bucket.meta.testx%3amyfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257d6800 con 0x55fc257ca400 2024-09-13T23:57:06.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [call out=48b,stat out=16b,read 0~371 out=371b,getxattrs out=298b] v0'0 uv3 ondisk = 0) v8 ==== 338+0+733 (crc 0 0 0) 0x55fc257ab440 con 0x55fc257ca400 2024-09-13T23:57:06.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5fadbf40 20 rados_obj.operate() r=0 bl.length=371 2024-09-13T23:57:06.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5fadbf40 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 info.flags=0x17 2024-09-13T23:57:06.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5fadbf40 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 to cache LRU end 2024-09-13T23:57:06.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5fadbf40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:06.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5fadbf40 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-13T23:57:06.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5fadbf40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 2024-09-13T23:57:06.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5fadbf40 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-13T23:57:06.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.157+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257d6000 con 0x55fc25737400 2024-09-13T23:57:06.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.161+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v33'2 uv2 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.161+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 8.17 8:ea49432e:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [create,call version.inc in=38b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257d6c00 con 0x55fc25737c00 2024-09-13T23:57:06.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.161+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(66 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [create,call,writefull 0~352,setxattr (123)] v33'5 uv5 ondisk = 0) v8 ==== 332+0+0 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.161+0000 7f8e5fadbf40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 info.flags=0x7 2024-09-13T23:57:06.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.161+0000 7f8e5fadbf40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 to cache LRU end 2024-09-13T23:57:06.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.161+0000 7f8e5fadbf40 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:57:06.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.161+0000 7f8e5fadbf40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1, ofs0, ns] 2024-09-13T23:57:06.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.161+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94541449136384 in=713b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257d7000 con 0x55fc25737c00 2024-09-13T23:57:06.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.165+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== watch-notify(notify (1) cookie 94541447676928 notify 141733920793 ret 0) v3 ==== 743+0+0 (crc 0 0 0) 0x55fc253b1860 con 0x55fc25737c00 2024-09-13T23:57:06.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.165+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(67 notify.2 [notify cookie 94541449136384 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.165+0000 7f8e58a89700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920793 cookie 94541447676928 notifier 4608 bl.length()=701 2024-09-13T23:57:06.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.165+0000 7f8e58a89700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 info.flags=0x7 2024-09-13T23:57:06.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.165+0000 7f8e58a89700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 to cache LRU end 2024-09-13T23:57:06.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.165+0000 7f8e58a89700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:57:06.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.165+0000 7f8e58a89700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc258ea000 con 0x55fc25737c00 2024-09-13T23:57:06.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.165+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== watch-notify(notify_complete (2) cookie 94541449136384 notify 141733920793 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55fc26216000 con 0x55fc25737c00 2024-09-13T23:57:06.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.165+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.165+0000 7f8e5fadbf40 20 handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1]): orig_sources= new_sources= 2024-09-13T23:57:06.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.165+0000 7f8e5fadbf40 20 handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1]): potential sources added=[] removed=[] 2024-09-13T23:57:06.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.165+0000 7f8e5fadbf40 20 handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1]): orig_dests= new_dests= 2024-09-13T23:57:06.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.165+0000 7f8e5fadbf40 20 handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1]): potential dests added=[] removed=[] 2024-09-13T23:57:06.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.165+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257d6400 con 0x55fc257ca800 2024-09-13T23:57:06.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.165+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(69 foo.buckets [call] v33'26 uv26 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x55fc257aab40 con 0x55fc257ca800 2024-09-13T23:57:06.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.165+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257cb000 con 0x55fc257ca800 2024-09-13T23:57:06.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.169+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v33'27 uv27 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x55fc257aab40 con 0x55fc257ca800 2024-09-13T23:57:06.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.169+0000 7f8e5fadbf40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T23:57:06.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.169+0000 7f8e5fadbf40 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:57:06.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.169+0000 7f8e5fadbf40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T23:57:06.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.169+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94541449136384 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc258ea800 con 0x55fc257ca400 2024-09-13T23:57:06.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.169+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== watch-notify(notify (1) cookie 94541447681536 notify 141733920786 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x55fc258329c0 con 0x55fc257ca400 2024-09-13T23:57:06.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.169+0000 7f8e58a89700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920786 cookie 94541447681536 notifier 4608 bl.length()=314 2024-09-13T23:57:06.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.169+0000 7f8e58a89700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T23:57:06.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.169+0000 7f8e58a89700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:57:06.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.169+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(71 notify.6 [notify cookie 94541449136384 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55fc257ab440 con 0x55fc257ca400 2024-09-13T23:57:06.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.169+0000 7f8e58a89700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc258ea400 con 0x55fc257ca400 2024-09-13T23:57:06.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.169+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257ab440 con 0x55fc257ca400 2024-09-13T23:57:06.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.169+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== watch-notify(notify_complete (2) cookie 94541449136384 notify 141733920786 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55fc25832b60 con 0x55fc257ca400 2024-09-13T23:57:06.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.169+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc258eac00 con 0x55fc25737400 2024-09-13T23:57:06.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.173+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(73 testx/myfoo [call,delete] v33'2 uv2 ondisk = 0) v8 ==== 197+0+0 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.173+0000 7f8e5fadbf40 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-13T23:57:06.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.173+0000 7f8e5fadbf40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-13T23:57:06.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.173+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94541449136384 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc258eb000 con 0x55fc25737c00 2024-09-13T23:57:06.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.173+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== watch-notify(notify (1) cookie 94541447679232 notify 141733920794 ret 0) v3 ==== 197+0+0 (crc 0 0 0) 0x55fc26216000 con 0x55fc25737c00 2024-09-13T23:57:06.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.173+0000 7f8e58288700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920794 cookie 94541447679232 notifier 4608 bl.length()=155 2024-09-13T23:57:06.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.173+0000 7f8e58288700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc25736800 con 0x55fc25737c00 2024-09-13T23:57:06.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.173+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(74 notify.4 [notify cookie 94541449136384 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.173+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.173+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== watch-notify(notify_complete (2) cookie 94541449136384 notify 141733920794 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55fc262161a0 con 0x55fc25737c00 2024-09-13T23:57:06.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.177+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:76 8.15 8:af528289:root::.bucket.meta.testx%3amyfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc258eb400 con 0x55fc257ca400 2024-09-13T23:57:06.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.177+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 <== osd.3 v2:172.21.15.173:6800/4020038786 20 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [call,delete] v33'4 uv4 ondisk = 0) v8 ==== 254+0+0 (crc 0 0 0) 0x55fc257ab440 con 0x55fc257ca400 2024-09-13T23:57:06.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.177+0000 7f8e5fadbf40 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 from cache 2024-09-13T23:57:06.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.177+0000 7f8e5fadbf40 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1, ofs0, ns] 2024-09-13T23:57:06.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.177+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:77 7.0 7:05bf5b68:::notify.1:head [notify cookie 94541449136384 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc258eb800 con 0x55fc25737400 2024-09-13T23:57:06.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.177+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 24 ==== watch-notify(notify (1) cookie 94541447675776 notify 141733920769 ret 0) v3 ==== 254+0+0 (crc 0 0 0) 0x55fc253b1860 con 0x55fc25737400 2024-09-13T23:57:06.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.177+0000 7f8e58a89700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920769 cookie 94541447675776 notifier 4608 bl.length()=212 2024-09-13T23:57:06.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.177+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 25 ==== osd_op_reply(77 notify.1 [notify cookie 94541449136384 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.177+0000 7f8e58a89700 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:78 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257d6000 con 0x55fc25737400 2024-09-13T23:57:06.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.177+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 26 ==== osd_op_reply(78 notify.1 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.177+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 27 ==== watch-notify(notify_complete (2) cookie 94541449136384 notify 141733920769 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55fc258dd6c0 con 0x55fc25737400 2024-09-13T23:57:06.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.181+0000 7f8e45262700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:06.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.181+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94541449134080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc258ebc00 con 0x55fc25737400 2024-09-13T23:57:06.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.181+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 28 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94541449134080] v33'133 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.185+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94541447674624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc258eac00 con 0x55fc25737c00 2024-09-13T23:57:06.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.185+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 27 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94541447674624] v33'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.185+0000 7f8e5fadbf40 20 remove_watcher() i=0 2024-09-13T23:57:06.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.185+0000 7f8e5fadbf40 2 removed watcher, disabling cache 2024-09-13T23:57:06.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.185+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94541447675776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc258ea800 con 0x55fc25737400 2024-09-13T23:57:06.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.189+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.1 v2:172.21.15.173:6808/3256211813 29 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94541447675776] v33'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257aab40 con 0x55fc25737400 2024-09-13T23:57:06.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.189+0000 7f8e5fadbf40 20 remove_watcher() i=1 2024-09-13T23:57:06.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.189+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94541447676928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc258ea400 con 0x55fc25737c00 2024-09-13T23:57:06.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.189+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 28 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94541447676928] v33'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.189+0000 7f8e5fadbf40 20 remove_watcher() i=2 2024-09-13T23:57:06.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.189+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94541447678080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257d6400 con 0x55fc257ca800 2024-09-13T23:57:06.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.193+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94541447678080] v33'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257aab40 con 0x55fc257ca800 2024-09-13T23:57:06.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.193+0000 7f8e5fadbf40 20 remove_watcher() i=3 2024-09-13T23:57:06.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.193+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94541447679232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257d7800 con 0x55fc25737c00 2024-09-13T23:57:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.197+0000 7f8e5e294700 1 -- 172.21.15.173:0/3199391417 <== osd.0 v2:172.21.15.87:6800/3507919120 29 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94541447679232] v33'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257ab200 con 0x55fc25737c00 2024-09-13T23:57:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.197+0000 7f8e5fadbf40 20 remove_watcher() i=4 2024-09-13T23:57:06.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.197+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94541447680384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257d7c00 con 0x55fc257ca400 2024-09-13T23:57:06.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.197+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 <== osd.3 v2:172.21.15.173:6800/4020038786 21 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94541447680384] v33'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257ab440 con 0x55fc257ca400 2024-09-13T23:57:06.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.197+0000 7f8e5fadbf40 20 remove_watcher() i=5 2024-09-13T23:57:06.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.197+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94541447681536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc257d6800 con 0x55fc257ca400 2024-09-13T23:57:06.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.201+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 <== osd.3 v2:172.21.15.173:6800/4020038786 22 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94541447681536] v33'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257ab440 con 0x55fc257ca400 2024-09-13T23:57:06.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.201+0000 7f8e5fadbf40 20 remove_watcher() i=6 2024-09-13T23:57:06.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.201+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94541447682688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55fc258ea000 con 0x55fc257ca800 2024-09-13T23:57:06.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.201+0000 7f8e5ea95700 1 -- 172.21.15.173:0/3199391417 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94541447682688] v33'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55fc257aab40 con 0x55fc257ca800 2024-09-13T23:57:06.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.201+0000 7f8e5fadbf40 20 remove_watcher() i=7 2024-09-13T23:57:06.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.201+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55fc25737c00 msgr2=0x55fc25686100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.201+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/3199391417 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55fc25737c00 0x55fc25686100 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.201+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55fc25737400 msgr2=0x55fc25685b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.201+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/3199391417 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55fc25737400 0x55fc25685b80 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.201+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55fc257ca800 msgr2=0x55fc25686c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.201+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/3199391417 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55fc257ca800 0x55fc25686c00 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.201+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55fc257ca400 msgr2=0x55fc25686680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.201+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/3199391417 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55fc257ca400 0x55fc25686680 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.201+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fc25737000 msgr2=0x55fc25685600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.201+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/3199391417 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fc25737000 0x55fc25685600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55fc2567f920 tx=0x55fc254a3800 comp rx=0 tx=0).stop 2024-09-13T23:57:06.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.201+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f800 msgr2=0x55fc25684b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.201+0000 7f8e5da93700 1 -- 172.21.15.173:0/3199391417 reap_dead start 2024-09-13T23:57:06.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.201+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/3199391417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f800 0x55fc25684b00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x55fc25724a50 tx=0x55fc256fac00 comp rx=0 tx=0).stop 2024-09-13T23:57:06.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 shutdown_connections 2024-09-13T23:57:06.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/3199391417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f800 0x55fc25684b00 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 >> 172.21.15.173:0/3199391417 conn(0x55fc2539f400 msgr2=0x55fc2549f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 shutdown_connections 2024-09-13T23:57:06.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/3199391417 wait complete. 2024-09-13T23:57:06.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/1620316042 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fc257cac00 msgr2=0x55fc25872000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/1620316042 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fc257cac00 0x55fc25872000 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55fc25725ec0 tx=0x55fc256fa9c0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/1620316042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc257cb400 msgr2=0x55fc25687180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/1620316042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc257cb400 0x55fc25687180 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x55fc257e88d0 tx=0x55fc256fbc20 comp rx=0 tx=0).stop 2024-09-13T23:57:06.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/1620316042 shutdown_connections 2024-09-13T23:57:06.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/1620316042 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fc257cac00 0x55fc25872000 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/1620316042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc257cb400 0x55fc25687180 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/1620316042 >> 172.21.15.173:0/1620316042 conn(0x55fc257cb800 msgr2=0x55fc254a0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/1620316042 shutdown_connections 2024-09-13T23:57:06.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/1620316042 wait complete. 2024-09-13T23:57:06.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/1203102622 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fc25736000 msgr2=0x55fc25685080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/1203102622 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fc25736000 0x55fc25685080 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55fc256c2e10 tx=0x55fc256faa20 comp rx=0 tx=0).stop 2024-09-13T23:57:06.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/1203102622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f000 msgr2=0x55fc25684580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/1203102622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f000 0x55fc25684580 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x55fc26169e00 tx=0x55fc254a3920 comp rx=0 tx=0).stop 2024-09-13T23:57:06.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/1203102622 shutdown_connections 2024-09-13T23:57:06.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/1203102622 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55fc25736000 0x55fc25685080 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 --2- 172.21.15.173:0/1203102622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55fc2539f000 0x55fc25684580 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/1203102622 >> 172.21.15.173:0/1203102622 conn(0x55fc2539ec00 msgr2=0x55fc2549f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/1203102622 shutdown_connections 2024-09-13T23:57:06.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.205+0000 7f8e5fadbf40 1 -- 172.21.15.173:0/1203102622 wait complete. 2024-09-13T23:57:06.217 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T23:57:06.217 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T23:57:06.218 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-13T23:57:06.260 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:06.261 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:06.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f9635323f40 1 Processor -- start 2024-09-13T23:57:06.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f9635323f40 1 -- start start 2024-09-13T23:57:06.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f9635323f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x559e3b3ed400 0x559e3b6d2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f9635323f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559e3b4b1500 con 0x559e3b3ed000 2024-09-13T23:57:06.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f9635323f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x559e3b47aa00 con 0x559e3b3ed400 2024-09-13T23:57:06.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f96332db700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x559e3b3ed400 0x559e3b6d2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f9633adc700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x559e3b3ed000 0x559e3b4ec800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47542/0 (socket says 172.21.15.173:47542) 2024-09-13T23:57:06.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f9633adc700 1 -- 172.21.15.173:0/4181986564 learned_addr learned my addr 172.21.15.173:0/4181986564 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:06.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f96332db700 1 -- 172.21.15.173:0/4181986564 >> v1:172.21.15.87:6789/0 conn(0x559e3b3ed000 legacy=0x559e3b4ec800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f96332db700 1 -- 172.21.15.173:0/4181986564 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e3b3ffd40 con 0x559e3b3ed400 2024-09-13T23:57:06.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f96332db700 1 --2- 172.21.15.173:0/4181986564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed400 0x559e3b6d2580 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x559e3b6cd920 tx=0x559e3b4f1920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a4e8c0c2c7cec9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f9632ada700 1 -- 172.21.15.173:0/4181986564 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559e3b4914a0 con 0x559e3b3ed400 2024-09-13T23:57:06.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f9632ada700 1 -- 172.21.15.173:0/4181986564 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559e3b4b1800 con 0x559e3b3ed400 2024-09-13T23:57:06.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f9632ada700 1 -- 172.21.15.173:0/4181986564 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559e3b491600 con 0x559e3b3ed400 2024-09-13T23:57:06.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f9635323f40 1 -- 172.21.15.173:0/4181986564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed400 msgr2=0x559e3b6d2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f9635323f40 1 --2- 172.21.15.173:0/4181986564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed400 0x559e3b6d2580 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x559e3b6cd920 tx=0x559e3b4f1920 comp rx=0 tx=0).stop 2024-09-13T23:57:06.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f9635323f40 1 -- 172.21.15.173:0/4181986564 shutdown_connections 2024-09-13T23:57:06.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f9635323f40 1 --2- 172.21.15.173:0/4181986564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed400 0x559e3b6d2580 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f9635323f40 1 -- 172.21.15.173:0/4181986564 >> 172.21.15.173:0/4181986564 conn(0x559e3b3ecc00 msgr2=0x559e3b4ec000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f9635323f40 1 -- 172.21.15.173:0/4181986564 shutdown_connections 2024-09-13T23:57:06.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f9635323f40 1 -- 172.21.15.173:0/4181986564 wait complete. 2024-09-13T23:57:06.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f9635323f40 1 Processor -- start 2024-09-13T23:57:06.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f9635323f40 1 -- start start 2024-09-13T23:57:06.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f9635323f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed000 0x559e3b6d2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.257+0000 7f9635323f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e3b47a500 con 0x559e3b3ed000 2024-09-13T23:57:06.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.261+0000 7f9633adc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed000 0x559e3b6d2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.261+0000 7f9633adc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed000 0x559e3b6d2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50606/0 (socket says 172.21.15.173:50606) 2024-09-13T23:57:06.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.261+0000 7f9633adc700 1 -- 172.21.15.173:0/36152442 learned_addr learned my addr 172.21.15.173:0/36152442 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.261+0000 7f9633adc700 1 -- 172.21.15.173:0/36152442 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e3b3ffba0 con 0x559e3b3ed000 2024-09-13T23:57:06.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.261+0000 7f9633adc700 1 --2- 172.21.15.173:0/36152442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed000 0x559e3b6d2580 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x559e3b549e60 tx=0x559e3b4f1b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c931d1aea6b895b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.261+0000 7f96322d9700 1 -- 172.21.15.173:0/36152442 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559e3b4914a0 con 0x559e3b3ed000 2024-09-13T23:57:06.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.261+0000 7f96322d9700 1 -- 172.21.15.173:0/36152442 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559e3b4b1b00 con 0x559e3b3ed000 2024-09-13T23:57:06.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.261+0000 7f96322d9700 1 -- 172.21.15.173:0/36152442 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559e3b491600 con 0x559e3b3ed000 2024-09-13T23:57:06.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.261+0000 7f9635323f40 1 -- 172.21.15.173:0/36152442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed000 msgr2=0x559e3b6d2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.261+0000 7f9635323f40 1 --2- 172.21.15.173:0/36152442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed000 0x559e3b6d2580 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x559e3b549e60 tx=0x559e3b4f1b60 comp rx=0 tx=0).stop 2024-09-13T23:57:06.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.261+0000 7f9635323f40 1 -- 172.21.15.173:0/36152442 shutdown_connections 2024-09-13T23:57:06.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.261+0000 7f9635323f40 1 --2- 172.21.15.173:0/36152442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed000 0x559e3b6d2580 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.261+0000 7f9635323f40 1 -- 172.21.15.173:0/36152442 >> 172.21.15.173:0/36152442 conn(0x559e3b3ecc00 msgr2=0x559e3b4ed000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.261+0000 7f9635323f40 1 -- 172.21.15.173:0/36152442 shutdown_connections 2024-09-13T23:57:06.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.261+0000 7f9635323f40 1 -- 172.21.15.173:0/36152442 wait complete. 2024-09-13T23:57:06.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.261+0000 7f9635323f40 1 Processor -- start 2024-09-13T23:57:06.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.261+0000 7f9635323f40 1 -- start start 2024-09-13T23:57:06.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.265+0000 7f9635323f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed000 0x559e3b6d2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.265+0000 7f9635323f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e3b47a3c0 con 0x559e3b3ed000 2024-09-13T23:57:06.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.265+0000 7f9633adc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed000 0x559e3b6d2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.265+0000 7f9633adc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed000 0x559e3b6d2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50620/0 (socket says 172.21.15.173:50620) 2024-09-13T23:57:06.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.265+0000 7f9633adc700 1 -- 172.21.15.173:0/1685988028 learned_addr learned my addr 172.21.15.173:0/1685988028 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.265+0000 7f9633adc700 1 -- 172.21.15.173:0/1685988028 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e3b3ffa00 con 0x559e3b3ed000 2024-09-13T23:57:06.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.265+0000 7f9633adc700 1 --2- 172.21.15.173:0/1685988028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed000 0x559e3b6d2580 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x559e3b549f50 tx=0x559e3b4f1a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.265+0000 7f9630ad6700 1 -- 172.21.15.173:0/1685988028 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559e3b4918c0 con 0x559e3b3ed000 2024-09-13T23:57:06.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.265+0000 7f9630ad6700 1 -- 172.21.15.173:0/1685988028 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559e3b4b1c80 con 0x559e3b3ed000 2024-09-13T23:57:06.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.265+0000 7f9635323f40 1 -- 172.21.15.173:0/1685988028 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559e3b3ff860 con 0x559e3b3ed000 2024-09-13T23:57:06.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.265+0000 7f9630ad6700 1 -- 172.21.15.173:0/1685988028 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559e3b4914a0 con 0x559e3b3ed000 2024-09-13T23:57:06.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.265+0000 7f9635323f40 1 -- 172.21.15.173:0/1685988028 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559e3b3ff6c0 con 0x559e3b3ed000 2024-09-13T23:57:06.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.265+0000 7f9630ad6700 1 -- 172.21.15.173:0/1685988028 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x559e3b4e6b00 con 0x559e3b3ed000 2024-09-13T23:57:06.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.265+0000 7f9635323f40 1 Processor -- start 2024-09-13T23:57:06.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.265+0000 7f9635323f40 1 -- start start 2024-09-13T23:57:06.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9630ad6700 1 --2- 172.21.15.173:0/1685988028 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559e3b78a000 0x559e3b6d3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9635323f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed800 0x559e3b6d2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9635323f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e3b412640 con 0x559e3b3ed800 2024-09-13T23:57:06.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9630ad6700 1 -- 172.21.15.173:0/1685988028 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x559e3b453180 con 0x559e3b3ed000 2024-09-13T23:57:06.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f96342dd700 1 --2- 172.21.15.173:0/1685988028 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559e3b78a000 0x559e3b6d3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9633adc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed800 0x559e3b6d2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9633adc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed800 0x559e3b6d2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50632/0 (socket says 172.21.15.173:50632) 2024-09-13T23:57:06.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9633adc700 1 -- 172.21.15.173:0/673151950 learned_addr learned my addr 172.21.15.173:0/673151950 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9633adc700 1 -- 172.21.15.173:0/673151950 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e3b3fe000 con 0x559e3b3ed800 2024-09-13T23:57:06.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f96342dd700 1 --2- 172.21.15.173:0/1685988028 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559e3b78a000 0x559e3b6d3080 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x559e3c264990 tx=0x559e3b74aa20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9633adc700 1 --2- 172.21.15.173:0/673151950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed800 0x559e3b6d2b00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x559e3c2643c0 tx=0x559e3b74a240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595125bc57c5c034 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f962e2d1700 1 -- 172.21.15.173:0/673151950 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559e3b491600 con 0x559e3b3ed800 2024-09-13T23:57:06.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f962e2d1700 1 -- 172.21.15.173:0/673151950 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559e3b4b1c80 con 0x559e3b3ed800 2024-09-13T23:57:06.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f962e2d1700 1 -- 172.21.15.173:0/673151950 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559e3b491a20 con 0x559e3b3ed800 2024-09-13T23:57:06.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9635323f40 1 -- 172.21.15.173:0/673151950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed800 msgr2=0x559e3b6d2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9635323f40 1 --2- 172.21.15.173:0/673151950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed800 0x559e3b6d2b00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x559e3c2643c0 tx=0x559e3b74a240 comp rx=0 tx=0).stop 2024-09-13T23:57:06.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9635323f40 1 -- 172.21.15.173:0/673151950 shutdown_connections 2024-09-13T23:57:06.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9635323f40 1 --2- 172.21.15.173:0/673151950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed800 0x559e3b6d2b00 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9635323f40 1 -- 172.21.15.173:0/673151950 >> 172.21.15.173:0/673151950 conn(0x559e3b3ed400 msgr2=0x559e3b4ed800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9635323f40 1 -- 172.21.15.173:0/673151950 shutdown_connections 2024-09-13T23:57:06.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9635323f40 1 -- 172.21.15.173:0/673151950 wait complete. 2024-09-13T23:57:06.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9635323f40 1 Processor -- start 2024-09-13T23:57:06.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9635323f40 1 -- start start 2024-09-13T23:57:06.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9635323f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed800 0x559e3b6d2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9635323f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e3b4128c0 con 0x559e3b3ed800 2024-09-13T23:57:06.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9633adc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed800 0x559e3b6d2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9633adc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed800 0x559e3b6d2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50646/0 (socket says 172.21.15.173:50646) 2024-09-13T23:57:06.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 learned_addr learned my addr 172.21.15.173:0/2148877605 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e3b3feea0 con 0x559e3b3ed800 2024-09-13T23:57:06.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.269+0000 7f9633adc700 1 --2- 172.21.15.173:0/2148877605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed800 0x559e3b6d2b00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x559e3b78ce40 tx=0x559e3b74ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.273+0000 7f962cace700 1 -- 172.21.15.173:0/2148877605 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559e3b491600 con 0x559e3b3ed800 2024-09-13T23:57:06.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.273+0000 7f962cace700 1 -- 172.21.15.173:0/2148877605 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559e3b7aa000 con 0x559e3b3ed800 2024-09-13T23:57:06.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.273+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559e3b3fe820 con 0x559e3b3ed800 2024-09-13T23:57:06.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.273+0000 7f962cace700 1 -- 172.21.15.173:0/2148877605 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559e3b491a20 con 0x559e3b3ed800 2024-09-13T23:57:06.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.273+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559e3b3fe9c0 con 0x559e3b3ed800 2024-09-13T23:57:06.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.273+0000 7f962cace700 1 -- 172.21.15.173:0/2148877605 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x559e3b4e6dc0 con 0x559e3b3ed800 2024-09-13T23:57:06.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.273+0000 7f962cace700 1 --2- 172.21.15.173:0/2148877605 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559e3b78b000 0x559e3b6d3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.273+0000 7f962cace700 1 -- 172.21.15.173:0/2148877605 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x559e3b453340 con 0x559e3b3ed800 2024-09-13T23:57:06.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.273+0000 7f96332db700 1 --2- 172.21.15.173:0/2148877605 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559e3b78b000 0x559e3b6d3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.273+0000 7f9635323f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.273+0000 7f9635323f40 1 --2- 172.21.15.173:0/2148877605 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559e3b78b400 0x559e3b6d3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.273+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b78b800 con 0x559e3b78b400 2024-09-13T23:57:06.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.273+0000 7f96342dd700 1 --2- 172.21.15.173:0/2148877605 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559e3b78b400 0x559e3b6d3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.273+0000 7f96332db700 1 --2- 172.21.15.173:0/2148877605 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559e3b78b000 0x559e3b6d3600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x559e3b6cd920 tx=0x559e3b4f1800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.273+0000 7f96342dd700 1 --2- 172.21.15.173:0/2148877605 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559e3b78b400 0x559e3b6d3b80 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.273+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b78b400 2024-09-13T23:57:06.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.277+0000 7f9635323f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.277+0000 7f9635323f40 20 realm 2024-09-13T23:57:06.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.277+0000 7f9635323f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.277+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b78bc00 con 0x559e3b78b400 2024-09-13T23:57:06.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.277+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b78b400 2024-09-13T23:57:06.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.277+0000 7f9635323f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.277+0000 7f9635323f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:06.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.277+0000 7f9635323f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.277+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b78b800 con 0x559e3b78b400 2024-09-13T23:57:06.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.277+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b78b400 2024-09-13T23:57:06.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.277+0000 7f9635323f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.277+0000 7f9635323f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.277+0000 7f9635323f40 1 --2- 172.21.15.173:0/2148877605 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559e3b78bc00 0x559e3b6d4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.277+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b78bc00 2024-09-13T23:57:06.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.277+0000 7f9633adc700 1 --2- 172.21.15.173:0/2148877605 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559e3b78bc00 0x559e3b6d4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.277+0000 7f9633adc700 1 --2- 172.21.15.173:0/2148877605 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559e3b78bc00 0x559e3b6d4100 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.277+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x559e3b811200 con 0x559e3b78bc00 2024-09-13T23:57:06.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.277+0000 7f9635323f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:06.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.277+0000 7f9635323f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.277+0000 7f9635323f40 1 --2- 172.21.15.173:0/2148877605 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559e3b816400 0x559e3b6d4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.277+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816800 con 0x559e3b816400 2024-09-13T23:57:06.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.277+0000 7f96332db700 1 --2- 172.21.15.173:0/2148877605 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559e3b816400 0x559e3b6d4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.277+0000 7f96332db700 1 --2- 172.21.15.173:0/2148877605 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559e3b816400 0x559e3b6d4680 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.281+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x559e3b811440 con 0x559e3b816400 2024-09-13T23:57:06.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.281+0000 7f9635323f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:06.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.281+0000 7f9635323f40 20 searching for the correct realm 2024-09-13T23:57:06.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.281+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816c00 con 0x559e3b816400 2024-09-13T23:57:06.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.281+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x559e3b811440 con 0x559e3b816400 2024-09-13T23:57:06.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.281+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816800 con 0x559e3b78bc00 2024-09-13T23:57:06.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.281+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b811200 con 0x559e3b78bc00 2024-09-13T23:57:06.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.281+0000 7f9633adc700 1 --2- 172.21.15.173:0/2148877605 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559e3b816800 0x559e3b6d4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.281+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b816800 2024-09-13T23:57:06.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.281+0000 7f96342dd700 1 --2- 172.21.15.173:0/2148877605 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559e3b816800 0x559e3b6d4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.281+0000 7f96342dd700 1 --2- 172.21.15.173:0/2148877605 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559e3b816800 0x559e3b6d4c00 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.281+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b816800 2024-09-13T23:57:06.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.281+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b78b400 2024-09-13T23:57:06.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.281+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b78b400 2024-09-13T23:57:06.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.281+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b78b400 2024-09-13T23:57:06.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.285+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b78b400 2024-09-13T23:57:06.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.285+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b816400 2024-09-13T23:57:06.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.285+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b811440 con 0x559e3b816400 2024-09-13T23:57:06.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.285+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b78b400 2024-09-13T23:57:06.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.285+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b78b400 2024-09-13T23:57:06.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.285+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b78bc00 2024-09-13T23:57:06.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.285+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b811200 con 0x559e3b78bc00 2024-09-13T23:57:06.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.285+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b78bc00 2024-09-13T23:57:06.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.285+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b811200 con 0x559e3b78bc00 2024-09-13T23:57:06.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.285+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b78b400 2024-09-13T23:57:06.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.285+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b78b400 2024-09-13T23:57:06.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.285+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b816800 2024-09-13T23:57:06.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.285+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b816800 2024-09-13T23:57:06.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.285+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b78b400 2024-09-13T23:57:06.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.289+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b78b400 2024-09-13T23:57:06.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.289+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b816800 2024-09-13T23:57:06.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.289+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b816800 2024-09-13T23:57:06.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.289+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b78bc00 2024-09-13T23:57:06.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.289+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b811200 con 0x559e3b78bc00 2024-09-13T23:57:06.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.289+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b816400 2024-09-13T23:57:06.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.289+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b811440 con 0x559e3b816400 2024-09-13T23:57:06.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.289+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b78b400 2024-09-13T23:57:06.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.289+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b78b400 2024-09-13T23:57:06.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.289+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b78bc00 2024-09-13T23:57:06.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.293+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b811200 con 0x559e3b78bc00 2024-09-13T23:57:06.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.293+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b816400 2024-09-13T23:57:06.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.293+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b811440 con 0x559e3b816400 2024-09-13T23:57:06.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.293+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b78b400 2024-09-13T23:57:06.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.293+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b78b400 2024-09-13T23:57:06.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.293+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b78b400 2024-09-13T23:57:06.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.293+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b78b400 2024-09-13T23:57:06.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.293+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b78b400 2024-09-13T23:57:06.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.293+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b78b400 2024-09-13T23:57:06.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.293+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b816400 2024-09-13T23:57:06.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.293+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b811440 con 0x559e3b816400 2024-09-13T23:57:06.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.293+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b816800 2024-09-13T23:57:06.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.293+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b816800 2024-09-13T23:57:06.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.293+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b78b400 2024-09-13T23:57:06.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.293+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b78b400 2024-09-13T23:57:06.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.297+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b816800 2024-09-13T23:57:06.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.297+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b816800 2024-09-13T23:57:06.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.297+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b816400 2024-09-13T23:57:06.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.297+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b811440 con 0x559e3b816400 2024-09-13T23:57:06.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.297+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b816800 2024-09-13T23:57:06.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.297+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b816800 2024-09-13T23:57:06.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.297+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b78bc00 2024-09-13T23:57:06.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.297+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b811200 con 0x559e3b78bc00 2024-09-13T23:57:06.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.297+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b78bc00 2024-09-13T23:57:06.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.297+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b811200 con 0x559e3b78bc00 2024-09-13T23:57:06.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.297+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b816400 2024-09-13T23:57:06.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.297+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b811440 con 0x559e3b816400 2024-09-13T23:57:06.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.297+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b78bc00 2024-09-13T23:57:06.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x559e3b811200 con 0x559e3b78bc00 2024-09-13T23:57:06.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b78bc00 2024-09-13T23:57:06.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559e3b811200 con 0x559e3b78bc00 2024-09-13T23:57:06.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9635323f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:06.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9635323f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:06.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9635323f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:06.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9635323f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:06.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9635323f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b817000 con 0x559e3b78b400 2024-09-13T23:57:06.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b78b400 2024-09-13T23:57:06.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9635323f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9635323f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b817400 con 0x559e3b78bc00 2024-09-13T23:57:06.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x559e3b811200 con 0x559e3b78bc00 2024-09-13T23:57:06.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9635323f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:06.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9635323f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b817800 con 0x559e3b78b400 2024-09-13T23:57:06.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b78b400 2024-09-13T23:57:06.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9635323f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:06.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9635323f40 20 zone default found 2024-09-13T23:57:06.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9635323f40 4 Realm: () 2024-09-13T23:57:06.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9635323f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:06.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9635323f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:06.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9635323f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:06.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9635323f40 20 zonegroup default 2024-09-13T23:57:06.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9635323f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.301+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b817c00 con 0x559e3b816800 2024-09-13T23:57:06.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.305+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b816800 2024-09-13T23:57:06.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.305+0000 7f9635323f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.305+0000 7f9635323f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.305+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b817000 con 0x559e3b816400 2024-09-13T23:57:06.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.305+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x559e3b811440 con 0x559e3b816400 2024-09-13T23:57:06.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.305+0000 7f9635323f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.305+0000 7f9635323f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.305+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b817800 con 0x559e3b816400 2024-09-13T23:57:06.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.305+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x559e3b811440 con 0x559e3b816400 2024-09-13T23:57:06.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.305+0000 7f9635323f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.305+0000 7f9635323f40 20 started sync module instance, tier type = 2024-09-13T23:57:06.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.305+0000 7f9635323f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:06.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.305+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b78b800 con 0x559e3b78bc00 2024-09-13T23:57:06.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.309+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b78bc00 2024-09-13T23:57:06.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.309+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94138090167040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b78a800 con 0x559e3b78bc00 2024-09-13T23:57:06.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.309+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b78b800 con 0x559e3b78b400 2024-09-13T23:57:06.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.309+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94138090167040] v33'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b78bc00 2024-09-13T23:57:06.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.309+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b78b400 2024-09-13T23:57:06.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.309+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94138090168192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b78b400 2024-09-13T23:57:06.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.309+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b817400 con 0x559e3b78bc00 2024-09-13T23:57:06.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.313+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94138090168192] v33'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b78b400 2024-09-13T23:57:06.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.313+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b78bc00 2024-09-13T23:57:06.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.313+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94138090169344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b74e000 con 0x559e3b78bc00 2024-09-13T23:57:06.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.313+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b74e400 con 0x559e3b816800 2024-09-13T23:57:06.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.317+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94138090169344] v33'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b78bc00 2024-09-13T23:57:06.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.317+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b816800 2024-09-13T23:57:06.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.317+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94138090170496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b74e800 con 0x559e3b816800 2024-09-13T23:57:06.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.317+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b74ec00 con 0x559e3b78bc00 2024-09-13T23:57:06.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.317+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94138090170496] v33'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b816800 2024-09-13T23:57:06.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.321+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b78bc00 2024-09-13T23:57:06.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.321+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94138090171648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b74f000 con 0x559e3b78bc00 2024-09-13T23:57:06.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.321+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b74f400 con 0x559e3b816400 2024-09-13T23:57:06.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.321+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b811440 con 0x559e3b816400 2024-09-13T23:57:06.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.321+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94138090172800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b74f800 con 0x559e3b816400 2024-09-13T23:57:06.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.321+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b74fc00 con 0x559e3b816400 2024-09-13T23:57:06.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.321+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94138090171648] v33'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b78bc00 2024-09-13T23:57:06.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.325+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94138090172800] v33'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b811440 con 0x559e3b816400 2024-09-13T23:57:06.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.325+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b811440 con 0x559e3b816400 2024-09-13T23:57:06.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.325+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94138090173952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b74f400 con 0x559e3b816400 2024-09-13T23:57:06.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.325+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b74e000 con 0x559e3b816800 2024-09-13T23:57:06.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.325+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b816800 2024-09-13T23:57:06.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.325+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94138090175104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b74ec00 con 0x559e3b816800 2024-09-13T23:57:06.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.325+0000 7f9635323f40 20 add_watcher() i=0 2024-09-13T23:57:06.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.325+0000 7f9635323f40 20 add_watcher() i=1 2024-09-13T23:57:06.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.325+0000 7f9635323f40 20 add_watcher() i=2 2024-09-13T23:57:06.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.325+0000 7f9635323f40 20 add_watcher() i=3 2024-09-13T23:57:06.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.325+0000 7f9635323f40 20 add_watcher() i=4 2024-09-13T23:57:06.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.325+0000 7f9635323f40 20 add_watcher() i=5 2024-09-13T23:57:06.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.325+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94138090173952] v33'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b811440 con 0x559e3b816400 2024-09-13T23:57:06.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.325+0000 7f9635323f40 20 add_watcher() i=6 2024-09-13T23:57:06.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.329+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94138090175104] v33'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b816800 2024-09-13T23:57:06.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.329+0000 7f9635323f40 20 add_watcher() i=7 2024-09-13T23:57:06.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.329+0000 7f9635323f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:06.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.329+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816c00 con 0x559e3b78b400 2024-09-13T23:57:06.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.329+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b78b400 2024-09-13T23:57:06.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.329+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94138091601920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b817000 con 0x559e3b78b400 2024-09-13T23:57:06.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.329+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94138091601920] v33'134 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b78b400 2024-09-13T23:57:06.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.329+0000 7f961aaaa700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:06.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.329+0000 7f9635323f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:06.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.333+0000 7f9635323f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:06.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.333+0000 7f9635323f40 1 Processor -- start 2024-09-13T23:57:06.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.333+0000 7f9635323f40 1 -- start start 2024-09-13T23:57:06.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.333+0000 7f9635323f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b817400 0x559e3b6d5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.333+0000 7f9635323f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e3b47a3c0 con 0x559e3b817400 2024-09-13T23:57:06.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.333+0000 7f96332db700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b817400 0x559e3b6d5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.333+0000 7f96332db700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b817400 0x559e3b6d5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50652/0 (socket says 172.21.15.173:50652) 2024-09-13T23:57:06.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.333+0000 7f96332db700 1 -- 172.21.15.173:0/1609832156 learned_addr learned my addr 172.21.15.173:0/1609832156 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.333+0000 7f96332db700 1 -- 172.21.15.173:0/1609832156 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e3b3feb60 con 0x559e3b817400 2024-09-13T23:57:06.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.333+0000 7f96332db700 1 --2- 172.21.15.173:0/1609832156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b817400 0x559e3b6d5180 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x559e3b7c5d70 tx=0x559e3b4f1980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00bdc92554f298f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.333+0000 7f961a2a9700 1 -- 172.21.15.173:0/1609832156 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559e3b491760 con 0x559e3b817400 2024-09-13T23:57:06.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.333+0000 7f961a2a9700 1 -- 172.21.15.173:0/1609832156 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559e3b7aa900 con 0x559e3b817400 2024-09-13T23:57:06.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.333+0000 7f961a2a9700 1 -- 172.21.15.173:0/1609832156 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559e3b74c160 con 0x559e3b817400 2024-09-13T23:57:06.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.333+0000 7f9635323f40 1 -- 172.21.15.173:0/1609832156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b817400 msgr2=0x559e3b6d5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.333+0000 7f9635323f40 1 --2- 172.21.15.173:0/1609832156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b817400 0x559e3b6d5180 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x559e3b7c5d70 tx=0x559e3b4f1980 comp rx=0 tx=0).stop 2024-09-13T23:57:06.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.333+0000 7f9635323f40 1 -- 172.21.15.173:0/1609832156 shutdown_connections 2024-09-13T23:57:06.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.333+0000 7f9635323f40 1 --2- 172.21.15.173:0/1609832156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b817400 0x559e3b6d5180 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.333+0000 7f9635323f40 1 -- 172.21.15.173:0/1609832156 >> 172.21.15.173:0/1609832156 conn(0x559e3b817800 msgr2=0x559e3b4ee000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.333+0000 7f9635323f40 1 -- 172.21.15.173:0/1609832156 shutdown_connections 2024-09-13T23:57:06.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.333+0000 7f9635323f40 1 -- 172.21.15.173:0/1609832156 wait complete. 2024-09-13T23:57:06.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.333+0000 7f9635323f40 1 Processor -- start 2024-09-13T23:57:06.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.333+0000 7f9635323f40 1 -- start start 2024-09-13T23:57:06.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.337+0000 7f9635323f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b817400 0x559e3b6d5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.337+0000 7f9635323f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e3b47a500 con 0x559e3b817400 2024-09-13T23:57:06.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.337+0000 7f96332db700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b817400 0x559e3b6d5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.337+0000 7f96332db700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b817400 0x559e3b6d5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50662/0 (socket says 172.21.15.173:50662) 2024-09-13T23:57:06.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.337+0000 7f96332db700 1 -- 172.21.15.173:0/3489806401 learned_addr learned my addr 172.21.15.173:0/3489806401 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.337+0000 7f96332db700 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e3b3fed00 con 0x559e3b817400 2024-09-13T23:57:06.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.337+0000 7f96332db700 1 --2- 172.21.15.173:0/3489806401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b817400 0x559e3b6d5180 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x559e3b8320c0 tx=0x559e3b74bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.337+0000 7f9618aa6700 1 -- 172.21.15.173:0/3489806401 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559e3b74c2c0 con 0x559e3b817400 2024-09-13T23:57:06.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.337+0000 7f9618aa6700 1 -- 172.21.15.173:0/3489806401 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559e3b7aa600 con 0x559e3b817400 2024-09-13T23:57:06.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.337+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559e3b3fe340 con 0x559e3b817400 2024-09-13T23:57:06.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.337+0000 7f9618aa6700 1 -- 172.21.15.173:0/3489806401 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559e3b74c420 con 0x559e3b817400 2024-09-13T23:57:06.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.337+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559e3b3ffd40 con 0x559e3b817400 2024-09-13T23:57:06.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.337+0000 7f9618aa6700 1 -- 172.21.15.173:0/3489806401 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x559e3b4e7b80 con 0x559e3b817400 2024-09-13T23:57:06.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.337+0000 7f9618aa6700 1 --2- 172.21.15.173:0/3489806401 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559e3b816c00 0x559e3b8be000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.337+0000 7f9618aa6700 1 -- 172.21.15.173:0/3489806401 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x559e3b4536c0 con 0x559e3b817400 2024-09-13T23:57:06.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.337+0000 7f96342dd700 1 --2- 172.21.15.173:0/3489806401 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559e3b816c00 0x559e3b8be000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.337+0000 7f9635323f40 1 --2- 172.21.15.173:0/3489806401 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559e3b817c00 0x559e3b6d5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.337+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b817c00 2024-09-13T23:57:06.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.341+0000 7f9633adc700 1 --2- 172.21.15.173:0/3489806401 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559e3b817c00 0x559e3b6d5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.341+0000 7f96342dd700 1 --2- 172.21.15.173:0/3489806401 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559e3b816c00 0x559e3b8be000 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x559e3b7c4600 tx=0x559e3b74a9c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.341+0000 7f9633adc700 1 --2- 172.21.15.173:0/3489806401 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559e3b817c00 0x559e3b6d5700 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.341+0000 7f9633adc700 1 -- 172.21.15.173:0/3489806401 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v33'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b817c00 2024-09-13T23:57:06.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.341+0000 7f9635323f40 1 --2- 172.21.15.173:0/3489806401 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559e3b78a800 0x559e3b8be580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.341+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b78b800 con 0x559e3b78a800 2024-09-13T23:57:06.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.341+0000 7f96332db700 1 --2- 172.21.15.173:0/3489806401 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559e3b78a800 0x559e3b8be580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.341+0000 7f96332db700 1 --2- 172.21.15.173:0/3489806401 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559e3b78a800 0x559e3b8be580 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.345+0000 7f96332db700 1 -- 172.21.15.173:0/3489806401 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v33'16 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559e3b811440 con 0x559e3b78a800 2024-09-13T23:57:06.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.345+0000 7f9635323f40 1 --2- 172.21.15.173:0/3489806401 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559e3b74e800 0x559e3b8beb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.345+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b74e000 con 0x559e3b74e800 2024-09-13T23:57:06.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.345+0000 7f96342dd700 1 --2- 172.21.15.173:0/3489806401 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559e3b74e800 0x559e3b8beb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.345+0000 7f96342dd700 1 --2- 172.21.15.173:0/3489806401 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559e3b74e800 0x559e3b8beb00 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.349+0000 7f96342dd700 1 -- 172.21.15.173:0/3489806401 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v33'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b74e800 2024-09-13T23:57:06.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.349+0000 7f9635323f40 1 --2- 172.21.15.173:0/3489806401 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559e3b74ec00 0x559e3b8bf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.349+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b74f000 con 0x559e3b74ec00 2024-09-13T23:57:06.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.349+0000 7f9633adc700 1 --2- 172.21.15.173:0/3489806401 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559e3b74ec00 0x559e3b8bf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.349+0000 7f9633adc700 1 --2- 172.21.15.173:0/3489806401 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559e3b74ec00 0x559e3b8bf080 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.353+0000 7f9633adc700 1 -- 172.21.15.173:0/3489806401 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v33'135 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b74ec00 2024-09-13T23:57:06.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.353+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b74e400 con 0x559e3b817c00 2024-09-13T23:57:06.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.353+0000 7f9633adc700 1 -- 172.21.15.173:0/3489806401 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v33'38 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b817c00 2024-09-13T23:57:06.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.353+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b817000 con 0x559e3b74e800 2024-09-13T23:57:06.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.357+0000 7f96342dd700 1 -- 172.21.15.173:0/3489806401 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v33'25 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b74e800 2024-09-13T23:57:06.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.357+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f6000 con 0x559e3b817c00 2024-09-13T23:57:06.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.357+0000 7f9633adc700 1 -- 172.21.15.173:0/3489806401 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v33'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b817c00 2024-09-13T23:57:06.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.357+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f6400 con 0x559e3b74ec00 2024-09-13T23:57:06.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.361+0000 7f9633adc700 1 -- 172.21.15.173:0/3489806401 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v33'25 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b74ec00 2024-09-13T23:57:06.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.361+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f6800 con 0x559e3b817c00 2024-09-13T23:57:06.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.365+0000 7f9633adc700 1 -- 172.21.15.173:0/3489806401 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b817c00 2024-09-13T23:57:06.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.365+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f6c00 con 0x559e3b817c00 2024-09-13T23:57:06.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.365+0000 7f9633adc700 1 -- 172.21.15.173:0/3489806401 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v33'22 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b817c00 2024-09-13T23:57:06.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.365+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f7000 con 0x559e3b817c00 2024-09-13T23:57:06.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.369+0000 7f9633adc700 1 -- 172.21.15.173:0/3489806401 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v33'39 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b817c00 2024-09-13T23:57:06.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.369+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f7400 con 0x559e3b74e800 2024-09-13T23:57:06.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.373+0000 7f96342dd700 1 -- 172.21.15.173:0/3489806401 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b74e800 2024-09-13T23:57:06.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.373+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f7800 con 0x559e3b817c00 2024-09-13T23:57:06.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.373+0000 7f9633adc700 1 -- 172.21.15.173:0/3489806401 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b817c00 2024-09-13T23:57:06.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.373+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f7c00 con 0x559e3b74ec00 2024-09-13T23:57:06.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.377+0000 7f9633adc700 1 -- 172.21.15.173:0/3489806401 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v33'31 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b74ec00 2024-09-13T23:57:06.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.377+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f6000 con 0x559e3b74ec00 2024-09-13T23:57:06.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.381+0000 7f9633adc700 1 -- 172.21.15.173:0/3489806401 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v33'136 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b74ec00 2024-09-13T23:57:06.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.381+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f6400 con 0x559e3b817c00 2024-09-13T23:57:06.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.381+0000 7f9633adc700 1 -- 172.21.15.173:0/3489806401 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v33'32 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b817c00 2024-09-13T23:57:06.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.381+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f6800 con 0x559e3b817c00 2024-09-13T23:57:06.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.385+0000 7f9633adc700 1 -- 172.21.15.173:0/3489806401 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v33'40 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b817c00 2024-09-13T23:57:06.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.385+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b74f000 con 0x559e3b74e800 2024-09-13T23:57:06.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.389+0000 7f96342dd700 1 -- 172.21.15.173:0/3489806401 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v33'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b74e800 2024-09-13T23:57:06.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.389+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b74e400 con 0x559e3b817c00 2024-09-13T23:57:06.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.389+0000 7f9633adc700 1 -- 172.21.15.173:0/3489806401 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b817c00 2024-09-13T23:57:06.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.389+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b74ec00 2024-09-13T23:57:06.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.393+0000 7f9633adc700 1 -- 172.21.15.173:0/3489806401 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v33'137 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b74ec00 2024-09-13T23:57:06.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.393+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f6c00 con 0x559e3b817c00 2024-09-13T23:57:06.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.393+0000 7f9633adc700 1 -- 172.21.15.173:0/3489806401 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v33'33 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b817c00 2024-09-13T23:57:06.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.393+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f7000 con 0x559e3b817c00 2024-09-13T23:57:06.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.397+0000 7f9633adc700 1 -- 172.21.15.173:0/3489806401 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v33'26 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b817c00 2024-09-13T23:57:06.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.397+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f7800 con 0x559e3b74e800 2024-09-13T23:57:06.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.401+0000 7f96342dd700 1 -- 172.21.15.173:0/3489806401 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b74e800 2024-09-13T23:57:06.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.401+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f7c00 con 0x559e3b817c00 2024-09-13T23:57:06.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.401+0000 7f9633adc700 1 -- 172.21.15.173:0/3489806401 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v33'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b817c00 2024-09-13T23:57:06.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.401+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f6000 con 0x559e3b74e800 2024-09-13T23:57:06.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.405+0000 7f96342dd700 1 -- 172.21.15.173:0/3489806401 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v33'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b74e800 2024-09-13T23:57:06.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.405+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f6400 con 0x559e3b74e800 2024-09-13T23:57:06.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.409+0000 7f96342dd700 1 -- 172.21.15.173:0/3489806401 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v33'26 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b74e800 2024-09-13T23:57:06.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.409+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f6800 con 0x559e3b74e800 2024-09-13T23:57:06.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.413+0000 7f96342dd700 1 -- 172.21.15.173:0/3489806401 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b74e800 2024-09-13T23:57:06.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.413+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f7400 con 0x559e3b817c00 2024-09-13T23:57:06.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.413+0000 7f9633adc700 1 -- 172.21.15.173:0/3489806401 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b817c00 2024-09-13T23:57:06.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.413+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f7800 con 0x559e3b74ec00 2024-09-13T23:57:06.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.417+0000 7f9633adc700 1 -- 172.21.15.173:0/3489806401 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v33'26 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b74ec00 2024-09-13T23:57:06.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.417+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f6000 con 0x559e3b817c00 2024-09-13T23:57:06.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.421+0000 7f9633adc700 1 -- 172.21.15.173:0/3489806401 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v33'34 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b817c00 2024-09-13T23:57:06.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.421+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b74e000 con 0x559e3b74ec00 2024-09-13T23:57:06.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.421+0000 7f9633adc700 1 -- 172.21.15.173:0/3489806401 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v33'32 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b74ec00 2024-09-13T23:57:06.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.421+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b74f000 con 0x559e3b78a800 2024-09-13T23:57:06.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.425+0000 7f96332db700 1 -- 172.21.15.173:0/3489806401 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v33'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559e3b811440 con 0x559e3b78a800 2024-09-13T23:57:06.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.429+0000 7f96162a1700 20 reqs_thread_entry: start 2024-09-13T23:57:06.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.429+0000 7f9635323f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:06.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.429+0000 7f9635323f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:06.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.429+0000 7f961429d700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:36 2024 2024-09-13T23:57:06.435 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:06.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.429+0000 7f9613a7b700 20 reqs_thread_entry: start 2024-09-13T23:57:06.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.429+0000 7f9635323f40 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-13T23:57:06.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.429+0000 7f9635323f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.429+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f7000 con 0x559e3b816400 2024-09-13T23:57:06.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.429+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~385 out=385b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 246+0+508 (crc 0 0 0) 0x559e3b811440 con 0x559e3b816400 2024-09-13T23:57:06.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.429+0000 7f9635323f40 20 rados_obj.operate() r=0 bl.length=385 2024-09-13T23:57:06.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.429+0000 7f9635323f40 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-13T23:57:06.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.429+0000 7f9635323f40 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T23:57:06.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.429+0000 7f9635323f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:06.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.429+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f7c00 con 0x559e3b78b400 2024-09-13T23:57:06.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.429+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(63 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) v8 ==== 170+0+15 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b78b400 2024-09-13T23:57:06.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.429+0000 7f9635323f40 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-13T23:57:06.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.429+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:64 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f7400 con 0x559e3b816400 2024-09-13T23:57:06.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.433+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(64 p5YnriCv1nAtykxBrupQ [delete] v33'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x559e3b811440 con 0x559e3b816400 2024-09-13T23:57:06.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.433+0000 7f9635323f40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T23:57:06.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.433+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94138091605376 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f7800 con 0x559e3b78bc00 2024-09-13T23:57:06.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.433+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== watch-notify(notify (1) cookie 94138090169344 notify 141733920795 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x559e3b718d00 con 0x559e3b78bc00 2024-09-13T23:57:06.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.433+0000 7f962dad0700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920795 cookie 94138090169344 notifier 4616 bl.length()=170 2024-09-13T23:57:06.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.433+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(65 notify.2 [notify cookie 94138091605376 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x559e3b811200 con 0x559e3b78bc00 2024-09-13T23:57:06.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.433+0000 7f962dad0700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b74f800 con 0x559e3b78bc00 2024-09-13T23:57:06.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.433+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b78bc00 2024-09-13T23:57:06.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.437+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== watch-notify(notify_complete (2) cookie 94138091605376 notify 141733920795 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x559e3b788ea0 con 0x559e3b78bc00 2024-09-13T23:57:06.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.437+0000 7f9635323f40 10 removing email index: 2024-09-13T23:57:06.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.437+0000 7f9635323f40 10 removing user buckets index 2024-09-13T23:57:06.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.437+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:67 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f6000 con 0x559e3b78b400 2024-09-13T23:57:06.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.437+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(67 testx$tenanteduser.buckets [delete] v33'3 uv3 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b78b400 2024-09-13T23:57:06.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.437+0000 7f9635323f40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-13T23:57:06.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.437+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify cookie 94138091605376 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b816000 con 0x559e3b78bc00 2024-09-13T23:57:06.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.437+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== watch-notify(notify (1) cookie 94138090171648 notify 141733920796 ret 0) v3 ==== 217+0+0 (crc 0 0 0) 0x559e3b788ea0 con 0x559e3b78bc00 2024-09-13T23:57:06.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.437+0000 7f962dad0700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920796 cookie 94138090171648 notifier 4616 bl.length()=175 2024-09-13T23:57:06.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.437+0000 7f962dad0700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b78b800 con 0x559e3b78bc00 2024-09-13T23:57:06.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.437+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(68 notify.4 [notify cookie 94138091605376 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x559e3b811200 con 0x559e3b78bc00 2024-09-13T23:57:06.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.441+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== watch-notify(notify_complete (2) cookie 94138091605376 notify 141733920796 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x559e3b789040 con 0x559e3b78bc00 2024-09-13T23:57:06.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.441+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== osd_op_reply(69 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b78bc00 2024-09-13T23:57:06.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.441+0000 7f9635323f40 10 removing user index: testx$tenanteduser 2024-09-13T23:57:06.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.441+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b74e400 con 0x559e3b816400 2024-09-13T23:57:06.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.441+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(70 testx$tenanteduser [call,call,delete] v33'8 uv8 ondisk = 0) v8 ==== 246+0+0 (crc 0 0 0) 0x559e3b811440 con 0x559e3b816400 2024-09-13T23:57:06.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.441+0000 7f9635323f40 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-13T23:57:06.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.441+0000 7f9635323f40 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-13T23:57:06.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.441+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [notify cookie 94138091605376 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f7000 con 0x559e3b816800 2024-09-13T23:57:06.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.441+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== watch-notify(notify (1) cookie 94138090170496 notify 141733920777 ret 0) v3 ==== 209+0+0 (crc 0 0 0) 0x559e3b788ea0 con 0x559e3b816800 2024-09-13T23:57:06.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.441+0000 7f962e2d1700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920777 cookie 94138090170496 notifier 4616 bl.length()=167 2024-09-13T23:57:06.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.441+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(71 notify.3 [notify cookie 94138091605376 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b816800 2024-09-13T23:57:06.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.441+0000 7f962e2d1700 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b960000 con 0x559e3b816800 2024-09-13T23:57:06.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.445+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(72 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b816800 2024-09-13T23:57:06.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.445+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== watch-notify(notify_complete (2) cookie 94138091605376 notify 141733920777 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x559e3b718d00 con 0x559e3b816800 2024-09-13T23:57:06.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.445+0000 7f961aaaa700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:06.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.445+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94138091601920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b74fc00 con 0x559e3b78b400 2024-09-13T23:57:06.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.449+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94138091601920] v33'138 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b78b400 2024-09-13T23:57:06.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.449+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94138090167040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b74f000 con 0x559e3b78bc00 2024-09-13T23:57:06.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.449+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94138090167040] v33'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b78bc00 2024-09-13T23:57:06.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.449+0000 7f9635323f40 20 remove_watcher() i=0 2024-09-13T23:57:06.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.449+0000 7f9635323f40 2 removed watcher, disabling cache 2024-09-13T23:57:06.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.449+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94138090168192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b74fc00 con 0x559e3b78b400 2024-09-13T23:57:06.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.453+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94138090168192] v33'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b78b400 2024-09-13T23:57:06.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.453+0000 7f9635323f40 20 remove_watcher() i=1 2024-09-13T23:57:06.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.453+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94138090169344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f6400 con 0x559e3b78bc00 2024-09-13T23:57:06.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.453+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 27 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94138090169344] v33'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b78bc00 2024-09-13T23:57:06.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.453+0000 7f9635323f40 20 remove_watcher() i=2 2024-09-13T23:57:06.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.453+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94138090170496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f6800 con 0x559e3b816800 2024-09-13T23:57:06.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.457+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94138090170496] v33'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b816800 2024-09-13T23:57:06.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.457+0000 7f9635323f40 20 remove_watcher() i=3 2024-09-13T23:57:06.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.457+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94138090171648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f7c00 con 0x559e3b78bc00 2024-09-13T23:57:06.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.461+0000 7f9633adc700 1 -- 172.21.15.173:0/2148877605 <== osd.0 v2:172.21.15.87:6800/3507919120 28 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94138090171648] v33'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b811200 con 0x559e3b78bc00 2024-09-13T23:57:06.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.461+0000 7f9635323f40 20 remove_watcher() i=4 2024-09-13T23:57:06.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.461+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94138090172800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f6000 con 0x559e3b816400 2024-09-13T23:57:06.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.461+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94138090172800] v33'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b811440 con 0x559e3b816400 2024-09-13T23:57:06.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.461+0000 7f9635323f40 20 remove_watcher() i=5 2024-09-13T23:57:06.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.461+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94138090173952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b8f7000 con 0x559e3b816400 2024-09-13T23:57:06.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.465+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94138090173952] v33'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b811440 con 0x559e3b816400 2024-09-13T23:57:06.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.465+0000 7f9635323f40 20 remove_watcher() i=6 2024-09-13T23:57:06.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.465+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94138090175104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559e3b80a000 con 0x559e3b816800 2024-09-13T23:57:06.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.465+0000 7f96342dd700 1 -- 172.21.15.173:0/2148877605 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94138090175104] v33'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559e3b810b40 con 0x559e3b816800 2024-09-13T23:57:06.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.465+0000 7f9635323f40 20 remove_watcher() i=7 2024-09-13T23:57:06.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559e3b78bc00 msgr2=0x559e3b6d4100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 --2- 172.21.15.173:0/2148877605 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559e3b78bc00 0x559e3b6d4100 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559e3b78b400 msgr2=0x559e3b6d3b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 --2- 172.21.15.173:0/2148877605 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559e3b78b400 0x559e3b6d3b80 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559e3b816800 msgr2=0x559e3b6d4c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 --2- 172.21.15.173:0/2148877605 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559e3b816800 0x559e3b6d4c00 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559e3b816400 msgr2=0x559e3b6d4680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 --2- 172.21.15.173:0/2148877605 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559e3b816400 0x559e3b6d4680 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559e3b78b000 msgr2=0x559e3b6d3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 --2- 172.21.15.173:0/2148877605 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559e3b78b000 0x559e3b6d3600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x559e3b6cd920 tx=0x559e3b4f1800 comp rx=0 tx=0).stop 2024-09-13T23:57:06.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed800 msgr2=0x559e3b6d2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 --2- 172.21.15.173:0/2148877605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed800 0x559e3b6d2b00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x559e3b78ce40 tx=0x559e3b74ac00 comp rx=0 tx=0).stop 2024-09-13T23:57:06.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f96332db700 1 -- 172.21.15.173:0/2148877605 reap_dead start 2024-09-13T23:57:06.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 shutdown_connections 2024-09-13T23:57:06.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 --2- 172.21.15.173:0/2148877605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed800 0x559e3b6d2b00 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 >> 172.21.15.173:0/2148877605 conn(0x559e3b3ed400 msgr2=0x559e3b4ed800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 shutdown_connections 2024-09-13T23:57:06.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/2148877605 wait complete. 2024-09-13T23:57:06.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559e3b817c00 msgr2=0x559e3b6d5700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 --2- 172.21.15.173:0/3489806401 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559e3b817c00 0x559e3b6d5700 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559e3b74ec00 msgr2=0x559e3b8bf080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 --2- 172.21.15.173:0/3489806401 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559e3b74ec00 0x559e3b8bf080 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559e3b78a800 msgr2=0x559e3b8be580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 --2- 172.21.15.173:0/3489806401 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559e3b78a800 0x559e3b8be580 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559e3b74e800 msgr2=0x559e3b8beb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 --2- 172.21.15.173:0/3489806401 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559e3b74e800 0x559e3b8beb00 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559e3b816c00 msgr2=0x559e3b8be000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 --2- 172.21.15.173:0/3489806401 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559e3b816c00 0x559e3b8be000 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x559e3b7c4600 tx=0x559e3b74a9c0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b817400 msgr2=0x559e3b6d5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9633adc700 1 -- 172.21.15.173:0/3489806401 reap_dead start 2024-09-13T23:57:06.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 --2- 172.21.15.173:0/3489806401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b817400 0x559e3b6d5180 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x559e3b8320c0 tx=0x559e3b74bc20 comp rx=0 tx=0).stop 2024-09-13T23:57:06.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 shutdown_connections 2024-09-13T23:57:06.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 --2- 172.21.15.173:0/3489806401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b817400 0x559e3b6d5180 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 >> 172.21.15.173:0/3489806401 conn(0x559e3b817800 msgr2=0x559e3b4ee000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 shutdown_connections 2024-09-13T23:57:06.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/3489806401 wait complete. 2024-09-13T23:57:06.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/1685988028 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559e3b78a000 msgr2=0x559e3b6d3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 --2- 172.21.15.173:0/1685988028 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559e3b78a000 0x559e3b6d3080 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x559e3c264990 tx=0x559e3b74aa20 comp rx=0 tx=0).stop 2024-09-13T23:57:06.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/1685988028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed000 msgr2=0x559e3b6d2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 --2- 172.21.15.173:0/1685988028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed000 0x559e3b6d2580 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x559e3b549f50 tx=0x559e3b4f1a40 comp rx=0 tx=0).stop 2024-09-13T23:57:06.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/1685988028 shutdown_connections 2024-09-13T23:57:06.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 --2- 172.21.15.173:0/1685988028 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559e3b78a000 0x559e3b6d3080 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 --2- 172.21.15.173:0/1685988028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559e3b3ed000 0x559e3b6d2580 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/1685988028 >> 172.21.15.173:0/1685988028 conn(0x559e3b3ecc00 msgr2=0x559e3b4ed000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/1685988028 shutdown_connections 2024-09-13T23:57:06.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.469+0000 7f9635323f40 1 -- 172.21.15.173:0/1685988028 wait complete. 2024-09-13T23:57:06.496 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-13T23:57:06.501 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-13T23:57:06.549 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:57:06.549 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-13T23:57:06.550 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-13T23:57:06.550 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-13T23:57:06.595 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:06.595 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:06.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.589+0000 7fd69c8adf40 1 Processor -- start 2024-09-13T23:57:06.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.589+0000 7fd69c8adf40 1 -- start start 2024-09-13T23:57:06.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.589+0000 7fd69c8adf40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x564690ce7000 0x564690fcc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.589+0000 7fd69c8adf40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564690dab500 con 0x564690ce7400 2024-09-13T23:57:06.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.589+0000 7fd69c8adf40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x564690d74a00 con 0x564690ce7000 2024-09-13T23:57:06.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.589+0000 7fd69b066700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x564690ce7000 0x564690fcc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.589+0000 7fd69b066700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x564690ce7000 0x564690fcc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50676/0 (socket says 172.21.15.173:50676) 2024-09-13T23:57:06.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.589+0000 7fd69b066700 1 -- 172.21.15.173:0/1699417738 learned_addr learned my addr 172.21.15.173:0/1699417738 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.589+0000 7fd69a865700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x564690ce7400 0x564690de6800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47548/0 (socket says 172.21.15.173:47548) 2024-09-13T23:57:06.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.593+0000 7fd69b066700 1 -- 172.21.15.173:0/1699417738 >> v1:172.21.15.87:6789/0 conn(0x564690ce7400 legacy=0x564690de6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.593+0000 7fd69a064700 1 -- 172.21.15.173:0/1699417738 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472709982 0 0) 0x564690e42000 con 0x564690ce7400 2024-09-13T23:57:06.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.593+0000 7fd69b066700 1 -- 172.21.15.173:0/1699417738 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564690cf9d40 con 0x564690ce7000 2024-09-13T23:57:06.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.593+0000 7fd69b066700 1 --2- 172.21.15.173:0/1699417738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7000 0x564690fcc580 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x564690fc7a70 tx=0x564690deb920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9efd01556cd391d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.593+0000 7fd69a064700 1 -- 172.21.15.173:0/1699417738 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564690d8b4a0 con 0x564690ce7000 2024-09-13T23:57:06.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.593+0000 7fd69a064700 1 -- 172.21.15.173:0/1699417738 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564690dab800 con 0x564690ce7000 2024-09-13T23:57:06.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.593+0000 7fd69a064700 1 -- 172.21.15.173:0/1699417738 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564690d8b600 con 0x564690ce7000 2024-09-13T23:57:06.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.593+0000 7fd69c8adf40 1 -- 172.21.15.173:0/1699417738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7000 msgr2=0x564690fcc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.593+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/1699417738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7000 0x564690fcc580 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x564690fc7a70 tx=0x564690deb920 comp rx=0 tx=0).stop 2024-09-13T23:57:06.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.593+0000 7fd69c8adf40 1 -- 172.21.15.173:0/1699417738 shutdown_connections 2024-09-13T23:57:06.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.593+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/1699417738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7000 0x564690fcc580 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.593+0000 7fd69c8adf40 1 -- 172.21.15.173:0/1699417738 >> 172.21.15.173:0/1699417738 conn(0x564690ce6c00 msgr2=0x564690de6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.593+0000 7fd69c8adf40 1 -- 172.21.15.173:0/1699417738 shutdown_connections 2024-09-13T23:57:06.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.593+0000 7fd69c8adf40 1 -- 172.21.15.173:0/1699417738 wait complete. 2024-09-13T23:57:06.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.593+0000 7fd69c8adf40 1 Processor -- start 2024-09-13T23:57:06.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.593+0000 7fd69c8adf40 1 -- start start 2024-09-13T23:57:06.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.593+0000 7fd69c8adf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7400 0x564690fccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.593+0000 7fd69c8adf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564690d74500 con 0x564690ce7400 2024-09-13T23:57:06.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.593+0000 7fd69b066700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7400 0x564690fccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.593+0000 7fd69b066700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7400 0x564690fccb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50678/0 (socket says 172.21.15.173:50678) 2024-09-13T23:57:06.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.593+0000 7fd69b066700 1 -- 172.21.15.173:0/2001052388 learned_addr learned my addr 172.21.15.173:0/2001052388 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.597+0000 7fd69b066700 1 -- 172.21.15.173:0/2001052388 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564690cf9ba0 con 0x564690ce7400 2024-09-13T23:57:06.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.597+0000 7fd69b066700 1 --2- 172.21.15.173:0/2001052388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7400 0x564690fccb00 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x564691abbc80 tx=0x564690deb800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb4b36c820dbb38 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.597+0000 7fd699863700 1 -- 172.21.15.173:0/2001052388 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564690d8b760 con 0x564690ce7400 2024-09-13T23:57:06.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.597+0000 7fd699863700 1 -- 172.21.15.173:0/2001052388 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564690dabb00 con 0x564690ce7400 2024-09-13T23:57:06.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.597+0000 7fd699863700 1 -- 172.21.15.173:0/2001052388 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564690d8b4a0 con 0x564690ce7400 2024-09-13T23:57:06.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.597+0000 7fd69c8adf40 1 -- 172.21.15.173:0/2001052388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7400 msgr2=0x564690fccb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.597+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/2001052388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7400 0x564690fccb00 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x564691abbc80 tx=0x564690deb800 comp rx=0 tx=0).stop 2024-09-13T23:57:06.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.597+0000 7fd69c8adf40 1 -- 172.21.15.173:0/2001052388 shutdown_connections 2024-09-13T23:57:06.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.597+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/2001052388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7400 0x564690fccb00 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.597+0000 7fd69c8adf40 1 -- 172.21.15.173:0/2001052388 >> 172.21.15.173:0/2001052388 conn(0x564690ce6c00 msgr2=0x564690de7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.597+0000 7fd69c8adf40 1 -- 172.21.15.173:0/2001052388 shutdown_connections 2024-09-13T23:57:06.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.597+0000 7fd69c8adf40 1 -- 172.21.15.173:0/2001052388 wait complete. 2024-09-13T23:57:06.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.597+0000 7fd69c8adf40 1 Processor -- start 2024-09-13T23:57:06.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.597+0000 7fd69c8adf40 1 -- start start 2024-09-13T23:57:06.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.597+0000 7fd69c8adf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7400 0x564690fccb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.597+0000 7fd69c8adf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564690d743c0 con 0x564690ce7400 2024-09-13T23:57:06.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.597+0000 7fd69b066700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7400 0x564690fccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.597+0000 7fd69b066700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7400 0x564690fccb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50686/0 (socket says 172.21.15.173:50686) 2024-09-13T23:57:06.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.597+0000 7fd69b066700 1 -- 172.21.15.173:0/3167926511 learned_addr learned my addr 172.21.15.173:0/3167926511 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.597+0000 7fd69b066700 1 -- 172.21.15.173:0/3167926511 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564690cf9a00 con 0x564690ce7400 2024-09-13T23:57:06.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.597+0000 7fd69b066700 1 --2- 172.21.15.173:0/3167926511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7400 0x564690fccb00 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x564691abbd70 tx=0x564690deb920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.597+0000 7fd698060700 1 -- 172.21.15.173:0/3167926511 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564690d8b600 con 0x564690ce7400 2024-09-13T23:57:06.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.597+0000 7fd698060700 1 -- 172.21.15.173:0/3167926511 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564690dabc80 con 0x564690ce7400 2024-09-13T23:57:06.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.597+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3167926511 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564690cf9860 con 0x564690ce7400 2024-09-13T23:57:06.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.601+0000 7fd698060700 1 -- 172.21.15.173:0/3167926511 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564690d8b8c0 con 0x564690ce7400 2024-09-13T23:57:06.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.601+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3167926511 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564690cf96c0 con 0x564690ce7400 2024-09-13T23:57:06.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.601+0000 7fd69c8adf40 1 Processor -- start 2024-09-13T23:57:06.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.601+0000 7fd69c8adf40 1 -- start start 2024-09-13T23:57:06.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.601+0000 7fd69c8adf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7c00 0x564690fcd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.601+0000 7fd69c8adf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564690d0c640 con 0x564690ce7c00 2024-09-13T23:57:06.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.601+0000 7fd698060700 1 -- 172.21.15.173:0/3167926511 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x564690de0b00 con 0x564690ce7400 2024-09-13T23:57:06.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.601+0000 7fd698060700 1 --2- 172.21.15.173:0/3167926511 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56469107c000 0x564690fce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.601+0000 7fd69b867700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7c00 0x564690fcd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.601+0000 7fd698060700 1 -- 172.21.15.173:0/3167926511 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x564690d4d180 con 0x564690ce7400 2024-09-13T23:57:06.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.601+0000 7fd69b867700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7c00 0x564690fcd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50694/0 (socket says 172.21.15.173:50694) 2024-09-13T23:57:06.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.601+0000 7fd69b867700 1 -- 172.21.15.173:0/3747584933 learned_addr learned my addr 172.21.15.173:0/3747584933 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.601+0000 7fd69b066700 1 --2- 172.21.15.173:0/3167926511 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56469107c000 0x564690fce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.601+0000 7fd69b867700 1 -- 172.21.15.173:0/3747584933 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564690cf8000 con 0x564690ce7c00 2024-09-13T23:57:06.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.601+0000 7fd69b066700 1 --2- 172.21.15.173:0/3167926511 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56469107c000 0x564690fce100 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x56469100d3e0 tx=0x564691040780 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.601+0000 7fd69b867700 1 --2- 172.21.15.173:0/3747584933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7c00 0x564690fcd080 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x56469100c8d0 tx=0x564691040a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f532b31bd252e7be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.601+0000 7fd69585b700 1 -- 172.21.15.173:0/3747584933 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564690d8b600 con 0x564690ce7c00 2024-09-13T23:57:06.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.601+0000 7fd69585b700 1 -- 172.21.15.173:0/3747584933 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564691090000 con 0x564690ce7c00 2024-09-13T23:57:06.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.601+0000 7fd69585b700 1 -- 172.21.15.173:0/3747584933 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564690d8b8c0 con 0x564690ce7c00 2024-09-13T23:57:06.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.605+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3747584933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7c00 msgr2=0x564690fcd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.605+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3747584933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7c00 0x564690fcd080 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x56469100c8d0 tx=0x564691040a80 comp rx=0 tx=0).stop 2024-09-13T23:57:06.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.605+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3747584933 shutdown_connections 2024-09-13T23:57:06.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.605+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3747584933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7c00 0x564690fcd080 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.605+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3747584933 >> 172.21.15.173:0/3747584933 conn(0x564690ce7800 msgr2=0x564690de7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.605+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3747584933 shutdown_connections 2024-09-13T23:57:06.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.605+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3747584933 wait complete. 2024-09-13T23:57:06.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.605+0000 7fd69c8adf40 1 Processor -- start 2024-09-13T23:57:06.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.605+0000 7fd69c8adf40 1 -- start start 2024-09-13T23:57:06.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.605+0000 7fd69c8adf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7c00 0x564690fcd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.605+0000 7fd69c8adf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564690d0c8c0 con 0x564690ce7c00 2024-09-13T23:57:06.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.605+0000 7fd69b867700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7c00 0x564690fcd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.605+0000 7fd69b867700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7c00 0x564690fcd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50706/0 (socket says 172.21.15.173:50706) 2024-09-13T23:57:06.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.605+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 learned_addr learned my addr 172.21.15.173:0/3571333714 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.605+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564690cf8ea0 con 0x564690ce7c00 2024-09-13T23:57:06.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.605+0000 7fd69b867700 1 --2- 172.21.15.173:0/3571333714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7c00 0x564690fcd080 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x56469100c390 tx=0x5646910405a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.605+0000 7fd694058700 1 -- 172.21.15.173:0/3571333714 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564690d8b760 con 0x564690ce7c00 2024-09-13T23:57:06.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.605+0000 7fd694058700 1 -- 172.21.15.173:0/3571333714 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564691090180 con 0x564690ce7c00 2024-09-13T23:57:06.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.605+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564690cf8820 con 0x564690ce7c00 2024-09-13T23:57:06.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.605+0000 7fd694058700 1 -- 172.21.15.173:0/3571333714 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564690d8b600 con 0x564690ce7c00 2024-09-13T23:57:06.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.605+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564690cf89c0 con 0x564690ce7c00 2024-09-13T23:57:06.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.609+0000 7fd69c8adf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.609+0000 7fd694058700 1 -- 172.21.15.173:0/3571333714 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x564690de0dc0 con 0x564690ce7c00 2024-09-13T23:57:06.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.609+0000 7fd694058700 1 --2- 172.21.15.173:0/3571333714 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56469107cc00 0x564690fce680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.609+0000 7fd694058700 1 -- 172.21.15.173:0/3571333714 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x564690d4d340 con 0x564690ce7c00 2024-09-13T23:57:06.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.609+0000 7fd69a865700 1 --2- 172.21.15.173:0/3571333714 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56469107cc00 0x564690fce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.609+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3571333714 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56469107d000 0x564690fcd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.609+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d400 con 0x56469107d000 2024-09-13T23:57:06.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.609+0000 7fd69b867700 1 --2- 172.21.15.173:0/3571333714 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56469107d000 0x564690fcd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.609+0000 7fd69a865700 1 --2- 172.21.15.173:0/3571333714 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56469107cc00 0x564690fce680 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x56469106b830 tx=0x564691041920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.609+0000 7fd69b867700 1 --2- 172.21.15.173:0/3571333714 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56469107d000 0x564690fcd600 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.609+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d000 2024-09-13T23:57:06.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.609+0000 7fd69c8adf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.609+0000 7fd69c8adf40 20 realm 2024-09-13T23:57:06.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.609+0000 7fd69c8adf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.609+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107d000 2024-09-13T23:57:06.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.609+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d000 2024-09-13T23:57:06.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.609+0000 7fd69c8adf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.609+0000 7fd69c8adf40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:06.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.609+0000 7fd69c8adf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.609+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107dc00 con 0x56469107d000 2024-09-13T23:57:06.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.613+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d000 2024-09-13T23:57:06.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.613+0000 7fd69c8adf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.613+0000 7fd69c8adf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.613+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3571333714 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56469107d400 0x564690fcdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.613+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107d400 2024-09-13T23:57:06.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.613+0000 7fd69b066700 1 --2- 172.21.15.173:0/3571333714 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56469107d400 0x564690fcdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.613+0000 7fd69b066700 1 --2- 172.21.15.173:0/3571333714 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56469107d400 0x564690fcdb80 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.613+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5646910ef200 con 0x56469107d400 2024-09-13T23:57:06.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.613+0000 7fd69c8adf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:06.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.613+0000 7fd69c8adf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.613+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3571333714 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56469107dc00 0x564690fcec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.613+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564691146000 con 0x56469107dc00 2024-09-13T23:57:06.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.613+0000 7fd69a865700 1 --2- 172.21.15.173:0/3571333714 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56469107dc00 0x564690fcec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.613+0000 7fd69a865700 1 --2- 172.21.15.173:0/3571333714 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56469107dc00 0x564690fcec00 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.613+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5646910ef440 con 0x56469107dc00 2024-09-13T23:57:06.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.613+0000 7fd69c8adf40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:06.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.613+0000 7fd69c8adf40 20 searching for the correct realm 2024-09-13T23:57:06.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.613+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564691146400 con 0x56469107dc00 2024-09-13T23:57:06.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.613+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5646910ef440 con 0x56469107dc00 2024-09-13T23:57:06.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.613+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564691146000 con 0x56469107d400 2024-09-13T23:57:06.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.617+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910ef200 con 0x56469107d400 2024-09-13T23:57:06.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.617+0000 7fd69b066700 1 --2- 172.21.15.173:0/3571333714 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564691146000 0x564690fcc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.617+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x564691146000 2024-09-13T23:57:06.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.617+0000 7fd69b867700 1 --2- 172.21.15.173:0/3571333714 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564691146000 0x564690fcc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.617+0000 7fd69b867700 1 --2- 172.21.15.173:0/3571333714 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564691146000 0x564690fcc580 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.617+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910eeb40 con 0x564691146000 2024-09-13T23:57:06.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.617+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107d000 2024-09-13T23:57:06.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.617+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d000 2024-09-13T23:57:06.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.617+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107d000 2024-09-13T23:57:06.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.617+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d000 2024-09-13T23:57:06.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.617+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107dc00 2024-09-13T23:57:06.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.617+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910ef440 con 0x56469107dc00 2024-09-13T23:57:06.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.617+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107d000 2024-09-13T23:57:06.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.617+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d000 2024-09-13T23:57:06.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.617+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107d400 2024-09-13T23:57:06.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.621+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910ef200 con 0x56469107d400 2024-09-13T23:57:06.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.621+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107d400 2024-09-13T23:57:06.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.621+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910ef200 con 0x56469107d400 2024-09-13T23:57:06.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.621+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107d000 2024-09-13T23:57:06.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.621+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d000 2024-09-13T23:57:06.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.621+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x564691146000 2024-09-13T23:57:06.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.621+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910eeb40 con 0x564691146000 2024-09-13T23:57:06.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.621+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107d000 2024-09-13T23:57:06.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.621+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d000 2024-09-13T23:57:06.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.621+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x564691146000 2024-09-13T23:57:06.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.621+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910eeb40 con 0x564691146000 2024-09-13T23:57:06.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.621+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107d400 2024-09-13T23:57:06.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.621+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910ef200 con 0x56469107d400 2024-09-13T23:57:06.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.621+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107dc00 2024-09-13T23:57:06.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.625+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910ef440 con 0x56469107dc00 2024-09-13T23:57:06.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.625+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107d000 2024-09-13T23:57:06.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.625+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d000 2024-09-13T23:57:06.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.625+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107d400 2024-09-13T23:57:06.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.625+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910ef200 con 0x56469107d400 2024-09-13T23:57:06.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.625+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107dc00 2024-09-13T23:57:06.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.625+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910ef440 con 0x56469107dc00 2024-09-13T23:57:06.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.625+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107d000 2024-09-13T23:57:06.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.625+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d000 2024-09-13T23:57:06.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.625+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107d000 2024-09-13T23:57:06.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.625+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d000 2024-09-13T23:57:06.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.625+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107d000 2024-09-13T23:57:06.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.625+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d000 2024-09-13T23:57:06.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.625+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107dc00 2024-09-13T23:57:06.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.629+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910ef440 con 0x56469107dc00 2024-09-13T23:57:06.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.629+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x564691146000 2024-09-13T23:57:06.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.629+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910eeb40 con 0x564691146000 2024-09-13T23:57:06.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.629+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107d000 2024-09-13T23:57:06.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.629+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d000 2024-09-13T23:57:06.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.629+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x564691146000 2024-09-13T23:57:06.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.629+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910eeb40 con 0x564691146000 2024-09-13T23:57:06.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.629+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107dc00 2024-09-13T23:57:06.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.629+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910ef440 con 0x56469107dc00 2024-09-13T23:57:06.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.629+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x564691146000 2024-09-13T23:57:06.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.629+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910eeb40 con 0x564691146000 2024-09-13T23:57:06.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.629+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107d400 2024-09-13T23:57:06.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.629+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910ef200 con 0x56469107d400 2024-09-13T23:57:06.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.629+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107d400 2024-09-13T23:57:06.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.633+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910ef200 con 0x56469107d400 2024-09-13T23:57:06.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.633+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107dc00 2024-09-13T23:57:06.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.633+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910ef440 con 0x56469107dc00 2024-09-13T23:57:06.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.633+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107d400 2024-09-13T23:57:06.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.633+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5646910ef200 con 0x56469107d400 2024-09-13T23:57:06.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.633+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x56469107d400 2024-09-13T23:57:06.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.633+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5646910ef200 con 0x56469107d400 2024-09-13T23:57:06.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.633+0000 7fd69c8adf40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:06.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.633+0000 7fd69c8adf40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:06.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.633+0000 7fd69c8adf40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:06.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.633+0000 7fd69c8adf40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:06.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.633+0000 7fd69c8adf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.633+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564691146800 con 0x56469107d000 2024-09-13T23:57:06.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.633+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d000 2024-09-13T23:57:06.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.633+0000 7fd69c8adf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.633+0000 7fd69c8adf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.633+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564691146c00 con 0x56469107d400 2024-09-13T23:57:06.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.633+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5646910ef200 con 0x56469107d400 2024-09-13T23:57:06.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69c8adf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:06.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69c8adf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564691147000 con 0x56469107d000 2024-09-13T23:57:06.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d000 2024-09-13T23:57:06.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69c8adf40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:06.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69c8adf40 20 zone default found 2024-09-13T23:57:06.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69c8adf40 4 Realm: () 2024-09-13T23:57:06.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69c8adf40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:06.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69c8adf40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:06.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69c8adf40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:06.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69c8adf40 20 zonegroup default 2024-09-13T23:57:06.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69c8adf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564691147400 con 0x564691146000 2024-09-13T23:57:06.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5646910eeb40 con 0x564691146000 2024-09-13T23:57:06.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69c8adf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69c8adf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564691147800 con 0x56469107dc00 2024-09-13T23:57:06.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5646910ef440 con 0x56469107dc00 2024-09-13T23:57:06.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69c8adf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69c8adf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564691147c00 con 0x56469107dc00 2024-09-13T23:57:06.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5646910ef440 con 0x56469107dc00 2024-09-13T23:57:06.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69c8adf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69c8adf40 20 started sync module instance, tier type = 2024-09-13T23:57:06.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69c8adf40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:06.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.637+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114c000 con 0x56469107d400 2024-09-13T23:57:06.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.641+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5646910ef200 con 0x56469107d400 2024-09-13T23:57:06.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.641+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94861080148736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114c400 con 0x56469107d400 2024-09-13T23:57:06.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.641+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114c800 con 0x56469107d000 2024-09-13T23:57:06.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.645+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94861080148736] v33'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5646910ef200 con 0x56469107d400 2024-09-13T23:57:06.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.645+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d000 2024-09-13T23:57:06.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.645+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94861080149888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114cc00 con 0x56469107d000 2024-09-13T23:57:06.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.645+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114d000 con 0x56469107d400 2024-09-13T23:57:06.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.645+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94861080149888] v33'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d000 2024-09-13T23:57:06.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.645+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5646910ef200 con 0x56469107d400 2024-09-13T23:57:06.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.645+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94861080151040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114d400 con 0x56469107d400 2024-09-13T23:57:06.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.645+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114d800 con 0x564691146000 2024-09-13T23:57:06.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.649+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5646910eeb40 con 0x564691146000 2024-09-13T23:57:06.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.649+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94861080152192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114dc00 con 0x564691146000 2024-09-13T23:57:06.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.649+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114c800 con 0x56469107d400 2024-09-13T23:57:06.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.649+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94861080151040] v33'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5646910ef200 con 0x56469107d400 2024-09-13T23:57:06.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.653+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94861080152192] v33'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5646910eeb40 con 0x564691146000 2024-09-13T23:57:06.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.653+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5646910ef200 con 0x56469107d400 2024-09-13T23:57:06.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.653+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94861080153344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114c000 con 0x56469107d400 2024-09-13T23:57:06.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.653+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114c400 con 0x56469107dc00 2024-09-13T23:57:06.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.653+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5646910ef440 con 0x56469107dc00 2024-09-13T23:57:06.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.653+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94861080154496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564691146800 con 0x56469107dc00 2024-09-13T23:57:06.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.653+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564691147000 con 0x56469107dc00 2024-09-13T23:57:06.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.653+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94861080153344] v33'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5646910ef200 con 0x56469107d400 2024-09-13T23:57:06.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.657+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94861080154496] v33'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5646910ef440 con 0x56469107dc00 2024-09-13T23:57:06.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.657+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5646910ef440 con 0x56469107dc00 2024-09-13T23:57:06.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.657+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94861080155648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564691147400 con 0x56469107dc00 2024-09-13T23:57:06.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.657+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564691146c00 con 0x564691146000 2024-09-13T23:57:06.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.657+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94861080155648] v33'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5646910ef440 con 0x56469107dc00 2024-09-13T23:57:06.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.657+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5646910eeb40 con 0x564691146000 2024-09-13T23:57:06.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.657+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94861080156800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469107d800 con 0x564691146000 2024-09-13T23:57:06.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.657+0000 7fd69c8adf40 20 add_watcher() i=0 2024-09-13T23:57:06.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.657+0000 7fd69c8adf40 20 add_watcher() i=1 2024-09-13T23:57:06.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.657+0000 7fd69c8adf40 20 add_watcher() i=2 2024-09-13T23:57:06.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.657+0000 7fd69c8adf40 20 add_watcher() i=3 2024-09-13T23:57:06.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.657+0000 7fd69c8adf40 20 add_watcher() i=4 2024-09-13T23:57:06.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.657+0000 7fd69c8adf40 20 add_watcher() i=5 2024-09-13T23:57:06.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.657+0000 7fd69c8adf40 20 add_watcher() i=6 2024-09-13T23:57:06.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.661+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94861080156800] v33'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5646910eeb40 con 0x564691146000 2024-09-13T23:57:06.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.661+0000 7fd69c8adf40 20 add_watcher() i=7 2024-09-13T23:57:06.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.661+0000 7fd69c8adf40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:06.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.661+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114cc00 con 0x56469107d000 2024-09-13T23:57:06.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.661+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d000 2024-09-13T23:57:06.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.661+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94861081780224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114d800 con 0x56469107d000 2024-09-13T23:57:06.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.665+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94861081780224] v33'139 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d000 2024-09-13T23:57:06.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.665+0000 7fd682034700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:06.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.665+0000 7fd69c8adf40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:06.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.665+0000 7fd69c8adf40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:06.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.665+0000 7fd69c8adf40 1 Processor -- start 2024-09-13T23:57:06.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.665+0000 7fd69c8adf40 1 -- start start 2024-09-13T23:57:06.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.665+0000 7fd69c8adf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56469114c400 0x564690fcf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.665+0000 7fd69c8adf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564690d743c0 con 0x56469114c400 2024-09-13T23:57:06.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.665+0000 7fd69a865700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56469114c400 0x564690fcf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.665+0000 7fd69a865700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56469114c400 0x564690fcf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50714/0 (socket says 172.21.15.173:50714) 2024-09-13T23:57:06.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.665+0000 7fd69a865700 1 -- 172.21.15.173:0/2408926913 learned_addr learned my addr 172.21.15.173:0/2408926913 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.665+0000 7fd69a865700 1 -- 172.21.15.173:0/2408926913 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564690cf8b60 con 0x56469114c400 2024-09-13T23:57:06.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.665+0000 7fd69a865700 1 --2- 172.21.15.173:0/2408926913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56469114c400 0x564690fcf180 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x56469115c090 tx=0x5646910418c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802d4718387a23f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.665+0000 7fd681833700 1 -- 172.21.15.173:0/2408926913 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564691164000 con 0x56469114c400 2024-09-13T23:57:06.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.665+0000 7fd681833700 1 -- 172.21.15.173:0/2408926913 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564691090600 con 0x56469114c400 2024-09-13T23:57:06.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.665+0000 7fd681833700 1 -- 172.21.15.173:0/2408926913 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564691164160 con 0x56469114c400 2024-09-13T23:57:06.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.665+0000 7fd69c8adf40 1 -- 172.21.15.173:0/2408926913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56469114c400 msgr2=0x564690fcf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.665+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/2408926913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56469114c400 0x564690fcf180 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x56469115c090 tx=0x5646910418c0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.665+0000 7fd69c8adf40 1 -- 172.21.15.173:0/2408926913 shutdown_connections 2024-09-13T23:57:06.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.665+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/2408926913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56469114c400 0x564690fcf180 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.665+0000 7fd69c8adf40 1 -- 172.21.15.173:0/2408926913 >> 172.21.15.173:0/2408926913 conn(0x56469114dc00 msgr2=0x564690de8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.669+0000 7fd69c8adf40 1 -- 172.21.15.173:0/2408926913 shutdown_connections 2024-09-13T23:57:06.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.669+0000 7fd69c8adf40 1 -- 172.21.15.173:0/2408926913 wait complete. 2024-09-13T23:57:06.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.669+0000 7fd69c8adf40 1 Processor -- start 2024-09-13T23:57:06.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.669+0000 7fd69c8adf40 1 -- start start 2024-09-13T23:57:06.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.669+0000 7fd69c8adf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56469114c400 0x564690fcf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.669+0000 7fd69c8adf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564690d74500 con 0x56469114c400 2024-09-13T23:57:06.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.669+0000 7fd69a865700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56469114c400 0x564690fcf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.669+0000 7fd69a865700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56469114c400 0x564690fcf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50718/0 (socket says 172.21.15.173:50718) 2024-09-13T23:57:06.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.669+0000 7fd69a865700 1 -- 172.21.15.173:0/3619795345 learned_addr learned my addr 172.21.15.173:0/3619795345 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.669+0000 7fd69a865700 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564690cf8d00 con 0x56469114c400 2024-09-13T23:57:06.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.669+0000 7fd69a865700 1 --2- 172.21.15.173:0/3619795345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56469114c400 0x564690fcf180 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x56469115c2a0 tx=0x564691041a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.669+0000 7fd680030700 1 -- 172.21.15.173:0/3619795345 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5646911642c0 con 0x56469114c400 2024-09-13T23:57:06.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.669+0000 7fd680030700 1 -- 172.21.15.173:0/3619795345 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564691090300 con 0x56469114c400 2024-09-13T23:57:06.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.669+0000 7fd680030700 1 -- 172.21.15.173:0/3619795345 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564691164000 con 0x56469114c400 2024-09-13T23:57:06.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.669+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564690cf8340 con 0x56469114c400 2024-09-13T23:57:06.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.669+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564690cf8b60 con 0x56469114c400 2024-09-13T23:57:06.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.673+0000 7fd680030700 1 -- 172.21.15.173:0/3619795345 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x564690de1b80 con 0x56469114c400 2024-09-13T23:57:06.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.673+0000 7fd680030700 1 --2- 172.21.15.173:0/3619795345 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5646911e0000 0x5646911e6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.673+0000 7fd680030700 1 -- 172.21.15.173:0/3619795345 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x564690d4d500 con 0x56469114c400 2024-09-13T23:57:06.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.673+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3619795345 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564691146c00 0x564690fcf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.673+0000 7fd69b867700 1 --2- 172.21.15.173:0/3619795345 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5646911e0000 0x5646911e6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.673+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564691146400 con 0x564691146c00 2024-09-13T23:57:06.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.673+0000 7fd69b066700 1 --2- 172.21.15.173:0/3619795345 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564691146c00 0x564690fcf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.673+0000 7fd69b867700 1 --2- 172.21.15.173:0/3619795345 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5646911e0000 0x5646911e6000 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x5646910c0600 tx=0x5646911ac660 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.673+0000 7fd69b066700 1 --2- 172.21.15.173:0/3619795345 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564691146c00 0x564690fcf700 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.677+0000 7fd69b066700 1 -- 172.21.15.173:0/3619795345 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v33'26 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5646910ef200 con 0x564691146c00 2024-09-13T23:57:06.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.677+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3619795345 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564691147800 0x5646911e6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.677+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564691147c00 con 0x564691147800 2024-09-13T23:57:06.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.677+0000 7fd69a865700 1 --2- 172.21.15.173:0/3619795345 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564691147800 0x5646911e6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.677+0000 7fd69a865700 1 --2- 172.21.15.173:0/3619795345 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564691147800 0x5646911e6580 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.677+0000 7fd69a865700 1 -- 172.21.15.173:0/3619795345 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v33'17 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5646910ef440 con 0x564691147800 2024-09-13T23:57:06.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.677+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3619795345 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56469107d800 0x5646911e6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.677+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5646911e0400 con 0x56469107d800 2024-09-13T23:57:06.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.677+0000 7fd69b867700 1 --2- 172.21.15.173:0/3619795345 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56469107d800 0x5646911e6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.677+0000 7fd69b867700 1 --2- 172.21.15.173:0/3619795345 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56469107d800 0x5646911e6b00 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.681+0000 7fd69b867700 1 -- 172.21.15.173:0/3619795345 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v33'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d800 2024-09-13T23:57:06.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.681+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3619795345 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5646911e0800 0x5646911e7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.681+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5646911e0c00 con 0x5646911e0800 2024-09-13T23:57:06.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.681+0000 7fd69b066700 1 --2- 172.21.15.173:0/3619795345 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5646911e0800 0x5646911e7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.681+0000 7fd69b066700 1 --2- 172.21.15.173:0/3619795345 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5646911e0800 0x5646911e7080 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.685+0000 7fd69b066700 1 -- 172.21.15.173:0/3619795345 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v33'140 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5646910ef200 con 0x5646911e0800 2024-09-13T23:57:06.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.685+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5646911e1000 con 0x564691146c00 2024-09-13T23:57:06.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.685+0000 7fd69b066700 1 -- 172.21.15.173:0/3619795345 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v33'41 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5646910ef200 con 0x564691146c00 2024-09-13T23:57:06.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.685+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5646911e1400 con 0x56469107d800 2024-09-13T23:57:06.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.689+0000 7fd69b867700 1 -- 172.21.15.173:0/3619795345 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v33'27 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d800 2024-09-13T23:57:06.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.689+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5646911e1800 con 0x564691146c00 2024-09-13T23:57:06.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.693+0000 7fd69b066700 1 -- 172.21.15.173:0/3619795345 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v33'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5646910ef200 con 0x564691146c00 2024-09-13T23:57:06.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.693+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5646911e1c00 con 0x5646911e0800 2024-09-13T23:57:06.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.693+0000 7fd69b066700 1 -- 172.21.15.173:0/3619795345 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v33'27 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5646910ef200 con 0x5646911e0800 2024-09-13T23:57:06.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.693+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564691146400 con 0x564691146c00 2024-09-13T23:57:06.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.697+0000 7fd69b066700 1 -- 172.21.15.173:0/3619795345 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5646910ef200 con 0x564691146c00 2024-09-13T23:57:06.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.697+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114d000 con 0x564691146c00 2024-09-13T23:57:06.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.701+0000 7fd69b066700 1 -- 172.21.15.173:0/3619795345 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v33'23 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x5646910ef200 con 0x564691146c00 2024-09-13T23:57:06.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.701+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114d400 con 0x564691146c00 2024-09-13T23:57:06.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.701+0000 7fd69b066700 1 -- 172.21.15.173:0/3619795345 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v33'42 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5646910ef200 con 0x564691146c00 2024-09-13T23:57:06.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.701+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114c800 con 0x56469107d800 2024-09-13T23:57:06.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.705+0000 7fd69b867700 1 -- 172.21.15.173:0/3619795345 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d800 2024-09-13T23:57:06.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.705+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114c000 con 0x564691146c00 2024-09-13T23:57:06.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.709+0000 7fd69b066700 1 -- 172.21.15.173:0/3619795345 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5646910ef200 con 0x564691146c00 2024-09-13T23:57:06.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.709+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114d000 con 0x5646911e0800 2024-09-13T23:57:06.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.709+0000 7fd69b066700 1 -- 172.21.15.173:0/3619795345 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v33'33 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5646910ef200 con 0x5646911e0800 2024-09-13T23:57:06.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.709+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564691146400 con 0x5646911e0800 2024-09-13T23:57:06.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.713+0000 7fd69b066700 1 -- 172.21.15.173:0/3619795345 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v33'141 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5646910ef200 con 0x5646911e0800 2024-09-13T23:57:06.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.713+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5646911e0c00 con 0x564691146c00 2024-09-13T23:57:06.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.717+0000 7fd69b066700 1 -- 172.21.15.173:0/3619795345 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v33'35 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5646910ef200 con 0x564691146c00 2024-09-13T23:57:06.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.717+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5646911e1000 con 0x564691146c00 2024-09-13T23:57:06.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.717+0000 7fd69b066700 1 -- 172.21.15.173:0/3619795345 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v33'43 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5646910ef200 con 0x564691146c00 2024-09-13T23:57:06.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.717+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5646911e1800 con 0x56469107d800 2024-09-13T23:57:06.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.721+0000 7fd69b867700 1 -- 172.21.15.173:0/3619795345 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v33'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d800 2024-09-13T23:57:06.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.721+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5646911e1c00 con 0x564691146c00 2024-09-13T23:57:06.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.725+0000 7fd69b066700 1 -- 172.21.15.173:0/3619795345 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v33'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5646910ef200 con 0x564691146c00 2024-09-13T23:57:06.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.725+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5646911e0c00 con 0x5646911e0800 2024-09-13T23:57:06.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.725+0000 7fd69b066700 1 -- 172.21.15.173:0/3619795345 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v33'142 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5646910ef200 con 0x5646911e0800 2024-09-13T23:57:06.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.725+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5646911e1000 con 0x564691146c00 2024-09-13T23:57:06.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.729+0000 7fd69b066700 1 -- 172.21.15.173:0/3619795345 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v33'36 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5646910ef200 con 0x564691146c00 2024-09-13T23:57:06.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.729+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5646911e1c00 con 0x564691146c00 2024-09-13T23:57:06.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.733+0000 7fd69b066700 1 -- 172.21.15.173:0/3619795345 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v33'27 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5646910ef200 con 0x564691146c00 2024-09-13T23:57:06.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.733+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5646911e0400 con 0x56469107d800 2024-09-13T23:57:06.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.737+0000 7fd69b867700 1 -- 172.21.15.173:0/3619795345 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d800 2024-09-13T23:57:06.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.737+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5646911e1400 con 0x564691146c00 2024-09-13T23:57:06.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.737+0000 7fd69b066700 1 -- 172.21.15.173:0/3619795345 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5646910ef200 con 0x564691146c00 2024-09-13T23:57:06.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.737+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5646911e1800 con 0x56469107d800 2024-09-13T23:57:06.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.741+0000 7fd69b867700 1 -- 172.21.15.173:0/3619795345 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v33'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d800 2024-09-13T23:57:06.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.741+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114d400 con 0x56469107d800 2024-09-13T23:57:06.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.745+0000 7fd69b867700 1 -- 172.21.15.173:0/3619795345 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v33'28 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d800 2024-09-13T23:57:06.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.745+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114c000 con 0x56469107d800 2024-09-13T23:57:06.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.745+0000 7fd69b867700 1 -- 172.21.15.173:0/3619795345 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d800 2024-09-13T23:57:06.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.745+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114d000 con 0x564691146c00 2024-09-13T23:57:06.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.749+0000 7fd69b066700 1 -- 172.21.15.173:0/3619795345 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v33'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5646910ef200 con 0x564691146c00 2024-09-13T23:57:06.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.749+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114cc00 con 0x5646911e0800 2024-09-13T23:57:06.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.753+0000 7fd69b066700 1 -- 172.21.15.173:0/3619795345 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v33'28 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5646910ef200 con 0x5646911e0800 2024-09-13T23:57:06.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.753+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114d800 con 0x564691146c00 2024-09-13T23:57:06.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.753+0000 7fd69b066700 1 -- 172.21.15.173:0/3619795345 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v33'37 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5646910ef200 con 0x564691146c00 2024-09-13T23:57:06.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.753+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114c800 con 0x5646911e0800 2024-09-13T23:57:06.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.757+0000 7fd69b066700 1 -- 172.21.15.173:0/3619795345 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v33'34 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5646910ef200 con 0x5646911e0800 2024-09-13T23:57:06.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.757+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564691146400 con 0x564691147800 2024-09-13T23:57:06.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.761+0000 7fd69a865700 1 -- 172.21.15.173:0/3619795345 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v33'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x5646910ef440 con 0x564691147800 2024-09-13T23:57:06.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.761+0000 7fd67d82b700 20 reqs_thread_entry: start 2024-09-13T23:57:06.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.761+0000 7fd69c8adf40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:06.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.765+0000 7fd69c8adf40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:06.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.765+0000 7fd67b026700 20 reqs_thread_entry: start 2024-09-13T23:57:06.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.765+0000 7fd69c8adf40 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:57:06.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.765+0000 7fd69c8adf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.765+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114d800 con 0x564691146000 2024-09-13T23:57:06.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.765+0000 7fd67b827700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:37 2024 2024-09-13T23:57:06.770 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:06.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.765+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x5646910eeb40 con 0x564691146000 2024-09-13T23:57:06.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.765+0000 7fd69c8adf40 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:57:06.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.765+0000 7fd69c8adf40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:57:06.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.765+0000 7fd69c8adf40 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:57:06.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.765+0000 7fd69c8adf40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 : miss 2024-09-13T23:57:06.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.765+0000 7fd69c8adf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.765+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:63 8.17 8:ea49432e:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114c800 con 0x56469107d400 2024-09-13T23:57:06.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.765+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(63 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x5646910ef200 con 0x56469107d400 2024-09-13T23:57:06.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.765+0000 7fd69c8adf40 20 rados_obj.operate() r=0 bl.length=352 2024-09-13T23:57:06.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.765+0000 7fd69c8adf40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 info.flags=0x17 2024-09-13T23:57:06.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.765+0000 7fd69c8adf40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 to cache LRU end 2024-09-13T23:57:06.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.765+0000 7fd69c8adf40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:06.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.765+0000 7fd69c8adf40 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:57:06.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.765+0000 7fd69c8adf40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 2024-09-13T23:57:06.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.765+0000 7fd69c8adf40 20 get_obj_state: rctx=0x564690d77a40 obj=myfoo:four state=0x5646912981e8 s->prefetch_data=0 2024-09-13T23:57:06.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.765+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:64 3.13s0 3:c9d37c70:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5646911e0c00 con 0x56469107dc00 2024-09-13T23:57:06.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.765+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(64 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1_four [getxattrs out=851b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 234+0+867 (crc 0 0 0) 0x5646910ef440 con 0x56469107dc00 2024-09-13T23:57:06.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.769+0000 7fd69c8adf40 10 manifest: total_size = 4 2024-09-13T23:57:06.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.769+0000 7fd69c8adf40 20 get_obj_state: setting s->obj_tag to d342d0db-d035-4a54-bae7-2e0f76db6818.4232.10115194353038143296 2024-09-13T23:57:06.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.769+0000 7fd69c8adf40 20 get_obj_state: rctx=0x564690d77a40 obj=myfoo:four state=0x5646912981e8 s->prefetch_data=0 2024-09-13T23:57:06.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.769+0000 7fd69c8adf40 20 prepare_atomic_modification: state is not atomic. state=0x5646912981e8 2024-09-13T23:57:06.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.769+0000 7fd69c8adf40 20 bucket index object: default.rgw.buckets.index:.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.6 2024-09-13T23:57:06.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.769+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 4.32 4:4e7c1df1:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5646911e1000 con 0x56469107d400 2024-09-13T23:57:06.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.769+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(65 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.6 [stat,call,call] v33'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x5646910ef200 con 0x56469107d400 2024-09-13T23:57:06.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.769+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:66 3.13s0 3:c9d37c70:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5646911e1c00 con 0x56469107dc00 2024-09-13T23:57:06.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.773+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(66 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1_four [call] v33'2 uv2 ondisk = 0) v8 ==== 192+0+0 (crc 0 0 0) 0x5646910ef440 con 0x56469107dc00 2024-09-13T23:57:06.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.773+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 4.32 4:4e7c1df1:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5646911e0c00 con 0x56469107d400 2024-09-13T23:57:06.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.777+0000 7fd682034700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:06.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.777+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:68 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94861081780224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564691146800 con 0x56469107d000 2024-09-13T23:57:06.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.777+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(67 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.6 [stat,call,call] v33'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x5646910ef200 con 0x56469107d400 2024-09-13T23:57:06.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.777+0000 7fd69585b700 20 handle_completion(): completion ok for obj=four 2024-09-13T23:57:06.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.777+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(68 data_loggenerations_metadata [watch unwatch cookie 94861081780224] v33'143 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d000 2024-09-13T23:57:06.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.777+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94861080148736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564691147000 con 0x56469107d400 2024-09-13T23:57:06.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.781+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(69 notify.0 [watch unwatch cookie 94861080148736] v33'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5646910ef200 con 0x56469107d400 2024-09-13T23:57:06.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.781+0000 7fd69c8adf40 20 remove_watcher() i=0 2024-09-13T23:57:06.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.781+0000 7fd69c8adf40 2 removed watcher, disabling cache 2024-09-13T23:57:06.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.781+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:70 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94861080149888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564691147c00 con 0x56469107d000 2024-09-13T23:57:06.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.785+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(70 notify.1 [watch unwatch cookie 94861080149888] v33'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5646910eeb40 con 0x56469107d000 2024-09-13T23:57:06.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.785+0000 7fd69c8adf40 20 remove_watcher() i=1 2024-09-13T23:57:06.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.785+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94861080151040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564691146400 con 0x56469107d400 2024-09-13T23:57:06.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.785+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(71 notify.2 [watch unwatch cookie 94861080151040] v33'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5646910ef200 con 0x56469107d400 2024-09-13T23:57:06.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.785+0000 7fd69c8adf40 20 remove_watcher() i=2 2024-09-13T23:57:06.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.785+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94861080152192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564691146800 con 0x564691146000 2024-09-13T23:57:06.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.789+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(72 notify.3 [watch unwatch cookie 94861080152192] v33'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5646910eeb40 con 0x564691146000 2024-09-13T23:57:06.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.789+0000 7fd69c8adf40 20 remove_watcher() i=3 2024-09-13T23:57:06.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.789+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:73 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94861080153344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564691147c00 con 0x56469107d400 2024-09-13T23:57:06.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.793+0000 7fd69b066700 1 -- 172.21.15.173:0/3571333714 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(73 notify.4 [watch unwatch cookie 94861080153344] v33'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5646910ef200 con 0x56469107d400 2024-09-13T23:57:06.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.793+0000 7fd69c8adf40 20 remove_watcher() i=4 2024-09-13T23:57:06.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.793+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:74 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94861080154496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114d400 con 0x56469107dc00 2024-09-13T23:57:06.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.793+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(74 notify.5 [watch unwatch cookie 94861080154496] v33'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5646910ef440 con 0x56469107dc00 2024-09-13T23:57:06.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.793+0000 7fd69c8adf40 20 remove_watcher() i=5 2024-09-13T23:57:06.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.793+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94861080155648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114c000 con 0x56469107dc00 2024-09-13T23:57:06.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.797+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(75 notify.6 [watch unwatch cookie 94861080155648] v33'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5646910ef440 con 0x56469107dc00 2024-09-13T23:57:06.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.797+0000 7fd69c8adf40 20 remove_watcher() i=6 2024-09-13T23:57:06.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.797+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:76 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94861080156800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56469114d800 con 0x564691146000 2024-09-13T23:57:06.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.797+0000 7fd69b867700 1 -- 172.21.15.173:0/3571333714 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(76 notify.7 [watch unwatch cookie 94861080156800] v33'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5646910eeb40 con 0x564691146000 2024-09-13T23:57:06.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.797+0000 7fd69c8adf40 20 remove_watcher() i=7 2024-09-13T23:57:06.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.797+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56469107d400 msgr2=0x564690fcdb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.797+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3571333714 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56469107d400 0x564690fcdb80 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.797+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56469107d000 msgr2=0x564690fcd600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.797+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3571333714 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56469107d000 0x564690fcd600 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.797+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564691146000 msgr2=0x564690fcc580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.797+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3571333714 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564691146000 0x564690fcc580 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.797+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56469107dc00 msgr2=0x564690fcec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.797+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3571333714 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56469107dc00 0x564690fcec00 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.797+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56469107cc00 msgr2=0x564690fce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.797+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3571333714 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56469107cc00 0x564690fce680 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x56469106b830 tx=0x564691041920 comp rx=0 tx=0).stop 2024-09-13T23:57:06.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.797+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7c00 msgr2=0x564690fcd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.797+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3571333714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7c00 0x564690fcd080 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x56469100c390 tx=0x5646910405a0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.797+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 reap_dead start 2024-09-13T23:57:06.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69a865700 1 -- 172.21.15.173:0/3571333714 reap_dead start 2024-09-13T23:57:06.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 shutdown_connections 2024-09-13T23:57:06.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 >> 172.21.15.173:0/3571333714 conn(0x564690ce7800 msgr2=0x564690de7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 shutdown_connections 2024-09-13T23:57:06.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3571333714 wait complete. 2024-09-13T23:57:06.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564691146c00 msgr2=0x564690fcf700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3619795345 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564691146c00 0x564690fcf700 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5646911e0800 msgr2=0x5646911e7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3619795345 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5646911e0800 0x5646911e7080 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564691147800 msgr2=0x5646911e6580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3619795345 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564691147800 0x5646911e6580 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56469107d800 msgr2=0x5646911e6b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3619795345 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56469107d800 0x5646911e6b00 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5646911e0000 msgr2=0x5646911e6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3619795345 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5646911e0000 0x5646911e6000 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x5646910c0600 tx=0x5646911ac660 comp rx=0 tx=0).stop 2024-09-13T23:57:06.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56469114c400 msgr2=0x564690fcf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3619795345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56469114c400 0x564690fcf180 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x56469115c2a0 tx=0x564691041a40 comp rx=0 tx=0).stop 2024-09-13T23:57:06.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69b066700 1 -- 172.21.15.173:0/3619795345 reap_dead start 2024-09-13T23:57:06.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 shutdown_connections 2024-09-13T23:57:06.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 >> 172.21.15.173:0/3619795345 conn(0x56469114dc00 msgr2=0x564690de8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 shutdown_connections 2024-09-13T23:57:06.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3619795345 wait complete. 2024-09-13T23:57:06.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3167926511 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56469107c000 msgr2=0x564690fce100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3167926511 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56469107c000 0x564690fce100 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x56469100d3e0 tx=0x564691040780 comp rx=0 tx=0).stop 2024-09-13T23:57:06.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3167926511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7400 msgr2=0x564690fccb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3167926511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7400 0x564690fccb00 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x564691abbd70 tx=0x564690deb920 comp rx=0 tx=0).stop 2024-09-13T23:57:06.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3167926511 shutdown_connections 2024-09-13T23:57:06.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3167926511 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56469107c000 0x564690fce100 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 --2- 172.21.15.173:0/3167926511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564690ce7400 0x564690fccb00 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3167926511 >> 172.21.15.173:0/3167926511 conn(0x564690ce6c00 msgr2=0x564690de7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3167926511 shutdown_connections 2024-09-13T23:57:06.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.801+0000 7fd69c8adf40 1 -- 172.21.15.173:0/3167926511 wait complete. 2024-09-13T23:57:06.812 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T23:57:06.812 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T23:57:06.813 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-13T23:57:06.853 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:06.854 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:06.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.849+0000 7f21366baf40 1 Processor -- start 2024-09-13T23:57:06.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.849+0000 7f21366baf40 1 -- start start 2024-09-13T23:57:06.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.849+0000 7f21366baf40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55587cfb1000 0x55587d296580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.849+0000 7f21366baf40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55587d075500 con 0x55587cfb1400 2024-09-13T23:57:06.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.849+0000 7f21366baf40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55587d03ea00 con 0x55587cfb1000 2024-09-13T23:57:06.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.849+0000 7f2134e73700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55587cfb1000 0x55587d296580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.849+0000 7f2134672700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55587cfb1400 0x55587d0b0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47558/0 (socket says 172.21.15.173:47558) 2024-09-13T23:57:06.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.849+0000 7f2134672700 1 -- 172.21.15.173:0/807289208 learned_addr learned my addr 172.21.15.173:0/807289208 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:06.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.849+0000 7f2134e73700 1 -- 172.21.15.173:0/807289208 >> v1:172.21.15.87:6789/0 conn(0x55587cfb1400 legacy=0x55587d0b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.849+0000 7f2133e71700 1 -- 172.21.15.173:0/807289208 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3152088070 0 0) 0x55587d10c000 con 0x55587cfb1400 2024-09-13T23:57:06.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.849+0000 7f2134e73700 1 -- 172.21.15.173:0/807289208 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55587cfc3d40 con 0x55587cfb1000 2024-09-13T23:57:06.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.849+0000 7f2134e73700 1 --2- 172.21.15.173:0/807289208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1000 0x55587d296580 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x55587d291a70 tx=0x55587d0b5920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c0b724b76ce17ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.849+0000 7f2133e71700 1 -- 172.21.15.173:0/807289208 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55587d0554a0 con 0x55587cfb1000 2024-09-13T23:57:06.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.849+0000 7f2133e71700 1 -- 172.21.15.173:0/807289208 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55587d075800 con 0x55587cfb1000 2024-09-13T23:57:06.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.849+0000 7f2133e71700 1 -- 172.21.15.173:0/807289208 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55587d055600 con 0x55587cfb1000 2024-09-13T23:57:06.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.853+0000 7f21366baf40 1 -- 172.21.15.173:0/807289208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1000 msgr2=0x55587d296580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.853+0000 7f21366baf40 1 --2- 172.21.15.173:0/807289208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1000 0x55587d296580 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x55587d291a70 tx=0x55587d0b5920 comp rx=0 tx=0).stop 2024-09-13T23:57:06.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.853+0000 7f21366baf40 1 -- 172.21.15.173:0/807289208 shutdown_connections 2024-09-13T23:57:06.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.853+0000 7f21366baf40 1 --2- 172.21.15.173:0/807289208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1000 0x55587d296580 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.853+0000 7f21366baf40 1 -- 172.21.15.173:0/807289208 >> 172.21.15.173:0/807289208 conn(0x55587cfb0c00 msgr2=0x55587d0b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.853+0000 7f21366baf40 1 -- 172.21.15.173:0/807289208 shutdown_connections 2024-09-13T23:57:06.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.853+0000 7f21366baf40 1 -- 172.21.15.173:0/807289208 wait complete. 2024-09-13T23:57:06.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.853+0000 7f21366baf40 1 Processor -- start 2024-09-13T23:57:06.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.853+0000 7f21366baf40 1 -- start start 2024-09-13T23:57:06.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.853+0000 7f21366baf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1000 0x55587d296580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.853+0000 7f21366baf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55587d03e500 con 0x55587cfb1000 2024-09-13T23:57:06.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.853+0000 7f2134e73700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1000 0x55587d296580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.853+0000 7f2134e73700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1000 0x55587d296580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50736/0 (socket says 172.21.15.173:50736) 2024-09-13T23:57:06.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.853+0000 7f2134e73700 1 -- 172.21.15.173:0/3348700059 learned_addr learned my addr 172.21.15.173:0/3348700059 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.853+0000 7f2134e73700 1 -- 172.21.15.173:0/3348700059 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55587cfc3ba0 con 0x55587cfb1000 2024-09-13T23:57:06.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.857+0000 7f2134e73700 1 --2- 172.21.15.173:0/3348700059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1000 0x55587d296580 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x55587dd7be00 tx=0x55587d0b5800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c4d6ff54eaf6956 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.857+0000 7f2133670700 1 -- 172.21.15.173:0/3348700059 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55587d055760 con 0x55587cfb1000 2024-09-13T23:57:06.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.857+0000 7f2133670700 1 -- 172.21.15.173:0/3348700059 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55587d075b00 con 0x55587cfb1000 2024-09-13T23:57:06.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.857+0000 7f2133670700 1 -- 172.21.15.173:0/3348700059 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55587d0554a0 con 0x55587cfb1000 2024-09-13T23:57:06.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.857+0000 7f21366baf40 1 -- 172.21.15.173:0/3348700059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1000 msgr2=0x55587d296580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.857+0000 7f21366baf40 1 --2- 172.21.15.173:0/3348700059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1000 0x55587d296580 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x55587dd7be00 tx=0x55587d0b5800 comp rx=0 tx=0).stop 2024-09-13T23:57:06.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.857+0000 7f21366baf40 1 -- 172.21.15.173:0/3348700059 shutdown_connections 2024-09-13T23:57:06.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.857+0000 7f21366baf40 1 --2- 172.21.15.173:0/3348700059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1000 0x55587d296580 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.857+0000 7f21366baf40 1 -- 172.21.15.173:0/3348700059 >> 172.21.15.173:0/3348700059 conn(0x55587cfb0c00 msgr2=0x55587d0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.857+0000 7f21366baf40 1 -- 172.21.15.173:0/3348700059 shutdown_connections 2024-09-13T23:57:06.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.857+0000 7f21366baf40 1 -- 172.21.15.173:0/3348700059 wait complete. 2024-09-13T23:57:06.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.857+0000 7f21366baf40 1 Processor -- start 2024-09-13T23:57:06.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.857+0000 7f21366baf40 1 -- start start 2024-09-13T23:57:06.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.857+0000 7f21366baf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1000 0x55587d296580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.857+0000 7f21366baf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55587d03e3c0 con 0x55587cfb1000 2024-09-13T23:57:06.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.857+0000 7f2134e73700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1000 0x55587d296580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.857+0000 7f2134e73700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1000 0x55587d296580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50748/0 (socket says 172.21.15.173:50748) 2024-09-13T23:57:06.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.857+0000 7f2134e73700 1 -- 172.21.15.173:0/1987574764 learned_addr learned my addr 172.21.15.173:0/1987574764 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.861+0000 7f2134e73700 1 -- 172.21.15.173:0/1987574764 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55587cfc3a00 con 0x55587cfb1000 2024-09-13T23:57:06.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.861+0000 7f2134e73700 1 --2- 172.21.15.173:0/1987574764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1000 0x55587d296580 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x55587dd7bf20 tx=0x55587d0b5920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.861+0000 7f2131e6d700 1 -- 172.21.15.173:0/1987574764 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55587d055600 con 0x55587cfb1000 2024-09-13T23:57:06.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.861+0000 7f2131e6d700 1 -- 172.21.15.173:0/1987574764 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55587d075c80 con 0x55587cfb1000 2024-09-13T23:57:06.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.861+0000 7f21366baf40 1 -- 172.21.15.173:0/1987574764 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55587cfc3860 con 0x55587cfb1000 2024-09-13T23:57:06.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.861+0000 7f2131e6d700 1 -- 172.21.15.173:0/1987574764 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55587d0558c0 con 0x55587cfb1000 2024-09-13T23:57:06.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.861+0000 7f21366baf40 1 -- 172.21.15.173:0/1987574764 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55587cfc36c0 con 0x55587cfb1000 2024-09-13T23:57:06.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.861+0000 7f2131e6d700 1 -- 172.21.15.173:0/1987574764 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55587d0aab00 con 0x55587cfb1000 2024-09-13T23:57:06.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.861+0000 7f21366baf40 1 Processor -- start 2024-09-13T23:57:06.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.861+0000 7f2131e6d700 1 --2- 172.21.15.173:0/1987574764 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55587d342000 0x55587d297080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.861+0000 7f2131e6d700 1 -- 172.21.15.173:0/1987574764 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55587d017180 con 0x55587cfb1000 2024-09-13T23:57:06.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.861+0000 7f21366baf40 1 -- start start 2024-09-13T23:57:06.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.861+0000 7f2134672700 1 --2- 172.21.15.173:0/1987574764 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55587d342000 0x55587d297080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.861+0000 7f21366baf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1800 0x55587d296b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.861+0000 7f21366baf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55587d03e000 con 0x55587cfb1800 2024-09-13T23:57:06.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.861+0000 7f2134672700 1 --2- 172.21.15.173:0/1987574764 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55587d342000 0x55587d297080 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55587dd7a030 tx=0x55587d308780 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.861+0000 7f2134e73700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1800 0x55587d296b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.861+0000 7f2134e73700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1800 0x55587d296b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50750/0 (socket says 172.21.15.173:50750) 2024-09-13T23:57:06.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.861+0000 7f2134e73700 1 -- 172.21.15.173:0/3367517430 learned_addr learned my addr 172.21.15.173:0/3367517430 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.865+0000 7f2134e73700 1 -- 172.21.15.173:0/3367517430 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55587cfc2000 con 0x55587cfb1800 2024-09-13T23:57:06.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.865+0000 7f2134e73700 1 --2- 172.21.15.173:0/3367517430 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1800 0x55587d296b00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x55587d2d9020 tx=0x55587d3088a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395b011e25e1ac73 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.865+0000 7f212f668700 1 -- 172.21.15.173:0/3367517430 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55587d055600 con 0x55587cfb1800 2024-09-13T23:57:06.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.865+0000 7f212f668700 1 -- 172.21.15.173:0/3367517430 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55587d075c80 con 0x55587cfb1800 2024-09-13T23:57:06.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.865+0000 7f212f668700 1 -- 172.21.15.173:0/3367517430 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55587d0558c0 con 0x55587cfb1800 2024-09-13T23:57:06.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.865+0000 7f21366baf40 1 -- 172.21.15.173:0/3367517430 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1800 msgr2=0x55587d296b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.865+0000 7f21366baf40 1 --2- 172.21.15.173:0/3367517430 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1800 0x55587d296b00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x55587d2d9020 tx=0x55587d3088a0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.865+0000 7f21366baf40 1 -- 172.21.15.173:0/3367517430 shutdown_connections 2024-09-13T23:57:06.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.865+0000 7f21366baf40 1 --2- 172.21.15.173:0/3367517430 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1800 0x55587d296b00 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.865+0000 7f21366baf40 1 -- 172.21.15.173:0/3367517430 >> 172.21.15.173:0/3367517430 conn(0x55587cfb1400 msgr2=0x55587d0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.865+0000 7f21366baf40 1 -- 172.21.15.173:0/3367517430 shutdown_connections 2024-09-13T23:57:06.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.865+0000 7f21366baf40 1 -- 172.21.15.173:0/3367517430 wait complete. 2024-09-13T23:57:06.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.865+0000 7f21366baf40 1 Processor -- start 2024-09-13T23:57:06.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.865+0000 7f21366baf40 1 -- start start 2024-09-13T23:57:06.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.865+0000 7f21366baf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1800 0x55587d296b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.865+0000 7f21366baf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55587cfd6640 con 0x55587cfb1800 2024-09-13T23:57:06.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.865+0000 7f2134e73700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1800 0x55587d296b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.865+0000 7f2134e73700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1800 0x55587d296b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50762/0 (socket says 172.21.15.173:50762) 2024-09-13T23:57:06.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.865+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 learned_addr learned my addr 172.21.15.173:0/817937245 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.865+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55587cfc2ea0 con 0x55587cfb1800 2024-09-13T23:57:06.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.869+0000 7f2134e73700 1 --2- 172.21.15.173:0/817937245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1800 0x55587d296b00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x55587d33ca20 tx=0x55587d308a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.869+0000 7f212de65700 1 -- 172.21.15.173:0/817937245 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55587d055760 con 0x55587cfb1800 2024-09-13T23:57:06.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.869+0000 7f212de65700 1 -- 172.21.15.173:0/817937245 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55587d366000 con 0x55587cfb1800 2024-09-13T23:57:06.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.869+0000 7f212de65700 1 -- 172.21.15.173:0/817937245 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55587d0554a0 con 0x55587cfb1800 2024-09-13T23:57:06.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.869+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55587cfc2820 con 0x55587cfb1800 2024-09-13T23:57:06.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.869+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55587cfc29c0 con 0x55587cfb1800 2024-09-13T23:57:06.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.869+0000 7f212de65700 1 -- 172.21.15.173:0/817937245 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55587d0aadc0 con 0x55587cfb1800 2024-09-13T23:57:06.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.869+0000 7f21366baf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.869+0000 7f212de65700 1 --2- 172.21.15.173:0/817937245 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55587d343000 0x55587d297600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.869+0000 7f212de65700 1 -- 172.21.15.173:0/817937245 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55587d017340 con 0x55587cfb1800 2024-09-13T23:57:06.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.869+0000 7f2134672700 1 --2- 172.21.15.173:0/817937245 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55587d343000 0x55587d297600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.869+0000 7f21366baf40 1 --2- 172.21.15.173:0/817937245 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55587d343400 0x55587d297b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.869+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d343800 con 0x55587d343400 2024-09-13T23:57:06.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.869+0000 7f2135674700 1 --2- 172.21.15.173:0/817937245 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55587d343400 0x55587d297b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.869+0000 7f2134672700 1 --2- 172.21.15.173:0/817937245 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55587d343000 0x55587d297600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55587d33dbf0 tx=0x55587d3086c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.873+0000 7f2135674700 1 --2- 172.21.15.173:0/817937245 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55587d343400 0x55587d297b80 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.873+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.873+0000 7f21366baf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.873+0000 7f21366baf40 20 realm 2024-09-13T23:57:06.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.873+0000 7f21366baf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.873+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d343c00 con 0x55587d343400 2024-09-13T23:57:06.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.873+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.873+0000 7f21366baf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.873+0000 7f21366baf40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:06.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.873+0000 7f21366baf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.873+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d343800 con 0x55587d343400 2024-09-13T23:57:06.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.873+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.873+0000 7f21366baf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.873+0000 7f21366baf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.873+0000 7f21366baf40 1 --2- 172.21.15.173:0/817937245 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55587d343c00 0x55587d298100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.873+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d343c00 2024-09-13T23:57:06.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.873+0000 7f2134e73700 1 --2- 172.21.15.173:0/817937245 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55587d343c00 0x55587d298100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.873+0000 7f2134e73700 1 --2- 172.21.15.173:0/817937245 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55587d343c00 0x55587d298100 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.873+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.873+0000 7f21366baf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:06.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.873+0000 7f21366baf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.873+0000 7f21366baf40 1 --2- 172.21.15.173:0/817937245 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55587d3dc400 0x55587d298680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.873+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc800 con 0x55587d3dc400 2024-09-13T23:57:06.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.873+0000 7f2134672700 1 --2- 172.21.15.173:0/817937245 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55587d3dc400 0x55587d298680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.877+0000 7f2134672700 1 --2- 172.21.15.173:0/817937245 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55587d3dc400 0x55587d298680 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.877+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55587d3bb440 con 0x55587d3dc400 2024-09-13T23:57:06.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.877+0000 7f21366baf40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:06.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.877+0000 7f21366baf40 20 searching for the correct realm 2024-09-13T23:57:06.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.877+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dcc00 con 0x55587d3dc400 2024-09-13T23:57:06.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.877+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55587d3bb440 con 0x55587d3dc400 2024-09-13T23:57:06.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.877+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc800 con 0x55587d343c00 2024-09-13T23:57:06.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.877+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.877+0000 7f2134e73700 1 --2- 172.21.15.173:0/817937245 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55587d3dc800 0x55587d298c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.877+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d3dc800 2024-09-13T23:57:06.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.877+0000 7f2135674700 1 --2- 172.21.15.173:0/817937245 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55587d3dc800 0x55587d298c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.877+0000 7f2135674700 1 --2- 172.21.15.173:0/817937245 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55587d3dc800 0x55587d298c00 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.877+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bab40 con 0x55587d3dc800 2024-09-13T23:57:06.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.877+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d343400 2024-09-13T23:57:06.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.881+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.881+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d343400 2024-09-13T23:57:06.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.881+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.881+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d3dc400 2024-09-13T23:57:06.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.881+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bb440 con 0x55587d3dc400 2024-09-13T23:57:06.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.881+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d343400 2024-09-13T23:57:06.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.881+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.881+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d343c00 2024-09-13T23:57:06.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.881+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.881+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d343c00 2024-09-13T23:57:06.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.881+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.881+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d343400 2024-09-13T23:57:06.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.881+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.881+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d3dc800 2024-09-13T23:57:06.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.885+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bab40 con 0x55587d3dc800 2024-09-13T23:57:06.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.885+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d343400 2024-09-13T23:57:06.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.885+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.885+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d3dc800 2024-09-13T23:57:06.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.885+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bab40 con 0x55587d3dc800 2024-09-13T23:57:06.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.885+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d343c00 2024-09-13T23:57:06.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.885+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.885+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d3dc400 2024-09-13T23:57:06.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.885+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bb440 con 0x55587d3dc400 2024-09-13T23:57:06.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.885+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d343400 2024-09-13T23:57:06.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.885+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.885+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d343c00 2024-09-13T23:57:06.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.889+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.889+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d3dc400 2024-09-13T23:57:06.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.889+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bb440 con 0x55587d3dc400 2024-09-13T23:57:06.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.889+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d343400 2024-09-13T23:57:06.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.889+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.889+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d343400 2024-09-13T23:57:06.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.889+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.889+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d343400 2024-09-13T23:57:06.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.889+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.889+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d3dc400 2024-09-13T23:57:06.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.889+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bb440 con 0x55587d3dc400 2024-09-13T23:57:06.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.889+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d3dc800 2024-09-13T23:57:06.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.889+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bab40 con 0x55587d3dc800 2024-09-13T23:57:06.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.889+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d343400 2024-09-13T23:57:06.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.893+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.893+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d3dc800 2024-09-13T23:57:06.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.893+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bab40 con 0x55587d3dc800 2024-09-13T23:57:06.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.893+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d3dc400 2024-09-13T23:57:06.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.893+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bb440 con 0x55587d3dc400 2024-09-13T23:57:06.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.893+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d3dc800 2024-09-13T23:57:06.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.893+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bab40 con 0x55587d3dc800 2024-09-13T23:57:06.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.893+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d343c00 2024-09-13T23:57:06.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.893+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.893+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d343c00 2024-09-13T23:57:06.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.893+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.893+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d3dc400 2024-09-13T23:57:06.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bb440 con 0x55587d3dc400 2024-09-13T23:57:06.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d343c00 2024-09-13T23:57:06.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d343c00 2024-09-13T23:57:06.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f21366baf40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:06.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f21366baf40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:06.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f21366baf40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:06.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f21366baf40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:06.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f21366baf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dd000 con 0x55587d343400 2024-09-13T23:57:06.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f21366baf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f21366baf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dd400 con 0x55587d343c00 2024-09-13T23:57:06.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f21366baf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:06.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f21366baf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dd800 con 0x55587d343400 2024-09-13T23:57:06.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f21366baf40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:06.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f21366baf40 20 zone default found 2024-09-13T23:57:06.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f21366baf40 4 Realm: () 2024-09-13T23:57:06.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f21366baf40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:06.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f21366baf40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:06.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f21366baf40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:06.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f21366baf40 20 zonegroup default 2024-09-13T23:57:06.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f21366baf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.897+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3ddc00 con 0x55587d3dc800 2024-09-13T23:57:06.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.901+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55587d3bab40 con 0x55587d3dc800 2024-09-13T23:57:06.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.901+0000 7f21366baf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.901+0000 7f21366baf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.901+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dd000 con 0x55587d3dc400 2024-09-13T23:57:06.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.901+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55587d3bb440 con 0x55587d3dc400 2024-09-13T23:57:06.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.901+0000 7f21366baf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.901+0000 7f21366baf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.901+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dd800 con 0x55587d3dc400 2024-09-13T23:57:06.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.901+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55587d3bb440 con 0x55587d3dc400 2024-09-13T23:57:06.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.901+0000 7f21366baf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:06.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.901+0000 7f21366baf40 20 started sync module instance, tier type = 2024-09-13T23:57:06.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.901+0000 7f21366baf40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:06.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.901+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d343800 con 0x55587d343c00 2024-09-13T23:57:06.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.905+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.905+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93838545312512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d342800 con 0x55587d343c00 2024-09-13T23:57:06.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.905+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d343800 con 0x55587d343400 2024-09-13T23:57:06.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.905+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.905+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93838545313664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dc000 con 0x55587d343400 2024-09-13T23:57:06.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.905+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93838545312512] v33'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.905+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dd400 con 0x55587d343c00 2024-09-13T23:57:06.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.909+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93838545313664] v33'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.909+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.909+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93838545314816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3ea000 con 0x55587d343c00 2024-09-13T23:57:06.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.909+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3ea400 con 0x55587d3dc800 2024-09-13T23:57:06.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.913+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93838545314816] v33'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.913+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55587d3bab40 con 0x55587d3dc800 2024-09-13T23:57:06.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.913+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93838545315968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3ea800 con 0x55587d3dc800 2024-09-13T23:57:06.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.913+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3eac00 con 0x55587d343c00 2024-09-13T23:57:06.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.917+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 93838545315968] v33'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55587d3bab40 con 0x55587d3dc800 2024-09-13T23:57:06.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.917+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.917+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93838545317120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3eb000 con 0x55587d343c00 2024-09-13T23:57:06.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.917+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3eb400 con 0x55587d3dc400 2024-09-13T23:57:06.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.917+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55587d3bb440 con 0x55587d3dc400 2024-09-13T23:57:06.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.917+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93838545318272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3eb800 con 0x55587d3dc400 2024-09-13T23:57:06.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.917+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3ebc00 con 0x55587d3dc400 2024-09-13T23:57:06.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.917+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93838545317120] v33'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.921+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v33'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55587d3bb440 con 0x55587d3dc400 2024-09-13T23:57:06.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.921+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93838545319424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3eb400 con 0x55587d3dc400 2024-09-13T23:57:06.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.921+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3ea000 con 0x55587d3dc800 2024-09-13T23:57:06.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.921+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93838545318272] v33'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55587d3bb440 con 0x55587d3dc400 2024-09-13T23:57:06.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.921+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55587d3bab40 con 0x55587d3dc800 2024-09-13T23:57:06.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.921+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93838545320576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3eac00 con 0x55587d3dc800 2024-09-13T23:57:06.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.921+0000 7f21366baf40 20 add_watcher() i=0 2024-09-13T23:57:06.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.921+0000 7f21366baf40 20 add_watcher() i=1 2024-09-13T23:57:06.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.921+0000 7f21366baf40 20 add_watcher() i=2 2024-09-13T23:57:06.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.921+0000 7f21366baf40 20 add_watcher() i=3 2024-09-13T23:57:06.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.921+0000 7f21366baf40 20 add_watcher() i=4 2024-09-13T23:57:06.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.921+0000 7f21366baf40 20 add_watcher() i=5 2024-09-13T23:57:06.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.921+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93838545319424] v33'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55587d3bb440 con 0x55587d3dc400 2024-09-13T23:57:06.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.921+0000 7f21366baf40 20 add_watcher() i=6 2024-09-13T23:57:06.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.925+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 93838545320576] v33'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55587d3bab40 con 0x55587d3dc800 2024-09-13T23:57:06.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.925+0000 7f21366baf40 20 add_watcher() i=7 2024-09-13T23:57:06.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.925+0000 7f21366baf40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:06.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.925+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dcc00 con 0x55587d343400 2024-09-13T23:57:06.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.925+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.925+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93838546763776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dd000 con 0x55587d343400 2024-09-13T23:57:06.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.929+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93838546763776] v33'144 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.929+0000 7f211be41700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:06.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.929+0000 7f21366baf40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:06.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.929+0000 7f21366baf40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:06.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.929+0000 7f21366baf40 1 Processor -- start 2024-09-13T23:57:06.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.929+0000 7f21366baf40 1 -- start start 2024-09-13T23:57:06.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.929+0000 7f21366baf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587d3dd400 0x55587d299180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.929+0000 7f21366baf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55587cfd6780 con 0x55587d3dd400 2024-09-13T23:57:06.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.929+0000 7f2134672700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587d3dd400 0x55587d299180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.929+0000 7f2134672700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587d3dd400 0x55587d299180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50778/0 (socket says 172.21.15.173:50778) 2024-09-13T23:57:06.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.929+0000 7f2134672700 1 -- 172.21.15.173:0/2168767152 learned_addr learned my addr 172.21.15.173:0/2168767152 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.929+0000 7f2134672700 1 -- 172.21.15.173:0/2168767152 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55587cfc2b60 con 0x55587d3dd400 2024-09-13T23:57:06.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.929+0000 7f2134672700 1 --2- 172.21.15.173:0/2168767152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587d3dd400 0x55587d299180 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x55587d3796b0 tx=0x55587d309920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb8545bb474de5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.929+0000 7f211b640700 1 -- 172.21.15.173:0/2168767152 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55587d3ee160 con 0x55587d3dd400 2024-09-13T23:57:06.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.929+0000 7f211b640700 1 -- 172.21.15.173:0/2168767152 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55587d366a80 con 0x55587d3dd400 2024-09-13T23:57:06.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.929+0000 7f211b640700 1 -- 172.21.15.173:0/2168767152 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55587d3ee2c0 con 0x55587d3dd400 2024-09-13T23:57:06.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.929+0000 7f21366baf40 1 -- 172.21.15.173:0/2168767152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587d3dd400 msgr2=0x55587d299180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.929+0000 7f21366baf40 1 --2- 172.21.15.173:0/2168767152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587d3dd400 0x55587d299180 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x55587d3796b0 tx=0x55587d309920 comp rx=0 tx=0).stop 2024-09-13T23:57:06.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.929+0000 7f21366baf40 1 -- 172.21.15.173:0/2168767152 shutdown_connections 2024-09-13T23:57:06.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.929+0000 7f21366baf40 1 --2- 172.21.15.173:0/2168767152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587d3dd400 0x55587d299180 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.929+0000 7f21366baf40 1 -- 172.21.15.173:0/2168767152 >> 172.21.15.173:0/2168767152 conn(0x55587d3dd800 msgr2=0x55587d0b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.929+0000 7f21366baf40 1 -- 172.21.15.173:0/2168767152 shutdown_connections 2024-09-13T23:57:06.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.929+0000 7f21366baf40 1 -- 172.21.15.173:0/2168767152 wait complete. 2024-09-13T23:57:06.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.933+0000 7f21366baf40 1 Processor -- start 2024-09-13T23:57:06.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.933+0000 7f21366baf40 1 -- start start 2024-09-13T23:57:06.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.933+0000 7f21366baf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587d3dd400 0x55587d299180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.933+0000 7f21366baf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55587d03e000 con 0x55587d3dd400 2024-09-13T23:57:06.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.933+0000 7f2134672700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587d3dd400 0x55587d299180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.933+0000 7f2134672700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587d3dd400 0x55587d299180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50788/0 (socket says 172.21.15.173:50788) 2024-09-13T23:57:06.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.933+0000 7f2134672700 1 -- 172.21.15.173:0/2832283478 learned_addr learned my addr 172.21.15.173:0/2832283478 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:06.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.933+0000 7f2134672700 1 -- 172.21.15.173:0/2832283478 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55587cfc2d00 con 0x55587d3dd400 2024-09-13T23:57:06.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.933+0000 7f2134672700 1 --2- 172.21.15.173:0/2832283478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587d3dd400 0x55587d299180 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x55587d4000f0 tx=0x55587d3087e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.933+0000 7f2119e3d700 1 -- 172.21.15.173:0/2832283478 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55587d3ee420 con 0x55587d3dd400 2024-09-13T23:57:06.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.933+0000 7f2119e3d700 1 -- 172.21.15.173:0/2832283478 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55587d366780 con 0x55587d3dd400 2024-09-13T23:57:06.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.933+0000 7f21366baf40 1 -- 172.21.15.173:0/2832283478 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55587cfc2340 con 0x55587d3dd400 2024-09-13T23:57:06.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.933+0000 7f2119e3d700 1 -- 172.21.15.173:0/2832283478 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55587d3ee160 con 0x55587d3dd400 2024-09-13T23:57:06.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.933+0000 7f21366baf40 1 -- 172.21.15.173:0/2832283478 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55587cfc2b60 con 0x55587d3dd400 2024-09-13T23:57:06.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.933+0000 7f2119e3d700 1 -- 172.21.15.173:0/2832283478 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55587d0abb80 con 0x55587d3dd400 2024-09-13T23:57:06.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.933+0000 7f2119e3d700 1 --2- 172.21.15.173:0/2832283478 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55587d3dcc00 0x55587d488000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:06.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.937+0000 7f2119e3d700 1 -- 172.21.15.173:0/2832283478 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x55587d0176c0 con 0x55587d3dd400 2024-09-13T23:57:06.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.937+0000 7f21366baf40 5 note: GC not initialized 2024-09-13T23:57:06.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.937+0000 7f2135674700 1 --2- 172.21.15.173:0/2832283478 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55587d3dcc00 0x55587d488000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:06.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.937+0000 7f2135674700 1 --2- 172.21.15.173:0/2832283478 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55587d3dcc00 0x55587d488000 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55587d3797a0 tx=0x55587d309740 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:06.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.937+0000 7f2117638700 20 reqs_thread_entry: start 2024-09-13T23:57:06.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.937+0000 7f21366baf40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:06.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.937+0000 7f21366baf40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:06.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.937+0000 7f2115634700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:37 2024 2024-09-13T23:57:06.944 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:06.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.937+0000 7f2114e12700 20 reqs_thread_entry: start 2024-09-13T23:57:06.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.937+0000 7f21366baf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.937+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d342800 con 0x55587d3dc800 2024-09-13T23:57:06.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.937+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x55587d3bab40 con 0x55587d3dc800 2024-09-13T23:57:06.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.937+0000 7f21366baf40 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:57:06.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.937+0000 7f21366baf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.937+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:63 8.17 8:ea49432e:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d343800 con 0x55587d343c00 2024-09-13T23:57:06.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(63 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f21366baf40 20 rados_obj.operate() r=0 bl.length=352 2024-09-13T23:57:06.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f21366baf40 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T23:57:06.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f21366baf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3ea800 con 0x55587d3dc800 2024-09-13T23:57:06.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x55587d3bab40 con 0x55587d3dc800 2024-09-13T23:57:06.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f21366baf40 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:57:06.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f21366baf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:06.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 8.17 8:ea49432e:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3ea000 con 0x55587d343c00 2024-09-13T23:57:06.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(65 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f21366baf40 20 rados_obj.operate() r=0 bl.length=352 2024-09-13T23:57:06.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f21366baf40 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T23:57:06.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:66 4.3a 4:5ed28fc2:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3eac00 con 0x55587d3dc400 2024-09-13T23:57:06.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 4.18 4:18584371:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3eb000 con 0x55587d343c00 2024-09-13T23:57:06.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:68 4.34 4:2cdc3579:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3ea400 con 0x55587d3dc800 2024-09-13T23:57:06.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:69 4.1e 4:7ad1e97c:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dd000 con 0x55587d343400 2024-09-13T23:57:06.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:70 4.2f 4:f65cb84f:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d4f4000 con 0x55587d343400 2024-09-13T23:57:06.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:71 4.b 4:d29b135b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d4f4400 con 0x55587d3dc800 2024-09-13T23:57:06.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:72 4.32 4:4e7c1df1:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d4f4800 con 0x55587d343c00 2024-09-13T23:57:06.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:73 4.17 4:ebadd201:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d4f4c00 con 0x55587d3dc400 2024-09-13T23:57:06.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:74 4.2 4:40ba7f18:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d4f5000 con 0x55587d343400 2024-09-13T23:57:06.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:75 4.26 4:66627631:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d4f5400 con 0x55587d343400 2024-09-13T23:57:06.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:76 4.a 4:53f2fc8c:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d4f5800 con 0x55587d343c00 2024-09-13T23:57:06.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(67 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(68 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55587d3bab40 con 0x55587d3dc800 2024-09-13T23:57:06.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(71 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.5 [call out=124b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x55587d3bab40 con 0x55587d3dc800 2024-09-13T23:57:06.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(66 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55587d3bb440 con 0x55587d3dc400 2024-09-13T23:57:06.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(72 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.6 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(76 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(70 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(69 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.941+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(73 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55587d3bb440 con 0x55587d3dc400 2024-09-13T23:57:06.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.945+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(75 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.945+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(74 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1.8 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.945+0000 7f211be41700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:06.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.945+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93838546763776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d4f5c00 con 0x55587d343400 2024-09-13T23:57:06.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.949+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 24 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 93838546763776] v33'145 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.949+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93838545312512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d4f4000 con 0x55587d343c00 2024-09-13T23:57:06.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.949+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 93838545312512] v33'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.949+0000 7f21366baf40 20 remove_watcher() i=0 2024-09-13T23:57:06.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.949+0000 7f21366baf40 2 removed watcher, disabling cache 2024-09-13T23:57:06.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.949+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93838545313664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d4f4400 con 0x55587d343400 2024-09-13T23:57:06.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.953+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.1 v2:172.21.15.173:6808/3256211813 25 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 93838545313664] v33'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55587d3bab40 con 0x55587d343400 2024-09-13T23:57:06.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.953+0000 7f21366baf40 20 remove_watcher() i=1 2024-09-13T23:57:06.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.953+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93838545314816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3dd000 con 0x55587d343c00 2024-09-13T23:57:06.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.953+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 93838545314816] v33'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.953+0000 7f21366baf40 20 remove_watcher() i=2 2024-09-13T23:57:06.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.953+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93838545315968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3ea800 con 0x55587d3dc800 2024-09-13T23:57:06.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.957+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 93838545315968] v33'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55587d3bab40 con 0x55587d3dc800 2024-09-13T23:57:06.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.957+0000 7f21366baf40 20 remove_watcher() i=3 2024-09-13T23:57:06.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.957+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93838545317120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d3ea400 con 0x55587d343c00 2024-09-13T23:57:06.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.957+0000 7f2134e73700 1 -- 172.21.15.173:0/817937245 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 93838545317120] v33'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55587d3bb200 con 0x55587d343c00 2024-09-13T23:57:06.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.961+0000 7f21366baf40 20 remove_watcher() i=4 2024-09-13T23:57:06.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.961+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93838545318272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d342800 con 0x55587d3dc400 2024-09-13T23:57:06.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.961+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 93838545318272] v33'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55587d3bb440 con 0x55587d3dc400 2024-09-13T23:57:06.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.961+0000 7f21366baf40 20 remove_watcher() i=5 2024-09-13T23:57:06.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.961+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93838545319424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d4f4c00 con 0x55587d3dc400 2024-09-13T23:57:06.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.961+0000 7f2134672700 1 -- 172.21.15.173:0/817937245 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 93838545319424] v33'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55587d3bb440 con 0x55587d3dc400 2024-09-13T23:57:06.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 20 remove_watcher() i=6 2024-09-13T23:57:06.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93838545320576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55587d4f4800 con 0x55587d3dc800 2024-09-13T23:57:06.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 93838545320576] v33'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55587d3bab40 con 0x55587d3dc800 2024-09-13T23:57:06.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 20 remove_watcher() i=7 2024-09-13T23:57:06.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55587d343c00 msgr2=0x55587d298100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 --2- 172.21.15.173:0/817937245 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55587d343c00 0x55587d298100 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55587d343400 msgr2=0x55587d297b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 --2- 172.21.15.173:0/817937245 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55587d343400 0x55587d297b80 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55587d3dc800 msgr2=0x55587d298c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 --2- 172.21.15.173:0/817937245 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55587d3dc800 0x55587d298c00 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55587d3dc400 msgr2=0x55587d298680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 --2- 172.21.15.173:0/817937245 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55587d3dc400 0x55587d298680 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55587d343000 msgr2=0x55587d297600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 --2- 172.21.15.173:0/817937245 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55587d343000 0x55587d297600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55587d33dbf0 tx=0x55587d3086c0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1800 msgr2=0x55587d296b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 --2- 172.21.15.173:0/817937245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1800 0x55587d296b00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x55587d33ca20 tx=0x55587d308a80 comp rx=0 tx=0).stop 2024-09-13T23:57:06.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f2135674700 1 -- 172.21.15.173:0/817937245 reap_dead start 2024-09-13T23:57:06.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 shutdown_connections 2024-09-13T23:57:06.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 --2- 172.21.15.173:0/817937245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1800 0x55587d296b00 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 >> 172.21.15.173:0/817937245 conn(0x55587cfb1400 msgr2=0x55587d0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 shutdown_connections 2024-09-13T23:57:06.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 -- 172.21.15.173:0/817937245 wait complete. 2024-09-13T23:57:06.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 -- 172.21.15.173:0/2832283478 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55587d3dcc00 msgr2=0x55587d488000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 --2- 172.21.15.173:0/2832283478 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55587d3dcc00 0x55587d488000 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55587d3797a0 tx=0x55587d309740 comp rx=0 tx=0).stop 2024-09-13T23:57:06.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 -- 172.21.15.173:0/2832283478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587d3dd400 msgr2=0x55587d299180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 --2- 172.21.15.173:0/2832283478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587d3dd400 0x55587d299180 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x55587d4000f0 tx=0x55587d3087e0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 -- 172.21.15.173:0/2832283478 shutdown_connections 2024-09-13T23:57:06.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 --2- 172.21.15.173:0/2832283478 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55587d3dcc00 0x55587d488000 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 --2- 172.21.15.173:0/2832283478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587d3dd400 0x55587d299180 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.965+0000 7f21366baf40 1 -- 172.21.15.173:0/2832283478 >> 172.21.15.173:0/2832283478 conn(0x55587d3dd800 msgr2=0x55587d0b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.969+0000 7f21366baf40 1 -- 172.21.15.173:0/2832283478 shutdown_connections 2024-09-13T23:57:06.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.969+0000 7f21366baf40 1 -- 172.21.15.173:0/2832283478 wait complete. 2024-09-13T23:57:06.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.969+0000 7f21366baf40 1 -- 172.21.15.173:0/1987574764 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55587d342000 msgr2=0x55587d297080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.969+0000 7f21366baf40 1 --2- 172.21.15.173:0/1987574764 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55587d342000 0x55587d297080 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55587dd7a030 tx=0x55587d308780 comp rx=0 tx=0).stop 2024-09-13T23:57:06.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.969+0000 7f21366baf40 1 -- 172.21.15.173:0/1987574764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1000 msgr2=0x55587d296580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:06.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.969+0000 7f21366baf40 1 --2- 172.21.15.173:0/1987574764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1000 0x55587d296580 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x55587dd7bf20 tx=0x55587d0b5920 comp rx=0 tx=0).stop 2024-09-13T23:57:06.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.969+0000 7f21366baf40 1 -- 172.21.15.173:0/1987574764 shutdown_connections 2024-09-13T23:57:06.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.969+0000 7f21366baf40 1 --2- 172.21.15.173:0/1987574764 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55587d342000 0x55587d297080 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.969+0000 7f21366baf40 1 --2- 172.21.15.173:0/1987574764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55587cfb1000 0x55587d296580 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:06.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.969+0000 7f21366baf40 1 -- 172.21.15.173:0/1987574764 >> 172.21.15.173:0/1987574764 conn(0x55587cfb0c00 msgr2=0x55587d0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:06.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.969+0000 7f21366baf40 1 -- 172.21.15.173:0/1987574764 shutdown_connections 2024-09-13T23:57:06.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:06.969+0000 7f21366baf40 1 -- 172.21.15.173:0/1987574764 wait complete. 2024-09-13T23:57:06.977 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:06.977 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo", 2024-09-13T23:57:06.977 INFO:teuthology.orchestra.run.smithi173.stdout: "num_shards": 11, 2024-09-13T23:57:06.977 INFO:teuthology.orchestra.run.smithi173.stdout: "tenant": "", 2024-09-13T23:57:06.977 INFO:teuthology.orchestra.run.smithi173.stdout: "zonegroup": "45606a84-a024-4d59-86ac-9903db661675", 2024-09-13T23:57:06.978 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_rule": "default-placement", 2024-09-13T23:57:06.978 INFO:teuthology.orchestra.run.smithi173.stdout: "explicit_placement": { 2024-09-13T23:57:06.978 INFO:teuthology.orchestra.run.smithi173.stdout: "data_pool": "", 2024-09-13T23:57:06.978 INFO:teuthology.orchestra.run.smithi173.stdout: "data_extra_pool": "", 2024-09-13T23:57:06.978 INFO:teuthology.orchestra.run.smithi173.stdout: "index_pool": "" 2024-09-13T23:57:06.978 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:06.978 INFO:teuthology.orchestra.run.smithi173.stdout: "id": "d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1", 2024-09-13T23:57:06.978 INFO:teuthology.orchestra.run.smithi173.stdout: "marker": "d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1", 2024-09-13T23:57:06.978 INFO:teuthology.orchestra.run.smithi173.stdout: "index_type": "Normal", 2024-09-13T23:57:06.978 INFO:teuthology.orchestra.run.smithi173.stdout: "versioned": false, 2024-09-13T23:57:06.978 INFO:teuthology.orchestra.run.smithi173.stdout: "versioning_enabled": false, 2024-09-13T23:57:06.978 INFO:teuthology.orchestra.run.smithi173.stdout: "object_lock_enabled": false, 2024-09-13T23:57:06.978 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_enabled": false, 2024-09-13T23:57:06.979 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:57:06.979 INFO:teuthology.orchestra.run.smithi173.stdout: "ver": "0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1", 2024-09-13T23:57:06.979 INFO:teuthology.orchestra.run.smithi173.stdout: "master_ver": "0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0", 2024-09-13T23:57:06.979 INFO:teuthology.orchestra.run.smithi173.stdout: "mtime": "2024-09-13T23:57:06.166731Z", 2024-09-13T23:57:06.979 INFO:teuthology.orchestra.run.smithi173.stdout: "creation_time": "2024-09-13T23:57:02.413869Z", 2024-09-13T23:57:06.979 INFO:teuthology.orchestra.run.smithi173.stdout: "max_marker": "0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#", 2024-09-13T23:57:06.979 INFO:teuthology.orchestra.run.smithi173.stdout: "usage": { 2024-09-13T23:57:06.979 INFO:teuthology.orchestra.run.smithi173.stdout: "rgw.main": { 2024-09-13T23:57:06.979 INFO:teuthology.orchestra.run.smithi173.stdout: "size": 0, 2024-09-13T23:57:06.979 INFO:teuthology.orchestra.run.smithi173.stdout: "size_actual": 0, 2024-09-13T23:57:06.979 INFO:teuthology.orchestra.run.smithi173.stdout: "size_utilized": 0, 2024-09-13T23:57:06.979 INFO:teuthology.orchestra.run.smithi173.stdout: "size_kb": 0, 2024-09-13T23:57:06.979 INFO:teuthology.orchestra.run.smithi173.stdout: "size_kb_actual": 0, 2024-09-13T23:57:06.979 INFO:teuthology.orchestra.run.smithi173.stdout: "size_kb_utilized": 0, 2024-09-13T23:57:06.980 INFO:teuthology.orchestra.run.smithi173.stdout: "num_objects": 0 2024-09-13T23:57:06.980 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:06.980 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:06.980 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:57:06.980 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:06.980 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:06.980 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:06.980 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:06.980 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:06.980 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:06.980 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:06.981 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '45606a84-a024-4d59-86ac-9903db661675', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.1', 'marker': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.1', 'index_type': 'Normal', 'versioned': False, 'versioning_enabled': False, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T23:57:06.166731Z', 'creation_time': '2024-09-13T23:57:02.413869Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T23:57:06.981 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-13T23:57:06.982 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-13T23:57:06.982 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-13T23:57:07.019 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:07.019 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:07.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.013+0000 7f3c5554cf40 1 Processor -- start 2024-09-13T23:57:07.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.013+0000 7f3c5554cf40 1 -- start start 2024-09-13T23:57:07.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.013+0000 7f3c5554cf40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x558acbc97000 0x558acbf7c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.013+0000 7f3c5554cf40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558acbd5b500 con 0x558acbc97400 2024-09-13T23:57:07.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.013+0000 7f3c5554cf40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x558acbd24a00 con 0x558acbc97000 2024-09-13T23:57:07.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.013+0000 7f3c53d05700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x558acbc97000 0x558acbf7c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.013+0000 7f3c53504700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x558acbc97400 0x558acbd96800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47562/0 (socket says 172.21.15.173:47562) 2024-09-13T23:57:07.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.013+0000 7f3c53504700 1 -- 172.21.15.173:0/3279744713 learned_addr learned my addr 172.21.15.173:0/3279744713 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:07.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.013+0000 7f3c53d05700 1 -- 172.21.15.173:0/3279744713 >> v1:172.21.15.87:6789/0 conn(0x558acbc97400 legacy=0x558acbd96800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.017+0000 7f3c53d05700 1 -- 172.21.15.173:0/3279744713 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558acbca9d40 con 0x558acbc97000 2024-09-13T23:57:07.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.017+0000 7f3c53d05700 1 --2- 172.21.15.173:0/3279744713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97000 0x558acbf7c580 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x558acbf77a70 tx=0x558acbd9b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba44b493007e1f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.017+0000 7f3c52d03700 1 -- 172.21.15.173:0/3279744713 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558acbd3b4a0 con 0x558acbc97000 2024-09-13T23:57:07.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.017+0000 7f3c52d03700 1 -- 172.21.15.173:0/3279744713 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558acbd5b800 con 0x558acbc97000 2024-09-13T23:57:07.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.017+0000 7f3c52d03700 1 -- 172.21.15.173:0/3279744713 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558acbd3b600 con 0x558acbc97000 2024-09-13T23:57:07.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.017+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3279744713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97000 msgr2=0x558acbf7c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.017+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/3279744713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97000 0x558acbf7c580 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x558acbf77a70 tx=0x558acbd9b920 comp rx=0 tx=0).stop 2024-09-13T23:57:07.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.017+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3279744713 shutdown_connections 2024-09-13T23:57:07.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.017+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/3279744713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97000 0x558acbf7c580 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.017+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3279744713 >> 172.21.15.173:0/3279744713 conn(0x558acbc96c00 msgr2=0x558acbd96000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:07.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.017+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3279744713 shutdown_connections 2024-09-13T23:57:07.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.017+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3279744713 wait complete. 2024-09-13T23:57:07.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.017+0000 7f3c5554cf40 1 Processor -- start 2024-09-13T23:57:07.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.017+0000 7f3c5554cf40 1 -- start start 2024-09-13T23:57:07.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.017+0000 7f3c5554cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97000 0x558acbf7c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.017+0000 7f3c5554cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558acbd24500 con 0x558acbc97000 2024-09-13T23:57:07.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.017+0000 7f3c53d05700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97000 0x558acbf7c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.017+0000 7f3c53d05700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97000 0x558acbf7c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50814/0 (socket says 172.21.15.173:50814) 2024-09-13T23:57:07.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.017+0000 7f3c53d05700 1 -- 172.21.15.173:0/3076929920 learned_addr learned my addr 172.21.15.173:0/3076929920 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:07.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.017+0000 7f3c53d05700 1 -- 172.21.15.173:0/3076929920 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558acbca9ba0 con 0x558acbc97000 2024-09-13T23:57:07.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c53d05700 1 --2- 172.21.15.173:0/3076929920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97000 0x558acbf7c580 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x558acbdf20c0 tx=0x558acbd9b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8deb3d40665a1343 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c52502700 1 -- 172.21.15.173:0/3076929920 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558acbd3b760 con 0x558acbc97000 2024-09-13T23:57:07.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c52502700 1 -- 172.21.15.173:0/3076929920 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558acbd5bb00 con 0x558acbc97000 2024-09-13T23:57:07.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c52502700 1 -- 172.21.15.173:0/3076929920 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558acbd3b4a0 con 0x558acbc97000 2024-09-13T23:57:07.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3076929920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97000 msgr2=0x558acbf7c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/3076929920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97000 0x558acbf7c580 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x558acbdf20c0 tx=0x558acbd9b800 comp rx=0 tx=0).stop 2024-09-13T23:57:07.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3076929920 shutdown_connections 2024-09-13T23:57:07.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/3076929920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97000 0x558acbf7c580 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3076929920 >> 172.21.15.173:0/3076929920 conn(0x558acbc96c00 msgr2=0x558acbd97000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:07.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3076929920 shutdown_connections 2024-09-13T23:57:07.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3076929920 wait complete. 2024-09-13T23:57:07.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c5554cf40 1 Processor -- start 2024-09-13T23:57:07.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c5554cf40 1 -- start start 2024-09-13T23:57:07.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c5554cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97000 0x558acbf7c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c5554cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558acbd243c0 con 0x558acbc97000 2024-09-13T23:57:07.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c53d05700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97000 0x558acbf7c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c53d05700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97000 0x558acbf7c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50830/0 (socket says 172.21.15.173:50830) 2024-09-13T23:57:07.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c53d05700 1 -- 172.21.15.173:0/2660856755 learned_addr learned my addr 172.21.15.173:0/2660856755 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:07.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c53d05700 1 -- 172.21.15.173:0/2660856755 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558acbca9a00 con 0x558acbc97000 2024-09-13T23:57:07.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c53d05700 1 --2- 172.21.15.173:0/2660856755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97000 0x558acbf7c580 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x558acbdf3f50 tx=0x558acbd9b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c50cff700 1 -- 172.21.15.173:0/2660856755 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558acbd3b600 con 0x558acbc97000 2024-09-13T23:57:07.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c50cff700 1 -- 172.21.15.173:0/2660856755 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558acbd5bc80 con 0x558acbc97000 2024-09-13T23:57:07.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c5554cf40 1 -- 172.21.15.173:0/2660856755 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558acbca9860 con 0x558acbc97000 2024-09-13T23:57:07.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c50cff700 1 -- 172.21.15.173:0/2660856755 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558acbd3b8c0 con 0x558acbc97000 2024-09-13T23:57:07.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.021+0000 7f3c5554cf40 1 -- 172.21.15.173:0/2660856755 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558acbca96c0 con 0x558acbc97000 2024-09-13T23:57:07.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c5554cf40 1 Processor -- start 2024-09-13T23:57:07.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c5554cf40 1 -- start start 2024-09-13T23:57:07.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c5554cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97800 0x558acbf7cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c5554cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558acbd24000 con 0x558acbc97800 2024-09-13T23:57:07.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c50cff700 1 -- 172.21.15.173:0/2660856755 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x558acbd90b00 con 0x558acbc97000 2024-09-13T23:57:07.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c54506700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97800 0x558acbf7cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c54506700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97800 0x558acbf7cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50836/0 (socket says 172.21.15.173:50836) 2024-09-13T23:57:07.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c54506700 1 -- 172.21.15.173:0/831867178 learned_addr learned my addr 172.21.15.173:0/831867178 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:07.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c50cff700 1 --2- 172.21.15.173:0/2660856755 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558acc030000 0x558acbf7d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c50cff700 1 -- 172.21.15.173:0/2660856755 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x558acbcfd180 con 0x558acbc97000 2024-09-13T23:57:07.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c53d05700 1 --2- 172.21.15.173:0/2660856755 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558acc030000 0x558acbf7d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c54506700 1 -- 172.21.15.173:0/831867178 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558acbca8000 con 0x558acbc97800 2024-09-13T23:57:07.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c54506700 1 --2- 172.21.15.173:0/831867178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97800 0x558acbf7cb00 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x558acc00e510 tx=0x558acbd9b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62aa0bfc094b184b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c4e4fa700 1 -- 172.21.15.173:0/831867178 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558acbd3b600 con 0x558acbc97800 2024-09-13T23:57:07.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c4e4fa700 1 -- 172.21.15.173:0/831867178 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558acc034000 con 0x558acbc97800 2024-09-13T23:57:07.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c4e4fa700 1 -- 172.21.15.173:0/831867178 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558acbd3b8c0 con 0x558acbc97800 2024-09-13T23:57:07.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c5554cf40 1 -- 172.21.15.173:0/831867178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97800 msgr2=0x558acbf7cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/831867178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97800 0x558acbf7cb00 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x558acc00e510 tx=0x558acbd9b8c0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c53d05700 1 --2- 172.21.15.173:0/2660856755 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558acc030000 0x558acbf7d080 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x558acbfbf4d0 tx=0x558acbff08a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c5554cf40 1 -- 172.21.15.173:0/831867178 shutdown_connections 2024-09-13T23:57:07.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/831867178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97800 0x558acbf7cb00 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c5554cf40 1 -- 172.21.15.173:0/831867178 >> 172.21.15.173:0/831867178 conn(0x558acbc97400 msgr2=0x558acbd97800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:07.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c5554cf40 1 -- 172.21.15.173:0/831867178 shutdown_connections 2024-09-13T23:57:07.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c5554cf40 1 -- 172.21.15.173:0/831867178 wait complete. 2024-09-13T23:57:07.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.025+0000 7f3c5554cf40 1 Processor -- start 2024-09-13T23:57:07.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.029+0000 7f3c5554cf40 1 -- start start 2024-09-13T23:57:07.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.029+0000 7f3c5554cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97800 0x558acbf7cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.029+0000 7f3c5554cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558acbcbc640 con 0x558acbc97800 2024-09-13T23:57:07.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.029+0000 7f3c54506700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97800 0x558acbf7cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.029+0000 7f3c54506700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97800 0x558acbf7cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50848/0 (socket says 172.21.15.173:50848) 2024-09-13T23:57:07.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.029+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 learned_addr learned my addr 172.21.15.173:0/3173311998 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:07.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.029+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558acbca8ea0 con 0x558acbc97800 2024-09-13T23:57:07.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.029+0000 7f3c54506700 1 --2- 172.21.15.173:0/3173311998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97800 0x558acbf7cb00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x558acbfbe0f0 tx=0x558acbff0660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.029+0000 7f3c4ccf7700 1 -- 172.21.15.173:0/3173311998 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558acbd3b760 con 0x558acbc97800 2024-09-13T23:57:07.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.029+0000 7f3c4ccf7700 1 -- 172.21.15.173:0/3173311998 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558acc034180 con 0x558acbc97800 2024-09-13T23:57:07.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.029+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558acbca8820 con 0x558acbc97800 2024-09-13T23:57:07.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.029+0000 7f3c4ccf7700 1 -- 172.21.15.173:0/3173311998 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558acbd3b600 con 0x558acbc97800 2024-09-13T23:57:07.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.029+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558acbca89c0 con 0x558acbc97800 2024-09-13T23:57:07.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.029+0000 7f3c5554cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.029+0000 7f3c4ccf7700 1 -- 172.21.15.173:0/3173311998 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x558acbd90dc0 con 0x558acbc97800 2024-09-13T23:57:07.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c4ccf7700 1 --2- 172.21.15.173:0/3173311998 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558acc030c00 0x558acbf7d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c4ccf7700 1 -- 172.21.15.173:0/3173311998 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x558acbcfd340 con 0x558acbc97800 2024-09-13T23:57:07.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c53504700 1 --2- 172.21.15.173:0/3173311998 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558acc030c00 0x558acbf7d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/3173311998 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x558acc031000 0x558acbf7db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031400 con 0x558acc031000 2024-09-13T23:57:07.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c54506700 1 --2- 172.21.15.173:0/3173311998 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x558acc031000 0x558acbf7db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c53504700 1 --2- 172.21.15.173:0/3173311998 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558acc030c00 0x558acbf7d600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x558acc00faa0 tx=0x558acbff1920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c54506700 1 --2- 172.21.15.173:0/3173311998 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x558acc031000 0x558acbf7db80 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x558acc08eb40 con 0x558acc031000 2024-09-13T23:57:07.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c5554cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:07.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c5554cf40 20 realm 2024-09-13T23:57:07.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c5554cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031000 2024-09-13T23:57:07.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x558acc08eb40 con 0x558acc031000 2024-09-13T23:57:07.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c5554cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:07.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c5554cf40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:07.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c5554cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031c00 con 0x558acc031000 2024-09-13T23:57:07.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x558acc08eb40 con 0x558acc031000 2024-09-13T23:57:07.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c5554cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:07.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c5554cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/3173311998 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558acc031400 0x558acbf7e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031400 2024-09-13T23:57:07.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c53d05700 1 --2- 172.21.15.173:0/3173311998 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558acc031400 0x558acbf7e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.033+0000 7f3c53d05700 1 --2- 172.21.15.173:0/3173311998 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558acc031400 0x558acbf7e100 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.037+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x558acc08f200 con 0x558acc031400 2024-09-13T23:57:07.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.037+0000 7f3c5554cf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:07.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.037+0000 7f3c5554cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.037+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/3173311998 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558acc031c00 0x558acbf7e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.037+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0f8000 con 0x558acc031c00 2024-09-13T23:57:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.037+0000 7f3c53504700 1 --2- 172.21.15.173:0/3173311998 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558acc031c00 0x558acbf7e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.037+0000 7f3c53504700 1 --2- 172.21.15.173:0/3173311998 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558acc031c00 0x558acbf7e680 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.037+0000 7f3c53504700 1 -- 172.21.15.173:0/3173311998 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x558acc08f440 con 0x558acc031c00 2024-09-13T23:57:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.037+0000 7f3c5554cf40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.037+0000 7f3c5554cf40 20 searching for the correct realm 2024-09-13T23:57:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.037+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0f8400 con 0x558acc031c00 2024-09-13T23:57:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.037+0000 7f3c53504700 1 -- 172.21.15.173:0/3173311998 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x558acc08f440 con 0x558acc031c00 2024-09-13T23:57:07.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.037+0000 7f3c53504700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0f8000 con 0x558acc031400 2024-09-13T23:57:07.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.037+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08f200 con 0x558acc031400 2024-09-13T23:57:07.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.037+0000 7f3c53d05700 1 --2- 172.21.15.173:0/3173311998 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x558acc0f8000 0x558acbf7ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.037+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc0f8000 2024-09-13T23:57:07.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.037+0000 7f3c54506700 1 --2- 172.21.15.173:0/3173311998 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x558acc0f8000 0x558acbf7ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.041+0000 7f3c54506700 1 --2- 172.21.15.173:0/3173311998 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x558acc0f8000 0x558acbf7ec00 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.041+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08eb40 con 0x558acc0f8000 2024-09-13T23:57:07.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.041+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031000 2024-09-13T23:57:07.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.041+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x558acc08eb40 con 0x558acc031000 2024-09-13T23:57:07.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.041+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031000 2024-09-13T23:57:07.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.041+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08eb40 con 0x558acc031000 2024-09-13T23:57:07.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.041+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031c00 2024-09-13T23:57:07.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.041+0000 7f3c53504700 1 -- 172.21.15.173:0/3173311998 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08f440 con 0x558acc031c00 2024-09-13T23:57:07.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.041+0000 7f3c53504700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031000 2024-09-13T23:57:07.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.041+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08eb40 con 0x558acc031000 2024-09-13T23:57:07.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.041+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031400 2024-09-13T23:57:07.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.041+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08f200 con 0x558acc031400 2024-09-13T23:57:07.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.041+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031400 2024-09-13T23:57:07.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.045+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08f200 con 0x558acc031400 2024-09-13T23:57:07.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.045+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031000 2024-09-13T23:57:07.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.045+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08eb40 con 0x558acc031000 2024-09-13T23:57:07.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.045+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc0f8000 2024-09-13T23:57:07.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.045+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08eb40 con 0x558acc0f8000 2024-09-13T23:57:07.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.045+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031000 2024-09-13T23:57:07.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.045+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08eb40 con 0x558acc031000 2024-09-13T23:57:07.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.045+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc0f8000 2024-09-13T23:57:07.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.045+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08eb40 con 0x558acc0f8000 2024-09-13T23:57:07.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.045+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031400 2024-09-13T23:57:07.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.045+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08f200 con 0x558acc031400 2024-09-13T23:57:07.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.045+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031c00 2024-09-13T23:57:07.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.045+0000 7f3c53504700 1 -- 172.21.15.173:0/3173311998 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08f440 con 0x558acc031c00 2024-09-13T23:57:07.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.045+0000 7f3c53504700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031000 2024-09-13T23:57:07.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.049+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08eb40 con 0x558acc031000 2024-09-13T23:57:07.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.049+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031400 2024-09-13T23:57:07.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.049+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08f200 con 0x558acc031400 2024-09-13T23:57:07.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.049+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031c00 2024-09-13T23:57:07.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.049+0000 7f3c53504700 1 -- 172.21.15.173:0/3173311998 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08f440 con 0x558acc031c00 2024-09-13T23:57:07.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.049+0000 7f3c53504700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031000 2024-09-13T23:57:07.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.049+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08eb40 con 0x558acc031000 2024-09-13T23:57:07.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.049+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031000 2024-09-13T23:57:07.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.049+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08eb40 con 0x558acc031000 2024-09-13T23:57:07.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.049+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031000 2024-09-13T23:57:07.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.049+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08eb40 con 0x558acc031000 2024-09-13T23:57:07.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.049+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031c00 2024-09-13T23:57:07.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.053+0000 7f3c53504700 1 -- 172.21.15.173:0/3173311998 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08f440 con 0x558acc031c00 2024-09-13T23:57:07.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.053+0000 7f3c53504700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc0f8000 2024-09-13T23:57:07.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.053+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08eb40 con 0x558acc0f8000 2024-09-13T23:57:07.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.053+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031000 2024-09-13T23:57:07.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.053+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08eb40 con 0x558acc031000 2024-09-13T23:57:07.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.053+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc0f8000 2024-09-13T23:57:07.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.053+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08eb40 con 0x558acc0f8000 2024-09-13T23:57:07.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.053+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031c00 2024-09-13T23:57:07.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.053+0000 7f3c53504700 1 -- 172.21.15.173:0/3173311998 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08f440 con 0x558acc031c00 2024-09-13T23:57:07.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.053+0000 7f3c53504700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc0f8000 2024-09-13T23:57:07.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.053+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08eb40 con 0x558acc0f8000 2024-09-13T23:57:07.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.053+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031400 2024-09-13T23:57:07.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.053+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08f200 con 0x558acc031400 2024-09-13T23:57:07.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.053+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031400 2024-09-13T23:57:07.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.057+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08f200 con 0x558acc031400 2024-09-13T23:57:07.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.057+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031c00 2024-09-13T23:57:07.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.057+0000 7f3c53504700 1 -- 172.21.15.173:0/3173311998 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08f440 con 0x558acc031c00 2024-09-13T23:57:07.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.057+0000 7f3c53504700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031400 2024-09-13T23:57:07.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.057+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x558acc08f200 con 0x558acc031400 2024-09-13T23:57:07.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.057+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc031400 2024-09-13T23:57:07.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.057+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558acc08f200 con 0x558acc031400 2024-09-13T23:57:07.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.057+0000 7f3c5554cf40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:07.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.057+0000 7f3c5554cf40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:07.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.057+0000 7f3c5554cf40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:07.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.057+0000 7f3c5554cf40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:07.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.057+0000 7f3c5554cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.057+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0f8800 con 0x558acc031000 2024-09-13T23:57:07.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.057+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x558acc08eb40 con 0x558acc031000 2024-09-13T23:57:07.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.057+0000 7f3c5554cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:07.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.057+0000 7f3c5554cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.057+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0f8c00 con 0x558acc031400 2024-09-13T23:57:07.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.057+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x558acc08f200 con 0x558acc031400 2024-09-13T23:57:07.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.057+0000 7f3c5554cf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:07.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.057+0000 7f3c5554cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.057+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0f9000 con 0x558acc031000 2024-09-13T23:57:07.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.061+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x558acc08eb40 con 0x558acc031000 2024-09-13T23:57:07.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.061+0000 7f3c5554cf40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:07.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.061+0000 7f3c5554cf40 20 zone default found 2024-09-13T23:57:07.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.061+0000 7f3c5554cf40 4 Realm: () 2024-09-13T23:57:07.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.061+0000 7f3c5554cf40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:07.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.061+0000 7f3c5554cf40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:07.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.061+0000 7f3c5554cf40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:07.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.061+0000 7f3c5554cf40 20 zonegroup default 2024-09-13T23:57:07.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.061+0000 7f3c5554cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.061+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0f9400 con 0x558acc0f8000 2024-09-13T23:57:07.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.061+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x558acc08eb40 con 0x558acc0f8000 2024-09-13T23:57:07.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.061+0000 7f3c5554cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:07.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.061+0000 7f3c5554cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.061+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0f9800 con 0x558acc031c00 2024-09-13T23:57:07.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.061+0000 7f3c53504700 1 -- 172.21.15.173:0/3173311998 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x558acc08f440 con 0x558acc031c00 2024-09-13T23:57:07.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.061+0000 7f3c5554cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:07.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.061+0000 7f3c5554cf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.061+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0f9c00 con 0x558acc031c00 2024-09-13T23:57:07.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.061+0000 7f3c53504700 1 -- 172.21.15.173:0/3173311998 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x558acc08f440 con 0x558acc031c00 2024-09-13T23:57:07.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.061+0000 7f3c5554cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:07.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.061+0000 7f3c5554cf40 20 started sync module instance, tier type = 2024-09-13T23:57:07.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.061+0000 7f3c5554cf40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:07.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.061+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fa000 con 0x558acc031400 2024-09-13T23:57:07.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.065+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558acc08f200 con 0x558acc031400 2024-09-13T23:57:07.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.065+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94054615825152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fa400 con 0x558acc031400 2024-09-13T23:57:07.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.065+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fa800 con 0x558acc031000 2024-09-13T23:57:07.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.069+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94054615825152] v33'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558acc08f200 con 0x558acc031400 2024-09-13T23:57:07.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.069+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558acc08eb40 con 0x558acc031000 2024-09-13T23:57:07.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.069+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94054615826304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fac00 con 0x558acc031000 2024-09-13T23:57:07.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.069+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb000 con 0x558acc031400 2024-09-13T23:57:07.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.073+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558acc08f200 con 0x558acc031400 2024-09-13T23:57:07.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.073+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94054615826304] v33'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558acc08eb40 con 0x558acc031000 2024-09-13T23:57:07.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.073+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94054615827456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc031400 2024-09-13T23:57:07.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.073+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb800 con 0x558acc0f8000 2024-09-13T23:57:07.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.073+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94054615827456] v33'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558acc08f200 con 0x558acc031400 2024-09-13T23:57:07.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.073+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558acc08eb40 con 0x558acc0f8000 2024-09-13T23:57:07.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.073+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94054615828608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fbc00 con 0x558acc0f8000 2024-09-13T23:57:07.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.073+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fa800 con 0x558acc031400 2024-09-13T23:57:07.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.077+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94054615828608] v33'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558acc08eb40 con 0x558acc0f8000 2024-09-13T23:57:07.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.077+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558acc08f200 con 0x558acc031400 2024-09-13T23:57:07.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.077+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94054615829760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fa000 con 0x558acc031400 2024-09-13T23:57:07.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.077+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0f8800 con 0x558acc031c00 2024-09-13T23:57:07.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.081+0000 7f3c53504700 1 -- 172.21.15.173:0/3173311998 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558acc08f440 con 0x558acc031c00 2024-09-13T23:57:07.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.081+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94054615830912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0f9000 con 0x558acc031c00 2024-09-13T23:57:07.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.081+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0f9400 con 0x558acc031c00 2024-09-13T23:57:07.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.081+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94054615829760] v33'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558acc08f200 con 0x558acc031400 2024-09-13T23:57:07.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.081+0000 7f3c53504700 1 -- 172.21.15.173:0/3173311998 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v33'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558acc08f440 con 0x558acc031c00 2024-09-13T23:57:07.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.081+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94054615832064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0f8c00 con 0x558acc031c00 2024-09-13T23:57:07.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.081+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc031800 con 0x558acc0f8000 2024-09-13T23:57:07.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.081+0000 7f3c53504700 1 -- 172.21.15.173:0/3173311998 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94054615830912] v33'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558acc08f440 con 0x558acc031c00 2024-09-13T23:57:07.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.085+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558acc08eb40 con 0x558acc0f8000 2024-09-13T23:57:07.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.085+0000 7f3c53504700 1 -- 172.21.15.173:0/3173311998 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94054615832064] v33'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558acc08f440 con 0x558acc031c00 2024-09-13T23:57:07.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.085+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94054615833216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fa400 con 0x558acc0f8000 2024-09-13T23:57:07.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.085+0000 7f3c5554cf40 20 add_watcher() i=0 2024-09-13T23:57:07.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.085+0000 7f3c5554cf40 20 add_watcher() i=1 2024-09-13T23:57:07.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.085+0000 7f3c5554cf40 20 add_watcher() i=2 2024-09-13T23:57:07.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.085+0000 7f3c5554cf40 20 add_watcher() i=3 2024-09-13T23:57:07.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.085+0000 7f3c5554cf40 20 add_watcher() i=4 2024-09-13T23:57:07.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.085+0000 7f3c5554cf40 20 add_watcher() i=5 2024-09-13T23:57:07.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.085+0000 7f3c5554cf40 20 add_watcher() i=6 2024-09-13T23:57:07.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.085+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94054615833216] v33'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558acc08eb40 con 0x558acc0f8000 2024-09-13T23:57:07.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.085+0000 7f3c5554cf40 20 add_watcher() i=7 2024-09-13T23:57:07.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.085+0000 7f3c5554cf40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:07.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.085+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb000 con 0x558acc031000 2024-09-13T23:57:07.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.089+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x558acc08eb40 con 0x558acc031000 2024-09-13T23:57:07.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.089+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94054617448448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc031000 2024-09-13T23:57:07.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.089+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94054617448448] v33'146 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x558acc08eb40 con 0x558acc031000 2024-09-13T23:57:07.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.089+0000 7f3c3acd3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:07.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.089+0000 7f3c5554cf40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:07.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.089+0000 7f3c5554cf40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:07.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.089+0000 7f3c5554cf40 1 Processor -- start 2024-09-13T23:57:07.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.089+0000 7f3c5554cf40 1 -- start start 2024-09-13T23:57:07.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.089+0000 7f3c5554cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acc0f8400 0x558acbf7f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.089+0000 7f3c5554cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558acbcbc780 con 0x558acc0f8400 2024-09-13T23:57:07.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.093+0000 7f3c53504700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acc0f8400 0x558acbf7f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.093+0000 7f3c53504700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acc0f8400 0x558acbf7f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50864/0 (socket says 172.21.15.173:50864) 2024-09-13T23:57:07.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.093+0000 7f3c53504700 1 -- 172.21.15.173:0/2925938083 learned_addr learned my addr 172.21.15.173:0/2925938083 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:07.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.093+0000 7f3c53504700 1 -- 172.21.15.173:0/2925938083 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558acbca8b60 con 0x558acc0f8400 2024-09-13T23:57:07.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.093+0000 7f3c53504700 1 --2- 172.21.15.173:0/2925938083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acc0f8400 0x558acbf7f180 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x558acc10a090 tx=0x558acbff18c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213e32f4700e3bed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.093+0000 7f3c3a4d2700 1 -- 172.21.15.173:0/2925938083 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558acc112000 con 0x558acc0f8400 2024-09-13T23:57:07.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.093+0000 7f3c3a4d2700 1 -- 172.21.15.173:0/2925938083 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558acc034600 con 0x558acc0f8400 2024-09-13T23:57:07.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.093+0000 7f3c3a4d2700 1 -- 172.21.15.173:0/2925938083 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558acc112160 con 0x558acc0f8400 2024-09-13T23:57:07.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.093+0000 7f3c5554cf40 1 -- 172.21.15.173:0/2925938083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acc0f8400 msgr2=0x558acbf7f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.093+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/2925938083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acc0f8400 0x558acbf7f180 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x558acc10a090 tx=0x558acbff18c0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.093+0000 7f3c5554cf40 1 -- 172.21.15.173:0/2925938083 shutdown_connections 2024-09-13T23:57:07.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.093+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/2925938083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acc0f8400 0x558acbf7f180 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.093+0000 7f3c5554cf40 1 -- 172.21.15.173:0/2925938083 >> 172.21.15.173:0/2925938083 conn(0x558acc0fa800 msgr2=0x558acbd98000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:07.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.093+0000 7f3c5554cf40 1 -- 172.21.15.173:0/2925938083 shutdown_connections 2024-09-13T23:57:07.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.093+0000 7f3c5554cf40 1 -- 172.21.15.173:0/2925938083 wait complete. 2024-09-13T23:57:07.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.093+0000 7f3c5554cf40 1 Processor -- start 2024-09-13T23:57:07.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.093+0000 7f3c5554cf40 1 -- start start 2024-09-13T23:57:07.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.093+0000 7f3c5554cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acc0f8400 0x558acbf7f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.093+0000 7f3c5554cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558acbd24000 con 0x558acc0f8400 2024-09-13T23:57:07.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.093+0000 7f3c53504700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acc0f8400 0x558acbf7f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.093+0000 7f3c53504700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acc0f8400 0x558acbf7f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50874/0 (socket says 172.21.15.173:50874) 2024-09-13T23:57:07.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.093+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 learned_addr learned my addr 172.21.15.173:0/1371588408 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:07.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.097+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558acbca8d00 con 0x558acc0f8400 2024-09-13T23:57:07.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.097+0000 7f3c53504700 1 --2- 172.21.15.173:0/1371588408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acc0f8400 0x558acbf7f180 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x558acc10a2a0 tx=0x558acbff1a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.097+0000 7f3c38ccf700 1 -- 172.21.15.173:0/1371588408 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558acc1122c0 con 0x558acc0f8400 2024-09-13T23:57:07.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.097+0000 7f3c38ccf700 1 -- 172.21.15.173:0/1371588408 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558acc034300 con 0x558acc0f8400 2024-09-13T23:57:07.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.097+0000 7f3c5554cf40 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558acbca8340 con 0x558acc0f8400 2024-09-13T23:57:07.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.097+0000 7f3c38ccf700 1 -- 172.21.15.173:0/1371588408 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558acc112000 con 0x558acc0f8400 2024-09-13T23:57:07.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.097+0000 7f3c5554cf40 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558acbca8b60 con 0x558acc0f8400 2024-09-13T23:57:07.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.097+0000 7f3c38ccf700 1 -- 172.21.15.173:0/1371588408 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x558acbd91b80 con 0x558acc0f8400 2024-09-13T23:57:07.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.097+0000 7f3c38ccf700 1 --2- 172.21.15.173:0/1371588408 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558acc031800 0x558acc192000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.097+0000 7f3c38ccf700 1 -- 172.21.15.173:0/1371588408 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x558acbcfd500 con 0x558acc0f8400 2024-09-13T23:57:07.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.097+0000 7f3c5554cf40 5 note: GC not initialized 2024-09-13T23:57:07.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.097+0000 7f3c54506700 1 --2- 172.21.15.173:0/1371588408 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558acc031800 0x558acc192000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.097+0000 7f3c54506700 1 --2- 172.21.15.173:0/1371588408 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558acc031800 0x558acc192000 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x558acc0a2e10 tx=0x558acc158660 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.101+0000 7f3c5554cf40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:07.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.101+0000 7f3c5554cf40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:07.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.101+0000 7f3c344c6700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:37 2024 2024-09-13T23:57:07.107 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:07.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.101+0000 7f3c33ca4700 20 reqs_thread_entry: start 2024-09-13T23:57:07.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.101+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/1371588408 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x558acc0f8800 0x558acbf7f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.101+0000 7f3c5554cf40 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 6.0 6:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fac00 con 0x558acc0f8800 2024-09-13T23:57:07.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.101+0000 7f3c364ca700 20 reqs_thread_entry: start 2024-09-13T23:57:07.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.101+0000 7f3c53d05700 1 --2- 172.21.15.173:0/1371588408 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x558acc0f8800 0x558acbf7f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.101+0000 7f3c53d05700 1 --2- 172.21.15.173:0/1371588408 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x558acc0f8800 0x558acbf7f700 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.101+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 [pgnls start_epoch 33 out=254b] v33'34 uv18 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x558acc08f200 con 0x558acc0f8800 2024-09-13T23:57:07.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.101+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 6.10 6:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fac00 con 0x558acc0f8800 2024-09-13T23:57:07.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.101+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 [pgnls start_epoch 33 out=131b] v33'4 uv4 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x558acc08f200 con 0x558acc0f8800 2024-09-13T23:57:07.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.101+0000 7f3c53d05700 1 --2- 172.21.15.173:0/1371588408 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558acc0fac00 0x558acc192580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.101+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:3 6.8 6:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fa000 con 0x558acc0fac00 2024-09-13T23:57:07.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.105+0000 7f3c53504700 1 --2- 172.21.15.173:0/1371588408 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558acc0fac00 0x558acc192580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.105+0000 7f3c53504700 1 --2- 172.21.15.173:0/1371588408 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558acc0fac00 0x558acc192580 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.105+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(3 [pgnls start_epoch 33 out=295b] v33'24 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x558acc08f440 con 0x558acc0fac00 2024-09-13T23:57:07.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.105+0000 7f3c53504700 1 --2- 172.21.15.173:0/1371588408 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x558acc0fa000 0x558acc193080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.105+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:4 6.18 6:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0f9400 con 0x558acc0fa000 2024-09-13T23:57:07.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.105+0000 7f3c54506700 1 --2- 172.21.15.173:0/1371588408 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x558acc0fa000 0x558acc193080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.105+0000 7f3c54506700 1 --2- 172.21.15.173:0/1371588408 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x558acc0fa000 0x558acc193080 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.105+0000 7f3c54506700 1 -- 172.21.15.173:0/1371588408 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(4 [pgnls start_epoch 33 out=172b] v33'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x558acc08eb40 con 0x558acc0fa000 2024-09-13T23:57:07.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.105+0000 7f3c54506700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:5 6.4 6:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0f9400 con 0x558acc0f8800 2024-09-13T23:57:07.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.105+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(5 [pgnls start_epoch 33 out=335b] v33'146 uv23 ondisk = 1) v8 ==== 144+0+335 (crc 0 0 0) 0x558acc08f200 con 0x558acc0f8800 2024-09-13T23:57:07.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.105+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:6 6.14 6:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0f9400 con 0x558acc0fa000 2024-09-13T23:57:07.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.109+0000 7f3c54506700 1 -- 172.21.15.173:0/1371588408 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=213b] v33'10 uv10 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x558acc08eb40 con 0x558acc0fa000 2024-09-13T23:57:07.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.109+0000 7f3c54506700 1 --2- 172.21.15.173:0/1371588408 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558acc0f9400 0x558acc193600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.109+0000 7f3c54506700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:7 6.c 6:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0f9400 2024-09-13T23:57:07.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.109+0000 7f3c53d05700 1 --2- 172.21.15.173:0/1371588408 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558acc0f9400 0x558acc193600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.109+0000 7f3c53d05700 1 --2- 172.21.15.173:0/1371588408 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558acc0f9400 0x558acc193600 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.109+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=254b] v33'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x558acc08f200 con 0x558acc0f9400 2024-09-13T23:57:07.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.109+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:8 6.1c 6:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0fac00 2024-09-13T23:57:07.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.109+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(8 [pgnls start_epoch 33 out=295b] v33'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x558acc08f440 con 0x558acc0fac00 2024-09-13T23:57:07.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.109+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:9 6.2 6:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0f9400 2024-09-13T23:57:07.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.109+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(9 [pgnls start_epoch 33 out=213b] v33'10 uv10 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x558acc08f200 con 0x558acc0f9400 2024-09-13T23:57:07.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.109+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:10 6.12 6:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0fac00 2024-09-13T23:57:07.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.109+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(10 [pgnls start_epoch 33 out=172b] v33'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x558acc08f440 con 0x558acc0fac00 2024-09-13T23:57:07.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.109+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:11 6.a 6:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0fac00 2024-09-13T23:57:07.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.113+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(11 [pgnls start_epoch 33 out=336b] v33'27 uv19 ondisk = 1) v8 ==== 144+0+336 (crc 0 0 0) 0x558acc08f440 con 0x558acc0fac00 2024-09-13T23:57:07.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.113+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:12 6.1a 6:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0fac00 2024-09-13T23:57:07.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.113+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(12 [pgnls start_epoch 33 out=131b] v33'20 uv16 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x558acc08f440 con 0x558acc0fac00 2024-09-13T23:57:07.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.113+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:13 6.6 6:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0f9400 2024-09-13T23:57:07.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.113+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=254b] v33'13 uv12 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x558acc08f200 con 0x558acc0f9400 2024-09-13T23:57:07.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.113+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:14 6.16 6:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0f9400 2024-09-13T23:57:07.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.113+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=90b] v33'20 uv16 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x558acc08f200 con 0x558acc0f9400 2024-09-13T23:57:07.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.113+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:15 6.e 6:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0fac00 2024-09-13T23:57:07.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.113+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(15 [pgnls start_epoch 33 out=213b] v33'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x558acc08f440 con 0x558acc0fac00 2024-09-13T23:57:07.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.113+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:16 6.1e 6:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0f9400 2024-09-13T23:57:07.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.117+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(16 [pgnls start_epoch 33 out=254b] v33'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x558acc08f200 con 0x558acc0f9400 2024-09-13T23:57:07.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.117+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 6.1 6:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0f8800 2024-09-13T23:57:07.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.117+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(17 [pgnls start_epoch 33 out=254b] v33'14 uv14 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x558acc08f200 con 0x558acc0f8800 2024-09-13T23:57:07.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.117+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:18 6.11 6:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0f9400 2024-09-13T23:57:07.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.117+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(18 [pgnls start_epoch 33 out=213b] v33'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x558acc08f200 con 0x558acc0f9400 2024-09-13T23:57:07.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.117+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:19 6.9 6:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0f9400 2024-09-13T23:57:07.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.117+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(19 [pgnls start_epoch 33 out=172b] v33'28 uv12 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x558acc08f200 con 0x558acc0f9400 2024-09-13T23:57:07.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.117+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:20 6.19 6:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0fac00 2024-09-13T23:57:07.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.117+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(20 [pgnls start_epoch 33 out=295b] v33'26 uv22 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x558acc08f440 con 0x558acc0fac00 2024-09-13T23:57:07.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.117+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:21 6.5 6:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0fac00 2024-09-13T23:57:07.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.121+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(21 [pgnls start_epoch 33 out=276b] v33'13 uv13 ondisk = 1) v8 ==== 144+0+276 (crc 0 0 0) 0x558acc08f440 con 0x558acc0fac00 2024-09-13T23:57:07.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.121+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 6.15 6:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0fac00 2024-09-13T23:57:07.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.121+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(22 [pgnls start_epoch 33 out=172b] v33'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x558acc08f440 con 0x558acc0fac00 2024-09-13T23:57:07.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.121+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:23 6.d 6:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0fac00 2024-09-13T23:57:07.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.121+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(23 [pgnls start_epoch 33 out=295b] v33'25 uv17 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x558acc08f440 con 0x558acc0fac00 2024-09-13T23:57:07.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.121+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 6.1d 6:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0f8800 2024-09-13T23:57:07.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.121+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(24 [pgnls start_epoch 33 out=172b] v33'28 uv12 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x558acc08f200 con 0x558acc0f8800 2024-09-13T23:57:07.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.121+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:25 6.3 6:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0fac00 2024-09-13T23:57:07.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.121+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=213b] v33'43 uv19 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x558acc08f440 con 0x558acc0fac00 2024-09-13T23:57:07.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.121+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:26 6.13 6:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0f9400 2024-09-13T23:57:07.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.121+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(26 [pgnls start_epoch 33 out=172b] v33'19 uv11 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x558acc08f200 con 0x558acc0f9400 2024-09-13T23:57:07.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.121+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 6.b 6:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0f9400 2024-09-13T23:57:07.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.125+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(27 [pgnls start_epoch 33 out=172b] v33'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x558acc08f200 con 0x558acc0f9400 2024-09-13T23:57:07.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.125+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:28 6.1b 6:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0f9400 2024-09-13T23:57:07.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.125+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(28 [pgnls start_epoch 33 out=90b] v33'13 uv5 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x558acc08f200 con 0x558acc0f9400 2024-09-13T23:57:07.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.125+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:29 6.7 6:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0fac00 2024-09-13T23:57:07.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.125+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=90b] v33'37 uv13 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x558acc08f440 con 0x558acc0fac00 2024-09-13T23:57:07.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.125+0000 7f3c53504700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:30 6.17 6:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0f8800 2024-09-13T23:57:07.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.125+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=131b] v33'7 uv6 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x558acc08f200 con 0x558acc0f8800 2024-09-13T23:57:07.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.125+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:31 6.f 6:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0fa000 2024-09-13T23:57:07.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.125+0000 7f3c54506700 1 -- 172.21.15.173:0/1371588408 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(31 [pgnls start_epoch 33 out=295b] v33'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x558acc08eb40 con 0x558acc0fa000 2024-09-13T23:57:07.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.125+0000 7f3c54506700 1 -- 172.21.15.173:0/1371588408 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:32 6.1f 6:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb400 con 0x558acc0f9400 2024-09-13T23:57:07.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.129+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(32 [pgnls start_epoch 33 out=213b] v33'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x558acc08f200 con 0x558acc0f9400 2024-09-13T23:57:07.134 INFO:teuthology.orchestra.run.smithi173.stdout:[ 2024-09-13T23:57:07.135 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000078", 2024-09-13T23:57:07.135 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000070", 2024-09-13T23:57:07.135 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000104", 2024-09-13T23:57:07.135 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000026", 2024-09-13T23:57:07.135 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000028", 2024-09-13T23:57:07.135 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000040", 2024-09-13T23:57:07.135 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000015", 2024-09-13T23:57:07.136 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000069", 2024-09-13T23:57:07.136 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000095", 2024-09-13T23:57:07.136 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000003", 2024-09-13T23:57:07.136 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000047", 2024-09-13T23:57:07.136 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000035", 2024-09-13T23:57:07.136 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000037", 2024-09-13T23:57:07.136 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000024", 2024-09-13T23:57:07.137 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000000", 2024-09-13T23:57:07.137 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000031", 2024-09-13T23:57:07.137 INFO:teuthology.orchestra.run.smithi173.stdout: "data_loggenerations_metadata", 2024-09-13T23:57:07.137 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000076", 2024-09-13T23:57:07.137 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000113", 2024-09-13T23:57:07.137 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000005", 2024-09-13T23:57:07.137 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000011", 2024-09-13T23:57:07.138 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000058", 2024-09-13T23:57:07.138 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000052", 2024-09-13T23:57:07.138 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000088", 2024-09-13T23:57:07.138 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000080", 2024-09-13T23:57:07.138 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000090", 2024-09-13T23:57:07.138 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000110", 2024-09-13T23:57:07.138 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000096", 2024-09-13T23:57:07.139 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000087", 2024-09-13T23:57:07.139 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000008", 2024-09-13T23:57:07.139 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000006", 2024-09-13T23:57:07.139 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000029", 2024-09-13T23:57:07.139 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000089", 2024-09-13T23:57:07.139 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000022", 2024-09-13T23:57:07.139 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000016", 2024-09-13T23:57:07.139 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000041", 2024-09-13T23:57:07.140 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000018", 2024-09-13T23:57:07.140 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000092", 2024-09-13T23:57:07.140 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000014", 2024-09-13T23:57:07.140 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000112", 2024-09-13T23:57:07.140 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000007", 2024-09-13T23:57:07.140 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000021", 2024-09-13T23:57:07.140 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000064", 2024-09-13T23:57:07.141 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000071", 2024-09-13T23:57:07.141 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000074", 2024-09-13T23:57:07.141 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000081", 2024-09-13T23:57:07.141 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000009", 2024-09-13T23:57:07.141 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000121", 2024-09-13T23:57:07.141 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000125", 2024-09-13T23:57:07.141 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000082", 2024-09-13T23:57:07.141 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000105", 2024-09-13T23:57:07.142 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000059", 2024-09-13T23:57:07.142 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000077", 2024-09-13T23:57:07.142 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000032", 2024-09-13T23:57:07.142 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000053", 2024-09-13T23:57:07.142 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000091", 2024-09-13T23:57:07.142 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000065", 2024-09-13T23:57:07.142 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000083", 2024-09-13T23:57:07.143 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000010", 2024-09-13T23:57:07.143 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000045", 2024-09-13T23:57:07.143 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000002", 2024-09-13T23:57:07.143 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000116", 2024-09-13T23:57:07.143 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000034", 2024-09-13T23:57:07.143 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000101", 2024-09-13T23:57:07.143 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000079", 2024-09-13T23:57:07.143 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000049", 2024-09-13T23:57:07.144 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000117", 2024-09-13T23:57:07.144 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000044", 2024-09-13T23:57:07.144 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000066", 2024-09-13T23:57:07.144 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000068", 2024-09-13T23:57:07.144 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000085", 2024-09-13T23:57:07.144 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000073", 2024-09-13T23:57:07.144 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000038", 2024-09-13T23:57:07.144 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000118", 2024-09-13T23:57:07.145 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000036", 2024-09-13T23:57:07.145 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000103", 2024-09-13T23:57:07.145 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000119", 2024-09-13T23:57:07.145 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000098", 2024-09-13T23:57:07.145 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000027", 2024-09-13T23:57:07.145 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000019", 2024-09-13T23:57:07.145 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000039", 2024-09-13T23:57:07.146 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000100", 2024-09-13T23:57:07.146 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000093", 2024-09-13T23:57:07.146 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000004", 2024-09-13T23:57:07.146 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000063", 2024-09-13T23:57:07.146 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000122", 2024-09-13T23:57:07.146 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000057", 2024-09-13T23:57:07.146 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000054", 2024-09-13T23:57:07.146 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000114", 2024-09-13T23:57:07.147 INFO:teuthology.orchestra.run.smithi173.stdout: "data_log.0", 2024-09-13T23:57:07.147 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000012", 2024-09-13T23:57:07.147 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000084", 2024-09-13T23:57:07.147 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000043", 2024-09-13T23:57:07.147 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000111", 2024-09-13T23:57:07.147 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000048", 2024-09-13T23:57:07.147 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000020", 2024-09-13T23:57:07.147 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000099", 2024-09-13T23:57:07.148 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000056", 2024-09-13T23:57:07.148 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000072", 2024-09-13T23:57:07.148 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000062", 2024-09-13T23:57:07.148 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000115", 2024-09-13T23:57:07.148 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000033", 2024-09-13T23:57:07.148 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000025", 2024-09-13T23:57:07.148 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000123", 2024-09-13T23:57:07.149 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000108", 2024-09-13T23:57:07.149 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000094", 2024-09-13T23:57:07.149 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000060", 2024-09-13T23:57:07.149 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000109", 2024-09-13T23:57:07.149 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000013", 2024-09-13T23:57:07.149 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000051", 2024-09-13T23:57:07.149 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000106", 2024-09-13T23:57:07.150 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000017", 2024-09-13T23:57:07.150 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000023", 2024-09-13T23:57:07.150 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000107", 2024-09-13T23:57:07.150 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000046", 2024-09-13T23:57:07.150 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000067", 2024-09-13T23:57:07.150 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000086", 2024-09-13T23:57:07.150 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000050", 2024-09-13T23:57:07.150 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000102", 2024-09-13T23:57:07.151 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000124", 2024-09-13T23:57:07.151 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000001", 2024-09-13T23:57:07.151 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000126", 2024-09-13T23:57:07.151 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000055", 2024-09-13T23:57:07.151 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000061", 2024-09-13T23:57:07.151 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000097", 2024-09-13T23:57:07.151 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000042", 2024-09-13T23:57:07.152 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000075", 2024-09-13T23:57:07.152 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000120", 2024-09-13T23:57:07.152 INFO:teuthology.orchestra.run.smithi173.stdout: "obj_delete_at_hint.0000000030" 2024-09-13T23:57:07.152 INFO:teuthology.orchestra.run.smithi173.stdout:] 2024-09-13T23:57:07.152 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:57:07.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.129+0000 7f3c3acd3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:07.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.129+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94054617448448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fb800 con 0x558acc031000 2024-09-13T23:57:07.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.133+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 data_loggenerations_metadata [watch unwatch cookie 94054617448448] v33'147 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x558acc08eb40 con 0x558acc031000 2024-09-13T23:57:07.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.133+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:63 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94054615825152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fbc00 con 0x558acc031400 2024-09-13T23:57:07.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.137+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(63 notify.0 [watch unwatch cookie 94054615825152] v33'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558acc08f200 con 0x558acc031400 2024-09-13T23:57:07.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.137+0000 7f3c5554cf40 20 remove_watcher() i=0 2024-09-13T23:57:07.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.137+0000 7f3c5554cf40 2 removed watcher, disabling cache 2024-09-13T23:57:07.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.137+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94054615826304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc0fa400 con 0x558acc031000 2024-09-13T23:57:07.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.137+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(64 notify.1 [watch unwatch cookie 94054615826304] v33'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558acc08eb40 con 0x558acc031000 2024-09-13T23:57:07.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.137+0000 7f3c5554cf40 20 remove_watcher() i=1 2024-09-13T23:57:07.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.137+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94054615827456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc054000 con 0x558acc031400 2024-09-13T23:57:07.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.141+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(65 notify.2 [watch unwatch cookie 94054615827456] v33'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558acc08f200 con 0x558acc031400 2024-09-13T23:57:07.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.141+0000 7f3c5554cf40 20 remove_watcher() i=2 2024-09-13T23:57:07.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.141+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94054615828608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc054400 con 0x558acc0f8000 2024-09-13T23:57:07.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.145+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(66 notify.3 [watch unwatch cookie 94054615828608] v33'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558acc08eb40 con 0x558acc0f8000 2024-09-13T23:57:07.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.145+0000 7f3c5554cf40 20 remove_watcher() i=3 2024-09-13T23:57:07.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.145+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94054615829760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc054800 con 0x558acc031400 2024-09-13T23:57:07.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.145+0000 7f3c53d05700 1 -- 172.21.15.173:0/3173311998 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(67 notify.4 [watch unwatch cookie 94054615829760] v33'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558acc08f200 con 0x558acc031400 2024-09-13T23:57:07.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.145+0000 7f3c5554cf40 20 remove_watcher() i=4 2024-09-13T23:57:07.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.145+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94054615830912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc054c00 con 0x558acc031c00 2024-09-13T23:57:07.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.149+0000 7f3c53504700 1 -- 172.21.15.173:0/3173311998 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(68 notify.5 [watch unwatch cookie 94054615830912] v33'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558acc08f440 con 0x558acc031c00 2024-09-13T23:57:07.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.149+0000 7f3c5554cf40 20 remove_watcher() i=5 2024-09-13T23:57:07.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.149+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94054615832064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc055000 con 0x558acc031c00 2024-09-13T23:57:07.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.149+0000 7f3c53504700 1 -- 172.21.15.173:0/3173311998 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(69 notify.6 [watch unwatch cookie 94054615832064] v33'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558acc08f440 con 0x558acc031c00 2024-09-13T23:57:07.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.153+0000 7f3c5554cf40 20 remove_watcher() i=6 2024-09-13T23:57:07.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.153+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:70 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94054615833216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558acc055400 con 0x558acc0f8000 2024-09-13T23:57:07.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.153+0000 7f3c54506700 1 -- 172.21.15.173:0/3173311998 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(70 notify.7 [watch unwatch cookie 94054615833216] v33'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x558acc08eb40 con 0x558acc0f8000 2024-09-13T23:57:07.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.153+0000 7f3c5554cf40 20 remove_watcher() i=7 2024-09-13T23:57:07.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.153+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558acc031400 msgr2=0x558acbf7e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.153+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/3173311998 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558acc031400 0x558acbf7e100 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.153+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x558acc031000 msgr2=0x558acbf7db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.153+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/3173311998 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x558acc031000 0x558acbf7db80 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.153+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x558acc0f8000 msgr2=0x558acbf7ec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.153+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/3173311998 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x558acc0f8000 0x558acbf7ec00 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.153+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558acc031c00 msgr2=0x558acbf7e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.153+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/3173311998 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558acc031c00 0x558acbf7e680 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.153+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558acc030c00 msgr2=0x558acbf7d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.153+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/3173311998 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558acc030c00 0x558acbf7d600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x558acc00faa0 tx=0x558acbff1920 comp rx=0 tx=0).stop 2024-09-13T23:57:07.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.153+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97800 msgr2=0x558acbf7cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.153+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/3173311998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97800 0x558acbf7cb00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x558acbfbe0f0 tx=0x558acbff0660 comp rx=0 tx=0).stop 2024-09-13T23:57:07.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.153+0000 7f3c53504700 1 -- 172.21.15.173:0/3173311998 reap_dead start 2024-09-13T23:57:07.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.153+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 shutdown_connections 2024-09-13T23:57:07.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.153+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/3173311998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97800 0x558acbf7cb00 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.153+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 >> 172.21.15.173:0/3173311998 conn(0x558acbc97400 msgr2=0x558acbd97800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:07.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.153+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 shutdown_connections 2024-09-13T23:57:07.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.153+0000 7f3c5554cf40 1 -- 172.21.15.173:0/3173311998 wait complete. 2024-09-13T23:57:07.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 -- 172.21.15.173:0/1371588408 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558acc0fac00 msgr2=0x558acc192580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/1371588408 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558acc0fac00 0x558acc192580 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 -- 172.21.15.173:0/1371588408 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x558acc0f8800 msgr2=0x558acbf7f700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/1371588408 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x558acc0f8800 0x558acbf7f700 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 -- 172.21.15.173:0/1371588408 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x558acc0fa000 msgr2=0x558acc193080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/1371588408 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x558acc0fa000 0x558acc193080 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 -- 172.21.15.173:0/1371588408 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558acc0f9400 msgr2=0x558acc193600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/1371588408 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558acc0f9400 0x558acc193600 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 -- 172.21.15.173:0/1371588408 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558acc031800 msgr2=0x558acc192000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/1371588408 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558acc031800 0x558acc192000 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x558acc0a2e10 tx=0x558acc158660 comp rx=0 tx=0).stop 2024-09-13T23:57:07.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 -- 172.21.15.173:0/1371588408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acc0f8400 msgr2=0x558acbf7f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/1371588408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acc0f8400 0x558acbf7f180 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x558acc10a2a0 tx=0x558acbff1a40 comp rx=0 tx=0).stop 2024-09-13T23:57:07.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c53d05700 1 -- 172.21.15.173:0/1371588408 reap_dead start 2024-09-13T23:57:07.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 -- 172.21.15.173:0/1371588408 shutdown_connections 2024-09-13T23:57:07.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 -- 172.21.15.173:0/1371588408 >> 172.21.15.173:0/1371588408 conn(0x558acc0fa800 msgr2=0x558acbd98000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:07.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 -- 172.21.15.173:0/1371588408 shutdown_connections 2024-09-13T23:57:07.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 -- 172.21.15.173:0/1371588408 wait complete. 2024-09-13T23:57:07.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 -- 172.21.15.173:0/2660856755 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558acc030000 msgr2=0x558acbf7d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/2660856755 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558acc030000 0x558acbf7d080 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x558acbfbf4d0 tx=0x558acbff08a0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 -- 172.21.15.173:0/2660856755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97000 msgr2=0x558acbf7c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/2660856755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97000 0x558acbf7c580 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x558acbdf3f50 tx=0x558acbd9b920 comp rx=0 tx=0).stop 2024-09-13T23:57:07.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 -- 172.21.15.173:0/2660856755 shutdown_connections 2024-09-13T23:57:07.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/2660856755 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558acc030000 0x558acbf7d080 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 --2- 172.21.15.173:0/2660856755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558acbc97000 0x558acbf7c580 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 -- 172.21.15.173:0/2660856755 >> 172.21.15.173:0/2660856755 conn(0x558acbc96c00 msgr2=0x558acbd97000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:07.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 -- 172.21.15.173:0/2660856755 shutdown_connections 2024-09-13T23:57:07.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.157+0000 7f3c5554cf40 1 -- 172.21.15.173:0/2660856755 wait complete. 2024-09-13T23:57:07.173 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-13T23:57:07.174 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-13T23:57:07.174 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-13T23:57:07.174 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-13T23:57:07.217 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:07.217 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:07.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd723337f40 1 Processor -- start 2024-09-13T23:57:07.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd723337f40 1 -- start start 2024-09-13T23:57:07.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd723337f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x560411889000 0x560411b6e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd723337f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56041194d500 con 0x560411889400 2024-09-13T23:57:07.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd723337f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x560411916a00 con 0x560411889000 2024-09-13T23:57:07.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd721af0700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x560411889000 0x560411b6e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd7212ef700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x560411889400 0x560411988800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47574/0 (socket says 172.21.15.173:47574) 2024-09-13T23:57:07.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd7212ef700 1 -- 172.21.15.173:0/2546180848 learned_addr learned my addr 172.21.15.173:0/2546180848 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:07.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd721af0700 1 -- 172.21.15.173:0/2546180848 >> v1:172.21.15.87:6789/0 conn(0x560411889400 legacy=0x560411988800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd721af0700 1 -- 172.21.15.173:0/2546180848 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56041189bd40 con 0x560411889000 2024-09-13T23:57:07.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd721af0700 1 --2- 172.21.15.173:0/2546180848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889000 0x560411b6e580 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x560411b69a70 tx=0x56041198d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f32c87d614ca5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd720aee700 1 -- 172.21.15.173:0/2546180848 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56041192d4a0 con 0x560411889000 2024-09-13T23:57:07.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd720aee700 1 -- 172.21.15.173:0/2546180848 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56041194d800 con 0x560411889000 2024-09-13T23:57:07.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd720aee700 1 -- 172.21.15.173:0/2546180848 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56041192d600 con 0x560411889000 2024-09-13T23:57:07.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd723337f40 1 -- 172.21.15.173:0/2546180848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889000 msgr2=0x560411b6e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd723337f40 1 --2- 172.21.15.173:0/2546180848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889000 0x560411b6e580 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x560411b69a70 tx=0x56041198d920 comp rx=0 tx=0).stop 2024-09-13T23:57:07.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd723337f40 1 -- 172.21.15.173:0/2546180848 shutdown_connections 2024-09-13T23:57:07.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd723337f40 1 --2- 172.21.15.173:0/2546180848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889000 0x560411b6e580 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd723337f40 1 -- 172.21.15.173:0/2546180848 >> 172.21.15.173:0/2546180848 conn(0x560411888c00 msgr2=0x560411988000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:07.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd723337f40 1 -- 172.21.15.173:0/2546180848 shutdown_connections 2024-09-13T23:57:07.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd723337f40 1 -- 172.21.15.173:0/2546180848 wait complete. 2024-09-13T23:57:07.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd723337f40 1 Processor -- start 2024-09-13T23:57:07.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd723337f40 1 -- start start 2024-09-13T23:57:07.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd723337f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889000 0x560411b6e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.213+0000 7fd723337f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560411916500 con 0x560411889000 2024-09-13T23:57:07.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.217+0000 7fd721af0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889000 0x560411b6e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.217+0000 7fd721af0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889000 0x560411b6e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50886/0 (socket says 172.21.15.173:50886) 2024-09-13T23:57:07.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.217+0000 7fd721af0700 1 -- 172.21.15.173:0/3150296785 learned_addr learned my addr 172.21.15.173:0/3150296785 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:07.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.217+0000 7fd721af0700 1 -- 172.21.15.173:0/3150296785 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56041189bba0 con 0x560411889000 2024-09-13T23:57:07.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.217+0000 7fd721af0700 1 --2- 172.21.15.173:0/3150296785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889000 0x560411b6e580 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x5604126ed800 tx=0x56041198d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed021bfc96f5259 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.217+0000 7fd7202ed700 1 -- 172.21.15.173:0/3150296785 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56041192d760 con 0x560411889000 2024-09-13T23:57:07.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.217+0000 7fd7202ed700 1 -- 172.21.15.173:0/3150296785 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56041194db00 con 0x560411889000 2024-09-13T23:57:07.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.217+0000 7fd7202ed700 1 -- 172.21.15.173:0/3150296785 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56041192d4a0 con 0x560411889000 2024-09-13T23:57:07.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.217+0000 7fd723337f40 1 -- 172.21.15.173:0/3150296785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889000 msgr2=0x560411b6e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.217+0000 7fd723337f40 1 --2- 172.21.15.173:0/3150296785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889000 0x560411b6e580 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x5604126ed800 tx=0x56041198d800 comp rx=0 tx=0).stop 2024-09-13T23:57:07.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.217+0000 7fd723337f40 1 -- 172.21.15.173:0/3150296785 shutdown_connections 2024-09-13T23:57:07.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.217+0000 7fd723337f40 1 --2- 172.21.15.173:0/3150296785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889000 0x560411b6e580 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.217+0000 7fd723337f40 1 -- 172.21.15.173:0/3150296785 >> 172.21.15.173:0/3150296785 conn(0x560411888c00 msgr2=0x560411989000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:07.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.217+0000 7fd723337f40 1 -- 172.21.15.173:0/3150296785 shutdown_connections 2024-09-13T23:57:07.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.217+0000 7fd723337f40 1 -- 172.21.15.173:0/3150296785 wait complete. 2024-09-13T23:57:07.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.217+0000 7fd723337f40 1 Processor -- start 2024-09-13T23:57:07.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.217+0000 7fd723337f40 1 -- start start 2024-09-13T23:57:07.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.217+0000 7fd723337f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889000 0x560411b6e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.217+0000 7fd723337f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604119163c0 con 0x560411889000 2024-09-13T23:57:07.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.217+0000 7fd721af0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889000 0x560411b6e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.217+0000 7fd721af0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889000 0x560411b6e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50898/0 (socket says 172.21.15.173:50898) 2024-09-13T23:57:07.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.217+0000 7fd721af0700 1 -- 172.21.15.173:0/1945238985 learned_addr learned my addr 172.21.15.173:0/1945238985 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:07.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.221+0000 7fd721af0700 1 -- 172.21.15.173:0/1945238985 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56041189ba00 con 0x560411889000 2024-09-13T23:57:07.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.221+0000 7fd721af0700 1 --2- 172.21.15.173:0/1945238985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889000 0x560411b6e580 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x5604126ed6b0 tx=0x56041198d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.221+0000 7fd71eaea700 1 -- 172.21.15.173:0/1945238985 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56041192d600 con 0x560411889000 2024-09-13T23:57:07.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.221+0000 7fd723337f40 1 -- 172.21.15.173:0/1945238985 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56041189b860 con 0x560411889000 2024-09-13T23:57:07.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.221+0000 7fd71eaea700 1 -- 172.21.15.173:0/1945238985 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56041194dc80 con 0x560411889000 2024-09-13T23:57:07.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.221+0000 7fd71eaea700 1 -- 172.21.15.173:0/1945238985 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56041192d8c0 con 0x560411889000 2024-09-13T23:57:07.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.221+0000 7fd723337f40 1 -- 172.21.15.173:0/1945238985 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56041189b6c0 con 0x560411889000 2024-09-13T23:57:07.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.221+0000 7fd723337f40 1 Processor -- start 2024-09-13T23:57:07.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.221+0000 7fd723337f40 1 -- start start 2024-09-13T23:57:07.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.221+0000 7fd723337f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889800 0x560411b6eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.221+0000 7fd723337f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604118ae640 con 0x560411889800 2024-09-13T23:57:07.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.221+0000 7fd71eaea700 1 -- 172.21.15.173:0/1945238985 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x560411982b00 con 0x560411889000 2024-09-13T23:57:07.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.221+0000 7fd71eaea700 1 --2- 172.21.15.173:0/1945238985 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560411c1c000 0x560411b6f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.221+0000 7fd71eaea700 1 -- 172.21.15.173:0/1945238985 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5604118ef180 con 0x560411889000 2024-09-13T23:57:07.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.221+0000 7fd7222f1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889800 0x560411b6eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.221+0000 7fd7222f1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889800 0x560411b6eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50906/0 (socket says 172.21.15.173:50906) 2024-09-13T23:57:07.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.221+0000 7fd7222f1700 1 -- 172.21.15.173:0/3116452291 learned_addr learned my addr 172.21.15.173:0/3116452291 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:07.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.221+0000 7fd721af0700 1 --2- 172.21.15.173:0/1945238985 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560411c1c000 0x560411b6f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.221+0000 7fd7222f1700 1 -- 172.21.15.173:0/3116452291 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56041189a000 con 0x560411889800 2024-09-13T23:57:07.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.221+0000 7fd7222f1700 1 --2- 172.21.15.173:0/3116452291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889800 0x560411b6eb00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x560411bac420 tx=0x560411be2780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ee80e44ee78c3e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd721af0700 1 --2- 172.21.15.173:0/1945238985 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560411c1c000 0x560411b6f080 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x560411bacf90 tx=0x560411be28a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd71c2e5700 1 -- 172.21.15.173:0/3116452291 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56041192d600 con 0x560411889800 2024-09-13T23:57:07.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd71c2e5700 1 -- 172.21.15.173:0/3116452291 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560411c3e000 con 0x560411889800 2024-09-13T23:57:07.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd71c2e5700 1 -- 172.21.15.173:0/3116452291 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56041192d8c0 con 0x560411889800 2024-09-13T23:57:07.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd723337f40 1 -- 172.21.15.173:0/3116452291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889800 msgr2=0x560411b6eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd723337f40 1 --2- 172.21.15.173:0/3116452291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889800 0x560411b6eb00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x560411bac420 tx=0x560411be2780 comp rx=0 tx=0).stop 2024-09-13T23:57:07.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd723337f40 1 -- 172.21.15.173:0/3116452291 shutdown_connections 2024-09-13T23:57:07.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd723337f40 1 --2- 172.21.15.173:0/3116452291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889800 0x560411b6eb00 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd723337f40 1 -- 172.21.15.173:0/3116452291 >> 172.21.15.173:0/3116452291 conn(0x560411889400 msgr2=0x560411989800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:07.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd723337f40 1 -- 172.21.15.173:0/3116452291 shutdown_connections 2024-09-13T23:57:07.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd723337f40 1 -- 172.21.15.173:0/3116452291 wait complete. 2024-09-13T23:57:07.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd723337f40 1 Processor -- start 2024-09-13T23:57:07.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd723337f40 1 -- start start 2024-09-13T23:57:07.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd723337f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889800 0x560411b6eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd723337f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604118ae8c0 con 0x560411889800 2024-09-13T23:57:07.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd7222f1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889800 0x560411b6eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd7222f1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889800 0x560411b6eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50912/0 (socket says 172.21.15.173:50912) 2024-09-13T23:57:07.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 learned_addr learned my addr 172.21.15.173:0/2533361740 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:07.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56041189aea0 con 0x560411889800 2024-09-13T23:57:07.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd7222f1700 1 --2- 172.21.15.173:0/2533361740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889800 0x560411b6eb00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x5604126ed860 tx=0x560411be26c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd71aae2700 1 -- 172.21.15.173:0/2533361740 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56041192d760 con 0x560411889800 2024-09-13T23:57:07.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd71aae2700 1 -- 172.21.15.173:0/2533361740 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560411c3e180 con 0x560411889800 2024-09-13T23:57:07.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56041189a820 con 0x560411889800 2024-09-13T23:57:07.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd71aae2700 1 -- 172.21.15.173:0/2533361740 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56041192d600 con 0x560411889800 2024-09-13T23:57:07.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.225+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56041189a9c0 con 0x560411889800 2024-09-13T23:57:07.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.229+0000 7fd71aae2700 1 -- 172.21.15.173:0/2533361740 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x560411982dc0 con 0x560411889800 2024-09-13T23:57:07.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.229+0000 7fd723337f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.229+0000 7fd71aae2700 1 --2- 172.21.15.173:0/2533361740 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560411c1cc00 0x560411b6f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.229+0000 7fd71aae2700 1 -- 172.21.15.173:0/2533361740 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5604118ef340 con 0x560411889800 2024-09-13T23:57:07.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.229+0000 7fd7212ef700 1 --2- 172.21.15.173:0/2533361740 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560411c1cc00 0x560411b6f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.229+0000 7fd723337f40 1 --2- 172.21.15.173:0/2533361740 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560411c1d000 0x560411b6fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.229+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d400 con 0x560411c1d000 2024-09-13T23:57:07.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.229+0000 7fd7222f1700 1 --2- 172.21.15.173:0/2533361740 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560411c1d000 0x560411b6fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.229+0000 7fd7212ef700 1 --2- 172.21.15.173:0/2533361740 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560411c1cc00 0x560411b6f600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x560411c1fe60 tx=0x560411be3920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.229+0000 7fd7222f1700 1 --2- 172.21.15.173:0/2533361740 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560411c1d000 0x560411b6fb80 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.229+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x560411cdab40 con 0x560411c1d000 2024-09-13T23:57:07.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.229+0000 7fd723337f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:07.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.229+0000 7fd723337f40 20 realm 2024-09-13T23:57:07.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.229+0000 7fd723337f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.229+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1d000 2024-09-13T23:57:07.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.229+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x560411cdab40 con 0x560411c1d000 2024-09-13T23:57:07.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.229+0000 7fd723337f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:07.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.229+0000 7fd723337f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:07.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.229+0000 7fd723337f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.229+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1dc00 con 0x560411c1d000 2024-09-13T23:57:07.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.229+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x560411cdab40 con 0x560411c1d000 2024-09-13T23:57:07.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.229+0000 7fd723337f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:07.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.229+0000 7fd723337f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.229+0000 7fd723337f40 1 --2- 172.21.15.173:0/2533361740 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560411c1d400 0x560411b70100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.233+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1d400 2024-09-13T23:57:07.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.233+0000 7fd721af0700 1 --2- 172.21.15.173:0/2533361740 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560411c1d400 0x560411b70100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.233+0000 7fd721af0700 1 --2- 172.21.15.173:0/2533361740 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560411c1d400 0x560411b70100 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.233+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.233+0000 7fd723337f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:07.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.233+0000 7fd723337f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.233+0000 7fd723337f40 1 --2- 172.21.15.173:0/2533361740 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560411c1dc00 0x560411b70680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.233+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cea000 con 0x560411c1dc00 2024-09-13T23:57:07.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.233+0000 7fd7212ef700 1 --2- 172.21.15.173:0/2533361740 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560411c1dc00 0x560411b70680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.233+0000 7fd7212ef700 1 --2- 172.21.15.173:0/2533361740 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560411c1dc00 0x560411b70680 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.233+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x560411cdb440 con 0x560411c1dc00 2024-09-13T23:57:07.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.233+0000 7fd723337f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:07.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.233+0000 7fd723337f40 20 searching for the correct realm 2024-09-13T23:57:07.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.233+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cea400 con 0x560411c1dc00 2024-09-13T23:57:07.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.233+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x560411cdb440 con 0x560411c1dc00 2024-09-13T23:57:07.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.233+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cea000 con 0x560411c1d400 2024-09-13T23:57:07.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.237+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.237+0000 7fd721af0700 1 --2- 172.21.15.173:0/2533361740 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560411cea000 0x560411b70c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.237+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411cea000 2024-09-13T23:57:07.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.237+0000 7fd7222f1700 1 --2- 172.21.15.173:0/2533361740 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560411cea000 0x560411b70c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.237+0000 7fd7222f1700 1 --2- 172.21.15.173:0/2533361740 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560411cea000 0x560411b70c00 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.237+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdab40 con 0x560411cea000 2024-09-13T23:57:07.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.237+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1d000 2024-09-13T23:57:07.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.237+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x560411cdab40 con 0x560411c1d000 2024-09-13T23:57:07.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.237+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1d000 2024-09-13T23:57:07.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.237+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdab40 con 0x560411c1d000 2024-09-13T23:57:07.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.237+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1dc00 2024-09-13T23:57:07.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.237+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdb440 con 0x560411c1dc00 2024-09-13T23:57:07.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.237+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1d000 2024-09-13T23:57:07.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.237+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdab40 con 0x560411c1d000 2024-09-13T23:57:07.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.237+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1d400 2024-09-13T23:57:07.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.241+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.241+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1d400 2024-09-13T23:57:07.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.241+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.241+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1d000 2024-09-13T23:57:07.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.241+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdab40 con 0x560411c1d000 2024-09-13T23:57:07.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.241+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411cea000 2024-09-13T23:57:07.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.241+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdab40 con 0x560411cea000 2024-09-13T23:57:07.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.241+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1d000 2024-09-13T23:57:07.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.241+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdab40 con 0x560411c1d000 2024-09-13T23:57:07.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.241+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411cea000 2024-09-13T23:57:07.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.241+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdab40 con 0x560411cea000 2024-09-13T23:57:07.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.241+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1d400 2024-09-13T23:57:07.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.245+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.245+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1dc00 2024-09-13T23:57:07.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.245+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdb440 con 0x560411c1dc00 2024-09-13T23:57:07.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.245+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1d000 2024-09-13T23:57:07.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.245+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdab40 con 0x560411c1d000 2024-09-13T23:57:07.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.245+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1d400 2024-09-13T23:57:07.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.245+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.245+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1dc00 2024-09-13T23:57:07.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.245+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdb440 con 0x560411c1dc00 2024-09-13T23:57:07.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.245+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1d000 2024-09-13T23:57:07.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.245+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdab40 con 0x560411c1d000 2024-09-13T23:57:07.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.245+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1d000 2024-09-13T23:57:07.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.245+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdab40 con 0x560411c1d000 2024-09-13T23:57:07.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.245+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1d000 2024-09-13T23:57:07.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.249+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdab40 con 0x560411c1d000 2024-09-13T23:57:07.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.249+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1dc00 2024-09-13T23:57:07.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.249+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdb440 con 0x560411c1dc00 2024-09-13T23:57:07.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.249+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411cea000 2024-09-13T23:57:07.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.249+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdab40 con 0x560411cea000 2024-09-13T23:57:07.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.249+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1d000 2024-09-13T23:57:07.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.249+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdab40 con 0x560411c1d000 2024-09-13T23:57:07.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.249+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411cea000 2024-09-13T23:57:07.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.249+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdab40 con 0x560411cea000 2024-09-13T23:57:07.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.249+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1dc00 2024-09-13T23:57:07.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.249+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdb440 con 0x560411c1dc00 2024-09-13T23:57:07.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.249+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411cea000 2024-09-13T23:57:07.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.249+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdab40 con 0x560411cea000 2024-09-13T23:57:07.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.249+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1d400 2024-09-13T23:57:07.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.253+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.253+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1d400 2024-09-13T23:57:07.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.253+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.253+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1dc00 2024-09-13T23:57:07.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.253+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdb440 con 0x560411c1dc00 2024-09-13T23:57:07.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.253+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1d400 2024-09-13T23:57:07.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.253+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.253+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411c1d400 2024-09-13T23:57:07.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.253+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.253+0000 7fd723337f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:07.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.253+0000 7fd723337f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:07.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.253+0000 7fd723337f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:07.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.253+0000 7fd723337f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:07.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.253+0000 7fd723337f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.253+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cea800 con 0x560411c1d000 2024-09-13T23:57:07.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.253+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x560411cdab40 con 0x560411c1d000 2024-09-13T23:57:07.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.253+0000 7fd723337f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:07.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.253+0000 7fd723337f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.253+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411ceac00 con 0x560411c1d400 2024-09-13T23:57:07.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd723337f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:07.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd723337f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411ceb000 con 0x560411c1d000 2024-09-13T23:57:07.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x560411cdab40 con 0x560411c1d000 2024-09-13T23:57:07.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd723337f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:07.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd723337f40 20 zone default found 2024-09-13T23:57:07.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd723337f40 4 Realm: () 2024-09-13T23:57:07.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd723337f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:07.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd723337f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:07.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd723337f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:07.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd723337f40 20 zonegroup default 2024-09-13T23:57:07.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd723337f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411ceb400 con 0x560411cea000 2024-09-13T23:57:07.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x560411cdab40 con 0x560411cea000 2024-09-13T23:57:07.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd723337f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:07.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd723337f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411ceb800 con 0x560411c1dc00 2024-09-13T23:57:07.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x560411cdb440 con 0x560411c1dc00 2024-09-13T23:57:07.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd723337f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:07.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd723337f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cebc00 con 0x560411c1dc00 2024-09-13T23:57:07.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x560411cdb440 con 0x560411c1dc00 2024-09-13T23:57:07.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd723337f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:07.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd723337f40 20 started sync module instance, tier type = 2024-09-13T23:57:07.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd723337f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:07.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.257+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cf0000 con 0x560411c1d400 2024-09-13T23:57:07.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.261+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.261+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94575477021440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cf0400 con 0x560411c1d400 2024-09-13T23:57:07.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.261+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cf0800 con 0x560411c1d000 2024-09-13T23:57:07.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.265+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdab40 con 0x560411c1d000 2024-09-13T23:57:07.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.265+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94575477022592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cf0c00 con 0x560411c1d000 2024-09-13T23:57:07.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.265+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94575477021440] v33'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.265+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cf1000 con 0x560411c1d400 2024-09-13T23:57:07.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.265+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.265+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94575477022592] v33'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdab40 con 0x560411c1d000 2024-09-13T23:57:07.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.269+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94575477023744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cf1400 con 0x560411c1d400 2024-09-13T23:57:07.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.269+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cf1800 con 0x560411cea000 2024-09-13T23:57:07.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.269+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94575477023744] v33'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.269+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdab40 con 0x560411cea000 2024-09-13T23:57:07.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.269+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94575477024896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cf1c00 con 0x560411cea000 2024-09-13T23:57:07.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.269+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cf0800 con 0x560411c1d400 2024-09-13T23:57:07.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.273+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94575477024896] v33'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdab40 con 0x560411cea000 2024-09-13T23:57:07.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.273+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.273+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94575477026048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cf0000 con 0x560411c1d400 2024-09-13T23:57:07.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.273+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cea800 con 0x560411c1dc00 2024-09-13T23:57:07.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.277+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdb440 con 0x560411c1dc00 2024-09-13T23:57:07.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.277+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94575477027200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411ceb000 con 0x560411c1dc00 2024-09-13T23:57:07.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.277+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411ceb400 con 0x560411c1dc00 2024-09-13T23:57:07.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.277+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94575477026048] v33'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.277+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94575477027200] v33'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdb440 con 0x560411c1dc00 2024-09-13T23:57:07.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.277+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v33'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdb440 con 0x560411c1dc00 2024-09-13T23:57:07.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.277+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94575477028352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411ceac00 con 0x560411c1dc00 2024-09-13T23:57:07.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.277+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411c1d800 con 0x560411cea000 2024-09-13T23:57:07.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.281+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94575477028352] v33'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdb440 con 0x560411c1dc00 2024-09-13T23:57:07.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.281+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdab40 con 0x560411cea000 2024-09-13T23:57:07.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.281+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94575477029504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cf0400 con 0x560411cea000 2024-09-13T23:57:07.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.281+0000 7fd723337f40 20 add_watcher() i=0 2024-09-13T23:57:07.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.281+0000 7fd723337f40 20 add_watcher() i=1 2024-09-13T23:57:07.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.281+0000 7fd723337f40 20 add_watcher() i=2 2024-09-13T23:57:07.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.281+0000 7fd723337f40 20 add_watcher() i=3 2024-09-13T23:57:07.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.281+0000 7fd723337f40 20 add_watcher() i=4 2024-09-13T23:57:07.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.281+0000 7fd723337f40 20 add_watcher() i=5 2024-09-13T23:57:07.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.281+0000 7fd723337f40 20 add_watcher() i=6 2024-09-13T23:57:07.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.281+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94575477029504] v33'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdab40 con 0x560411cea000 2024-09-13T23:57:07.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.281+0000 7fd723337f40 20 add_watcher() i=7 2024-09-13T23:57:07.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.281+0000 7fd723337f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:07.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.281+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cf1000 con 0x560411c1d000 2024-09-13T23:57:07.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.281+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x560411cdab40 con 0x560411c1d000 2024-09-13T23:57:07.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.281+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94575478661120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cf1400 con 0x560411c1d000 2024-09-13T23:57:07.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.285+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94575478661120] v33'148 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x560411cdab40 con 0x560411c1d000 2024-09-13T23:57:07.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.285+0000 7fd708abe700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:07.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.285+0000 7fd723337f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:07.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.285+0000 7fd723337f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:07.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.285+0000 7fd723337f40 1 Processor -- start 2024-09-13T23:57:07.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.285+0000 7fd723337f40 1 -- start start 2024-09-13T23:57:07.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.285+0000 7fd723337f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411cea400 0x560411b71180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.285+0000 7fd723337f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604119163c0 con 0x560411cea400 2024-09-13T23:57:07.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.285+0000 7fd7212ef700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411cea400 0x560411b71180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.285+0000 7fd7212ef700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411cea400 0x560411b71180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50918/0 (socket says 172.21.15.173:50918) 2024-09-13T23:57:07.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.285+0000 7fd7212ef700 1 -- 172.21.15.173:0/452679863 learned_addr learned my addr 172.21.15.173:0/452679863 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:07.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.285+0000 7fd7212ef700 1 -- 172.21.15.173:0/452679863 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56041189ab60 con 0x560411cea400 2024-09-13T23:57:07.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.289+0000 7fd7212ef700 1 --2- 172.21.15.173:0/452679863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411cea400 0x560411b71180 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x560411cfe090 tx=0x560411be38c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa051907c1751e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.289+0000 7fd7082bd700 1 -- 172.21.15.173:0/452679863 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560411d06000 con 0x560411cea400 2024-09-13T23:57:07.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.289+0000 7fd7082bd700 1 -- 172.21.15.173:0/452679863 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560411c3e600 con 0x560411cea400 2024-09-13T23:57:07.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.289+0000 7fd7082bd700 1 -- 172.21.15.173:0/452679863 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560411d06160 con 0x560411cea400 2024-09-13T23:57:07.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.289+0000 7fd723337f40 1 -- 172.21.15.173:0/452679863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411cea400 msgr2=0x560411b71180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.289+0000 7fd723337f40 1 --2- 172.21.15.173:0/452679863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411cea400 0x560411b71180 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x560411cfe090 tx=0x560411be38c0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.289+0000 7fd723337f40 1 -- 172.21.15.173:0/452679863 shutdown_connections 2024-09-13T23:57:07.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.289+0000 7fd723337f40 1 --2- 172.21.15.173:0/452679863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411cea400 0x560411b71180 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.289+0000 7fd723337f40 1 -- 172.21.15.173:0/452679863 >> 172.21.15.173:0/452679863 conn(0x560411cf0800 msgr2=0x56041198a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:07.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.289+0000 7fd723337f40 1 -- 172.21.15.173:0/452679863 shutdown_connections 2024-09-13T23:57:07.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.289+0000 7fd723337f40 1 -- 172.21.15.173:0/452679863 wait complete. 2024-09-13T23:57:07.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.289+0000 7fd723337f40 1 Processor -- start 2024-09-13T23:57:07.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.289+0000 7fd723337f40 1 -- start start 2024-09-13T23:57:07.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.289+0000 7fd723337f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411cea400 0x560411b71180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.289+0000 7fd723337f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560411916500 con 0x560411cea400 2024-09-13T23:57:07.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.289+0000 7fd7212ef700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411cea400 0x560411b71180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.289+0000 7fd7212ef700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411cea400 0x560411b71180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50930/0 (socket says 172.21.15.173:50930) 2024-09-13T23:57:07.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.289+0000 7fd7212ef700 1 -- 172.21.15.173:0/428823644 learned_addr learned my addr 172.21.15.173:0/428823644 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:07.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.289+0000 7fd7212ef700 1 -- 172.21.15.173:0/428823644 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56041189ad00 con 0x560411cea400 2024-09-13T23:57:07.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.293+0000 7fd7212ef700 1 --2- 172.21.15.173:0/428823644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411cea400 0x560411b71180 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x560411cfe2a0 tx=0x560411be3a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.293+0000 7fd706aba700 1 -- 172.21.15.173:0/428823644 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560411d062c0 con 0x560411cea400 2024-09-13T23:57:07.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.293+0000 7fd706aba700 1 -- 172.21.15.173:0/428823644 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560411c3e300 con 0x560411cea400 2024-09-13T23:57:07.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.293+0000 7fd723337f40 1 -- 172.21.15.173:0/428823644 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56041189a340 con 0x560411cea400 2024-09-13T23:57:07.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.293+0000 7fd706aba700 1 -- 172.21.15.173:0/428823644 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560411d06000 con 0x560411cea400 2024-09-13T23:57:07.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.293+0000 7fd723337f40 1 -- 172.21.15.173:0/428823644 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56041189ab60 con 0x560411cea400 2024-09-13T23:57:07.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.293+0000 7fd706aba700 1 -- 172.21.15.173:0/428823644 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x560411983b80 con 0x560411cea400 2024-09-13T23:57:07.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.293+0000 7fd706aba700 1 --2- 172.21.15.173:0/428823644 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560411c1d800 0x560411d92000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.293+0000 7fd706aba700 1 -- 172.21.15.173:0/428823644 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x5604118ef500 con 0x560411cea400 2024-09-13T23:57:07.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.293+0000 7fd7222f1700 1 --2- 172.21.15.173:0/428823644 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560411c1d800 0x560411d92000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.293+0000 7fd723337f40 5 note: GC not initialized 2024-09-13T23:57:07.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.293+0000 7fd7222f1700 1 --2- 172.21.15.173:0/428823644 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560411c1d800 0x560411d92000 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x560411c1ee40 tx=0x560411d58660 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.297+0000 7fd7042b5700 20 reqs_thread_entry: start 2024-09-13T23:57:07.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.297+0000 7fd723337f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:07.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.297+0000 7fd723337f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:07.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.297+0000 7fd7022b1700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:37 2024 2024-09-13T23:57:07.303 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:07.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.297+0000 7fd701a8f700 20 reqs_thread_entry: start 2024-09-13T23:57:07.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.297+0000 7fd723337f40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:57:07.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.297+0000 7fd723337f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.297+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cea800 con 0x560411c1d000 2024-09-13T23:57:07.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.297+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x560411cdab40 con 0x560411c1d000 2024-09-13T23:57:07.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.297+0000 7fd723337f40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:57:07.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.297+0000 7fd723337f40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:57:07.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.297+0000 7fd723337f40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:07.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.297+0000 7fd723337f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:07.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.297+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cf0c00 con 0x560411cea000 2024-09-13T23:57:07.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.297+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x560411cdab40 con 0x560411cea000 2024-09-13T23:57:07.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.297+0000 7fd723337f40 20 disabling bucket name=myfoo 2024-09-13T23:57:07.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.297+0000 7fd723337f40 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:57:07.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.297+0000 7fd723337f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.297+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cf1800 con 0x560411cea000 2024-09-13T23:57:07.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.301+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x560411cdab40 con 0x560411cea000 2024-09-13T23:57:07.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.301+0000 7fd723337f40 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:57:07.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.301+0000 7fd723337f40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-13T23:57:07.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.301+0000 7fd723337f40 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:57:07.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.301+0000 7fd723337f40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 : miss 2024-09-13T23:57:07.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.301+0000 7fd723337f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.301+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 8.17 8:ea49432e:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cf1c00 con 0x560411c1d400 2024-09-13T23:57:07.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.301+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(65 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.301+0000 7fd723337f40 20 rados_obj.operate() r=0 bl.length=352 2024-09-13T23:57:07.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.301+0000 7fd723337f40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 info.flags=0x17 2024-09-13T23:57:07.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.301+0000 7fd723337f40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 to cache LRU end 2024-09-13T23:57:07.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.301+0000 7fd723337f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:07.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.301+0000 7fd723337f40 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:57:07.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.301+0000 7fd723337f40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 2024-09-13T23:57:07.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.301+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 8.17 8:ea49432e:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411e00000 con 0x560411c1d400 2024-09-13T23:57:07.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.305+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(66 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v33'6 uv6 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.305+0000 7fd723337f40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 info.flags=0x17 2024-09-13T23:57:07.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.305+0000 7fd723337f40 10 moving default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 to cache LRU end 2024-09-13T23:57:07.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.305+0000 7fd723337f40 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:57:07.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.305+0000 7fd723337f40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1, ofs0, ns] 2024-09-13T23:57:07.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.305+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94575478663424 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411e00800 con 0x560411c1d400 2024-09-13T23:57:07.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.305+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== watch-notify(notify (1) cookie 94575477023744 notify 141733920797 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x560411be0680 con 0x560411c1d400 2024-09-13T23:57:07.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.305+0000 7fd71bae4700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920797 cookie 94575477023744 notifier 4648 bl.length()=725 2024-09-13T23:57:07.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.305+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(67 notify.2 [notify cookie 94575478663424 out=8b] v0'0 uv153 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.305+0000 7fd71bae4700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 info.flags=0x17 2024-09-13T23:57:07.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.305+0000 7fd71bae4700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 to cache LRU end 2024-09-13T23:57:07.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.305+0000 7fd71bae4700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:57:07.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.305+0000 7fd71bae4700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cf0000 con 0x560411c1d400 2024-09-13T23:57:07.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.305+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.305+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== watch-notify(notify_complete (2) cookie 94575478663424 notify 141733920797 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x560411be0820 con 0x560411c1d400 2024-09-13T23:57:07.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.305+0000 7fd723337f40 20 handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1]): orig_sources= new_sources= 2024-09-13T23:57:07.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.305+0000 7fd723337f40 20 handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1]): potential sources added=[] removed=[] 2024-09-13T23:57:07.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.305+0000 7fd723337f40 20 handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1]): orig_dests= new_dests= 2024-09-13T23:57:07.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.305+0000 7fd723337f40 20 handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1]): potential dests added=[] removed=[] 2024-09-13T23:57:07.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.305+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411e01000 con 0x560411c1d000 2024-09-13T23:57:07.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.309+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~357] v33'15 uv15 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x560411cdab40 con 0x560411c1d000 2024-09-13T23:57:07.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.309+0000 7fd723337f40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:57:07.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.309+0000 7fd723337f40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:07.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.309+0000 7fd723337f40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:57:07.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.309+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94575478663424 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411e01400 con 0x560411c1d400 2024-09-13T23:57:07.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.309+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== watch-notify(notify (1) cookie 94575477026048 notify 141733920798 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x560411be0820 con 0x560411c1d400 2024-09-13T23:57:07.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.309+0000 7fd71bae4700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920798 cookie 94575477026048 notifier 4648 bl.length()=533 2024-09-13T23:57:07.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.309+0000 7fd71bae4700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:57:07.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.309+0000 7fd71bae4700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:07.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.309+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== osd_op_reply(70 notify.4 [notify cookie 94575478663424 out=8b] v0'0 uv153 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.309+0000 7fd71bae4700 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cf1c00 con 0x560411c1d400 2024-09-13T23:57:07.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.309+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.313+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 27 ==== watch-notify(notify_complete (2) cookie 94575478663424 notify 141733920798 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x560411be09c0 con 0x560411c1d400 2024-09-13T23:57:07.318 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:07.318 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "foo", 2024-09-13T23:57:07.318 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Foo", 2024-09-13T23:57:07.318 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "foo@foo.com", 2024-09-13T23:57:07.318 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 1, 2024-09-13T23:57:07.318 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:57:07.318 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [], 2024-09-13T23:57:07.318 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:57:07.318 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:07.318 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:57:07.318 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-09-13T23:57:07.319 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-09-13T23:57:07.319 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:07.319 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:07.319 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [], 2024-09-13T23:57:07.319 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:57:07.319 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:57:07.319 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:57:07.319 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:57:07.319 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:57:07.319 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:57:07.319 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:07.319 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:07.319 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:07.320 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:07.320 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:07.320 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:07.320 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:57:07.320 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:07.320 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:07.320 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:07.320 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:07.320 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:07.320 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:07.320 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:57:07.320 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:57:07.320 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:57:07.321 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:07.321 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:57:07.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.313+0000 7fd708abe700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:07.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.313+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94575478661120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411e01800 con 0x560411c1d000 2024-09-13T23:57:07.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.317+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94575478661120] v33'149 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x560411cdab40 con 0x560411c1d000 2024-09-13T23:57:07.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.317+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94575477021440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411e01c00 con 0x560411c1d400 2024-09-13T23:57:07.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.317+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 28 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94575477021440] v33'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.317+0000 7fd723337f40 20 remove_watcher() i=0 2024-09-13T23:57:07.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.317+0000 7fd723337f40 2 removed watcher, disabling cache 2024-09-13T23:57:07.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.317+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94575477022592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411e01000 con 0x560411c1d000 2024-09-13T23:57:07.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.321+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94575477022592] v33'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdab40 con 0x560411c1d000 2024-09-13T23:57:07.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.321+0000 7fd723337f40 20 remove_watcher() i=1 2024-09-13T23:57:07.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.321+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94575477023744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411e00400 con 0x560411c1d400 2024-09-13T23:57:07.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.325+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 29 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94575477023744] v33'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.325+0000 7fd723337f40 20 remove_watcher() i=2 2024-09-13T23:57:07.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.325+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94575477024896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411e00000 con 0x560411cea000 2024-09-13T23:57:07.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.325+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94575477024896] v33'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdab40 con 0x560411cea000 2024-09-13T23:57:07.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.325+0000 7fd723337f40 20 remove_watcher() i=3 2024-09-13T23:57:07.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.325+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94575477026048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cf1000 con 0x560411c1d400 2024-09-13T23:57:07.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.329+0000 7fd721af0700 1 -- 172.21.15.173:0/2533361740 <== osd.0 v2:172.21.15.87:6800/3507919120 30 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94575477026048] v33'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdb200 con 0x560411c1d400 2024-09-13T23:57:07.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.329+0000 7fd723337f40 20 remove_watcher() i=4 2024-09-13T23:57:07.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.329+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94575477027200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cf1400 con 0x560411c1dc00 2024-09-13T23:57:07.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.333+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94575477027200] v33'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdb440 con 0x560411c1dc00 2024-09-13T23:57:07.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.333+0000 7fd723337f40 20 remove_watcher() i=5 2024-09-13T23:57:07.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.333+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94575477028352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cf0c00 con 0x560411c1dc00 2024-09-13T23:57:07.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.333+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94575477028352] v33'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdb440 con 0x560411c1dc00 2024-09-13T23:57:07.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.337+0000 7fd723337f40 20 remove_watcher() i=6 2024-09-13T23:57:07.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.337+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94575477029504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560411cf1800 con 0x560411cea000 2024-09-13T23:57:07.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.337+0000 7fd7222f1700 1 -- 172.21.15.173:0/2533361740 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94575477029504] v33'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560411cdab40 con 0x560411cea000 2024-09-13T23:57:07.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.337+0000 7fd723337f40 20 remove_watcher() i=7 2024-09-13T23:57:07.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.337+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560411c1d400 msgr2=0x560411b70100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.337+0000 7fd723337f40 1 --2- 172.21.15.173:0/2533361740 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560411c1d400 0x560411b70100 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.337+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560411c1d000 msgr2=0x560411b6fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.337+0000 7fd723337f40 1 --2- 172.21.15.173:0/2533361740 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560411c1d000 0x560411b6fb80 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.337+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560411cea000 msgr2=0x560411b70c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.337+0000 7fd723337f40 1 --2- 172.21.15.173:0/2533361740 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560411cea000 0x560411b70c00 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.337+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560411c1dc00 msgr2=0x560411b70680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.337+0000 7fd723337f40 1 --2- 172.21.15.173:0/2533361740 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560411c1dc00 0x560411b70680 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.337+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560411c1cc00 msgr2=0x560411b6f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.337+0000 7fd723337f40 1 --2- 172.21.15.173:0/2533361740 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560411c1cc00 0x560411b6f600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x560411c1fe60 tx=0x560411be3920 comp rx=0 tx=0).stop 2024-09-13T23:57:07.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.337+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889800 msgr2=0x560411b6eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.337+0000 7fd723337f40 1 --2- 172.21.15.173:0/2533361740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889800 0x560411b6eb00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x5604126ed860 tx=0x560411be26c0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.337+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 reap_dead start 2024-09-13T23:57:07.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.337+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 shutdown_connections 2024-09-13T23:57:07.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.337+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 >> 172.21.15.173:0/2533361740 conn(0x560411889400 msgr2=0x560411989800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:07.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.337+0000 7fd7212ef700 1 -- 172.21.15.173:0/2533361740 reap_dead start 2024-09-13T23:57:07.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.337+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 shutdown_connections 2024-09-13T23:57:07.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.337+0000 7fd723337f40 1 -- 172.21.15.173:0/2533361740 wait complete. 2024-09-13T23:57:07.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.341+0000 7fd723337f40 1 -- 172.21.15.173:0/428823644 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560411c1d800 msgr2=0x560411d92000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.341+0000 7fd723337f40 1 --2- 172.21.15.173:0/428823644 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560411c1d800 0x560411d92000 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x560411c1ee40 tx=0x560411d58660 comp rx=0 tx=0).stop 2024-09-13T23:57:07.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.341+0000 7fd723337f40 1 -- 172.21.15.173:0/428823644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411cea400 msgr2=0x560411b71180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.341+0000 7fd723337f40 1 --2- 172.21.15.173:0/428823644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411cea400 0x560411b71180 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x560411cfe2a0 tx=0x560411be3a40 comp rx=0 tx=0).stop 2024-09-13T23:57:07.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.341+0000 7fd723337f40 1 -- 172.21.15.173:0/428823644 shutdown_connections 2024-09-13T23:57:07.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.341+0000 7fd723337f40 1 --2- 172.21.15.173:0/428823644 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560411c1d800 0x560411d92000 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.341+0000 7fd723337f40 1 --2- 172.21.15.173:0/428823644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411cea400 0x560411b71180 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.341+0000 7fd723337f40 1 -- 172.21.15.173:0/428823644 >> 172.21.15.173:0/428823644 conn(0x560411cf0800 msgr2=0x56041198a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:07.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.341+0000 7fd723337f40 1 -- 172.21.15.173:0/428823644 shutdown_connections 2024-09-13T23:57:07.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.341+0000 7fd723337f40 1 -- 172.21.15.173:0/428823644 wait complete. 2024-09-13T23:57:07.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.341+0000 7fd723337f40 1 -- 172.21.15.173:0/1945238985 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560411c1c000 msgr2=0x560411b6f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.341+0000 7fd723337f40 1 --2- 172.21.15.173:0/1945238985 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560411c1c000 0x560411b6f080 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x560411bacf90 tx=0x560411be28a0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.341+0000 7fd723337f40 1 -- 172.21.15.173:0/1945238985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889000 msgr2=0x560411b6e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.341+0000 7fd723337f40 1 --2- 172.21.15.173:0/1945238985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889000 0x560411b6e580 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x5604126ed6b0 tx=0x56041198d920 comp rx=0 tx=0).stop 2024-09-13T23:57:07.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.341+0000 7fd723337f40 1 -- 172.21.15.173:0/1945238985 shutdown_connections 2024-09-13T23:57:07.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.341+0000 7fd723337f40 1 --2- 172.21.15.173:0/1945238985 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560411c1c000 0x560411b6f080 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.341+0000 7fd723337f40 1 --2- 172.21.15.173:0/1945238985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560411889000 0x560411b6e580 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.341+0000 7fd723337f40 1 -- 172.21.15.173:0/1945238985 >> 172.21.15.173:0/1945238985 conn(0x560411888c00 msgr2=0x560411989000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:07.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.341+0000 7fd723337f40 1 -- 172.21.15.173:0/1945238985 shutdown_connections 2024-09-13T23:57:07.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.341+0000 7fd723337f40 1 -- 172.21.15.173:0/1945238985 wait complete. 2024-09-13T23:57:07.352 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:57:07.354 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-13T23:57:07.354 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-13T23:57:07.354 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-13T23:57:07.436 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:07.436 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:07.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.429+0000 7f5245e4bf40 1 Processor -- start 2024-09-13T23:57:07.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.429+0000 7f5245e4bf40 1 -- start start 2024-09-13T23:57:07.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.429+0000 7f5245e4bf40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x564bb3ef9000 0x564bb41de580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.429+0000 7f5245e4bf40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564bb3fbd500 con 0x564bb3ef9400 2024-09-13T23:57:07.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.429+0000 7f5245e4bf40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x564bb3f86a00 con 0x564bb3ef9000 2024-09-13T23:57:07.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5243e03700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x564bb3ef9400 0x564bb3ff8800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:47590/0 (socket says 172.21.15.173:47590) 2024-09-13T23:57:07.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5244604700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x564bb3ef9000 0x564bb41de580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5243e03700 1 -- 172.21.15.173:0/3352053465 learned_addr learned my addr 172.21.15.173:0/3352053465 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:07.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5243602700 1 -- 172.21.15.173:0/3352053465 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1178345655 0 0) 0x564bb4054000 con 0x564bb3ef9400 2024-09-13T23:57:07.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5243602700 1 -- 172.21.15.173:0/3352053465 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x564bb3fbd680 con 0x564bb3ef9400 2024-09-13T23:57:07.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5244604700 1 -- 172.21.15.173:0/3352053465 >> v1:172.21.15.87:6789/0 conn(0x564bb3ef9400 legacy=0x564bb3ff8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5244604700 1 -- 172.21.15.173:0/3352053465 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bb3f0bd40 con 0x564bb3ef9000 2024-09-13T23:57:07.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5244604700 1 --2- 172.21.15.173:0/3352053465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9000 0x564bb41de580 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x564bb41d9a70 tx=0x564bb3ffd980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24484cd77c39254f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5243602700 1 -- 172.21.15.173:0/3352053465 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564bb3f9d4a0 con 0x564bb3ef9000 2024-09-13T23:57:07.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5243602700 1 -- 172.21.15.173:0/3352053465 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564bb3fbd500 con 0x564bb3ef9000 2024-09-13T23:57:07.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5243602700 1 -- 172.21.15.173:0/3352053465 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564bb3f9d600 con 0x564bb3ef9000 2024-09-13T23:57:07.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5245e4bf40 1 -- 172.21.15.173:0/3352053465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9000 msgr2=0x564bb41de580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/3352053465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9000 0x564bb41de580 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x564bb41d9a70 tx=0x564bb3ffd980 comp rx=0 tx=0).stop 2024-09-13T23:57:07.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5245e4bf40 1 -- 172.21.15.173:0/3352053465 shutdown_connections 2024-09-13T23:57:07.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/3352053465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9000 0x564bb41de580 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5245e4bf40 1 -- 172.21.15.173:0/3352053465 >> 172.21.15.173:0/3352053465 conn(0x564bb3ef8c00 msgr2=0x564bb3ff8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:07.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5245e4bf40 1 -- 172.21.15.173:0/3352053465 shutdown_connections 2024-09-13T23:57:07.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5245e4bf40 1 -- 172.21.15.173:0/3352053465 wait complete. 2024-09-13T23:57:07.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5245e4bf40 1 Processor -- start 2024-09-13T23:57:07.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5245e4bf40 1 -- start start 2024-09-13T23:57:07.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5245e4bf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9000 0x564bb41de580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5245e4bf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bb3f86500 con 0x564bb3ef9000 2024-09-13T23:57:07.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5244604700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9000 0x564bb41de580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5244604700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9000 0x564bb41de580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50952/0 (socket says 172.21.15.173:50952) 2024-09-13T23:57:07.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.433+0000 7f5244604700 1 -- 172.21.15.173:0/285054354 learned_addr learned my addr 172.21.15.173:0/285054354 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:07.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.437+0000 7f5244604700 1 -- 172.21.15.173:0/285054354 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bb3f0bba0 con 0x564bb3ef9000 2024-09-13T23:57:07.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.437+0000 7f5244604700 1 --2- 172.21.15.173:0/285054354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9000 0x564bb41de580 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x564bb4cc3e00 tx=0x564bb3ffd800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf12853655c27d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.437+0000 7f5242e01700 1 -- 172.21.15.173:0/285054354 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564bb3f9d760 con 0x564bb3ef9000 2024-09-13T23:57:07.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.437+0000 7f5242e01700 1 -- 172.21.15.173:0/285054354 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564bb3fbd980 con 0x564bb3ef9000 2024-09-13T23:57:07.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.437+0000 7f5242e01700 1 -- 172.21.15.173:0/285054354 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564bb3f9d4a0 con 0x564bb3ef9000 2024-09-13T23:57:07.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.437+0000 7f5245e4bf40 1 -- 172.21.15.173:0/285054354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9000 msgr2=0x564bb41de580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.437+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/285054354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9000 0x564bb41de580 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x564bb4cc3e00 tx=0x564bb3ffd800 comp rx=0 tx=0).stop 2024-09-13T23:57:07.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.437+0000 7f5245e4bf40 1 -- 172.21.15.173:0/285054354 shutdown_connections 2024-09-13T23:57:07.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.437+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/285054354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9000 0x564bb41de580 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.437+0000 7f5245e4bf40 1 -- 172.21.15.173:0/285054354 >> 172.21.15.173:0/285054354 conn(0x564bb3ef8c00 msgr2=0x564bb3ff9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:07.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.437+0000 7f5245e4bf40 1 -- 172.21.15.173:0/285054354 shutdown_connections 2024-09-13T23:57:07.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.437+0000 7f5245e4bf40 1 -- 172.21.15.173:0/285054354 wait complete. 2024-09-13T23:57:07.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.437+0000 7f5245e4bf40 1 Processor -- start 2024-09-13T23:57:07.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.437+0000 7f5245e4bf40 1 -- start start 2024-09-13T23:57:07.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.437+0000 7f5245e4bf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9000 0x564bb41de580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.437+0000 7f5245e4bf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bb3f863c0 con 0x564bb3ef9000 2024-09-13T23:57:07.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.437+0000 7f5244604700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9000 0x564bb41de580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.437+0000 7f5244604700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9000 0x564bb41de580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50968/0 (socket says 172.21.15.173:50968) 2024-09-13T23:57:07.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.437+0000 7f5244604700 1 -- 172.21.15.173:0/1065768443 learned_addr learned my addr 172.21.15.173:0/1065768443 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:07.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.437+0000 7f5244604700 1 -- 172.21.15.173:0/1065768443 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bb3f0ba00 con 0x564bb3ef9000 2024-09-13T23:57:07.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.437+0000 7f5244604700 1 --2- 172.21.15.173:0/1065768443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9000 0x564bb41de580 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x564bb41d9f80 tx=0x564bb3ffd980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f52415fe700 1 -- 172.21.15.173:0/1065768443 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564bb3f9d600 con 0x564bb3ef9000 2024-09-13T23:57:07.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f52415fe700 1 -- 172.21.15.173:0/1065768443 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564bb3fbdb00 con 0x564bb3ef9000 2024-09-13T23:57:07.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f5245e4bf40 1 -- 172.21.15.173:0/1065768443 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564bb3f0b860 con 0x564bb3ef9000 2024-09-13T23:57:07.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f52415fe700 1 -- 172.21.15.173:0/1065768443 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564bb3f9d8c0 con 0x564bb3ef9000 2024-09-13T23:57:07.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f5245e4bf40 1 -- 172.21.15.173:0/1065768443 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564bb3f0b6c0 con 0x564bb3ef9000 2024-09-13T23:57:07.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f5245e4bf40 1 Processor -- start 2024-09-13T23:57:07.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f5245e4bf40 1 -- start start 2024-09-13T23:57:07.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f5245e4bf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9800 0x564bb41deb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f5245e4bf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bb3f1e640 con 0x564bb3ef9800 2024-09-13T23:57:07.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f5244e05700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9800 0x564bb41deb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f5244e05700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9800 0x564bb41deb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50978/0 (socket says 172.21.15.173:50978) 2024-09-13T23:57:07.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f5244e05700 1 -- 172.21.15.173:0/529631133 learned_addr learned my addr 172.21.15.173:0/529631133 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:07.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f5244e05700 1 -- 172.21.15.173:0/529631133 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bb3f0a000 con 0x564bb3ef9800 2024-09-13T23:57:07.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f52415fe700 1 -- 172.21.15.173:0/1065768443 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x564bb3ff2b00 con 0x564bb3ef9000 2024-09-13T23:57:07.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f52415fe700 1 --2- 172.21.15.173:0/1065768443 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564bb429e000 0x564bb41df080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f52415fe700 1 -- 172.21.15.173:0/1065768443 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x564bb3f5f180 con 0x564bb3ef9000 2024-09-13T23:57:07.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f5244e05700 1 --2- 172.21.15.173:0/529631133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9800 0x564bb41deb00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x564bb4d71050 tx=0x564bb4264540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f665c0af4b09e0a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f5244604700 1 --2- 172.21.15.173:0/1065768443 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564bb429e000 0x564bb41df080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f523edf9700 1 -- 172.21.15.173:0/529631133 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564bb3f9d600 con 0x564bb3ef9800 2024-09-13T23:57:07.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f523edf9700 1 -- 172.21.15.173:0/529631133 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564bb3fbdb00 con 0x564bb3ef9800 2024-09-13T23:57:07.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f523edf9700 1 -- 172.21.15.173:0/529631133 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564bb3f9d8c0 con 0x564bb3ef9800 2024-09-13T23:57:07.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f5245e4bf40 1 -- 172.21.15.173:0/529631133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9800 msgr2=0x564bb41deb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/529631133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9800 0x564bb41deb00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x564bb4d71050 tx=0x564bb4264540 comp rx=0 tx=0).stop 2024-09-13T23:57:07.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f5245e4bf40 1 -- 172.21.15.173:0/529631133 shutdown_connections 2024-09-13T23:57:07.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/529631133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9800 0x564bb41deb00 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f5245e4bf40 1 -- 172.21.15.173:0/529631133 >> 172.21.15.173:0/529631133 conn(0x564bb3ef9400 msgr2=0x564bb3ff9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:07.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.441+0000 7f5244604700 1 --2- 172.21.15.173:0/1065768443 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564bb429e000 0x564bb41df080 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x564bb4d71680 tx=0x564bb4264120 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.445+0000 7f5245e4bf40 1 -- 172.21.15.173:0/529631133 shutdown_connections 2024-09-13T23:57:07.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.445+0000 7f5245e4bf40 1 -- 172.21.15.173:0/529631133 wait complete. 2024-09-13T23:57:07.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.445+0000 7f5245e4bf40 1 Processor -- start 2024-09-13T23:57:07.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.445+0000 7f5245e4bf40 1 -- start start 2024-09-13T23:57:07.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.445+0000 7f5245e4bf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9800 0x564bb41deb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.445+0000 7f5245e4bf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bb3f1e8c0 con 0x564bb3ef9800 2024-09-13T23:57:07.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.445+0000 7f5244e05700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9800 0x564bb41deb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.445+0000 7f5244e05700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9800 0x564bb41deb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50994/0 (socket says 172.21.15.173:50994) 2024-09-13T23:57:07.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.445+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 learned_addr learned my addr 172.21.15.173:0/727851517 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:07.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.445+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bb3f0aea0 con 0x564bb3ef9800 2024-09-13T23:57:07.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.445+0000 7f5244e05700 1 --2- 172.21.15.173:0/727851517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9800 0x564bb41deb00 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x564bb4d70930 tx=0x564bb3ffdb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.445+0000 7f523d5f6700 1 -- 172.21.15.173:0/727851517 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564bb3f9d760 con 0x564bb3ef9800 2024-09-13T23:57:07.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.445+0000 7f523d5f6700 1 -- 172.21.15.173:0/727851517 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564bb42b6000 con 0x564bb3ef9800 2024-09-13T23:57:07.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.445+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564bb3f0a820 con 0x564bb3ef9800 2024-09-13T23:57:07.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.445+0000 7f523d5f6700 1 -- 172.21.15.173:0/727851517 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564bb3f9d600 con 0x564bb3ef9800 2024-09-13T23:57:07.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.445+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564bb3f0a9c0 con 0x564bb3ef9800 2024-09-13T23:57:07.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.445+0000 7f5245e4bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.449+0000 7f523d5f6700 1 -- 172.21.15.173:0/727851517 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x564bb3ff2dc0 con 0x564bb3ef9800 2024-09-13T23:57:07.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.449+0000 7f523d5f6700 1 --2- 172.21.15.173:0/727851517 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564bb429ec00 0x564bb41df600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.449+0000 7f523d5f6700 1 -- 172.21.15.173:0/727851517 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x564bb3f5f340 con 0x564bb3ef9800 2024-09-13T23:57:07.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.449+0000 7f5243e03700 1 --2- 172.21.15.173:0/727851517 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564bb429ec00 0x564bb41df600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.449+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/727851517 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564bb429f000 0x564bb41dfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.449+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f400 con 0x564bb429f000 2024-09-13T23:57:07.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.449+0000 7f5244e05700 1 --2- 172.21.15.173:0/727851517 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564bb429f000 0x564bb41dfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.449+0000 7f5243e03700 1 --2- 172.21.15.173:0/727851517 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564bb429ec00 0x564bb41df600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x564bb4cc2030 tx=0x564bb4265800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.449+0000 7f5244e05700 1 --2- 172.21.15.173:0/727851517 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564bb429f000 0x564bb41dfb80 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.449+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564bb42fab40 con 0x564bb429f000 2024-09-13T23:57:07.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.449+0000 7f5245e4bf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:07.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.449+0000 7f5245e4bf40 20 realm 2024-09-13T23:57:07.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.449+0000 7f5245e4bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.449+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429f000 2024-09-13T23:57:07.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.449+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564bb42fab40 con 0x564bb429f000 2024-09-13T23:57:07.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.449+0000 7f5245e4bf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:07.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.449+0000 7f5245e4bf40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:07.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.449+0000 7f5245e4bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.449+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429fc00 con 0x564bb429f000 2024-09-13T23:57:07.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.449+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564bb42fab40 con 0x564bb429f000 2024-09-13T23:57:07.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.449+0000 7f5245e4bf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:07.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.449+0000 7f5245e4bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.449+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/727851517 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564bb429f400 0x564bb41e0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.449+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429f400 2024-09-13T23:57:07.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.453+0000 7f5244604700 1 --2- 172.21.15.173:0/727851517 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564bb429f400 0x564bb41e0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.453+0000 7f5244604700 1 --2- 172.21.15.173:0/727851517 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564bb429f400 0x564bb41e0100 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.453+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.453+0000 7f5245e4bf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:07.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.453+0000 7f5245e4bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.453+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/727851517 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564bb429fc00 0x564bb41e0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.453+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb4356000 con 0x564bb429fc00 2024-09-13T23:57:07.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.453+0000 7f5243e03700 1 --2- 172.21.15.173:0/727851517 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564bb429fc00 0x564bb41e0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.453+0000 7f5243e03700 1 --2- 172.21.15.173:0/727851517 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564bb429fc00 0x564bb41e0680 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.453+0000 7f5243e03700 1 -- 172.21.15.173:0/727851517 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x564bb42fb440 con 0x564bb429fc00 2024-09-13T23:57:07.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.453+0000 7f5245e4bf40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:07.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.453+0000 7f5245e4bf40 20 searching for the correct realm 2024-09-13T23:57:07.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.453+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb4356400 con 0x564bb429fc00 2024-09-13T23:57:07.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.453+0000 7f5243e03700 1 -- 172.21.15.173:0/727851517 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x564bb42fb440 con 0x564bb429fc00 2024-09-13T23:57:07.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.453+0000 7f5243e03700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb4356000 con 0x564bb429f400 2024-09-13T23:57:07.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.457+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.457+0000 7f5244604700 1 --2- 172.21.15.173:0/727851517 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564bb4356000 0x564bb41e0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.457+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb4356000 2024-09-13T23:57:07.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.457+0000 7f5244e05700 1 --2- 172.21.15.173:0/727851517 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564bb4356000 0x564bb41e0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.457+0000 7f5244e05700 1 --2- 172.21.15.173:0/727851517 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564bb4356000 0x564bb41e0c00 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.457+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fab40 con 0x564bb4356000 2024-09-13T23:57:07.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.457+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429f000 2024-09-13T23:57:07.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.457+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(9 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x564bb42fab40 con 0x564bb429f000 2024-09-13T23:57:07.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.457+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429f000 2024-09-13T23:57:07.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.457+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fab40 con 0x564bb429f000 2024-09-13T23:57:07.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.457+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429fc00 2024-09-13T23:57:07.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.457+0000 7f5243e03700 1 -- 172.21.15.173:0/727851517 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fb440 con 0x564bb429fc00 2024-09-13T23:57:07.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.457+0000 7f5243e03700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429f000 2024-09-13T23:57:07.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.461+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fab40 con 0x564bb429f000 2024-09-13T23:57:07.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.461+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429f400 2024-09-13T23:57:07.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.461+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.461+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429f400 2024-09-13T23:57:07.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.461+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.461+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429f000 2024-09-13T23:57:07.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.461+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fab40 con 0x564bb429f000 2024-09-13T23:57:07.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.461+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb4356000 2024-09-13T23:57:07.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.461+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fab40 con 0x564bb4356000 2024-09-13T23:57:07.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.461+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429f000 2024-09-13T23:57:07.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.461+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fab40 con 0x564bb429f000 2024-09-13T23:57:07.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.461+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb4356000 2024-09-13T23:57:07.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.461+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fab40 con 0x564bb4356000 2024-09-13T23:57:07.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.461+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429f400 2024-09-13T23:57:07.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.465+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.465+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429fc00 2024-09-13T23:57:07.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.465+0000 7f5243e03700 1 -- 172.21.15.173:0/727851517 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fb440 con 0x564bb429fc00 2024-09-13T23:57:07.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.465+0000 7f5243e03700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429f000 2024-09-13T23:57:07.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.465+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fab40 con 0x564bb429f000 2024-09-13T23:57:07.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.465+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429f400 2024-09-13T23:57:07.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.465+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.465+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429fc00 2024-09-13T23:57:07.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.465+0000 7f5243e03700 1 -- 172.21.15.173:0/727851517 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fb440 con 0x564bb429fc00 2024-09-13T23:57:07.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.465+0000 7f5243e03700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429f000 2024-09-13T23:57:07.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.465+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fab40 con 0x564bb429f000 2024-09-13T23:57:07.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.465+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429f000 2024-09-13T23:57:07.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.469+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fab40 con 0x564bb429f000 2024-09-13T23:57:07.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.469+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429f000 2024-09-13T23:57:07.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.469+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fab40 con 0x564bb429f000 2024-09-13T23:57:07.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.469+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429fc00 2024-09-13T23:57:07.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.469+0000 7f5243e03700 1 -- 172.21.15.173:0/727851517 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fb440 con 0x564bb429fc00 2024-09-13T23:57:07.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.469+0000 7f5243e03700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb4356000 2024-09-13T23:57:07.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.469+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fab40 con 0x564bb4356000 2024-09-13T23:57:07.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.469+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429f000 2024-09-13T23:57:07.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.469+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fab40 con 0x564bb429f000 2024-09-13T23:57:07.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.469+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb4356000 2024-09-13T23:57:07.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.469+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fab40 con 0x564bb4356000 2024-09-13T23:57:07.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.469+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429fc00 2024-09-13T23:57:07.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.469+0000 7f5243e03700 1 -- 172.21.15.173:0/727851517 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fb440 con 0x564bb429fc00 2024-09-13T23:57:07.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.469+0000 7f5243e03700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb4356000 2024-09-13T23:57:07.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.469+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fab40 con 0x564bb4356000 2024-09-13T23:57:07.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.469+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429f400 2024-09-13T23:57:07.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.473+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.473+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429f400 2024-09-13T23:57:07.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.473+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.473+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429fc00 2024-09-13T23:57:07.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.473+0000 7f5243e03700 1 -- 172.21.15.173:0/727851517 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fb440 con 0x564bb429fc00 2024-09-13T23:57:07.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.473+0000 7f5243e03700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429f400 2024-09-13T23:57:07.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.473+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.473+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb429f400 2024-09-13T23:57:07.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:07.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:07.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:07.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:07.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb4356800 con 0x564bb429f000 2024-09-13T23:57:07.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564bb42fab40 con 0x564bb429f000 2024-09-13T23:57:07.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:07.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb4356c00 con 0x564bb429f400 2024-09-13T23:57:07.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:07.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb4357000 con 0x564bb429f000 2024-09-13T23:57:07.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x564bb42fab40 con 0x564bb429f000 2024-09-13T23:57:07.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:07.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 20 zone default found 2024-09-13T23:57:07.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 4 Realm: () 2024-09-13T23:57:07.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:07.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:07.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:07.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 20 zonegroup default 2024-09-13T23:57:07.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb4357400 con 0x564bb4356000 2024-09-13T23:57:07.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x564bb42fab40 con 0x564bb4356000 2024-09-13T23:57:07.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:07.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb4357800 con 0x564bb429fc00 2024-09-13T23:57:07.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5243e03700 1 -- 172.21.15.173:0/727851517 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x564bb42fb440 con 0x564bb429fc00 2024-09-13T23:57:07.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:07.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.477+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb4357c00 con 0x564bb429fc00 2024-09-13T23:57:07.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.481+0000 7f5243e03700 1 -- 172.21.15.173:0/727851517 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x564bb42fb440 con 0x564bb429fc00 2024-09-13T23:57:07.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.481+0000 7f5245e4bf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:07.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.481+0000 7f5245e4bf40 20 started sync module instance, tier type = 2024-09-13T23:57:07.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.481+0000 7f5245e4bf40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:07.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.481+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb435c000 con 0x564bb429f400 2024-09-13T23:57:07.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.481+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v33'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.481+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94883144358656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb435c400 con 0x564bb429f400 2024-09-13T23:57:07.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.481+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb435c800 con 0x564bb429f000 2024-09-13T23:57:07.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.485+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(46 notify.1 [create] v33'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fab40 con 0x564bb429f000 2024-09-13T23:57:07.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.485+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94883144358656] v33'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.485+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94883144359808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb435cc00 con 0x564bb429f000 2024-09-13T23:57:07.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.485+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb435d000 con 0x564bb429f400 2024-09-13T23:57:07.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.489+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94883144359808] v33'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fab40 con 0x564bb429f000 2024-09-13T23:57:07.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.489+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v33'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.489+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94883144360960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb435d400 con 0x564bb429f400 2024-09-13T23:57:07.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.489+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb435d800 con 0x564bb4356000 2024-09-13T23:57:07.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.489+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(50 notify.3 [create] v33'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fab40 con 0x564bb4356000 2024-09-13T23:57:07.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.489+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94883144362112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb435dc00 con 0x564bb4356000 2024-09-13T23:57:07.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.489+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb435c800 con 0x564bb429f400 2024-09-13T23:57:07.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.493+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94883144360960] v33'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.493+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(51 notify.3 [watch watch cookie 94883144362112] v33'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fab40 con 0x564bb4356000 2024-09-13T23:57:07.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.493+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v33'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.493+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94883144363264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb435c000 con 0x564bb429f400 2024-09-13T23:57:07.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.493+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb4356800 con 0x564bb429fc00 2024-09-13T23:57:07.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.497+0000 7f5243e03700 1 -- 172.21.15.173:0/727851517 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v33'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fb440 con 0x564bb429fc00 2024-09-13T23:57:07.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.497+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94883144364416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb4357000 con 0x564bb429fc00 2024-09-13T23:57:07.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.497+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb4357400 con 0x564bb429fc00 2024-09-13T23:57:07.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.497+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94883144363264] v33'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.497+0000 7f5243e03700 1 -- 172.21.15.173:0/727851517 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v33'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fb440 con 0x564bb429fc00 2024-09-13T23:57:07.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.497+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94883144365568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb4356c00 con 0x564bb429fc00 2024-09-13T23:57:07.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.497+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb429f800 con 0x564bb4356000 2024-09-13T23:57:07.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.497+0000 7f5243e03700 1 -- 172.21.15.173:0/727851517 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94883144364416] v33'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fb440 con 0x564bb429fc00 2024-09-13T23:57:07.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.501+0000 7f5243e03700 1 -- 172.21.15.173:0/727851517 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94883144365568] v33'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fb440 con 0x564bb429fc00 2024-09-13T23:57:07.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.501+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(58 notify.7 [create] v33'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fab40 con 0x564bb4356000 2024-09-13T23:57:07.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.501+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94883144366720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb435c400 con 0x564bb4356000 2024-09-13T23:57:07.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.501+0000 7f5245e4bf40 20 add_watcher() i=0 2024-09-13T23:57:07.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.501+0000 7f5245e4bf40 20 add_watcher() i=1 2024-09-13T23:57:07.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.501+0000 7f5245e4bf40 20 add_watcher() i=2 2024-09-13T23:57:07.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.501+0000 7f5245e4bf40 20 add_watcher() i=3 2024-09-13T23:57:07.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.501+0000 7f5245e4bf40 20 add_watcher() i=4 2024-09-13T23:57:07.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.501+0000 7f5245e4bf40 20 add_watcher() i=5 2024-09-13T23:57:07.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.501+0000 7f5245e4bf40 20 add_watcher() i=6 2024-09-13T23:57:07.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.501+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(59 notify.7 [watch watch cookie 94883144366720] v33'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fab40 con 0x564bb4356000 2024-09-13T23:57:07.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.501+0000 7f5245e4bf40 20 add_watcher() i=7 2024-09-13T23:57:07.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.501+0000 7f5245e4bf40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:07.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.501+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb435d000 con 0x564bb429f000 2024-09-13T23:57:07.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.501+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x564bb42fab40 con 0x564bb429f000 2024-09-13T23:57:07.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.501+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94883145981952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb435d400 con 0x564bb429f000 2024-09-13T23:57:07.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.505+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94883145981952] v33'150 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x564bb42fab40 con 0x564bb429f000 2024-09-13T23:57:07.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.505+0000 7f522b5d2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:07.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.505+0000 7f5245e4bf40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:07.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.505+0000 7f5245e4bf40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:07.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.505+0000 7f5245e4bf40 1 Processor -- start 2024-09-13T23:57:07.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.505+0000 7f5245e4bf40 1 -- start start 2024-09-13T23:57:07.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.505+0000 7f5245e4bf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb4356400 0x564bb41e1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.505+0000 7f5245e4bf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bb3f863c0 con 0x564bb4356400 2024-09-13T23:57:07.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.505+0000 7f5243e03700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb4356400 0x564bb41e1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.505+0000 7f5243e03700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb4356400 0x564bb41e1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51008/0 (socket says 172.21.15.173:51008) 2024-09-13T23:57:07.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.505+0000 7f5243e03700 1 -- 172.21.15.173:0/3749748561 learned_addr learned my addr 172.21.15.173:0/3749748561 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:07.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.509+0000 7f5243e03700 1 -- 172.21.15.173:0/3749748561 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bb3f0ab60 con 0x564bb4356400 2024-09-13T23:57:07.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.509+0000 7f5243e03700 1 --2- 172.21.15.173:0/3749748561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb4356400 0x564bb41e1180 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x564bb436c0c0 tx=0x564bb42657a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c715f63dc977663 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.509+0000 7f522add1700 1 -- 172.21.15.173:0/3749748561 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564bb4370000 con 0x564bb4356400 2024-09-13T23:57:07.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.509+0000 7f522add1700 1 -- 172.21.15.173:0/3749748561 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564bb42b6480 con 0x564bb4356400 2024-09-13T23:57:07.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.509+0000 7f522add1700 1 -- 172.21.15.173:0/3749748561 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564bb4370160 con 0x564bb4356400 2024-09-13T23:57:07.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.509+0000 7f5245e4bf40 1 -- 172.21.15.173:0/3749748561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb4356400 msgr2=0x564bb41e1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.509+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/3749748561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb4356400 0x564bb41e1180 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x564bb436c0c0 tx=0x564bb42657a0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.509+0000 7f5245e4bf40 1 -- 172.21.15.173:0/3749748561 shutdown_connections 2024-09-13T23:57:07.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.509+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/3749748561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb4356400 0x564bb41e1180 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.509+0000 7f5245e4bf40 1 -- 172.21.15.173:0/3749748561 >> 172.21.15.173:0/3749748561 conn(0x564bb435c800 msgr2=0x564bb3ffa000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:07.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.509+0000 7f5245e4bf40 1 -- 172.21.15.173:0/3749748561 shutdown_connections 2024-09-13T23:57:07.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.509+0000 7f5245e4bf40 1 -- 172.21.15.173:0/3749748561 wait complete. 2024-09-13T23:57:07.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.509+0000 7f5245e4bf40 1 Processor -- start 2024-09-13T23:57:07.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.509+0000 7f5245e4bf40 1 -- start start 2024-09-13T23:57:07.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.509+0000 7f5245e4bf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb4356400 0x564bb41e1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.509+0000 7f5245e4bf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bb3f86500 con 0x564bb4356400 2024-09-13T23:57:07.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.509+0000 7f5243e03700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb4356400 0x564bb41e1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.509+0000 7f5243e03700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb4356400 0x564bb41e1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51022/0 (socket says 172.21.15.173:51022) 2024-09-13T23:57:07.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.509+0000 7f5243e03700 1 -- 172.21.15.173:0/3082875656 learned_addr learned my addr 172.21.15.173:0/3082875656 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:07.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.513+0000 7f5243e03700 1 -- 172.21.15.173:0/3082875656 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bb3f0ad00 con 0x564bb4356400 2024-09-13T23:57:07.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.513+0000 7f5243e03700 1 --2- 172.21.15.173:0/3082875656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb4356400 0x564bb41e1180 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x564bb436c2d0 tx=0x564bb4265920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.513+0000 7f52295ce700 1 -- 172.21.15.173:0/3082875656 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564bb43702c0 con 0x564bb4356400 2024-09-13T23:57:07.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.513+0000 7f52295ce700 1 -- 172.21.15.173:0/3082875656 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564bb42b6600 con 0x564bb4356400 2024-09-13T23:57:07.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.513+0000 7f5245e4bf40 1 -- 172.21.15.173:0/3082875656 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564bb3f0a340 con 0x564bb4356400 2024-09-13T23:57:07.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.513+0000 7f52295ce700 1 -- 172.21.15.173:0/3082875656 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564bb4370000 con 0x564bb4356400 2024-09-13T23:57:07.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.513+0000 7f5245e4bf40 1 -- 172.21.15.173:0/3082875656 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564bb3f0ab60 con 0x564bb4356400 2024-09-13T23:57:07.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.513+0000 7f52295ce700 1 -- 172.21.15.173:0/3082875656 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x564bb3ff3b80 con 0x564bb4356400 2024-09-13T23:57:07.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.513+0000 7f52295ce700 1 --2- 172.21.15.173:0/3082875656 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564bb429f800 0x564bb43f4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:07.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.513+0000 7f52295ce700 1 -- 172.21.15.173:0/3082875656 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6038+0+0 (secure 0 0 0) 0x564bb3f5f500 con 0x564bb4356400 2024-09-13T23:57:07.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.513+0000 7f5244e05700 1 --2- 172.21.15.173:0/3082875656 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564bb429f800 0x564bb43f4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:07.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.513+0000 7f5245e4bf40 5 note: GC not initialized 2024-09-13T23:57:07.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.513+0000 7f5244e05700 1 --2- 172.21.15.173:0/3082875656 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564bb429f800 0x564bb43f4000 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x564bb42f7740 tx=0x564bb43ba660 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:07.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5226dc9700 20 reqs_thread_entry: start 2024-09-13T23:57:07.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5245e4bf40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:07.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5245e4bf40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:07.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5224dc5700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:37 2024 2024-09-13T23:57:07.524 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:07.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5245e4bf40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:57:07.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5245e4bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb4356800 con 0x564bb429f000 2024-09-13T23:57:07.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f52245a3700 20 reqs_thread_entry: start 2024-09-13T23:57:07.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x564bb42fab40 con 0x564bb429f000 2024-09-13T23:57:07.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5245e4bf40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:57:07.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5245e4bf40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:57:07.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5245e4bf40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:07.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5245e4bf40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:07.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb435cc00 con 0x564bb4356000 2024-09-13T23:57:07.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x564bb42fab40 con 0x564bb4356000 2024-09-13T23:57:07.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5245e4bf40 20 enabling bucket name=myfoo 2024-09-13T23:57:07.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5245e4bf40 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:57:07.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5245e4bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb435d800 con 0x564bb4356000 2024-09-13T23:57:07.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x564bb42fab40 con 0x564bb4356000 2024-09-13T23:57:07.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5245e4bf40 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:57:07.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5245e4bf40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-13T23:57:07.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5245e4bf40 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:57:07.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5245e4bf40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 : miss 2024-09-13T23:57:07.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5245e4bf40 20 rados->read ofs=0 len=0 2024-09-13T23:57:07.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.517+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 8.17 8:ea49432e:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb435dc00 con 0x564bb429f400 2024-09-13T23:57:07.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.521+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(65 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv6 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.521+0000 7f5245e4bf40 20 rados_obj.operate() r=0 bl.length=352 2024-09-13T23:57:07.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.521+0000 7f5245e4bf40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 info.flags=0x17 2024-09-13T23:57:07.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.521+0000 7f5245e4bf40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 to cache LRU end 2024-09-13T23:57:07.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.521+0000 7f5245e4bf40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:07.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.521+0000 7f5245e4bf40 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:57:07.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.521+0000 7f5245e4bf40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 2024-09-13T23:57:07.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.521+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 8.17 8:ea49432e:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb4466000 con 0x564bb429f400 2024-09-13T23:57:07.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.525+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(66 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v33'7 uv7 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.525+0000 7f5245e4bf40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 info.flags=0x17 2024-09-13T23:57:07.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.525+0000 7f5245e4bf40 10 moving default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 to cache LRU end 2024-09-13T23:57:07.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.525+0000 7f5245e4bf40 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:57:07.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.525+0000 7f5245e4bf40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1, ofs0, ns] 2024-09-13T23:57:07.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.525+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94883145984256 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb4466800 con 0x564bb429f400 2024-09-13T23:57:07.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.525+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== watch-notify(notify (1) cookie 94883144360960 notify 141733920799 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x564bb4262680 con 0x564bb429f400 2024-09-13T23:57:07.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.525+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(67 notify.2 [notify cookie 94883145984256 out=8b] v0'0 uv156 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.525+0000 7f523edf9700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920799 cookie 94883144360960 notifier 4656 bl.length()=725 2024-09-13T23:57:07.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.525+0000 7f523edf9700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 info.flags=0x17 2024-09-13T23:57:07.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.525+0000 7f523edf9700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1 to cache LRU end 2024-09-13T23:57:07.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.525+0000 7f523edf9700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:57:07.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.525+0000 7f523edf9700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb435c000 con 0x564bb429f400 2024-09-13T23:57:07.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.525+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== watch-notify(notify_complete (2) cookie 94883145984256 notify 141733920799 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x564bb4262820 con 0x564bb429f400 2024-09-13T23:57:07.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.525+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.525+0000 7f5245e4bf40 20 handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1]): orig_sources= new_sources= 2024-09-13T23:57:07.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.525+0000 7f5245e4bf40 20 handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1]): potential sources added=[] removed=[] 2024-09-13T23:57:07.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.525+0000 7f5245e4bf40 20 handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1]): orig_dests= new_dests= 2024-09-13T23:57:07.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.525+0000 7f5245e4bf40 20 handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1]): potential dests added=[] removed=[] 2024-09-13T23:57:07.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.525+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb4467000 con 0x564bb429f000 2024-09-13T23:57:07.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.529+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~357] v33'16 uv16 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x564bb42fab40 con 0x564bb429f000 2024-09-13T23:57:07.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.529+0000 7f5245e4bf40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:57:07.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.529+0000 7f5245e4bf40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:07.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.529+0000 7f5245e4bf40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:57:07.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.529+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94883145984256 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb4467400 con 0x564bb429f400 2024-09-13T23:57:07.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.529+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== watch-notify(notify (1) cookie 94883144363264 notify 141733920800 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x564bb4262820 con 0x564bb429f400 2024-09-13T23:57:07.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.529+0000 7f523edf9700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920800 cookie 94883144363264 notifier 4656 bl.length()=533 2024-09-13T23:57:07.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.529+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== osd_op_reply(70 notify.4 [notify cookie 94883145984256 out=8b] v0'0 uv156 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.529+0000 7f523edf9700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:57:07.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.529+0000 7f523edf9700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:07.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.529+0000 7f523edf9700 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb435dc00 con 0x564bb429f400 2024-09-13T23:57:07.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.529+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== watch-notify(notify_complete (2) cookie 94883145984256 notify 141733920800 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x564bb42629c0 con 0x564bb429f400 2024-09-13T23:57:07.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.529+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 27 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.537 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:07.537 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "foo", 2024-09-13T23:57:07.538 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Foo", 2024-09-13T23:57:07.538 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "foo@foo.com", 2024-09-13T23:57:07.538 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:57:07.538 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:57:07.538 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [], 2024-09-13T23:57:07.538 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:57:07.538 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:07.538 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:57:07.538 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-09-13T23:57:07.538 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-09-13T23:57:07.538 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:07.538 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:07.539 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [], 2024-09-13T23:57:07.539 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:57:07.539 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:57:07.539 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:57:07.539 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:57:07.539 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:57:07.539 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:57:07.539 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:07.539 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:07.539 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:07.539 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:07.539 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:07.539 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:07.540 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:57:07.540 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:07.540 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:07.540 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:07.540 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:07.540 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:07.540 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:07.540 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:57:07.540 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:57:07.540 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:57:07.540 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:07.540 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:57:07.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.533+0000 7f522b5d2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:07.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.533+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94883145981952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb4467800 con 0x564bb429f000 2024-09-13T23:57:07.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.537+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94883145981952] v33'151 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x564bb42fab40 con 0x564bb429f000 2024-09-13T23:57:07.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.537+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94883144358656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb4467c00 con 0x564bb429f400 2024-09-13T23:57:07.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.537+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 28 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94883144358656] v33'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.537+0000 7f5245e4bf40 20 remove_watcher() i=0 2024-09-13T23:57:07.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.537+0000 7f5245e4bf40 2 removed watcher, disabling cache 2024-09-13T23:57:07.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.537+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94883144359808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb4467000 con 0x564bb429f000 2024-09-13T23:57:07.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.541+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94883144359808] v33'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fab40 con 0x564bb429f000 2024-09-13T23:57:07.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.541+0000 7f5245e4bf40 20 remove_watcher() i=1 2024-09-13T23:57:07.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.541+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94883144360960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb4466400 con 0x564bb429f400 2024-09-13T23:57:07.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.545+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 29 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94883144360960] v33'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.545+0000 7f5245e4bf40 20 remove_watcher() i=2 2024-09-13T23:57:07.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.545+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94883144362112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb4466000 con 0x564bb4356000 2024-09-13T23:57:07.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.545+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94883144362112] v33'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fab40 con 0x564bb4356000 2024-09-13T23:57:07.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.545+0000 7f5245e4bf40 20 remove_watcher() i=3 2024-09-13T23:57:07.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.545+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94883144363264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb435d000 con 0x564bb429f400 2024-09-13T23:57:07.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.549+0000 7f5244604700 1 -- 172.21.15.173:0/727851517 <== osd.0 v2:172.21.15.87:6800/3507919120 30 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94883144363264] v33'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fb200 con 0x564bb429f400 2024-09-13T23:57:07.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.549+0000 7f5245e4bf40 20 remove_watcher() i=4 2024-09-13T23:57:07.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.549+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94883144364416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb435d400 con 0x564bb429fc00 2024-09-13T23:57:07.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.553+0000 7f5243e03700 1 -- 172.21.15.173:0/727851517 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94883144364416] v33'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fb440 con 0x564bb429fc00 2024-09-13T23:57:07.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.553+0000 7f5245e4bf40 20 remove_watcher() i=5 2024-09-13T23:57:07.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.553+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94883144365568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb435cc00 con 0x564bb429fc00 2024-09-13T23:57:07.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.553+0000 7f5243e03700 1 -- 172.21.15.173:0/727851517 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94883144365568] v33'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fb440 con 0x564bb429fc00 2024-09-13T23:57:07.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.553+0000 7f5245e4bf40 20 remove_watcher() i=6 2024-09-13T23:57:07.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.553+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94883144366720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x564bb435d800 con 0x564bb4356000 2024-09-13T23:57:07.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5244e05700 1 -- 172.21.15.173:0/727851517 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94883144366720] v33'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564bb42fab40 con 0x564bb4356000 2024-09-13T23:57:07.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 20 remove_watcher() i=7 2024-09-13T23:57:07.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564bb429f400 msgr2=0x564bb41e0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/727851517 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564bb429f400 0x564bb41e0100 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564bb429f000 msgr2=0x564bb41dfb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/727851517 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564bb429f000 0x564bb41dfb80 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564bb4356000 msgr2=0x564bb41e0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/727851517 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564bb4356000 0x564bb41e0c00 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564bb429fc00 msgr2=0x564bb41e0680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/727851517 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564bb429fc00 0x564bb41e0680 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564bb429ec00 msgr2=0x564bb41df600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/727851517 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564bb429ec00 0x564bb41df600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x564bb4cc2030 tx=0x564bb4265800 comp rx=0 tx=0).stop 2024-09-13T23:57:07.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9800 msgr2=0x564bb41deb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/727851517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9800 0x564bb41deb00 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x564bb4d70930 tx=0x564bb3ffdb60 comp rx=0 tx=0).stop 2024-09-13T23:57:07.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5243e03700 1 -- 172.21.15.173:0/727851517 reap_dead start 2024-09-13T23:57:07.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 shutdown_connections 2024-09-13T23:57:07.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/727851517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9800 0x564bb41deb00 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 >> 172.21.15.173:0/727851517 conn(0x564bb3ef9400 msgr2=0x564bb3ff9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:07.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 shutdown_connections 2024-09-13T23:57:07.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 -- 172.21.15.173:0/727851517 wait complete. 2024-09-13T23:57:07.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 -- 172.21.15.173:0/3082875656 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564bb429f800 msgr2=0x564bb43f4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/3082875656 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564bb429f800 0x564bb43f4000 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x564bb42f7740 tx=0x564bb43ba660 comp rx=0 tx=0).stop 2024-09-13T23:57:07.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 -- 172.21.15.173:0/3082875656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb4356400 msgr2=0x564bb41e1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/3082875656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb4356400 0x564bb41e1180 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x564bb436c2d0 tx=0x564bb4265920 comp rx=0 tx=0).stop 2024-09-13T23:57:07.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 -- 172.21.15.173:0/3082875656 shutdown_connections 2024-09-13T23:57:07.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/3082875656 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564bb429f800 0x564bb43f4000 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/3082875656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb4356400 0x564bb41e1180 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 -- 172.21.15.173:0/3082875656 >> 172.21.15.173:0/3082875656 conn(0x564bb435c800 msgr2=0x564bb3ffa000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:07.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 -- 172.21.15.173:0/3082875656 shutdown_connections 2024-09-13T23:57:07.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.557+0000 7f5245e4bf40 1 -- 172.21.15.173:0/3082875656 wait complete. 2024-09-13T23:57:07.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.561+0000 7f5245e4bf40 1 -- 172.21.15.173:0/1065768443 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564bb429e000 msgr2=0x564bb41df080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.561+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/1065768443 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564bb429e000 0x564bb41df080 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x564bb4d71680 tx=0x564bb4264120 comp rx=0 tx=0).stop 2024-09-13T23:57:07.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.561+0000 7f5245e4bf40 1 -- 172.21.15.173:0/1065768443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9000 msgr2=0x564bb41de580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:07.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.561+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/1065768443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9000 0x564bb41de580 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x564bb41d9f80 tx=0x564bb3ffd980 comp rx=0 tx=0).stop 2024-09-13T23:57:07.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.561+0000 7f5245e4bf40 1 -- 172.21.15.173:0/1065768443 shutdown_connections 2024-09-13T23:57:07.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.561+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/1065768443 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564bb429e000 0x564bb41df080 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.561+0000 7f5245e4bf40 1 --2- 172.21.15.173:0/1065768443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564bb3ef9000 0x564bb41de580 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:07.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.561+0000 7f5245e4bf40 1 -- 172.21.15.173:0/1065768443 >> 172.21.15.173:0/1065768443 conn(0x564bb3ef8c00 msgr2=0x564bb3ff9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:07.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.561+0000 7f5245e4bf40 1 -- 172.21.15.173:0/1065768443 shutdown_connections 2024-09-13T23:57:07.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:07.561+0000 7f5245e4bf40 1 -- 172.21.15.173:0/1065768443 wait complete. 2024-09-13T23:57:07.571 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:57:07.595 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T23:57:07.849 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-13T23:57:07.861 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:57:22.862 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-13T23:57:22.862 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-13T23:57:22.862 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-13T23:57:22.904 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:22.904 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:22.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.897+0000 7feece49ff40 1 Processor -- start 2024-09-13T23:57:22.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.897+0000 7feece49ff40 1 -- start start 2024-09-13T23:57:22.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.897+0000 7feece49ff40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x563858ae9400 0x563858dce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:22.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.897+0000 7feece49ff40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563858bad500 con 0x563858ae9000 2024-09-13T23:57:22.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.897+0000 7feece49ff40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x563858b76a00 con 0x563858ae9400 2024-09-13T23:57:22.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.897+0000 7feecc457700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x563858ae9400 0x563858dce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:22.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.901+0000 7feeccc58700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x563858ae9000 0x563858be8800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:44864/0 (socket says 172.21.15.173:44864) 2024-09-13T23:57:22.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.901+0000 7feecc457700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x563858ae9400 0x563858dce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34538/0 (socket says 172.21.15.173:34538) 2024-09-13T23:57:22.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.901+0000 7feeccc58700 1 -- 172.21.15.173:0/1475026603 learned_addr learned my addr 172.21.15.173:0/1475026603 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:22.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.901+0000 7feecc457700 1 -- 172.21.15.173:0/1475026603 >> v1:172.21.15.87:6789/0 conn(0x563858ae9000 legacy=0x563858be8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:22.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.901+0000 7feecbc56700 1 -- 172.21.15.173:0/1475026603 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902519404 0 0) 0x563858c44000 con 0x563858ae9000 2024-09-13T23:57:22.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.901+0000 7feecc457700 1 -- 172.21.15.173:0/1475026603 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563858afbd40 con 0x563858ae9400 2024-09-13T23:57:22.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.901+0000 7feecc457700 1 --2- 172.21.15.173:0/1475026603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9400 0x563858dce580 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x563858dc9920 tx=0x563858bed920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81a09350a436b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:22.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.901+0000 7feecbc56700 1 -- 172.21.15.173:0/1475026603 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563858b8d4a0 con 0x563858ae9400 2024-09-13T23:57:22.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.901+0000 7feecbc56700 1 -- 172.21.15.173:0/1475026603 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563858bad800 con 0x563858ae9400 2024-09-13T23:57:22.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.901+0000 7feecbc56700 1 -- 172.21.15.173:0/1475026603 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563858b8d600 con 0x563858ae9400 2024-09-13T23:57:22.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.901+0000 7feece49ff40 1 -- 172.21.15.173:0/1475026603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9400 msgr2=0x563858dce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:22.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.901+0000 7feece49ff40 1 --2- 172.21.15.173:0/1475026603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9400 0x563858dce580 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x563858dc9920 tx=0x563858bed920 comp rx=0 tx=0).stop 2024-09-13T23:57:22.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.901+0000 7feece49ff40 1 -- 172.21.15.173:0/1475026603 shutdown_connections 2024-09-13T23:57:22.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.901+0000 7feece49ff40 1 --2- 172.21.15.173:0/1475026603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9400 0x563858dce580 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:22.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.901+0000 7feece49ff40 1 -- 172.21.15.173:0/1475026603 >> 172.21.15.173:0/1475026603 conn(0x563858ae8c00 msgr2=0x563858be8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:22.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.901+0000 7feece49ff40 1 -- 172.21.15.173:0/1475026603 shutdown_connections 2024-09-13T23:57:22.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.901+0000 7feece49ff40 1 -- 172.21.15.173:0/1475026603 wait complete. 2024-09-13T23:57:22.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.901+0000 7feece49ff40 1 Processor -- start 2024-09-13T23:57:22.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.901+0000 7feece49ff40 1 -- start start 2024-09-13T23:57:22.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.901+0000 7feece49ff40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9000 0x563858dce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:22.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.901+0000 7feece49ff40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563858b76500 con 0x563858ae9000 2024-09-13T23:57:22.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.901+0000 7feeccc58700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9000 0x563858dce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:22.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.901+0000 7feeccc58700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9000 0x563858dce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34540/0 (socket says 172.21.15.173:34540) 2024-09-13T23:57:22.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.901+0000 7feeccc58700 1 -- 172.21.15.173:0/728521799 learned_addr learned my addr 172.21.15.173:0/728521799 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:22.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.905+0000 7feeccc58700 1 -- 172.21.15.173:0/728521799 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563858afbba0 con 0x563858ae9000 2024-09-13T23:57:22.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.905+0000 7feeccc58700 1 --2- 172.21.15.173:0/728521799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9000 0x563858dce580 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x5638598b3d70 tx=0x563858bedb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64fdf1632421a44 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:22.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.905+0000 7feecb455700 1 -- 172.21.15.173:0/728521799 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563858b8d4a0 con 0x563858ae9000 2024-09-13T23:57:22.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.905+0000 7feecb455700 1 -- 172.21.15.173:0/728521799 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563858badb00 con 0x563858ae9000 2024-09-13T23:57:22.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.905+0000 7feecb455700 1 -- 172.21.15.173:0/728521799 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563858b8d600 con 0x563858ae9000 2024-09-13T23:57:22.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.905+0000 7feece49ff40 1 -- 172.21.15.173:0/728521799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9000 msgr2=0x563858dce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:22.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.905+0000 7feece49ff40 1 --2- 172.21.15.173:0/728521799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9000 0x563858dce580 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x5638598b3d70 tx=0x563858bedb60 comp rx=0 tx=0).stop 2024-09-13T23:57:22.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.905+0000 7feece49ff40 1 -- 172.21.15.173:0/728521799 shutdown_connections 2024-09-13T23:57:22.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.905+0000 7feece49ff40 1 --2- 172.21.15.173:0/728521799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9000 0x563858dce580 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:22.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.905+0000 7feece49ff40 1 -- 172.21.15.173:0/728521799 >> 172.21.15.173:0/728521799 conn(0x563858ae8c00 msgr2=0x563858be9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:22.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.905+0000 7feece49ff40 1 -- 172.21.15.173:0/728521799 shutdown_connections 2024-09-13T23:57:22.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.905+0000 7feece49ff40 1 -- 172.21.15.173:0/728521799 wait complete. 2024-09-13T23:57:22.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.905+0000 7feece49ff40 1 Processor -- start 2024-09-13T23:57:22.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.905+0000 7feece49ff40 1 -- start start 2024-09-13T23:57:22.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.905+0000 7feece49ff40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9000 0x563858dce580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:22.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.905+0000 7feece49ff40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563858b763c0 con 0x563858ae9000 2024-09-13T23:57:22.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.905+0000 7feeccc58700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9000 0x563858dce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:22.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.905+0000 7feeccc58700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9000 0x563858dce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34544/0 (socket says 172.21.15.173:34544) 2024-09-13T23:57:22.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.905+0000 7feeccc58700 1 -- 172.21.15.173:0/318449477 learned_addr learned my addr 172.21.15.173:0/318449477 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:22.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.905+0000 7feeccc58700 1 -- 172.21.15.173:0/318449477 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563858afba00 con 0x563858ae9000 2024-09-13T23:57:22.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.905+0000 7feeccc58700 1 --2- 172.21.15.173:0/318449477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9000 0x563858dce580 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x5638598b3e60 tx=0x563858beda40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:22.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.909+0000 7feec9c52700 1 -- 172.21.15.173:0/318449477 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563858b8d8c0 con 0x563858ae9000 2024-09-13T23:57:22.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.909+0000 7feec9c52700 1 -- 172.21.15.173:0/318449477 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563858badc80 con 0x563858ae9000 2024-09-13T23:57:22.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.909+0000 7feece49ff40 1 -- 172.21.15.173:0/318449477 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563858afb860 con 0x563858ae9000 2024-09-13T23:57:22.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.909+0000 7feec9c52700 1 -- 172.21.15.173:0/318449477 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563858b8d4a0 con 0x563858ae9000 2024-09-13T23:57:22.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.909+0000 7feece49ff40 1 -- 172.21.15.173:0/318449477 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563858afb6c0 con 0x563858ae9000 2024-09-13T23:57:22.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.909+0000 7feece49ff40 1 Processor -- start 2024-09-13T23:57:22.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.909+0000 7feece49ff40 1 -- start start 2024-09-13T23:57:22.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.909+0000 7feece49ff40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9800 0x563858dceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:22.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.909+0000 7feece49ff40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563858b76000 con 0x563858ae9800 2024-09-13T23:57:22.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.909+0000 7feec9c52700 1 -- 172.21.15.173:0/318449477 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x563858be2b00 con 0x563858ae9000 2024-09-13T23:57:22.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.909+0000 7feecd459700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9800 0x563858dceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:22.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.909+0000 7feecd459700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9800 0x563858dceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34548/0 (socket says 172.21.15.173:34548) 2024-09-13T23:57:22.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.909+0000 7feecd459700 1 -- 172.21.15.173:0/1918558061 learned_addr learned my addr 172.21.15.173:0/1918558061 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:22.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.909+0000 7feec9c52700 1 --2- 172.21.15.173:0/318449477 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563858e92000 0x563858dcf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:22.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.909+0000 7feec9c52700 1 -- 172.21.15.173:0/318449477 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x563858b4f180 con 0x563858ae9000 2024-09-13T23:57:22.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.909+0000 7feeccc58700 1 --2- 172.21.15.173:0/318449477 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563858e92000 0x563858dcf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:22.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.909+0000 7feecd459700 1 -- 172.21.15.173:0/1918558061 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563858afa000 con 0x563858ae9800 2024-09-13T23:57:22.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.909+0000 7feecd459700 1 --2- 172.21.15.173:0/1918558061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9800 0x563858dceb00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x563858e74060 tx=0x563858e4cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a22145ffe476035 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:22.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.909+0000 7feeccc58700 1 --2- 172.21.15.173:0/318449477 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563858e92000 0x563858dcf080 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x563858e17500 tx=0x563858e4c240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:22.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.909+0000 7feec744d700 1 -- 172.21.15.173:0/1918558061 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563858b8d8c0 con 0x563858ae9800 2024-09-13T23:57:22.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.909+0000 7feec744d700 1 -- 172.21.15.173:0/1918558061 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563858eac000 con 0x563858ae9800 2024-09-13T23:57:22.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.909+0000 7feec744d700 1 -- 172.21.15.173:0/1918558061 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563858b8d4a0 con 0x563858ae9800 2024-09-13T23:57:22.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.913+0000 7feece49ff40 1 -- 172.21.15.173:0/1918558061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9800 msgr2=0x563858dceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:22.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.913+0000 7feece49ff40 1 --2- 172.21.15.173:0/1918558061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9800 0x563858dceb00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x563858e74060 tx=0x563858e4cde0 comp rx=0 tx=0).stop 2024-09-13T23:57:22.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.913+0000 7feece49ff40 1 -- 172.21.15.173:0/1918558061 shutdown_connections 2024-09-13T23:57:22.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.913+0000 7feece49ff40 1 --2- 172.21.15.173:0/1918558061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9800 0x563858dceb00 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:22.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.913+0000 7feece49ff40 1 -- 172.21.15.173:0/1918558061 >> 172.21.15.173:0/1918558061 conn(0x563858ae9400 msgr2=0x563858be9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:22.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.913+0000 7feece49ff40 1 -- 172.21.15.173:0/1918558061 shutdown_connections 2024-09-13T23:57:22.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.913+0000 7feece49ff40 1 -- 172.21.15.173:0/1918558061 wait complete. 2024-09-13T23:57:22.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.913+0000 7feece49ff40 1 Processor -- start 2024-09-13T23:57:22.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.913+0000 7feece49ff40 1 -- start start 2024-09-13T23:57:22.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.913+0000 7feece49ff40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9800 0x563858dceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:22.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.913+0000 7feece49ff40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563858b0e640 con 0x563858ae9800 2024-09-13T23:57:22.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.913+0000 7feecd459700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9800 0x563858dceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:22.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.913+0000 7feecd459700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9800 0x563858dceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34556/0 (socket says 172.21.15.173:34556) 2024-09-13T23:57:22.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.913+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 learned_addr learned my addr 172.21.15.173:0/2739609295 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:22.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.913+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563858afaea0 con 0x563858ae9800 2024-09-13T23:57:22.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.913+0000 7feecd459700 1 --2- 172.21.15.173:0/2739609295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9800 0x563858dceb00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x5638598b3f80 tx=0x563858e4c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:22.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.913+0000 7feec5c4a700 1 -- 172.21.15.173:0/2739609295 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563858b8db80 con 0x563858ae9800 2024-09-13T23:57:22.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.913+0000 7feec5c4a700 1 -- 172.21.15.173:0/2739609295 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563858eac180 con 0x563858ae9800 2024-09-13T23:57:22.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.913+0000 7feec5c4a700 1 -- 172.21.15.173:0/2739609295 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563858b8d8c0 con 0x563858ae9800 2024-09-13T23:57:22.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.913+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563858afa820 con 0x563858ae9800 2024-09-13T23:57:22.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.913+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563858afa9c0 con 0x563858ae9800 2024-09-13T23:57:22.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feece49ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:22.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feec5c4a700 1 -- 172.21.15.173:0/2739609295 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x563858be2dc0 con 0x563858ae9800 2024-09-13T23:57:22.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feec5c4a700 1 --2- 172.21.15.173:0/2739609295 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563858e92c00 0x563858dcf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:22.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feec5c4a700 1 -- 172.21.15.173:0/2739609295 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x563858b4f340 con 0x563858ae9800 2024-09-13T23:57:22.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feecc457700 1 --2- 172.21.15.173:0/2739609295 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563858e92c00 0x563858dcf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:22.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feece49ff40 1 --2- 172.21.15.173:0/2739609295 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563858e93000 0x563858dcfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:22.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93400 con 0x563858e93000 2024-09-13T23:57:22.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feecd459700 1 --2- 172.21.15.173:0/2739609295 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563858e93000 0x563858dcfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:22.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feecc457700 1 --2- 172.21.15.173:0/2739609295 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563858e92c00 0x563858dcf600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x563858dc9920 tx=0x563858bed800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:22.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feecd459700 1 --2- 172.21.15.173:0/2739609295 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563858e93000 0x563858dcfb80 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:22.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563858f2cb40 con 0x563858e93000 2024-09-13T23:57:22.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feece49ff40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:22.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feece49ff40 20 realm 2024-09-13T23:57:22.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feece49ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:22.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93000 2024-09-13T23:57:22.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563858f2cb40 con 0x563858e93000 2024-09-13T23:57:22.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feece49ff40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:22.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feece49ff40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:22.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feece49ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:22.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93c00 con 0x563858e93000 2024-09-13T23:57:22.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563858f2cb40 con 0x563858e93000 2024-09-13T23:57:22.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feece49ff40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:22.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feece49ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:22.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feece49ff40 1 --2- 172.21.15.173:0/2739609295 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563858e93400 0x563858dd0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:22.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.917+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93400 2024-09-13T23:57:22.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.921+0000 7feeccc58700 1 --2- 172.21.15.173:0/2739609295 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563858e93400 0x563858dd0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:22.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.921+0000 7feeccc58700 1 --2- 172.21.15.173:0/2739609295 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563858e93400 0x563858dd0100 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:22.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.921+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x563858f2d200 con 0x563858e93400 2024-09-13T23:57:22.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.921+0000 7feece49ff40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:22.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.921+0000 7feece49ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:22.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.921+0000 7feece49ff40 1 --2- 172.21.15.173:0/2739609295 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563858e93c00 0x563858dd0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:22.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.921+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f56000 con 0x563858e93c00 2024-09-13T23:57:22.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.921+0000 7feecc457700 1 --2- 172.21.15.173:0/2739609295 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563858e93c00 0x563858dd0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:22.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.921+0000 7feecc457700 1 --2- 172.21.15.173:0/2739609295 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563858e93c00 0x563858dd0680 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:22.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.921+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x563858f2d440 con 0x563858e93c00 2024-09-13T23:57:22.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.921+0000 7feece49ff40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:22.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.921+0000 7feece49ff40 20 searching for the correct realm 2024-09-13T23:57:22.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.921+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f56400 con 0x563858e93c00 2024-09-13T23:57:22.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.921+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x563858f2d440 con 0x563858e93c00 2024-09-13T23:57:22.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.921+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f56000 con 0x563858e93400 2024-09-13T23:57:22.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.925+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2d200 con 0x563858e93400 2024-09-13T23:57:22.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.925+0000 7feeccc58700 1 --2- 172.21.15.173:0/2739609295 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563858f56000 0x563858dd0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:22.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.925+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858f56000 2024-09-13T23:57:22.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.925+0000 7feecd459700 1 --2- 172.21.15.173:0/2739609295 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563858f56000 0x563858dd0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:22.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.925+0000 7feecd459700 1 --2- 172.21.15.173:0/2739609295 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563858f56000 0x563858dd0c00 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:22.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.925+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2cb40 con 0x563858f56000 2024-09-13T23:57:22.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.925+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858f56000 2024-09-13T23:57:22.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.925+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x563858f2cb40 con 0x563858f56000 2024-09-13T23:57:22.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.925+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93000 2024-09-13T23:57:22.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.925+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2cb40 con 0x563858e93000 2024-09-13T23:57:22.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.925+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93c00 2024-09-13T23:57:22.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.925+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2d440 con 0x563858e93c00 2024-09-13T23:57:22.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.925+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93000 2024-09-13T23:57:22.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.925+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2cb40 con 0x563858e93000 2024-09-13T23:57:22.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.925+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93400 2024-09-13T23:57:22.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.929+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2d200 con 0x563858e93400 2024-09-13T23:57:22.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.929+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93400 2024-09-13T23:57:22.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.929+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2d200 con 0x563858e93400 2024-09-13T23:57:22.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.929+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93000 2024-09-13T23:57:22.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.929+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2cb40 con 0x563858e93000 2024-09-13T23:57:22.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.929+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858f56000 2024-09-13T23:57:22.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.929+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2cb40 con 0x563858f56000 2024-09-13T23:57:22.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.929+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93000 2024-09-13T23:57:22.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.929+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2cb40 con 0x563858e93000 2024-09-13T23:57:22.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.929+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858f56000 2024-09-13T23:57:22.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.929+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2cb40 con 0x563858f56000 2024-09-13T23:57:22.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.929+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93400 2024-09-13T23:57:22.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.933+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2d200 con 0x563858e93400 2024-09-13T23:57:22.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.933+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93c00 2024-09-13T23:57:22.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.933+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2d440 con 0x563858e93c00 2024-09-13T23:57:22.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.933+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93000 2024-09-13T23:57:22.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.933+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2cb40 con 0x563858e93000 2024-09-13T23:57:22.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.933+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93400 2024-09-13T23:57:22.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.933+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2d200 con 0x563858e93400 2024-09-13T23:57:22.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.933+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93c00 2024-09-13T23:57:22.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.933+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2d440 con 0x563858e93c00 2024-09-13T23:57:22.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.933+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93000 2024-09-13T23:57:22.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.933+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2cb40 con 0x563858e93000 2024-09-13T23:57:22.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.933+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93000 2024-09-13T23:57:22.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.933+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2cb40 con 0x563858e93000 2024-09-13T23:57:22.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.937+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93000 2024-09-13T23:57:22.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.937+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2cb40 con 0x563858e93000 2024-09-13T23:57:22.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.937+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93c00 2024-09-13T23:57:22.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.937+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2d440 con 0x563858e93c00 2024-09-13T23:57:22.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.937+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858f56000 2024-09-13T23:57:22.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.937+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2cb40 con 0x563858f56000 2024-09-13T23:57:22.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.937+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93000 2024-09-13T23:57:22.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.937+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2cb40 con 0x563858e93000 2024-09-13T23:57:22.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.937+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858f56000 2024-09-13T23:57:22.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.937+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2cb40 con 0x563858f56000 2024-09-13T23:57:22.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.937+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93c00 2024-09-13T23:57:22.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.937+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2d440 con 0x563858e93c00 2024-09-13T23:57:22.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.937+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858f56000 2024-09-13T23:57:22.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.937+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2cb40 con 0x563858f56000 2024-09-13T23:57:22.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.937+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93400 2024-09-13T23:57:22.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.941+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2d200 con 0x563858e93400 2024-09-13T23:57:22.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.941+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93400 2024-09-13T23:57:22.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.941+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2d200 con 0x563858e93400 2024-09-13T23:57:22.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.941+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93c00 2024-09-13T23:57:22.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.941+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2d440 con 0x563858e93c00 2024-09-13T23:57:22.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.941+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93400 2024-09-13T23:57:22.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.941+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x563858f2d200 con 0x563858e93400 2024-09-13T23:57:22.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.941+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858e93400 2024-09-13T23:57:22.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.941+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563858f2d200 con 0x563858e93400 2024-09-13T23:57:22.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.941+0000 7feece49ff40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:22.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.941+0000 7feece49ff40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:22.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.941+0000 7feece49ff40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:22.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.941+0000 7feece49ff40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:22.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.941+0000 7feece49ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:22.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.941+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f56800 con 0x563858e93000 2024-09-13T23:57:22.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563858f2cb40 con 0x563858e93000 2024-09-13T23:57:22.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feece49ff40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:22.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feece49ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:22.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f56c00 con 0x563858e93400 2024-09-13T23:57:22.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x563858f2d200 con 0x563858e93400 2024-09-13T23:57:22.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feece49ff40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:22.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feece49ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:22.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57000 con 0x563858f56000 2024-09-13T23:57:22.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x563858f2cb40 con 0x563858f56000 2024-09-13T23:57:22.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feece49ff40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:22.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feece49ff40 20 zone default found 2024-09-13T23:57:22.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feece49ff40 4 Realm: () 2024-09-13T23:57:22.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feece49ff40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:22.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feece49ff40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:22.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feece49ff40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:22.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feece49ff40 20 zonegroup default 2024-09-13T23:57:22.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feece49ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:22.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57400 con 0x563858f56000 2024-09-13T23:57:22.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x563858f2cb40 con 0x563858f56000 2024-09-13T23:57:22.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feece49ff40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:22.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feece49ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:22.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57800 con 0x563858e93c00 2024-09-13T23:57:22.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x563858f2d440 con 0x563858e93c00 2024-09-13T23:57:22.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feece49ff40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:22.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feece49ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:22.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.945+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57c00 con 0x563858e93c00 2024-09-13T23:57:22.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.949+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x563858f2d440 con 0x563858e93c00 2024-09-13T23:57:22.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.949+0000 7feece49ff40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:22.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.949+0000 7feece49ff40 20 started sync module instance, tier type = 2024-09-13T23:57:22.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.949+0000 7feece49ff40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:22.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.949+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f60000 con 0x563858e93400 2024-09-13T23:57:22.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.949+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v35'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858e93400 2024-09-13T23:57:22.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.949+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94800008993536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f60400 con 0x563858e93400 2024-09-13T23:57:22.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.949+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f60800 con 0x563858e93000 2024-09-13T23:57:22.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.953+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v35'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563858f2cb40 con 0x563858e93000 2024-09-13T23:57:22.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.953+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94800008993536] v35'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858e93400 2024-09-13T23:57:22.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.953+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94800008994688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f60c00 con 0x563858e93000 2024-09-13T23:57:22.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.953+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f61000 con 0x563858e93400 2024-09-13T23:57:22.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.957+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94800008994688] v35'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563858f2cb40 con 0x563858e93000 2024-09-13T23:57:22.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.957+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v35'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858e93400 2024-09-13T23:57:22.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.957+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94800008995840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f61400 con 0x563858e93400 2024-09-13T23:57:22.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.957+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f61800 con 0x563858f56000 2024-09-13T23:57:22.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.957+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94800008995840] v35'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858e93400 2024-09-13T23:57:22.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.961+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v35'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563858f2cb40 con 0x563858f56000 2024-09-13T23:57:22.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.961+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94800008996992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f61c00 con 0x563858f56000 2024-09-13T23:57:22.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.961+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f60800 con 0x563858e93400 2024-09-13T23:57:22.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.961+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94800008996992] v35'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563858f2cb40 con 0x563858f56000 2024-09-13T23:57:22.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.961+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v35'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858e93400 2024-09-13T23:57:22.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.961+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94800008998144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f60000 con 0x563858e93400 2024-09-13T23:57:22.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.961+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f56800 con 0x563858e93c00 2024-09-13T23:57:22.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.965+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v35'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563858f2d440 con 0x563858e93c00 2024-09-13T23:57:22.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.965+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94800008999296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57000 con 0x563858e93c00 2024-09-13T23:57:22.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.965+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57400 con 0x563858e93c00 2024-09-13T23:57:22.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.965+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94800008998144] v35'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858e93400 2024-09-13T23:57:22.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.965+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v35'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563858f2d440 con 0x563858e93c00 2024-09-13T23:57:22.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.965+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94800009000448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f56c00 con 0x563858e93c00 2024-09-13T23:57:22.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.965+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858e93800 con 0x563858f56000 2024-09-13T23:57:22.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.965+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94800008999296] v35'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563858f2d440 con 0x563858e93c00 2024-09-13T23:57:22.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.969+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94800009000448] v35'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563858f2d440 con 0x563858e93c00 2024-09-13T23:57:22.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.969+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v35'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563858f2cb40 con 0x563858f56000 2024-09-13T23:57:22.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.969+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94800009001600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f60400 con 0x563858f56000 2024-09-13T23:57:22.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.969+0000 7feece49ff40 20 add_watcher() i=0 2024-09-13T23:57:22.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.969+0000 7feece49ff40 20 add_watcher() i=1 2024-09-13T23:57:22.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.969+0000 7feece49ff40 20 add_watcher() i=2 2024-09-13T23:57:22.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.969+0000 7feece49ff40 20 add_watcher() i=3 2024-09-13T23:57:22.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.969+0000 7feece49ff40 20 add_watcher() i=4 2024-09-13T23:57:22.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.969+0000 7feece49ff40 20 add_watcher() i=5 2024-09-13T23:57:22.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.969+0000 7feece49ff40 20 add_watcher() i=6 2024-09-13T23:57:22.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.973+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94800009001600] v35'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563858f2cb40 con 0x563858f56000 2024-09-13T23:57:22.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.973+0000 7feece49ff40 20 add_watcher() i=7 2024-09-13T23:57:22.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.973+0000 7feece49ff40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:22.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.973+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f61000 con 0x563858e93000 2024-09-13T23:57:22.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.973+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x563858f2cb40 con 0x563858e93000 2024-09-13T23:57:22.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.973+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94800010698752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f61400 con 0x563858e93000 2024-09-13T23:57:22.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.973+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94800010698752] v35'152 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x563858f2cb40 con 0x563858e93000 2024-09-13T23:57:22.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.973+0000 7feeb3c26700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:22.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.977+0000 7feece49ff40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:22.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.977+0000 7feece49ff40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:22.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.977+0000 7feece49ff40 1 Processor -- start 2024-09-13T23:57:22.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.977+0000 7feece49ff40 1 -- start start 2024-09-13T23:57:22.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.977+0000 7feece49ff40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858f56400 0x563858dd1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:22.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.977+0000 7feece49ff40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563858b0e780 con 0x563858f56400 2024-09-13T23:57:22.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.977+0000 7feecc457700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858f56400 0x563858dd1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:22.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.977+0000 7feecc457700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858f56400 0x563858dd1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34558/0 (socket says 172.21.15.173:34558) 2024-09-13T23:57:22.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.977+0000 7feecc457700 1 -- 172.21.15.173:0/1653920754 learned_addr learned my addr 172.21.15.173:0/1653920754 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:22.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.977+0000 7feecc457700 1 -- 172.21.15.173:0/1653920754 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563858afab60 con 0x563858f56400 2024-09-13T23:57:22.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.977+0000 7feecc457700 1 --2- 172.21.15.173:0/1653920754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858f56400 0x563858dd1180 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x563858f6e0c0 tx=0x563858bed980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6ae4cf07fe1d6d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:22.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.977+0000 7feeb3425700 1 -- 172.21.15.173:0/1653920754 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563858b8d760 con 0x563858f56400 2024-09-13T23:57:22.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.977+0000 7feeb3425700 1 -- 172.21.15.173:0/1653920754 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563858eac600 con 0x563858f56400 2024-09-13T23:57:22.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.977+0000 7feeb3425700 1 -- 172.21.15.173:0/1653920754 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563858f78000 con 0x563858f56400 2024-09-13T23:57:22.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.977+0000 7feece49ff40 1 -- 172.21.15.173:0/1653920754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858f56400 msgr2=0x563858dd1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:22.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.977+0000 7feece49ff40 1 --2- 172.21.15.173:0/1653920754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858f56400 0x563858dd1180 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x563858f6e0c0 tx=0x563858bed980 comp rx=0 tx=0).stop 2024-09-13T23:57:22.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.977+0000 7feece49ff40 1 -- 172.21.15.173:0/1653920754 shutdown_connections 2024-09-13T23:57:22.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.977+0000 7feece49ff40 1 --2- 172.21.15.173:0/1653920754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858f56400 0x563858dd1180 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.977+0000 7feece49ff40 1 -- 172.21.15.173:0/1653920754 >> 172.21.15.173:0/1653920754 conn(0x563858f60800 msgr2=0x563858bea000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.977+0000 7feece49ff40 1 -- 172.21.15.173:0/1653920754 shutdown_connections 2024-09-13T23:57:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.977+0000 7feece49ff40 1 -- 172.21.15.173:0/1653920754 wait complete. 2024-09-13T23:57:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.981+0000 7feece49ff40 1 Processor -- start 2024-09-13T23:57:22.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.981+0000 7feece49ff40 1 -- start start 2024-09-13T23:57:22.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.981+0000 7feece49ff40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858f56400 0x563858dd1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:22.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.981+0000 7feece49ff40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563858b76000 con 0x563858f56400 2024-09-13T23:57:22.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.981+0000 7feecc457700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858f56400 0x563858dd1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:22.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.981+0000 7feecc457700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858f56400 0x563858dd1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34574/0 (socket says 172.21.15.173:34574) 2024-09-13T23:57:22.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.981+0000 7feecc457700 1 -- 172.21.15.173:0/3077764286 learned_addr learned my addr 172.21.15.173:0/3077764286 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:22.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.981+0000 7feecc457700 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563858afad00 con 0x563858f56400 2024-09-13T23:57:22.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.981+0000 7feecc457700 1 --2- 172.21.15.173:0/3077764286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858f56400 0x563858dd1180 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x563858f6e2d0 tx=0x563858f405a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:22.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.981+0000 7feeb1c22700 1 -- 172.21.15.173:0/3077764286 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563858f78160 con 0x563858f56400 2024-09-13T23:57:22.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.981+0000 7feeb1c22700 1 -- 172.21.15.173:0/3077764286 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563858eac300 con 0x563858f56400 2024-09-13T23:57:22.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.981+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563858afa340 con 0x563858f56400 2024-09-13T23:57:22.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.981+0000 7feeb1c22700 1 -- 172.21.15.173:0/3077764286 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563858f782c0 con 0x563858f56400 2024-09-13T23:57:22.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.981+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563858afbd40 con 0x563858f56400 2024-09-13T23:57:22.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.981+0000 7feeb1c22700 1 -- 172.21.15.173:0/3077764286 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x563858be3b80 con 0x563858f56400 2024-09-13T23:57:22.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.981+0000 7feeb1c22700 1 --2- 172.21.15.173:0/3077764286 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563858e93800 0x563858ff2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:22.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.981+0000 7feeb1c22700 1 -- 172.21.15.173:0/3077764286 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x563858b4f500 con 0x563858f56400 2024-09-13T23:57:22.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.985+0000 7feecd459700 1 --2- 172.21.15.173:0/3077764286 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563858e93800 0x563858ff2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:22.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.985+0000 7feece49ff40 1 --2- 172.21.15.173:0/3077764286 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563858f57800 0x563858dd1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:22.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.985+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57c00 con 0x563858f57800 2024-09-13T23:57:22.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.985+0000 7feecd459700 1 --2- 172.21.15.173:0/3077764286 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563858e93800 0x563858ff2000 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x563858ef57a0 tx=0x563858f415c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:22.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.985+0000 7feeccc58700 1 --2- 172.21.15.173:0/3077764286 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563858f57800 0x563858dd1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:22.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.985+0000 7feeccc58700 1 --2- 172.21.15.173:0/3077764286 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563858f57800 0x563858dd1700 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:22.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.985+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v35'27 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:22.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.985+0000 7feece49ff40 1 --2- 172.21.15.173:0/3077764286 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563858f56800 0x563858ff2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:22.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.985+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f60c00 con 0x563858f56800 2024-09-13T23:57:22.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.985+0000 7feecc457700 1 --2- 172.21.15.173:0/3077764286 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563858f56800 0x563858ff2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:22.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.989+0000 7feecc457700 1 --2- 172.21.15.173:0/3077764286 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563858f56800 0x563858ff2580 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:22.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.989+0000 7feecc457700 1 -- 172.21.15.173:0/3077764286 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v35'18 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563858f2d440 con 0x563858f56800 2024-09-13T23:57:22.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.989+0000 7feece49ff40 1 --2- 172.21.15.173:0/3077764286 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563858f61800 0x563858ff2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:22.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.989+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f61c00 con 0x563858f61800 2024-09-13T23:57:22.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.989+0000 7feecd459700 1 --2- 172.21.15.173:0/3077764286 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563858f61800 0x563858ff2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:22.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.989+0000 7feecd459700 1 --2- 172.21.15.173:0/3077764286 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563858f61800 0x563858ff2b00 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:22.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.993+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v35'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:22.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.993+0000 7feece49ff40 1 --2- 172.21.15.173:0/3077764286 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563858f60400 0x563858ff3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:22.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.993+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859018000 con 0x563858f60400 2024-09-13T23:57:22.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.993+0000 7feeccc58700 1 --2- 172.21.15.173:0/3077764286 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563858f60400 0x563858ff3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:22.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.993+0000 7feeccc58700 1 --2- 172.21.15.173:0/3077764286 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563858f60400 0x563858ff3080 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.997+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v35'153 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.997+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859018400 con 0x563858f57800 2024-09-13T23:57:23.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.997+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v35'44 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:22.997+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859018800 con 0x563858f61800 2024-09-13T23:57:23.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.001+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v35'29 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.001+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859018c00 con 0x563858f57800 2024-09-13T23:57:23.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.005+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v35'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.005+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859019000 con 0x563858f60400 2024-09-13T23:57:23.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.005+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v35'29 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.005+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859019400 con 0x563858f57800 2024-09-13T23:57:23.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.009+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v35'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.009+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859019800 con 0x563858f57800 2024-09-13T23:57:23.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.013+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v35'24 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.013+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859019c00 con 0x563858f57800 2024-09-13T23:57:23.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.013+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v35'45 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.017+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859018000 con 0x563858f61800 2024-09-13T23:57:23.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.017+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v35'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.017+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859018400 con 0x563858f57800 2024-09-13T23:57:23.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.021+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v35'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.021+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859018c00 con 0x563858f60400 2024-09-13T23:57:23.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.021+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v35'35 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.025+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57c00 con 0x563858f60400 2024-09-13T23:57:23.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.025+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v35'154 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.025+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f60000 con 0x563858f57800 2024-09-13T23:57:23.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.029+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v35'38 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.029+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859019000 con 0x563858f57800 2024-09-13T23:57:23.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.029+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v35'46 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.033+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859019400 con 0x563858f61800 2024-09-13T23:57:23.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.033+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v35'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.033+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859019800 con 0x563858f57800 2024-09-13T23:57:23.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.037+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v35'26 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.037+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859019c00 con 0x563858f60400 2024-09-13T23:57:23.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.037+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v35'155 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.041+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859018400 con 0x563858f57800 2024-09-13T23:57:23.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.041+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v35'39 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.041+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859018c00 con 0x563858f57800 2024-09-13T23:57:23.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.045+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v35'28 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.045+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f60000 con 0x563858f61800 2024-09-13T23:57:23.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.045+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v35'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.049+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f61000 con 0x563858f57800 2024-09-13T23:57:23.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.049+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v35'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.049+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f61400 con 0x563858f61800 2024-09-13T23:57:23.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.053+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v35'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.053+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f61c00 con 0x563858f61800 2024-09-13T23:57:23.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.053+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v35'30 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.053+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57c00 con 0x563858f61800 2024-09-13T23:57:23.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.057+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v35'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.057+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859034000 con 0x563858f57800 2024-09-13T23:57:23.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.061+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v35'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.061+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859034400 con 0x563858f60400 2024-09-13T23:57:23.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.061+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v35'30 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.061+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859034800 con 0x563858f57800 2024-09-13T23:57:23.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.065+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v35'40 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.065+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859034c00 con 0x563858f60400 2024-09-13T23:57:23.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.069+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v35'36 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.069+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859035000 con 0x563858f56800 2024-09-13T23:57:23.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.069+0000 7feecc457700 1 -- 172.21.15.173:0/3077764286 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v35'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x563858f2d440 con 0x563858f56800 2024-09-13T23:57:23.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.073+0000 7feeaf41d700 20 reqs_thread_entry: start 2024-09-13T23:57:23.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.073+0000 7feece49ff40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:23.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.073+0000 7feece49ff40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:23.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.073+0000 7feeacc18700 20 reqs_thread_entry: start 2024-09-13T23:57:23.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.073+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859035c00 con 0x563858f57800 2024-09-13T23:57:23.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.073+0000 7feead419700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:53 2024 2024-09-13T23:57:23.080 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:23.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.073+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(33 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.073+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908e000 con 0x563858f57800 2024-09-13T23:57:23.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.077+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(34 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.077+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:35 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908e400 con 0x563858f57800 2024-09-13T23:57:23.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.077+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(35 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.077+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:36 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908e800 con 0x563858f56800 2024-09-13T23:57:23.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.077+0000 7feecc457700 1 -- 172.21.15.173:0/3077764286 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(36 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x563858f2d440 con 0x563858f56800 2024-09-13T23:57:23.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.077+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:37 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908ec00 con 0x563858f56800 2024-09-13T23:57:23.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.077+0000 7feecc457700 1 -- 172.21.15.173:0/3077764286 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(37 gc.1 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x563858f2d440 con 0x563858f56800 2024-09-13T23:57:23.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.077+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:38 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908f000 con 0x563858f56800 2024-09-13T23:57:23.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.077+0000 7feecc457700 1 -- 172.21.15.173:0/3077764286 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(38 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x563858f2d440 con 0x563858f56800 2024-09-13T23:57:23.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.077+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:39 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908f400 con 0x563858f61800 2024-09-13T23:57:23.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.081+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(39 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.081+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:40 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908f800 con 0x563858f61800 2024-09-13T23:57:23.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.081+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(40 gc.2 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.081+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:41 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908fc00 con 0x563858f61800 2024-09-13T23:57:23.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.081+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(41 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.081+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:42 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908f400 con 0x563858f60400 2024-09-13T23:57:23.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.081+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(42 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.081+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:43 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908f800 con 0x563858f60400 2024-09-13T23:57:23.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.081+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(43 gc.3 [call out=24b] v0'0 uv15 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.081+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:44 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908fc00 con 0x563858f60400 2024-09-13T23:57:23.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.081+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(44 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.081+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908e800 con 0x563858f57800 2024-09-13T23:57:23.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.085+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(45 gc.4 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.085+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:46 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859035000 con 0x563858f57800 2024-09-13T23:57:23.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.085+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(46 gc.4 [call out=24b] v0'0 uv13 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.085+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:47 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859034000 con 0x563858f57800 2024-09-13T23:57:23.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.085+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(47 gc.4 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.085+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:48 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859034400 con 0x563858f61800 2024-09-13T23:57:23.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.089+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(48 gc.5 [call out=15b] v0'0 uv12 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.089+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:49 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859034800 con 0x563858f61800 2024-09-13T23:57:23.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.089+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(49 gc.5 [call out=24b] v0'0 uv12 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.089+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:50 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859034c00 con 0x563858f61800 2024-09-13T23:57:23.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.089+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(50 gc.5 [call out=15b] v0'0 uv12 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.089+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:51 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859035c00 con 0x563858f57800 2024-09-13T23:57:23.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.089+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(51 gc.6 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.089+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f60000 con 0x563858f57800 2024-09-13T23:57:23.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.089+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(52 gc.6 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.089+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f61400 con 0x563858f57800 2024-09-13T23:57:23.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.093+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(53 gc.6 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.093+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:54 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f61c00 con 0x563858f60400 2024-09-13T23:57:23.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.093+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(54 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.093+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:55 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f60c00 con 0x563858f60400 2024-09-13T23:57:23.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.093+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(55 gc.7 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.093+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:56 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f61000 con 0x563858f60400 2024-09-13T23:57:23.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.093+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(56 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.093+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:57 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57c00 con 0x563858f57800 2024-09-13T23:57:23.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.097+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== osd_op_reply(57 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.097+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:58 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57000 con 0x563858f57800 2024-09-13T23:57:23.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.097+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== osd_op_reply(58 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.097+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:59 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57400 con 0x563858f57800 2024-09-13T23:57:23.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.097+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 27 ==== osd_op_reply(59 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.097+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:60 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908f400 con 0x563858f57800 2024-09-13T23:57:23.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.097+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 28 ==== osd_op_reply(60 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.097+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:61 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908f800 con 0x563858f57800 2024-09-13T23:57:23.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.097+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 29 ==== osd_op_reply(61 gc.9 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.097+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:62 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908fc00 con 0x563858f57800 2024-09-13T23:57:23.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.101+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 30 ==== osd_op_reply(62 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.101+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:63 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908e800 con 0x563858f57800 2024-09-13T23:57:23.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.101+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 31 ==== osd_op_reply(63 gc.10 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.101+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908e000 con 0x563858f57800 2024-09-13T23:57:23.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.101+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 32 ==== osd_op_reply(64 gc.10 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.101+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908e400 con 0x563858f57800 2024-09-13T23:57:23.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.101+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 33 ==== osd_op_reply(65 gc.10 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.101+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:66 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f60000 con 0x563858f61800 2024-09-13T23:57:23.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.105+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(66 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.105+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:67 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f61400 con 0x563858f61800 2024-09-13T23:57:23.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.105+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(67 gc.11 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.105+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:68 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859035000 con 0x563858f61800 2024-09-13T23:57:23.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.105+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(68 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.105+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859034000 con 0x563858f57800 2024-09-13T23:57:23.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.105+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 34 ==== osd_op_reply(69 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.105+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:70 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859035c00 con 0x563858f57800 2024-09-13T23:57:23.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.105+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 35 ==== osd_op_reply(70 gc.12 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.105+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908f400 con 0x563858f57800 2024-09-13T23:57:23.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.109+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 36 ==== osd_op_reply(71 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.109+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:72 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908f800 con 0x563858f60400 2024-09-13T23:57:23.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.109+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(72 gc.13 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.109+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:73 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908fc00 con 0x563858f60400 2024-09-13T23:57:23.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.109+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(73 gc.13 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.109+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:74 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908e800 con 0x563858f60400 2024-09-13T23:57:23.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.109+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(74 gc.13 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.109+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:75 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57c00 con 0x563858f60400 2024-09-13T23:57:23.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.109+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(75 gc.14 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.109+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57000 con 0x563858f60400 2024-09-13T23:57:23.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.113+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(76 gc.14 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.113+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:77 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57400 con 0x563858f60400 2024-09-13T23:57:23.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.113+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(77 gc.14 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.113+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:78 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f61c00 con 0x563858f57800 2024-09-13T23:57:23.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.113+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 37 ==== osd_op_reply(78 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.113+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:79 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f60c00 con 0x563858f57800 2024-09-13T23:57:23.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.113+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 38 ==== osd_op_reply(79 gc.15 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.113+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:80 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f61000 con 0x563858f57800 2024-09-13T23:57:23.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.113+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 39 ==== osd_op_reply(80 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.113+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:81 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57c00 con 0x563858f57800 2024-09-13T23:57:23.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.117+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 40 ==== osd_op_reply(81 gc.16 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.117+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:82 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57000 con 0x563858f57800 2024-09-13T23:57:23.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.117+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 41 ==== osd_op_reply(82 gc.16 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.117+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:83 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57400 con 0x563858f57800 2024-09-13T23:57:23.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.117+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 42 ==== osd_op_reply(83 gc.16 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.117+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:84 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908e000 con 0x563858f61800 2024-09-13T23:57:23.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.117+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(84 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.117+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:85 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908e400 con 0x563858f61800 2024-09-13T23:57:23.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.121+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== osd_op_reply(85 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.121+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:86 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908f400 con 0x563858f61800 2024-09-13T23:57:23.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.121+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 20 ==== osd_op_reply(86 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.121+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:87 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908f800 con 0x563858f57800 2024-09-13T23:57:23.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.121+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 43 ==== osd_op_reply(87 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.121+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:88 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908fc00 con 0x563858f57800 2024-09-13T23:57:23.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.121+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 44 ==== osd_op_reply(88 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.121+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:89 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908e800 con 0x563858f57800 2024-09-13T23:57:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.121+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 45 ==== osd_op_reply(89 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.125+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:90 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859034000 con 0x563858f60400 2024-09-13T23:57:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.125+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(90 gc.19 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.125+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:91 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859035c00 con 0x563858f60400 2024-09-13T23:57:23.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.125+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(91 gc.19 [call out=24b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.125+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:92 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908e000 con 0x563858f60400 2024-09-13T23:57:23.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.125+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(92 gc.19 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.125+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:93 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908e400 con 0x563858f57800 2024-09-13T23:57:23.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.125+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 46 ==== osd_op_reply(93 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.125+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:94 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859034400 con 0x563858f57800 2024-09-13T23:57:23.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.125+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 47 ==== osd_op_reply(94 gc.20 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.125+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:95 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859034800 con 0x563858f57800 2024-09-13T23:57:23.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.129+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 48 ==== osd_op_reply(95 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.129+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:96 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859034c00 con 0x563858f57800 2024-09-13T23:57:23.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.129+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 49 ==== osd_op_reply(96 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.129+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:97 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859035000 con 0x563858f57800 2024-09-13T23:57:23.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.129+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 50 ==== osd_op_reply(97 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.129+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:98 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f60000 con 0x563858f57800 2024-09-13T23:57:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.133+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 51 ==== osd_op_reply(98 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.133+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:99 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f61400 con 0x563858f61800 2024-09-13T23:57:23.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.133+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 21 ==== osd_op_reply(99 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.133+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:100 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908f800 con 0x563858f61800 2024-09-13T23:57:23.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.133+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 22 ==== osd_op_reply(100 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.133+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:101 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908fc00 con 0x563858f61800 2024-09-13T23:57:23.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.133+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 23 ==== osd_op_reply(101 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.133+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:102 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908e800 con 0x563858f57800 2024-09-13T23:57:23.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.133+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 52 ==== osd_op_reply(102 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.133+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:103 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908e000 con 0x563858f57800 2024-09-13T23:57:23.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.137+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 53 ==== osd_op_reply(103 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.137+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:104 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859034000 con 0x563858f57800 2024-09-13T23:57:23.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.137+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 54 ==== osd_op_reply(104 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.137+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:105 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859035c00 con 0x563858f61800 2024-09-13T23:57:23.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.137+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 24 ==== osd_op_reply(105 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.137+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:106 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57c00 con 0x563858f61800 2024-09-13T23:57:23.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.137+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 25 ==== osd_op_reply(106 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.137+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:107 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57000 con 0x563858f61800 2024-09-13T23:57:23.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.137+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 26 ==== osd_op_reply(107 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.137+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:108 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57400 con 0x563858f61800 2024-09-13T23:57:23.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.141+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 27 ==== osd_op_reply(108 gc.25 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.141+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:109 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f61c00 con 0x563858f61800 2024-09-13T23:57:23.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.141+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 28 ==== osd_op_reply(109 gc.25 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.141+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:110 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f60c00 con 0x563858f61800 2024-09-13T23:57:23.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.141+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 29 ==== osd_op_reply(110 gc.25 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.141+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:111 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f61000 con 0x563858f61800 2024-09-13T23:57:23.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.141+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 30 ==== osd_op_reply(111 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.141+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:112 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f61400 con 0x563858f61800 2024-09-13T23:57:23.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.141+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 31 ==== osd_op_reply(112 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.141+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:113 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f61c00 con 0x563858f61800 2024-09-13T23:57:23.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.141+0000 7feecd459700 1 -- 172.21.15.173:0/3077764286 <== osd.3 v2:172.21.15.173:6800/4020038786 32 ==== osd_op_reply(113 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2cb40 con 0x563858f61800 2024-09-13T23:57:23.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.141+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:114 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57c00 con 0x563858f57800 2024-09-13T23:57:23.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.145+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 55 ==== osd_op_reply(114 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.145+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:115 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57000 con 0x563858f57800 2024-09-13T23:57:23.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.145+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 56 ==== osd_op_reply(115 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.145+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:116 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57400 con 0x563858f57800 2024-09-13T23:57:23.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.145+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 57 ==== osd_op_reply(116 gc.27 [call out=1701b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+1701 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.145+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:117 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859035c00 con 0x563858f60400 2024-09-13T23:57:23.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.145+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(117 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.145+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:118 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908f400 con 0x563858f60400 2024-09-13T23:57:23.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.149+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 24 ==== osd_op_reply(118 gc.28 [call out=24b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.149+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:119 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908f800 con 0x563858f60400 2024-09-13T23:57:23.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.149+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 25 ==== osd_op_reply(119 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.149+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:120 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908fc00 con 0x563858f57800 2024-09-13T23:57:23.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.149+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 58 ==== osd_op_reply(120 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.149+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:121 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859034400 con 0x563858f57800 2024-09-13T23:57:23.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.149+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 59 ==== osd_op_reply(121 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.149+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:122 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859034800 con 0x563858f57800 2024-09-13T23:57:23.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.149+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.0 v2:172.21.15.87:6800/3507919120 60 ==== osd_op_reply(122 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f57800 2024-09-13T23:57:23.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.149+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:123 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859034c00 con 0x563858f60400 2024-09-13T23:57:23.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.153+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 26 ==== osd_op_reply(123 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.153+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:124 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859035000 con 0x563858f60400 2024-09-13T23:57:23.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.153+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 27 ==== osd_op_reply(124 gc.30 [call out=24b] v0'0 uv12 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.153+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:125 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859034000 con 0x563858f60400 2024-09-13T23:57:23.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.153+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 <== osd.1 v2:172.21.15.173:6808/3256211813 28 ==== osd_op_reply(125 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d200 con 0x563858f60400 2024-09-13T23:57:23.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.153+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:126 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563859035c00 con 0x563858f56800 2024-09-13T23:57:23.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.153+0000 7feecc457700 1 -- 172.21.15.173:0/3077764286 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(126 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d440 con 0x563858f56800 2024-09-13T23:57:23.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.153+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:127 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57c00 con 0x563858f56800 2024-09-13T23:57:23.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.153+0000 7feecc457700 1 -- 172.21.15.173:0/3077764286 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(127 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x563858f2d440 con 0x563858f56800 2024-09-13T23:57:23.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.153+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:128 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57000 con 0x563858f56800 2024-09-13T23:57:23.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.153+0000 7feecc457700 1 -- 172.21.15.173:0/3077764286 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(128 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x563858f2d440 con 0x563858f56800 2024-09-13T23:57:23.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.157+0000 7feeb3c26700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:23.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.157+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94800010698752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908e800 con 0x563858e93000 2024-09-13T23:57:23.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.161+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(62 data_loggenerations_metadata [watch unwatch cookie 94800010698752] v35'156 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x563858f2cb40 con 0x563858e93000 2024-09-13T23:57:23.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.161+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:63 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94800008993536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908e000 con 0x563858e93400 2024-09-13T23:57:23.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.161+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(63 notify.0 [watch unwatch cookie 94800008993536] v35'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858e93400 2024-09-13T23:57:23.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.161+0000 7feece49ff40 20 remove_watcher() i=0 2024-09-13T23:57:23.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.161+0000 7feece49ff40 2 removed watcher, disabling cache 2024-09-13T23:57:23.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.161+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94800008994688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f60000 con 0x563858e93000 2024-09-13T23:57:23.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.165+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(64 notify.1 [watch unwatch cookie 94800008994688] v35'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563858f2cb40 con 0x563858e93000 2024-09-13T23:57:23.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.165+0000 7feece49ff40 20 remove_watcher() i=1 2024-09-13T23:57:23.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.165+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94800008995840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858f57400 con 0x563858e93400 2024-09-13T23:57:23.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.169+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(65 notify.2 [watch unwatch cookie 94800008995840] v35'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858e93400 2024-09-13T23:57:23.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.169+0000 7feece49ff40 20 remove_watcher() i=2 2024-09-13T23:57:23.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.169+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94800008996992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56385908e400 con 0x563858f56000 2024-09-13T23:57:23.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.169+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(66 notify.3 [watch unwatch cookie 94800008996992] v35'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563858f2cb40 con 0x563858f56000 2024-09-13T23:57:23.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.169+0000 7feece49ff40 20 remove_watcher() i=3 2024-09-13T23:57:23.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.169+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94800008998144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858eea000 con 0x563858e93400 2024-09-13T23:57:23.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.173+0000 7feeccc58700 1 -- 172.21.15.173:0/2739609295 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(67 notify.4 [watch unwatch cookie 94800008998144] v35'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563858f2d200 con 0x563858e93400 2024-09-13T23:57:23.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.173+0000 7feece49ff40 20 remove_watcher() i=4 2024-09-13T23:57:23.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.173+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94800008999296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858eea400 con 0x563858e93c00 2024-09-13T23:57:23.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.177+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(68 notify.5 [watch unwatch cookie 94800008999296] v35'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563858f2d440 con 0x563858e93c00 2024-09-13T23:57:23.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.177+0000 7feece49ff40 20 remove_watcher() i=5 2024-09-13T23:57:23.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.177+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94800009000448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858eea800 con 0x563858e93c00 2024-09-13T23:57:23.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.177+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(69 notify.6 [watch unwatch cookie 94800009000448] v35'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563858f2d440 con 0x563858e93c00 2024-09-13T23:57:23.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.177+0000 7feece49ff40 20 remove_watcher() i=6 2024-09-13T23:57:23.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.177+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:70 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94800009001600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563858eeac00 con 0x563858f56000 2024-09-13T23:57:23.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feecd459700 1 -- 172.21.15.173:0/2739609295 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(70 notify.7 [watch unwatch cookie 94800009001600] v35'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563858f2cb40 con 0x563858f56000 2024-09-13T23:57:23.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 20 remove_watcher() i=7 2024-09-13T23:57:23.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563858e93400 msgr2=0x563858dd0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 --2- 172.21.15.173:0/2739609295 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563858e93400 0x563858dd0100 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563858e93000 msgr2=0x563858dcfb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 --2- 172.21.15.173:0/2739609295 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563858e93000 0x563858dcfb80 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563858f56000 msgr2=0x563858dd0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 --2- 172.21.15.173:0/2739609295 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563858f56000 0x563858dd0c00 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563858e93c00 msgr2=0x563858dd0680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 --2- 172.21.15.173:0/2739609295 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563858e93c00 0x563858dd0680 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563858e92c00 msgr2=0x563858dcf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 --2- 172.21.15.173:0/2739609295 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563858e92c00 0x563858dcf600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x563858dc9920 tx=0x563858bed800 comp rx=0 tx=0).stop 2024-09-13T23:57:23.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9800 msgr2=0x563858dceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 --2- 172.21.15.173:0/2739609295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9800 0x563858dceb00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x5638598b3f80 tx=0x563858e4c840 comp rx=0 tx=0).stop 2024-09-13T23:57:23.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 reap_dead start 2024-09-13T23:57:23.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feecc457700 1 -- 172.21.15.173:0/2739609295 reap_dead start 2024-09-13T23:57:23.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 shutdown_connections 2024-09-13T23:57:23.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 >> 172.21.15.173:0/2739609295 conn(0x563858ae9400 msgr2=0x563858be9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:23.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 shutdown_connections 2024-09-13T23:57:23.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 -- 172.21.15.173:0/2739609295 wait complete. 2024-09-13T23:57:23.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563858f57800 msgr2=0x563858dd1700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 --2- 172.21.15.173:0/3077764286 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563858f57800 0x563858dd1700 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563858f60400 msgr2=0x563858ff3080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 --2- 172.21.15.173:0/3077764286 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563858f60400 0x563858ff3080 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563858f56800 msgr2=0x563858ff2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 --2- 172.21.15.173:0/3077764286 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563858f56800 0x563858ff2580 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563858f61800 msgr2=0x563858ff2b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 --2- 172.21.15.173:0/3077764286 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563858f61800 0x563858ff2b00 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563858e93800 msgr2=0x563858ff2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 --2- 172.21.15.173:0/3077764286 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563858e93800 0x563858ff2000 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x563858ef57a0 tx=0x563858f415c0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858f56400 msgr2=0x563858dd1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 --2- 172.21.15.173:0/3077764286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858f56400 0x563858dd1180 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x563858f6e2d0 tx=0x563858f405a0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 reap_dead start 2024-09-13T23:57:23.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feeccc58700 1 -- 172.21.15.173:0/3077764286 reap_dead start 2024-09-13T23:57:23.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 shutdown_connections 2024-09-13T23:57:23.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.181+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 >> 172.21.15.173:0/3077764286 conn(0x563858f60800 msgr2=0x563858bea000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:23.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.185+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 shutdown_connections 2024-09-13T23:57:23.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.185+0000 7feece49ff40 1 -- 172.21.15.173:0/3077764286 wait complete. 2024-09-13T23:57:23.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.185+0000 7feece49ff40 1 -- 172.21.15.173:0/318449477 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563858e92000 msgr2=0x563858dcf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.185+0000 7feece49ff40 1 --2- 172.21.15.173:0/318449477 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563858e92000 0x563858dcf080 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x563858e17500 tx=0x563858e4c240 comp rx=0 tx=0).stop 2024-09-13T23:57:23.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.185+0000 7feece49ff40 1 -- 172.21.15.173:0/318449477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9000 msgr2=0x563858dce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.185+0000 7feece49ff40 1 --2- 172.21.15.173:0/318449477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9000 0x563858dce580 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x5638598b3e60 tx=0x563858beda40 comp rx=0 tx=0).stop 2024-09-13T23:57:23.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.185+0000 7feece49ff40 1 -- 172.21.15.173:0/318449477 shutdown_connections 2024-09-13T23:57:23.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.185+0000 7feece49ff40 1 --2- 172.21.15.173:0/318449477 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563858e92000 0x563858dcf080 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.185+0000 7feece49ff40 1 --2- 172.21.15.173:0/318449477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563858ae9000 0x563858dce580 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.185+0000 7feece49ff40 1 -- 172.21.15.173:0/318449477 >> 172.21.15.173:0/318449477 conn(0x563858ae8c00 msgr2=0x563858be9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:23.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.185+0000 7feece49ff40 1 -- 172.21.15.173:0/318449477 shutdown_connections 2024-09-13T23:57:23.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.185+0000 7feece49ff40 1 -- 172.21.15.173:0/318449477 wait complete. 2024-09-13T23:57:23.194 INFO:teuthology.orchestra.run.smithi173.stdout:[ 2024-09-13T23:57:23.194 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:23.194 INFO:teuthology.orchestra.run.smithi173.stdout: "tag": "d342d0db-d035-4a54-bae7-2e0f76db6818.4232.2495340917749831233\u0000", 2024-09-13T23:57:23.194 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:57:22.855256+0000", 2024-09-13T23:57:23.194 INFO:teuthology.orchestra.run.smithi173.stdout: "objs": [ 2024-09-13T23:57:23.194 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:23.194 INFO:teuthology.orchestra.run.smithi173.stdout: "pool": "default.rgw.buckets.data", 2024-09-13T23:57:23.194 INFO:teuthology.orchestra.run.smithi173.stdout: "oid": "d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_1", 2024-09-13T23:57:23.194 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "", 2024-09-13T23:57:23.195 INFO:teuthology.orchestra.run.smithi173.stdout: "instance": "" 2024-09-13T23:57:23.195 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:23.195 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:23.195 INFO:teuthology.orchestra.run.smithi173.stdout: "pool": "default.rgw.buckets.data", 2024-09-13T23:57:23.195 INFO:teuthology.orchestra.run.smithi173.stdout: "oid": "d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_2", 2024-09-13T23:57:23.195 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "", 2024-09-13T23:57:23.195 INFO:teuthology.orchestra.run.smithi173.stdout: "instance": "" 2024-09-13T23:57:23.195 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:23.195 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:23.195 INFO:teuthology.orchestra.run.smithi173.stdout: "pool": "default.rgw.buckets.data", 2024-09-13T23:57:23.195 INFO:teuthology.orchestra.run.smithi173.stdout: "oid": "d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_3", 2024-09-13T23:57:23.195 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "", 2024-09-13T23:57:23.195 INFO:teuthology.orchestra.run.smithi173.stdout: "instance": "" 2024-09-13T23:57:23.195 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:23.196 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:23.196 INFO:teuthology.orchestra.run.smithi173.stdout: "pool": "default.rgw.buckets.data", 2024-09-13T23:57:23.196 INFO:teuthology.orchestra.run.smithi173.stdout: "oid": "d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_4", 2024-09-13T23:57:23.196 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "", 2024-09-13T23:57:23.196 INFO:teuthology.orchestra.run.smithi173.stdout: "instance": "" 2024-09-13T23:57:23.196 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:23.196 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:23.196 INFO:teuthology.orchestra.run.smithi173.stdout: "pool": "default.rgw.buckets.data", 2024-09-13T23:57:23.196 INFO:teuthology.orchestra.run.smithi173.stdout: "oid": "d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_5", 2024-09-13T23:57:23.196 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "", 2024-09-13T23:57:23.196 INFO:teuthology.orchestra.run.smithi173.stdout: "instance": "" 2024-09-13T23:57:23.196 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:23.196 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:23.196 INFO:teuthology.orchestra.run.smithi173.stdout: "pool": "default.rgw.buckets.data", 2024-09-13T23:57:23.197 INFO:teuthology.orchestra.run.smithi173.stdout: "oid": "d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_6", 2024-09-13T23:57:23.197 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "", 2024-09-13T23:57:23.197 INFO:teuthology.orchestra.run.smithi173.stdout: "instance": "" 2024-09-13T23:57:23.197 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:23.197 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:23.197 INFO:teuthology.orchestra.run.smithi173.stdout: "pool": "default.rgw.buckets.data", 2024-09-13T23:57:23.197 INFO:teuthology.orchestra.run.smithi173.stdout: "oid": "d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_7", 2024-09-13T23:57:23.197 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "", 2024-09-13T23:57:23.197 INFO:teuthology.orchestra.run.smithi173.stdout: "instance": "" 2024-09-13T23:57:23.197 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:23.197 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:57:23.197 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:23.197 INFO:teuthology.orchestra.run.smithi173.stdout:] 2024-09-13T23:57:23.198 DEBUG:tasks.util.rgw: json result: [{'tag': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4232.2495340917749831233\x00', 'time': '2024-09-13T23:57:22.855256+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_7', 'key': '', 'instance': ''}]}] 2024-09-13T23:57:23.198 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-13T23:57:23.199 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-13T23:57:23.199 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-13T23:57:23.285 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:23.285 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:23.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.281+0000 7fedf4da6f40 1 Processor -- start 2024-09-13T23:57:23.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.281+0000 7fedf4da6f40 1 -- start start 2024-09-13T23:57:23.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.281+0000 7fedf4da6f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55cc702cf400 0x55cc705b4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.281+0000 7fedf4da6f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cc70393500 con 0x55cc702cf000 2024-09-13T23:57:23.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.281+0000 7fedf4da6f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cc7035ca00 con 0x55cc702cf400 2024-09-13T23:57:23.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.281+0000 7fedf2d5e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55cc702cf400 0x55cc705b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.281+0000 7fedf2d5e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55cc702cf400 0x55cc705b4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34588/0 (socket says 172.21.15.173:34588) 2024-09-13T23:57:23.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.281+0000 7fedf355f700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55cc702cf000 0x55cc703ce800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:44878/0 (socket says 172.21.15.173:44878) 2024-09-13T23:57:23.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.281+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2060330984 learned_addr learned my addr 172.21.15.173:0/2060330984 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:23.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.281+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2060330984 >> v1:172.21.15.87:6789/0 conn(0x55cc702cf000 legacy=0x55cc703ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.281+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2060330984 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc702e1d40 con 0x55cc702cf400 2024-09-13T23:57:23.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.281+0000 7fedf2d5e700 1 --2- 172.21.15.173:0/2060330984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf400 0x55cc705b4580 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x55cc705af920 tx=0x55cc703d3920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa66a13c663063f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.281+0000 7fedf255d700 1 -- 172.21.15.173:0/2060330984 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cc703734a0 con 0x55cc702cf400 2024-09-13T23:57:23.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.281+0000 7fedf255d700 1 -- 172.21.15.173:0/2060330984 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cc70393800 con 0x55cc702cf400 2024-09-13T23:57:23.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.281+0000 7fedf255d700 1 -- 172.21.15.173:0/2060330984 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cc70373600 con 0x55cc702cf400 2024-09-13T23:57:23.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.281+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2060330984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf400 msgr2=0x55cc705b4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.281+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/2060330984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf400 0x55cc705b4580 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x55cc705af920 tx=0x55cc703d3920 comp rx=0 tx=0).stop 2024-09-13T23:57:23.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.281+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2060330984 shutdown_connections 2024-09-13T23:57:23.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.281+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/2060330984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf400 0x55cc705b4580 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.281+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2060330984 >> 172.21.15.173:0/2060330984 conn(0x55cc702cec00 msgr2=0x55cc703ce000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:23.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.281+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2060330984 shutdown_connections 2024-09-13T23:57:23.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.281+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2060330984 wait complete. 2024-09-13T23:57:23.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf4da6f40 1 Processor -- start 2024-09-13T23:57:23.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf4da6f40 1 -- start start 2024-09-13T23:57:23.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf4da6f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf000 0x55cc705b4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf4da6f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc7035c500 con 0x55cc702cf000 2024-09-13T23:57:23.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf355f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf000 0x55cc705b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf355f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf000 0x55cc705b4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34592/0 (socket says 172.21.15.173:34592) 2024-09-13T23:57:23.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf355f700 1 -- 172.21.15.173:0/3660369985 learned_addr learned my addr 172.21.15.173:0/3660369985 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:23.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf355f700 1 -- 172.21.15.173:0/3660369985 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc702e1ba0 con 0x55cc702cf000 2024-09-13T23:57:23.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf355f700 1 --2- 172.21.15.173:0/3660369985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf000 0x55cc705b4580 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x55cc7042be90 tx=0x55cc703d3b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb50045417926db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf1d5c700 1 -- 172.21.15.173:0/3660369985 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cc703731e0 con 0x55cc702cf000 2024-09-13T23:57:23.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf1d5c700 1 -- 172.21.15.173:0/3660369985 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cc70393b00 con 0x55cc702cf000 2024-09-13T23:57:23.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf1d5c700 1 -- 172.21.15.173:0/3660369985 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cc703734a0 con 0x55cc702cf000 2024-09-13T23:57:23.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf4da6f40 1 -- 172.21.15.173:0/3660369985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf000 msgr2=0x55cc705b4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/3660369985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf000 0x55cc705b4580 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x55cc7042be90 tx=0x55cc703d3b60 comp rx=0 tx=0).stop 2024-09-13T23:57:23.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf4da6f40 1 -- 172.21.15.173:0/3660369985 shutdown_connections 2024-09-13T23:57:23.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/3660369985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf000 0x55cc705b4580 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf4da6f40 1 -- 172.21.15.173:0/3660369985 >> 172.21.15.173:0/3660369985 conn(0x55cc702cec00 msgr2=0x55cc703cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:23.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf4da6f40 1 -- 172.21.15.173:0/3660369985 shutdown_connections 2024-09-13T23:57:23.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf4da6f40 1 -- 172.21.15.173:0/3660369985 wait complete. 2024-09-13T23:57:23.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf4da6f40 1 Processor -- start 2024-09-13T23:57:23.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf4da6f40 1 -- start start 2024-09-13T23:57:23.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf4da6f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf000 0x55cc705b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf4da6f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc7035c3c0 con 0x55cc702cf000 2024-09-13T23:57:23.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf355f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf000 0x55cc705b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf355f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf000 0x55cc705b4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34596/0 (socket says 172.21.15.173:34596) 2024-09-13T23:57:23.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.285+0000 7fedf355f700 1 -- 172.21.15.173:0/623799828 learned_addr learned my addr 172.21.15.173:0/623799828 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:23.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.289+0000 7fedf355f700 1 -- 172.21.15.173:0/623799828 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc702e1a00 con 0x55cc702cf000 2024-09-13T23:57:23.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.289+0000 7fedf355f700 1 --2- 172.21.15.173:0/623799828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf000 0x55cc705b4580 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x55cc711400c0 tx=0x55cc703d3a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.289+0000 7fedf0559700 1 -- 172.21.15.173:0/623799828 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cc70373600 con 0x55cc702cf000 2024-09-13T23:57:23.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.289+0000 7fedf0559700 1 -- 172.21.15.173:0/623799828 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cc70393c80 con 0x55cc702cf000 2024-09-13T23:57:23.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.289+0000 7fedf4da6f40 1 -- 172.21.15.173:0/623799828 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cc702e1860 con 0x55cc702cf000 2024-09-13T23:57:23.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.289+0000 7fedf0559700 1 -- 172.21.15.173:0/623799828 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cc703731e0 con 0x55cc702cf000 2024-09-13T23:57:23.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.289+0000 7fedf4da6f40 1 -- 172.21.15.173:0/623799828 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc702e16c0 con 0x55cc702cf000 2024-09-13T23:57:23.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.289+0000 7fedf4da6f40 1 Processor -- start 2024-09-13T23:57:23.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.289+0000 7fedf4da6f40 1 -- start start 2024-09-13T23:57:23.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.289+0000 7fedf0559700 1 -- 172.21.15.173:0/623799828 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55cc703c8b00 con 0x55cc702cf000 2024-09-13T23:57:23.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.289+0000 7fedf4da6f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf800 0x55cc705b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.289+0000 7fedf4da6f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc702f4640 con 0x55cc702cf800 2024-09-13T23:57:23.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.289+0000 7fedf0559700 1 --2- 172.21.15.173:0/623799828 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cc70680000 0x55cc705b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.289+0000 7fedf0559700 1 -- 172.21.15.173:0/623799828 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55cc70335180 con 0x55cc702cf000 2024-09-13T23:57:23.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.289+0000 7fedf355f700 1 --2- 172.21.15.173:0/623799828 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cc70680000 0x55cc705b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.289+0000 7fedf3d60700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf800 0x55cc705b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.289+0000 7fedf3d60700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf800 0x55cc705b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34602/0 (socket says 172.21.15.173:34602) 2024-09-13T23:57:23.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.293+0000 7fedf3d60700 1 -- 172.21.15.173:0/3242562152 learned_addr learned my addr 172.21.15.173:0/3242562152 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:23.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.293+0000 7fedf355f700 1 --2- 172.21.15.173:0/623799828 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cc70680000 0x55cc705b5080 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55cc711416b0 tx=0x55cc70638240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.293+0000 7fedf3d60700 1 -- 172.21.15.173:0/3242562152 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc702e0000 con 0x55cc702cf800 2024-09-13T23:57:23.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.293+0000 7fedf3d60700 1 --2- 172.21.15.173:0/3242562152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf800 0x55cc705b4b00 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x55cc71140420 tx=0x55cc706390e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758cfd42a05bfd8b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.293+0000 7fededd54700 1 -- 172.21.15.173:0/3242562152 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cc70373600 con 0x55cc702cf800 2024-09-13T23:57:23.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.293+0000 7fededd54700 1 -- 172.21.15.173:0/3242562152 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cc7069a000 con 0x55cc702cf800 2024-09-13T23:57:23.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.293+0000 7fededd54700 1 -- 172.21.15.173:0/3242562152 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cc703731e0 con 0x55cc702cf800 2024-09-13T23:57:23.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.293+0000 7fedf4da6f40 1 -- 172.21.15.173:0/3242562152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf800 msgr2=0x55cc705b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.293+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/3242562152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf800 0x55cc705b4b00 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x55cc71140420 tx=0x55cc706390e0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.293+0000 7fedf4da6f40 1 -- 172.21.15.173:0/3242562152 shutdown_connections 2024-09-13T23:57:23.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.293+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/3242562152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf800 0x55cc705b4b00 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.293+0000 7fedf4da6f40 1 -- 172.21.15.173:0/3242562152 >> 172.21.15.173:0/3242562152 conn(0x55cc702cf400 msgr2=0x55cc703cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:23.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.293+0000 7fedf4da6f40 1 -- 172.21.15.173:0/3242562152 shutdown_connections 2024-09-13T23:57:23.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.293+0000 7fedf4da6f40 1 -- 172.21.15.173:0/3242562152 wait complete. 2024-09-13T23:57:23.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.293+0000 7fedf4da6f40 1 Processor -- start 2024-09-13T23:57:23.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.293+0000 7fedf4da6f40 1 -- start start 2024-09-13T23:57:23.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.293+0000 7fedf4da6f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf800 0x55cc705b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.293+0000 7fedf4da6f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc702f48c0 con 0x55cc702cf800 2024-09-13T23:57:23.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.293+0000 7fedf3d60700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf800 0x55cc705b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.293+0000 7fedf3d60700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf800 0x55cc705b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34608/0 (socket says 172.21.15.173:34608) 2024-09-13T23:57:23.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.293+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 learned_addr learned my addr 172.21.15.173:0/2861660137 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:23.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.297+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc702e0ea0 con 0x55cc702cf800 2024-09-13T23:57:23.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.297+0000 7fedf3d60700 1 --2- 172.21.15.173:0/2861660137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf800 0x55cc705b4b00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x55cc71140240 tx=0x55cc70638cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.297+0000 7fedec551700 1 -- 172.21.15.173:0/2861660137 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cc70373a20 con 0x55cc702cf800 2024-09-13T23:57:23.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.297+0000 7fedec551700 1 -- 172.21.15.173:0/2861660137 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cc7069a180 con 0x55cc702cf800 2024-09-13T23:57:23.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.297+0000 7fedec551700 1 -- 172.21.15.173:0/2861660137 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cc70373600 con 0x55cc702cf800 2024-09-13T23:57:23.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.297+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cc702e0820 con 0x55cc702cf800 2024-09-13T23:57:23.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.297+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc702e09c0 con 0x55cc702cf800 2024-09-13T23:57:23.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.297+0000 7fedec551700 1 -- 172.21.15.173:0/2861660137 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55cc703c8dc0 con 0x55cc702cf800 2024-09-13T23:57:23.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.297+0000 7fedf4da6f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:23.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.297+0000 7fedec551700 1 --2- 172.21.15.173:0/2861660137 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cc70680c00 0x55cc705b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.297+0000 7fedec551700 1 -- 172.21.15.173:0/2861660137 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55cc70335340 con 0x55cc702cf800 2024-09-13T23:57:23.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.297+0000 7fedf2d5e700 1 --2- 172.21.15.173:0/2861660137 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cc70680c00 0x55cc705b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.297+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/2861660137 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55cc70681000 0x55cc705b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.297+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681400 con 0x55cc70681000 2024-09-13T23:57:23.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.297+0000 7fedf3d60700 1 --2- 172.21.15.173:0/2861660137 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55cc70681000 0x55cc705b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.301+0000 7fedf2d5e700 1 --2- 172.21.15.173:0/2861660137 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cc70680c00 0x55cc705b5600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55cc705af920 tx=0x55cc703d3800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.301+0000 7fedf3d60700 1 --2- 172.21.15.173:0/2861660137 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55cc70681000 0x55cc705b5b80 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.301+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70681000 2024-09-13T23:57:23.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.301+0000 7fedf4da6f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:23.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.301+0000 7fedf4da6f40 20 realm 2024-09-13T23:57:23.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.301+0000 7fedf4da6f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:23.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.301+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681000 2024-09-13T23:57:23.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.301+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70681000 2024-09-13T23:57:23.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.301+0000 7fedf4da6f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:23.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.301+0000 7fedf4da6f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:23.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.301+0000 7fedf4da6f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:23.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.301+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681c00 con 0x55cc70681000 2024-09-13T23:57:23.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.301+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70681000 2024-09-13T23:57:23.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.301+0000 7fedf4da6f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:23.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.301+0000 7fedf4da6f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:23.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.301+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/2861660137 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55cc70681400 0x55cc705b6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.301+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681400 2024-09-13T23:57:23.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.301+0000 7fedf355f700 1 --2- 172.21.15.173:0/2861660137 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55cc70681400 0x55cc705b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.301+0000 7fedf355f700 1 --2- 172.21.15.173:0/2861660137 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55cc70681400 0x55cc705b6100 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.305+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55cc70739200 con 0x55cc70681400 2024-09-13T23:57:23.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.305+0000 7fedf4da6f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:23.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.305+0000 7fedf4da6f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:23.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.305+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/2861660137 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55cc70681c00 0x55cc705b6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.305+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70742000 con 0x55cc70681c00 2024-09-13T23:57:23.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.305+0000 7fedf2d5e700 1 --2- 172.21.15.173:0/2861660137 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55cc70681c00 0x55cc705b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.305+0000 7fedf2d5e700 1 --2- 172.21.15.173:0/2861660137 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55cc70681c00 0x55cc705b6680 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.305+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2861660137 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55cc70739440 con 0x55cc70681c00 2024-09-13T23:57:23.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.305+0000 7fedf4da6f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:23.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.305+0000 7fedf4da6f40 20 searching for the correct realm 2024-09-13T23:57:23.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.305+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70742400 con 0x55cc70681c00 2024-09-13T23:57:23.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.305+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2861660137 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55cc70739440 con 0x55cc70681c00 2024-09-13T23:57:23.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.305+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70742000 con 0x55cc70681400 2024-09-13T23:57:23.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.305+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70739200 con 0x55cc70681400 2024-09-13T23:57:23.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.305+0000 7fedf355f700 1 --2- 172.21.15.173:0/2861660137 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55cc70742000 0x55cc705b6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.305+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70742000 2024-09-13T23:57:23.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.305+0000 7fedf3d60700 1 --2- 172.21.15.173:0/2861660137 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55cc70742000 0x55cc705b6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.309+0000 7fedf3d60700 1 --2- 172.21.15.173:0/2861660137 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55cc70742000 0x55cc705b6c00 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.309+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70742000 2024-09-13T23:57:23.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.309+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70742000 2024-09-13T23:57:23.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.309+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70742000 2024-09-13T23:57:23.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.309+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681000 2024-09-13T23:57:23.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.309+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70681000 2024-09-13T23:57:23.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.309+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681c00 2024-09-13T23:57:23.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.309+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2861660137 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70739440 con 0x55cc70681c00 2024-09-13T23:57:23.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.309+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681000 2024-09-13T23:57:23.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.309+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70681000 2024-09-13T23:57:23.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.309+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681400 2024-09-13T23:57:23.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.309+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70739200 con 0x55cc70681400 2024-09-13T23:57:23.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.309+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681400 2024-09-13T23:57:23.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.313+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70739200 con 0x55cc70681400 2024-09-13T23:57:23.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.313+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681000 2024-09-13T23:57:23.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.313+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70681000 2024-09-13T23:57:23.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.313+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70742000 2024-09-13T23:57:23.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.313+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70742000 2024-09-13T23:57:23.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.313+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681000 2024-09-13T23:57:23.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.313+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70681000 2024-09-13T23:57:23.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.313+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70742000 2024-09-13T23:57:23.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.313+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70742000 2024-09-13T23:57:23.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.313+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681400 2024-09-13T23:57:23.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.313+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70739200 con 0x55cc70681400 2024-09-13T23:57:23.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.313+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681c00 2024-09-13T23:57:23.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.317+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2861660137 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70739440 con 0x55cc70681c00 2024-09-13T23:57:23.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.317+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681000 2024-09-13T23:57:23.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.317+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70681000 2024-09-13T23:57:23.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.317+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681400 2024-09-13T23:57:23.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.317+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70739200 con 0x55cc70681400 2024-09-13T23:57:23.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.317+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681c00 2024-09-13T23:57:23.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.317+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2861660137 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70739440 con 0x55cc70681c00 2024-09-13T23:57:23.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.317+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681000 2024-09-13T23:57:23.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.317+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70681000 2024-09-13T23:57:23.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.317+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681000 2024-09-13T23:57:23.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.317+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70681000 2024-09-13T23:57:23.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.317+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681000 2024-09-13T23:57:23.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.321+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70681000 2024-09-13T23:57:23.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.321+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681c00 2024-09-13T23:57:23.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.321+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2861660137 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70739440 con 0x55cc70681c00 2024-09-13T23:57:23.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.321+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70742000 2024-09-13T23:57:23.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.321+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70742000 2024-09-13T23:57:23.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.321+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681000 2024-09-13T23:57:23.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.321+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70681000 2024-09-13T23:57:23.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.321+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70742000 2024-09-13T23:57:23.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.321+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70742000 2024-09-13T23:57:23.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.321+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681c00 2024-09-13T23:57:23.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.321+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2861660137 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70739440 con 0x55cc70681c00 2024-09-13T23:57:23.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.321+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70742000 2024-09-13T23:57:23.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.321+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70742000 2024-09-13T23:57:23.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.321+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681400 2024-09-13T23:57:23.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.325+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70739200 con 0x55cc70681400 2024-09-13T23:57:23.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.325+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681400 2024-09-13T23:57:23.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.325+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70739200 con 0x55cc70681400 2024-09-13T23:57:23.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.325+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681c00 2024-09-13T23:57:23.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.325+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2861660137 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70739440 con 0x55cc70681c00 2024-09-13T23:57:23.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.325+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681400 2024-09-13T23:57:23.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.325+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55cc70739200 con 0x55cc70681400 2024-09-13T23:57:23.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.325+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70681400 2024-09-13T23:57:23.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.325+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cc70739200 con 0x55cc70681400 2024-09-13T23:57:23.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.325+0000 7fedf4da6f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:23.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.325+0000 7fedf4da6f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:23.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.325+0000 7fedf4da6f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:23.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.325+0000 7fedf4da6f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:23.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.325+0000 7fedf4da6f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:23.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.325+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70742800 con 0x55cc70681000 2024-09-13T23:57:23.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70681000 2024-09-13T23:57:23.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf4da6f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:23.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf4da6f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:23.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70742c00 con 0x55cc70681400 2024-09-13T23:57:23.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55cc70739200 con 0x55cc70681400 2024-09-13T23:57:23.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf4da6f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:23.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf4da6f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:23.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743000 con 0x55cc70742000 2024-09-13T23:57:23.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70742000 2024-09-13T23:57:23.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf4da6f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:23.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf4da6f40 20 zone default found 2024-09-13T23:57:23.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf4da6f40 4 Realm: () 2024-09-13T23:57:23.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf4da6f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:23.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf4da6f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:23.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf4da6f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:23.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf4da6f40 20 zonegroup default 2024-09-13T23:57:23.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf4da6f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:23.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743400 con 0x55cc70742000 2024-09-13T23:57:23.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70742000 2024-09-13T23:57:23.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf4da6f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:23.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf4da6f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:23.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743800 con 0x55cc70681c00 2024-09-13T23:57:23.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2861660137 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55cc70739440 con 0x55cc70681c00 2024-09-13T23:57:23.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf4da6f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:23.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf4da6f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:23.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.329+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743c00 con 0x55cc70681c00 2024-09-13T23:57:23.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.333+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2861660137 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55cc70739440 con 0x55cc70681c00 2024-09-13T23:57:23.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.333+0000 7fedf4da6f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:23.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.333+0000 7fedf4da6f40 20 started sync module instance, tier type = 2024-09-13T23:57:23.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.333+0000 7fedf4da6f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:23.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.333+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062a000 con 0x55cc70681400 2024-09-13T23:57:23.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.333+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v35'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70681400 2024-09-13T23:57:23.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.333+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94336546683648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062a400 con 0x55cc70681400 2024-09-13T23:57:23.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.333+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062a800 con 0x55cc70681000 2024-09-13T23:57:23.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.337+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v35'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70681000 2024-09-13T23:57:23.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.337+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94336546683648] v35'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70681400 2024-09-13T23:57:23.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.337+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94336546684800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062ac00 con 0x55cc70681000 2024-09-13T23:57:23.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.337+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062b000 con 0x55cc70681400 2024-09-13T23:57:23.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.341+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94336546684800] v35'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70681000 2024-09-13T23:57:23.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.341+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v35'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70681400 2024-09-13T23:57:23.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.341+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94336546685952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062b400 con 0x55cc70681400 2024-09-13T23:57:23.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.341+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062b800 con 0x55cc70742000 2024-09-13T23:57:23.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.341+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v35'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70742000 2024-09-13T23:57:23.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.345+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94336546687104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062bc00 con 0x55cc70742000 2024-09-13T23:57:23.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.345+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062a800 con 0x55cc70681400 2024-09-13T23:57:23.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.345+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94336546685952] v35'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70681400 2024-09-13T23:57:23.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.345+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94336546687104] v35'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70742000 2024-09-13T23:57:23.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.345+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v35'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70681400 2024-09-13T23:57:23.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.345+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94336546688256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062a000 con 0x55cc70681400 2024-09-13T23:57:23.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.345+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70742800 con 0x55cc70681c00 2024-09-13T23:57:23.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.349+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2861660137 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v35'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cc70739440 con 0x55cc70681c00 2024-09-13T23:57:23.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.349+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94336546689408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743000 con 0x55cc70681c00 2024-09-13T23:57:23.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.349+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743400 con 0x55cc70681c00 2024-09-13T23:57:23.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.349+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94336546688256] v35'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70681400 2024-09-13T23:57:23.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.349+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2861660137 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v35'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cc70739440 con 0x55cc70681c00 2024-09-13T23:57:23.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.349+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94336546690560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70742c00 con 0x55cc70681c00 2024-09-13T23:57:23.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.349+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70681800 con 0x55cc70742000 2024-09-13T23:57:23.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.349+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2861660137 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94336546689408] v35'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cc70739440 con 0x55cc70681c00 2024-09-13T23:57:23.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.353+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2861660137 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94336546690560] v35'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cc70739440 con 0x55cc70681c00 2024-09-13T23:57:23.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.353+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v35'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70742000 2024-09-13T23:57:23.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.353+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94336546691712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062a400 con 0x55cc70742000 2024-09-13T23:57:23.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.353+0000 7fedf4da6f40 20 add_watcher() i=0 2024-09-13T23:57:23.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.353+0000 7fedf4da6f40 20 add_watcher() i=1 2024-09-13T23:57:23.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.353+0000 7fedf4da6f40 20 add_watcher() i=2 2024-09-13T23:57:23.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.353+0000 7fedf4da6f40 20 add_watcher() i=3 2024-09-13T23:57:23.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.353+0000 7fedf4da6f40 20 add_watcher() i=4 2024-09-13T23:57:23.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.353+0000 7fedf4da6f40 20 add_watcher() i=5 2024-09-13T23:57:23.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.353+0000 7fedf4da6f40 20 add_watcher() i=6 2024-09-13T23:57:23.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.353+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94336546691712] v35'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70742000 2024-09-13T23:57:23.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.353+0000 7fedf4da6f40 20 add_watcher() i=7 2024-09-13T23:57:23.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.353+0000 7fedf4da6f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:23.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.353+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062b000 con 0x55cc70681000 2024-09-13T23:57:23.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.357+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70681000 2024-09-13T23:57:23.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.357+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94336548421632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062b400 con 0x55cc70681000 2024-09-13T23:57:23.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.357+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94336548421632] v35'157 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70681000 2024-09-13T23:57:23.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.357+0000 7fedda52d700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:23.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.357+0000 7fedf4da6f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:23.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.357+0000 7fedf4da6f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:23.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.357+0000 7fedf4da6f40 1 Processor -- start 2024-09-13T23:57:23.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.357+0000 7fedf4da6f40 1 -- start start 2024-09-13T23:57:23.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.357+0000 7fedf4da6f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc70742400 0x55cc705b7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.357+0000 7fedf4da6f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc7035c3c0 con 0x55cc70742400 2024-09-13T23:57:23.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.357+0000 7fedf2d5e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc70742400 0x55cc705b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.357+0000 7fedf2d5e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc70742400 0x55cc705b7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34620/0 (socket says 172.21.15.173:34620) 2024-09-13T23:57:23.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.357+0000 7fedf2d5e700 1 -- 172.21.15.173:0/680587811 learned_addr learned my addr 172.21.15.173:0/680587811 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:23.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.361+0000 7fedf2d5e700 1 -- 172.21.15.173:0/680587811 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc702e0b60 con 0x55cc70742400 2024-09-13T23:57:23.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.361+0000 7fedf2d5e700 1 --2- 172.21.15.173:0/680587811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc70742400 0x55cc705b7180 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x55cc7075c0f0 tx=0x55cc703d3980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe00b9cf4b886e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.361+0000 7fedd9d2c700 1 -- 172.21.15.173:0/680587811 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cc70373760 con 0x55cc70742400 2024-09-13T23:57:23.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.361+0000 7fedd9d2c700 1 -- 172.21.15.173:0/680587811 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cc7069a600 con 0x55cc70742400 2024-09-13T23:57:23.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.361+0000 7fedd9d2c700 1 -- 172.21.15.173:0/680587811 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cc70760000 con 0x55cc70742400 2024-09-13T23:57:23.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.361+0000 7fedf4da6f40 1 -- 172.21.15.173:0/680587811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc70742400 msgr2=0x55cc705b7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.361+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/680587811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc70742400 0x55cc705b7180 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x55cc7075c0f0 tx=0x55cc703d3980 comp rx=0 tx=0).stop 2024-09-13T23:57:23.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.361+0000 7fedf4da6f40 1 -- 172.21.15.173:0/680587811 shutdown_connections 2024-09-13T23:57:23.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.361+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/680587811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc70742400 0x55cc705b7180 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.361+0000 7fedf4da6f40 1 -- 172.21.15.173:0/680587811 >> 172.21.15.173:0/680587811 conn(0x55cc7062a800 msgr2=0x55cc703d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:23.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.361+0000 7fedf4da6f40 1 -- 172.21.15.173:0/680587811 shutdown_connections 2024-09-13T23:57:23.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.361+0000 7fedf4da6f40 1 -- 172.21.15.173:0/680587811 wait complete. 2024-09-13T23:57:23.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.361+0000 7fedf4da6f40 1 Processor -- start 2024-09-13T23:57:23.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.361+0000 7fedf4da6f40 1 -- start start 2024-09-13T23:57:23.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.361+0000 7fedf4da6f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc70742400 0x55cc705b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.361+0000 7fedf4da6f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc7035c500 con 0x55cc70742400 2024-09-13T23:57:23.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.361+0000 7fedf2d5e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc70742400 0x55cc705b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.361+0000 7fedf2d5e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc70742400 0x55cc705b7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34622/0 (socket says 172.21.15.173:34622) 2024-09-13T23:57:23.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.361+0000 7fedf2d5e700 1 -- 172.21.15.173:0/470361996 learned_addr learned my addr 172.21.15.173:0/470361996 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:23.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.365+0000 7fedf2d5e700 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc702e0d00 con 0x55cc70742400 2024-09-13T23:57:23.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.365+0000 7fedf2d5e700 1 --2- 172.21.15.173:0/470361996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc70742400 0x55cc705b7180 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x55cc7075c390 tx=0x55cc7072a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.365+0000 7fedd8529700 1 -- 172.21.15.173:0/470361996 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cc70760160 con 0x55cc70742400 2024-09-13T23:57:23.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.365+0000 7fedd8529700 1 -- 172.21.15.173:0/470361996 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cc7069a300 con 0x55cc70742400 2024-09-13T23:57:23.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.365+0000 7fedd8529700 1 -- 172.21.15.173:0/470361996 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cc707602c0 con 0x55cc70742400 2024-09-13T23:57:23.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.365+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cc702e0340 con 0x55cc70742400 2024-09-13T23:57:23.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.365+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc702e1d40 con 0x55cc70742400 2024-09-13T23:57:23.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.365+0000 7fedd8529700 1 -- 172.21.15.173:0/470361996 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55cc703c98c0 con 0x55cc70742400 2024-09-13T23:57:23.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.365+0000 7fedd8529700 1 --2- 172.21.15.173:0/470361996 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cc70681800 0x55cc707da000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.365+0000 7fedd8529700 1 -- 172.21.15.173:0/470361996 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55cc70335500 con 0x55cc70742400 2024-09-13T23:57:23.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.365+0000 7fedf3d60700 1 --2- 172.21.15.173:0/470361996 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cc70681800 0x55cc707da000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.365+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/470361996 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55cc70743800 0x55cc705b7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.365+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743c00 con 0x55cc70743800 2024-09-13T23:57:23.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.365+0000 7fedf355f700 1 --2- 172.21.15.173:0/470361996 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55cc70743800 0x55cc705b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.365+0000 7fedf3d60700 1 --2- 172.21.15.173:0/470361996 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cc70681800 0x55cc707da000 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55cc706d76e0 tx=0x55cc7072b5c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.369+0000 7fedf355f700 1 --2- 172.21.15.173:0/470361996 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55cc70743800 0x55cc705b7700 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.369+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v35'28 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.369+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/470361996 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55cc70742800 0x55cc707da580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.369+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062ac00 con 0x55cc70742800 2024-09-13T23:57:23.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.369+0000 7fedf2d5e700 1 --2- 172.21.15.173:0/470361996 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55cc70742800 0x55cc707da580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.369+0000 7fedf2d5e700 1 --2- 172.21.15.173:0/470361996 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55cc70742800 0x55cc707da580 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.373+0000 7fedf2d5e700 1 -- 172.21.15.173:0/470361996 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v35'19 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55cc70739440 con 0x55cc70742800 2024-09-13T23:57:23.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.373+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/470361996 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55cc7062b800 0x55cc707dab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.373+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062bc00 con 0x55cc7062b800 2024-09-13T23:57:23.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.373+0000 7fedf3d60700 1 --2- 172.21.15.173:0/470361996 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55cc7062b800 0x55cc707dab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.373+0000 7fedf3d60700 1 --2- 172.21.15.173:0/470361996 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55cc7062b800 0x55cc707dab00 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.377+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v35'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.377+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/470361996 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55cc7062a400 0x55cc707db080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.377+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc707fe000 con 0x55cc7062a400 2024-09-13T23:57:23.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.377+0000 7fedf355f700 1 --2- 172.21.15.173:0/470361996 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55cc7062a400 0x55cc707db080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.377+0000 7fedf355f700 1 --2- 172.21.15.173:0/470361996 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55cc7062a400 0x55cc707db080 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.377+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v35'158 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.377+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc707fe400 con 0x55cc70743800 2024-09-13T23:57:23.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.381+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v35'47 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.381+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc707fe800 con 0x55cc7062b800 2024-09-13T23:57:23.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.385+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v35'31 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.385+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc707fec00 con 0x55cc70743800 2024-09-13T23:57:23.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.385+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v35'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.385+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc707ff000 con 0x55cc7062a400 2024-09-13T23:57:23.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.389+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v35'31 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.389+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc707ff400 con 0x55cc70743800 2024-09-13T23:57:23.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.389+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v35'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.393+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc707ff800 con 0x55cc70743800 2024-09-13T23:57:23.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.393+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v35'25 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.393+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc707ffc00 con 0x55cc70743800 2024-09-13T23:57:23.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.397+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v35'48 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.397+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc707fe000 con 0x55cc7062b800 2024-09-13T23:57:23.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.401+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v35'22 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.401+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc707fe400 con 0x55cc70743800 2024-09-13T23:57:23.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.401+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v35'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.401+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc707fec00 con 0x55cc7062a400 2024-09-13T23:57:23.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.405+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v35'37 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.405+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743c00 con 0x55cc7062a400 2024-09-13T23:57:23.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.405+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v35'159 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.405+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062a000 con 0x55cc70743800 2024-09-13T23:57:23.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.409+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v35'41 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.409+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc707ff000 con 0x55cc70743800 2024-09-13T23:57:23.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.413+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v35'49 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.413+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc707ff400 con 0x55cc7062b800 2024-09-13T23:57:23.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.417+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v35'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.417+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc707ff800 con 0x55cc70743800 2024-09-13T23:57:23.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.417+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v35'27 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.417+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc707ffc00 con 0x55cc7062a400 2024-09-13T23:57:23.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.421+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v35'160 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.421+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc707fe400 con 0x55cc70743800 2024-09-13T23:57:23.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.425+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v35'42 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.425+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc707fec00 con 0x55cc70743800 2024-09-13T23:57:23.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.425+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v35'29 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.425+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062a000 con 0x55cc7062b800 2024-09-13T23:57:23.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.429+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v35'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.429+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062b000 con 0x55cc70743800 2024-09-13T23:57:23.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.433+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v35'26 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.433+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062b400 con 0x55cc7062b800 2024-09-13T23:57:23.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.437+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v35'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.437+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062bc00 con 0x55cc7062b800 2024-09-13T23:57:23.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.437+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v35'32 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.437+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743c00 con 0x55cc7062b800 2024-09-13T23:57:23.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.441+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v35'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.441+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e000 con 0x55cc70743800 2024-09-13T23:57:23.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.445+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v35'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.445+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e400 con 0x55cc7062a400 2024-09-13T23:57:23.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.445+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v35'32 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.445+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e800 con 0x55cc70743800 2024-09-13T23:57:23.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.449+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v35'43 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.449+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082ec00 con 0x55cc7062a400 2024-09-13T23:57:23.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.449+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v35'38 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.449+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082f000 con 0x55cc70742800 2024-09-13T23:57:23.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.453+0000 7fedf2d5e700 1 -- 172.21.15.173:0/470361996 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v35'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55cc70739440 con 0x55cc70742800 2024-09-13T23:57:23.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.457+0000 7fedd5d24700 20 reqs_thread_entry: start 2024-09-13T23:57:23.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.457+0000 7fedf4da6f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:23.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.457+0000 7fedf4da6f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:23.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.457+0000 7fedd3d20700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:53 2024 2024-09-13T23:57:23.463 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:23.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.457+0000 7fedd34fe700 20 reqs_thread_entry: start 2024-09-13T23:57:23.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.457+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-13T23:57:23.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.457+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082fc00 con 0x55cc70743800 2024-09-13T23:57:23.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.461+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(33 gc.20 [call] v35'44 uv44 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.461+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c000 con 0x55cc70743800 2024-09-13T23:57:23.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.461+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(34 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.461+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.461+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:35 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c400 con 0x55cc70743800 2024-09-13T23:57:23.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.461+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(35 gc.20 [call out=24b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.461+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c800 con 0x55cc70743800 2024-09-13T23:57:23.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.461+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(36 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.461+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.461+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088cc00 con 0x55cc70743800 2024-09-13T23:57:23.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.465+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(37 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.465+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.465+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:38 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088d000 con 0x55cc70743800 2024-09-13T23:57:23.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.469+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(38 gc.20 [call] v35'45 uv45 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.469+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-13T23:57:23.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.469+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088d400 con 0x55cc70743800 2024-09-13T23:57:23.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.469+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(39 gc.21 [call] v35'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.469+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:40 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088d800 con 0x55cc70743800 2024-09-13T23:57:23.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.469+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(40 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.469+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.473+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:41 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088dc00 con 0x55cc70743800 2024-09-13T23:57:23.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.473+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(41 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.473+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:42 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c000 con 0x55cc70743800 2024-09-13T23:57:23.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.473+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== osd_op_reply(42 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.473+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.473+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:43 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c400 con 0x55cc70743800 2024-09-13T23:57:23.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.473+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== osd_op_reply(43 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.473+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.473+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e000 con 0x55cc70743800 2024-09-13T23:57:23.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.477+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 27 ==== osd_op_reply(44 gc.21 [call] v35'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.477+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-13T23:57:23.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.477+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:45 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e400 con 0x55cc7062b800 2024-09-13T23:57:23.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.481+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(45 gc.22 [call] v35'22 uv22 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.481+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:46 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e800 con 0x55cc7062b800 2024-09-13T23:57:23.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.481+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(46 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.481+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.481+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:47 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082ec00 con 0x55cc7062b800 2024-09-13T23:57:23.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.481+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(47 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.481+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:48 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082fc00 con 0x55cc7062b800 2024-09-13T23:57:23.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.481+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(48 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.481+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.481+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:49 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062b000 con 0x55cc7062b800 2024-09-13T23:57:23.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.481+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(49 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.481+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.481+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:50 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e400 con 0x55cc7062b800 2024-09-13T23:57:23.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.485+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(50 gc.22 [call] v35'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.485+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-13T23:57:23.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.485+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:51 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e800 con 0x55cc70743800 2024-09-13T23:57:23.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.489+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 28 ==== osd_op_reply(51 gc.23 [call] v35'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.489+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082ec00 con 0x55cc70743800 2024-09-13T23:57:23.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.489+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 29 ==== osd_op_reply(52 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.489+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.489+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e000 con 0x55cc70743800 2024-09-13T23:57:23.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.489+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 30 ==== osd_op_reply(53 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.489+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:54 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743c00 con 0x55cc70743800 2024-09-13T23:57:23.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.489+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 31 ==== osd_op_reply(54 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.489+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.489+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:55 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062a000 con 0x55cc70743800 2024-09-13T23:57:23.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.493+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 32 ==== osd_op_reply(55 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.493+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.493+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:56 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062b400 con 0x55cc70743800 2024-09-13T23:57:23.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.497+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 33 ==== osd_op_reply(56 gc.23 [call] v35'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.497+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-13T23:57:23.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.497+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062bc00 con 0x55cc7062b800 2024-09-13T23:57:23.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.497+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(57 gc.24 [call] v35'16 uv16 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.497+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:58 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c000 con 0x55cc7062b800 2024-09-13T23:57:23.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.497+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(58 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.497+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.501+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:59 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c400 con 0x55cc7062b800 2024-09-13T23:57:23.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.501+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(59 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.501+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:60 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c800 con 0x55cc7062b800 2024-09-13T23:57:23.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.501+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(60 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.501+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.501+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:61 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088cc00 con 0x55cc7062b800 2024-09-13T23:57:23.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.501+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== osd_op_reply(61 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.501+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.501+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:62 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088d000 con 0x55cc7062b800 2024-09-13T23:57:23.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.505+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 20 ==== osd_op_reply(62 gc.24 [call] v35'17 uv17 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.505+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-13T23:57:23.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.505+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:63 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088d400 con 0x55cc7062b800 2024-09-13T23:57:23.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.505+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 21 ==== osd_op_reply(63 gc.25 [call] v35'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.505+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:64 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088d800 con 0x55cc7062b800 2024-09-13T23:57:23.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.509+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 22 ==== osd_op_reply(64 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.509+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.509+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:65 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088dc00 con 0x55cc7062b800 2024-09-13T23:57:23.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.509+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 23 ==== osd_op_reply(65 gc.25 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.509+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:66 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c000 con 0x55cc7062b800 2024-09-13T23:57:23.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.509+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 24 ==== osd_op_reply(66 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.509+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.509+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:67 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c400 con 0x55cc7062b800 2024-09-13T23:57:23.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.509+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 25 ==== osd_op_reply(67 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.509+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.509+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:68 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c800 con 0x55cc7062b800 2024-09-13T23:57:23.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.513+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 26 ==== osd_op_reply(68 gc.25 [call] v35'34 uv34 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.513+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-13T23:57:23.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.513+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088cc00 con 0x55cc7062b800 2024-09-13T23:57:23.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.513+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 27 ==== osd_op_reply(69 gc.26 [call] v35'22 uv22 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.513+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062b000 con 0x55cc7062b800 2024-09-13T23:57:23.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.513+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 28 ==== osd_op_reply(70 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.513+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.513+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062bc00 con 0x55cc7062b800 2024-09-13T23:57:23.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.517+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 29 ==== osd_op_reply(71 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.517+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:72 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082fc00 con 0x55cc7062b800 2024-09-13T23:57:23.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.517+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 30 ==== osd_op_reply(72 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.517+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.517+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:73 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e400 con 0x55cc7062b800 2024-09-13T23:57:23.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.517+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 31 ==== osd_op_reply(73 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.517+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.517+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:74 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062b000 con 0x55cc7062b800 2024-09-13T23:57:23.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.521+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 32 ==== osd_op_reply(74 gc.26 [call] v35'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.521+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-13T23:57:23.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.521+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:75 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088e000 con 0x55cc70743800 2024-09-13T23:57:23.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.521+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 34 ==== osd_op_reply(75 gc.27 [call] v35'24 uv24 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.521+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:76 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088e400 con 0x55cc70743800 2024-09-13T23:57:23.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.521+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 35 ==== osd_op_reply(76 gc.27 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.521+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.521+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:77 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088e800 con 0x55cc70743800 2024-09-13T23:57:23.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.525+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 36 ==== osd_op_reply(77 gc.27 [call out=24b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.525+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:78 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088ec00 con 0x55cc70743800 2024-09-13T23:57:23.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.525+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 37 ==== osd_op_reply(78 gc.27 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.525+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.525+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:79 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088f000 con 0x55cc70743800 2024-09-13T23:57:23.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.525+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 38 ==== osd_op_reply(79 gc.27 [call out=1701b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+1701 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.525+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-13T23:57:23.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.525+0000 7fedf4da6f40 20 garbage collection: RGWGC::process iterating over entry tag='d342d0db-d035-4a54-bae7-2e0f76db6818.4232.2495340917749831233', time=2024-09-13T23:57:22.855256+0000, chain.objs.size()=7 2024-09-13T23:57:23.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.525+0000 7fedf4da6f40 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_1 2024-09-13T23:57:23.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.525+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:80 3.14s0 3:2a9c5d28:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088f400 con 0x55cc70743800 2024-09-13T23:57:23.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.525+0000 7fedf4da6f40 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_2 2024-09-13T23:57:23.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.525+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:81 3.3cs0 3:3cfc2a48:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088f800 con 0x55cc70742800 2024-09-13T23:57:23.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.525+0000 7fedf4da6f40 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_3 2024-09-13T23:57:23.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.525+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:82 3.36s0 3:6f2efdfd:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088fc00 con 0x55cc70742800 2024-09-13T23:57:23.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.525+0000 7fedf4da6f40 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_4 2024-09-13T23:57:23.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.525+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:83 3.38s0 3:1c4c75ce:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088f800 con 0x55cc7062b800 2024-09-13T23:57:23.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.525+0000 7fedf4da6f40 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_5 2024-09-13T23:57:23.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.525+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:84 3.27s0 3:e4a80180:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088e000 con 0x55cc7062b800 2024-09-13T23:57:23.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.525+0000 7fedf4da6f40 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_6 2024-09-13T23:57:23.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.525+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:85 3.20s0 3:07a05207:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088e400 con 0x55cc70742800 2024-09-13T23:57:23.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.525+0000 7fedf4da6f40 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_7 2024-09-13T23:57:23.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.525+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:86 3.23s0 3:c7d5a8ca:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088e800 con 0x55cc70742800 2024-09-13T23:57:23.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.529+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 39 ==== osd_op_reply(80 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_1 [call] v35'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.533+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 33 ==== osd_op_reply(83 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_4 [call] v35'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.537+0000 7fedf2d5e700 1 -- 172.21.15.173:0/470361996 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(81 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_2 [call] v35'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x55cc70739440 con 0x55cc70742800 2024-09-13T23:57:23.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.537+0000 7fedf2d5e700 1 -- 172.21.15.173:0/470361996 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(85 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_6 [call] v35'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x55cc70739440 con 0x55cc70742800 2024-09-13T23:57:23.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.537+0000 7fedf2d5e700 1 -- 172.21.15.173:0/470361996 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(86 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_7 [call] v35'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x55cc70739440 con 0x55cc70742800 2024-09-13T23:57:23.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.537+0000 7fedf2d5e700 1 -- 172.21.15.173:0/470361996 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(82 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_3 [call] v35'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x55cc70739440 con 0x55cc70742800 2024-09-13T23:57:23.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.537+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 34 ==== osd_op_reply(84 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.1__shadow_.h5E6KKtapO9laiw3hP59lwNAKAwDguK_5 [call] v35'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.537+0000 7fedf4da6f40 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-13T23:57:23.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.537+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:87 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088ec00 con 0x55cc70743800 2024-09-13T23:57:23.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.541+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 40 ==== osd_op_reply(87 gc.27 [call] v35'25 uv25 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.541+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:88 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062ac00 con 0x55cc70743800 2024-09-13T23:57:23.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.541+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 41 ==== osd_op_reply(88 gc.27 [call] v35'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.541+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-13T23:57:23.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.541+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:89 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062a000 con 0x55cc7062a400 2024-09-13T23:57:23.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.545+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(89 gc.28 [call] v35'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.545+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062b400 con 0x55cc7062a400 2024-09-13T23:57:23.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.545+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(90 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.545+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.545+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:91 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743000 con 0x55cc7062a400 2024-09-13T23:57:23.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.545+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(91 gc.28 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.545+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:92 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743400 con 0x55cc7062a400 2024-09-13T23:57:23.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.545+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(92 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.545+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.545+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:93 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743c00 con 0x55cc7062a400 2024-09-13T23:57:23.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.545+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(93 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.545+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.545+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:94 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082f000 con 0x55cc7062a400 2024-09-13T23:57:23.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.545+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(94 gc.28 [call] v35'34 uv34 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.545+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-13T23:57:23.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.545+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:95 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e800 con 0x55cc70743800 2024-09-13T23:57:23.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.549+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 42 ==== osd_op_reply(95 gc.29 [call] v35'46 uv46 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.549+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:96 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082ec00 con 0x55cc70743800 2024-09-13T23:57:23.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.549+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 43 ==== osd_op_reply(96 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.549+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.549+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:97 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e000 con 0x55cc70743800 2024-09-13T23:57:23.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.549+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 44 ==== osd_op_reply(97 gc.29 [call out=24b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.549+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:98 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082f000 con 0x55cc70743800 2024-09-13T23:57:23.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.549+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 45 ==== osd_op_reply(98 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.549+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.549+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:99 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e800 con 0x55cc70743800 2024-09-13T23:57:23.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.549+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 46 ==== osd_op_reply(99 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.549+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.549+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:100 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743000 con 0x55cc70743800 2024-09-13T23:57:23.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.553+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 47 ==== osd_op_reply(100 gc.29 [call] v35'47 uv47 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.553+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-13T23:57:23.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.553+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:101 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743400 con 0x55cc7062a400 2024-09-13T23:57:23.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.553+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(101 gc.30 [call] v35'39 uv39 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.553+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:102 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743c00 con 0x55cc7062a400 2024-09-13T23:57:23.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.557+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(102 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.557+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.557+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:103 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062ac00 con 0x55cc7062a400 2024-09-13T23:57:23.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.557+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(103 gc.30 [call out=24b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.557+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:104 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062a000 con 0x55cc7062a400 2024-09-13T23:57:23.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.557+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(104 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.557+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.557+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:105 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062b400 con 0x55cc7062a400 2024-09-13T23:57:23.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.557+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(105 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.557+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.557+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:106 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088f000 con 0x55cc7062a400 2024-09-13T23:57:23.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.557+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(106 gc.30 [call] v35'40 uv40 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.557+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-13T23:57:23.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.557+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:107 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088f400 con 0x55cc70742800 2024-09-13T23:57:23.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.561+0000 7fedf2d5e700 1 -- 172.21.15.173:0/470361996 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(107 gc.31 [call] v35'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739440 con 0x55cc70742800 2024-09-13T23:57:23.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.561+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:108 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088ec00 con 0x55cc70742800 2024-09-13T23:57:23.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.561+0000 7fedf2d5e700 1 -- 172.21.15.173:0/470361996 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(108 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739440 con 0x55cc70742800 2024-09-13T23:57:23.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.561+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.561+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:109 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c000 con 0x55cc70742800 2024-09-13T23:57:23.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.561+0000 7fedf2d5e700 1 -- 172.21.15.173:0/470361996 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(109 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55cc70739440 con 0x55cc70742800 2024-09-13T23:57:23.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.561+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:110 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c400 con 0x55cc70742800 2024-09-13T23:57:23.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.561+0000 7fedf2d5e700 1 -- 172.21.15.173:0/470361996 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(110 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739440 con 0x55cc70742800 2024-09-13T23:57:23.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.561+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.561+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:111 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c800 con 0x55cc70742800 2024-09-13T23:57:23.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.561+0000 7fedf2d5e700 1 -- 172.21.15.173:0/470361996 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(111 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739440 con 0x55cc70742800 2024-09-13T23:57:23.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.561+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.561+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:112 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088cc00 con 0x55cc70742800 2024-09-13T23:57:23.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.565+0000 7fedf2d5e700 1 -- 172.21.15.173:0/470361996 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(112 gc.31 [call] v35'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739440 con 0x55cc70742800 2024-09-13T23:57:23.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.565+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-13T23:57:23.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.565+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:113 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088d000 con 0x55cc70743800 2024-09-13T23:57:23.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.565+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 48 ==== osd_op_reply(113 gc.0 [call] v35'29 uv29 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.565+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:114 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088d400 con 0x55cc70743800 2024-09-13T23:57:23.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.569+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 49 ==== osd_op_reply(114 gc.0 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.569+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.569+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:115 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088d800 con 0x55cc70743800 2024-09-13T23:57:23.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.569+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 50 ==== osd_op_reply(115 gc.0 [call out=24b] v0'0 uv29 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.569+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:116 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088dc00 con 0x55cc70743800 2024-09-13T23:57:23.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.569+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 51 ==== osd_op_reply(116 gc.0 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.569+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.569+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:117 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088d000 con 0x55cc70743800 2024-09-13T23:57:23.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.569+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 52 ==== osd_op_reply(117 gc.0 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.569+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.569+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:118 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c000 con 0x55cc70743800 2024-09-13T23:57:23.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.573+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 53 ==== osd_op_reply(118 gc.0 [call] v35'30 uv30 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.573+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-13T23:57:23.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.573+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:119 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088f000 con 0x55cc70742800 2024-09-13T23:57:23.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.577+0000 7fedf2d5e700 1 -- 172.21.15.173:0/470361996 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(119 gc.1 [call] v35'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55cc70739440 con 0x55cc70742800 2024-09-13T23:57:23.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.577+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:120 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088fc00 con 0x55cc70742800 2024-09-13T23:57:23.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.577+0000 7fedf2d5e700 1 -- 172.21.15.173:0/470361996 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(120 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70739440 con 0x55cc70742800 2024-09-13T23:57:23.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.577+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.577+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:121 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088e400 con 0x55cc70742800 2024-09-13T23:57:23.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.577+0000 7fedf2d5e700 1 -- 172.21.15.173:0/470361996 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(121 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x55cc70739440 con 0x55cc70742800 2024-09-13T23:57:23.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.577+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:122 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088e800 con 0x55cc70742800 2024-09-13T23:57:23.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.577+0000 7fedf2d5e700 1 -- 172.21.15.173:0/470361996 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(122 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70739440 con 0x55cc70742800 2024-09-13T23:57:23.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.577+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.577+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:123 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088f400 con 0x55cc70742800 2024-09-13T23:57:23.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.577+0000 7fedf2d5e700 1 -- 172.21.15.173:0/470361996 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(123 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70739440 con 0x55cc70742800 2024-09-13T23:57:23.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.577+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.577+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:124 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088ec00 con 0x55cc70742800 2024-09-13T23:57:23.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.581+0000 7fedf2d5e700 1 -- 172.21.15.173:0/470361996 <== osd.2 v2:172.21.15.173:6809/889985573 18 ==== osd_op_reply(124 gc.1 [call] v35'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55cc70739440 con 0x55cc70742800 2024-09-13T23:57:23.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.581+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-13T23:57:23.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.581+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:125 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062ac00 con 0x55cc7062b800 2024-09-13T23:57:23.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.585+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 35 ==== osd_op_reply(125 gc.2 [call] v35'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.585+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:126 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062a000 con 0x55cc7062b800 2024-09-13T23:57:23.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.585+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 36 ==== osd_op_reply(126 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.585+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.585+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:127 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062b400 con 0x55cc7062b800 2024-09-13T23:57:23.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.585+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 37 ==== osd_op_reply(127 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.585+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:128 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743000 con 0x55cc7062b800 2024-09-13T23:57:23.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.585+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 38 ==== osd_op_reply(128 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.585+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.585+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:129 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743400 con 0x55cc7062b800 2024-09-13T23:57:23.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.585+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 39 ==== osd_op_reply(129 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.585+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.585+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:130 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743c00 con 0x55cc7062b800 2024-09-13T23:57:23.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.589+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 40 ==== osd_op_reply(130 gc.2 [call] v35'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.589+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-13T23:57:23.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.589+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:131 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082ec00 con 0x55cc7062a400 2024-09-13T23:57:23.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.589+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(131 gc.3 [call] v35'161 uv161 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.589+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:132 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e000 con 0x55cc7062a400 2024-09-13T23:57:23.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.593+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(132 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.593+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.593+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:133 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082f000 con 0x55cc7062a400 2024-09-13T23:57:23.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.593+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(133 gc.3 [call out=24b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.593+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:134 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e800 con 0x55cc7062a400 2024-09-13T23:57:23.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.593+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(134 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.593+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.593+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:135 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088f800 con 0x55cc7062a400 2024-09-13T23:57:23.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.593+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 24 ==== osd_op_reply(135 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.593+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.593+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:136 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088e000 con 0x55cc7062a400 2024-09-13T23:57:23.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.597+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 25 ==== osd_op_reply(136 gc.3 [call] v35'162 uv162 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.597+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-13T23:57:23.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.597+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:137 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088f000 con 0x55cc70743800 2024-09-13T23:57:23.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.597+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 54 ==== osd_op_reply(137 gc.4 [call] v35'50 uv50 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.597+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:138 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088fc00 con 0x55cc70743800 2024-09-13T23:57:23.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.601+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 55 ==== osd_op_reply(138 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.601+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.601+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:139 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088e400 con 0x55cc70743800 2024-09-13T23:57:23.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.601+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 56 ==== osd_op_reply(139 gc.4 [call out=24b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.601+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:140 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088e800 con 0x55cc70743800 2024-09-13T23:57:23.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.601+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 57 ==== osd_op_reply(140 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.601+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.601+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:141 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c400 con 0x55cc70743800 2024-09-13T23:57:23.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.601+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 58 ==== osd_op_reply(141 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.601+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.601+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:142 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c800 con 0x55cc70743800 2024-09-13T23:57:23.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.605+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 59 ==== osd_op_reply(142 gc.4 [call] v35'51 uv51 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.605+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-13T23:57:23.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.605+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:143 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088cc00 con 0x55cc7062b800 2024-09-13T23:57:23.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.609+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 41 ==== osd_op_reply(143 gc.5 [call] v35'35 uv35 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.609+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:144 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743000 con 0x55cc7062b800 2024-09-13T23:57:23.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.609+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 42 ==== osd_op_reply(144 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.609+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.609+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:145 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062bc00 con 0x55cc7062b800 2024-09-13T23:57:23.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.609+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 43 ==== osd_op_reply(145 gc.5 [call out=24b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.609+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:146 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062b000 con 0x55cc7062b800 2024-09-13T23:57:23.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.609+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 44 ==== osd_op_reply(146 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.609+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.609+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:147 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062ac00 con 0x55cc7062b800 2024-09-13T23:57:23.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.609+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 45 ==== osd_op_reply(147 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.609+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.609+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:148 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062a000 con 0x55cc7062b800 2024-09-13T23:57:23.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.613+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 46 ==== osd_op_reply(148 gc.5 [call] v35'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.613+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-13T23:57:23.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.613+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:149 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062b400 con 0x55cc70743800 2024-09-13T23:57:23.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.617+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 60 ==== osd_op_reply(149 gc.6 [call] v35'22 uv22 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.617+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:150 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082fc00 con 0x55cc70743800 2024-09-13T23:57:23.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.617+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 61 ==== osd_op_reply(150 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.617+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.617+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:151 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e400 con 0x55cc70743800 2024-09-13T23:57:23.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.617+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 62 ==== osd_op_reply(151 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.617+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:152 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088f800 con 0x55cc70743800 2024-09-13T23:57:23.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.617+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 63 ==== osd_op_reply(152 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.617+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.617+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:153 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088e000 con 0x55cc70743800 2024-09-13T23:57:23.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.621+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 64 ==== osd_op_reply(153 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.621+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.621+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:154 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088f000 con 0x55cc70743800 2024-09-13T23:57:23.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.621+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 65 ==== osd_op_reply(154 gc.6 [call] v35'23 uv23 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.621+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-13T23:57:23.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.621+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:155 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088fc00 con 0x55cc7062a400 2024-09-13T23:57:23.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.625+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 26 ==== osd_op_reply(155 gc.7 [call] v35'35 uv35 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.625+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:156 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082ec00 con 0x55cc7062a400 2024-09-13T23:57:23.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.625+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 27 ==== osd_op_reply(156 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.625+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.625+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:157 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e000 con 0x55cc7062a400 2024-09-13T23:57:23.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.625+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 28 ==== osd_op_reply(157 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.625+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:158 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082f000 con 0x55cc7062a400 2024-09-13T23:57:23.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.625+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 29 ==== osd_op_reply(158 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.625+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.625+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:159 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e800 con 0x55cc7062a400 2024-09-13T23:57:23.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.629+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 30 ==== osd_op_reply(159 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.629+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.629+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:160 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088d400 con 0x55cc7062a400 2024-09-13T23:57:23.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.629+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 31 ==== osd_op_reply(160 gc.7 [call] v35'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.629+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-13T23:57:23.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.629+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:161 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088d800 con 0x55cc70743800 2024-09-13T23:57:23.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.633+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 66 ==== osd_op_reply(161 gc.8 [call] v35'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.633+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:162 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088dc00 con 0x55cc70743800 2024-09-13T23:57:23.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.633+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 67 ==== osd_op_reply(162 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.633+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.633+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:163 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088d000 con 0x55cc70743800 2024-09-13T23:57:23.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.633+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 68 ==== osd_op_reply(163 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.633+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:164 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c000 con 0x55cc70743800 2024-09-13T23:57:23.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.637+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 69 ==== osd_op_reply(164 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.637+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.637+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:165 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082fc00 con 0x55cc70743800 2024-09-13T23:57:23.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.637+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 70 ==== osd_op_reply(165 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.637+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.637+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:166 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e400 con 0x55cc70743800 2024-09-13T23:57:23.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.637+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 71 ==== osd_op_reply(166 gc.8 [call] v35'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.637+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-13T23:57:23.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.637+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:167 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082ec00 con 0x55cc70743800 2024-09-13T23:57:23.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.641+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 72 ==== osd_op_reply(167 gc.9 [call] v35'26 uv26 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.641+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:168 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e000 con 0x55cc70743800 2024-09-13T23:57:23.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.641+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 73 ==== osd_op_reply(168 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.641+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.641+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:169 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082f000 con 0x55cc70743800 2024-09-13T23:57:23.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.641+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 74 ==== osd_op_reply(169 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.641+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:170 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088e400 con 0x55cc70743800 2024-09-13T23:57:23.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.641+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 75 ==== osd_op_reply(170 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.641+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.641+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:171 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088e800 con 0x55cc70743800 2024-09-13T23:57:23.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.645+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 76 ==== osd_op_reply(171 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.645+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.645+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:172 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088f800 con 0x55cc70743800 2024-09-13T23:57:23.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.645+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 77 ==== osd_op_reply(172 gc.9 [call] v35'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.645+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-13T23:57:23.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.645+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:173 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088e000 con 0x55cc70743800 2024-09-13T23:57:23.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.649+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 78 ==== osd_op_reply(173 gc.10 [call] v35'52 uv52 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.649+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:174 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088f000 con 0x55cc70743800 2024-09-13T23:57:23.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.649+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 79 ==== osd_op_reply(174 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.649+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.649+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:175 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088fc00 con 0x55cc70743800 2024-09-13T23:57:23.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.649+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 80 ==== osd_op_reply(175 gc.10 [call out=24b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.649+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:176 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062b400 con 0x55cc70743800 2024-09-13T23:57:23.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.649+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 81 ==== osd_op_reply(176 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.649+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.649+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:177 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c400 con 0x55cc70743800 2024-09-13T23:57:23.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.649+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 82 ==== osd_op_reply(177 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.649+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.649+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:178 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c800 con 0x55cc70743800 2024-09-13T23:57:23.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.653+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 83 ==== osd_op_reply(178 gc.10 [call] v35'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.653+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-13T23:57:23.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.653+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:179 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088e400 con 0x55cc7062b800 2024-09-13T23:57:23.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.657+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 47 ==== osd_op_reply(179 gc.11 [call] v35'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.657+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:180 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088e800 con 0x55cc7062b800 2024-09-13T23:57:23.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.657+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 48 ==== osd_op_reply(180 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.657+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.657+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:181 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088f800 con 0x55cc7062b800 2024-09-13T23:57:23.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.657+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 49 ==== osd_op_reply(181 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.657+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:182 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088e000 con 0x55cc7062b800 2024-09-13T23:57:23.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.657+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 50 ==== osd_op_reply(182 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.657+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.657+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:183 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e800 con 0x55cc7062b800 2024-09-13T23:57:23.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.657+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 51 ==== osd_op_reply(183 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.657+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.657+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:184 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082fc00 con 0x55cc7062b800 2024-09-13T23:57:23.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.661+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 52 ==== osd_op_reply(184 gc.11 [call] v35'24 uv24 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.661+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-13T23:57:23.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.661+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:185 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e400 con 0x55cc70743800 2024-09-13T23:57:23.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.665+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 84 ==== osd_op_reply(185 gc.12 [call] v35'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.665+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:186 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082ec00 con 0x55cc70743800 2024-09-13T23:57:23.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.665+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 85 ==== osd_op_reply(186 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.665+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.665+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:187 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e000 con 0x55cc70743800 2024-09-13T23:57:23.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.665+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 86 ==== osd_op_reply(187 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.665+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:188 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082f000 con 0x55cc70743800 2024-09-13T23:57:23.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.665+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 87 ==== osd_op_reply(188 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.665+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.665+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:189 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088d400 con 0x55cc70743800 2024-09-13T23:57:23.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.669+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 88 ==== osd_op_reply(189 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.669+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.669+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:190 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088d800 con 0x55cc70743800 2024-09-13T23:57:23.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.669+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 89 ==== osd_op_reply(190 gc.12 [call] v35'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.669+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-13T23:57:23.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.669+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:191 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088dc00 con 0x55cc7062a400 2024-09-13T23:57:23.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.673+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 32 ==== osd_op_reply(191 gc.13 [call] v35'41 uv41 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.673+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:192 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088d000 con 0x55cc7062a400 2024-09-13T23:57:23.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.673+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 33 ==== osd_op_reply(192 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.673+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.673+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:193 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c000 con 0x55cc7062a400 2024-09-13T23:57:23.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.673+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 34 ==== osd_op_reply(193 gc.13 [call out=24b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.673+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:194 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088e400 con 0x55cc7062a400 2024-09-13T23:57:23.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.673+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 35 ==== osd_op_reply(194 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.673+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.673+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:195 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088e800 con 0x55cc7062a400 2024-09-13T23:57:23.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.677+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 36 ==== osd_op_reply(195 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.677+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.677+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:196 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088f800 con 0x55cc7062a400 2024-09-13T23:57:23.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.677+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 37 ==== osd_op_reply(196 gc.13 [call] v35'42 uv42 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.677+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-13T23:57:23.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.677+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:197 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062bc00 con 0x55cc7062a400 2024-09-13T23:57:23.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.681+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 38 ==== osd_op_reply(197 gc.14 [call] v35'163 uv163 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.681+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:198 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062b000 con 0x55cc7062a400 2024-09-13T23:57:23.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.681+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 39 ==== osd_op_reply(198 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.681+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.681+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:199 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062ac00 con 0x55cc7062a400 2024-09-13T23:57:23.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.681+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 40 ==== osd_op_reply(199 gc.14 [call out=24b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.681+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:200 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062a000 con 0x55cc7062a400 2024-09-13T23:57:23.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.681+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 41 ==== osd_op_reply(200 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.681+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.681+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:201 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743400 con 0x55cc7062a400 2024-09-13T23:57:23.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.681+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 42 ==== osd_op_reply(201 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.681+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.681+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:202 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743c00 con 0x55cc7062a400 2024-09-13T23:57:23.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.685+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 43 ==== osd_op_reply(202 gc.14 [call] v35'164 uv164 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.685+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-13T23:57:23.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.685+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:203 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743000 con 0x55cc70743800 2024-09-13T23:57:23.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.689+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 90 ==== osd_op_reply(203 gc.15 [call] v35'48 uv48 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.689+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:204 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088cc00 con 0x55cc70743800 2024-09-13T23:57:23.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.689+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 91 ==== osd_op_reply(204 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.689+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.689+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:205 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088f000 con 0x55cc70743800 2024-09-13T23:57:23.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.689+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 92 ==== osd_op_reply(205 gc.15 [call out=24b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.689+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:206 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088fc00 con 0x55cc70743800 2024-09-13T23:57:23.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.689+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 93 ==== osd_op_reply(206 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.689+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.689+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:207 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088e400 con 0x55cc70743800 2024-09-13T23:57:23.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.689+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 94 ==== osd_op_reply(207 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.689+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.689+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:208 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088e800 con 0x55cc70743800 2024-09-13T23:57:23.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.693+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 95 ==== osd_op_reply(208 gc.15 [call] v35'49 uv49 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.693+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-13T23:57:23.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.693+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:209 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c400 con 0x55cc70743800 2024-09-13T23:57:23.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.697+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 96 ==== osd_op_reply(209 gc.16 [call] v35'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.697+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:210 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c800 con 0x55cc70743800 2024-09-13T23:57:23.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.697+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 97 ==== osd_op_reply(210 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.697+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.697+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:211 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088d400 con 0x55cc70743800 2024-09-13T23:57:23.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.697+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 98 ==== osd_op_reply(211 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.697+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:212 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088d800 con 0x55cc70743800 2024-09-13T23:57:23.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.701+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 99 ==== osd_op_reply(212 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.701+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.701+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:213 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088dc00 con 0x55cc70743800 2024-09-13T23:57:23.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.701+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 100 ==== osd_op_reply(213 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.701+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.701+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:214 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088d000 con 0x55cc70743800 2024-09-13T23:57:23.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.705+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 101 ==== osd_op_reply(214 gc.16 [call] v35'55 uv55 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.705+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-13T23:57:23.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.705+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:215 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c000 con 0x55cc7062b800 2024-09-13T23:57:23.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.705+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 53 ==== osd_op_reply(215 gc.17 [call] v35'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.705+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:216 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e400 con 0x55cc7062b800 2024-09-13T23:57:23.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.709+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 54 ==== osd_op_reply(216 gc.17 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.709+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.709+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:217 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082ec00 con 0x55cc7062b800 2024-09-13T23:57:23.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.709+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 55 ==== osd_op_reply(217 gc.17 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.709+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:218 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082e000 con 0x55cc7062b800 2024-09-13T23:57:23.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.709+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 56 ==== osd_op_reply(218 gc.17 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.709+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.709+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:219 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7082f000 con 0x55cc7062b800 2024-09-13T23:57:23.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.709+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 57 ==== osd_op_reply(219 gc.17 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.709+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.709+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:220 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062b400 con 0x55cc7062b800 2024-09-13T23:57:23.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.713+0000 7fedf3d60700 1 -- 172.21.15.173:0/470361996 <== osd.3 v2:172.21.15.173:6800/4020038786 58 ==== osd_op_reply(220 gc.17 [call] v35'24 uv24 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc7062b800 2024-09-13T23:57:23.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.713+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-13T23:57:23.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.713+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:221 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088cc00 con 0x55cc70743800 2024-09-13T23:57:23.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.717+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 102 ==== osd_op_reply(221 gc.18 [call] v35'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.717+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:222 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c400 con 0x55cc70743800 2024-09-13T23:57:23.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.717+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 103 ==== osd_op_reply(222 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.717+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.717+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:223 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088c800 con 0x55cc70743800 2024-09-13T23:57:23.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.717+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 104 ==== osd_op_reply(223 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.717+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:224 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088d400 con 0x55cc70743800 2024-09-13T23:57:23.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.717+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 105 ==== osd_op_reply(224 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.717+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.717+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:225 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088d800 con 0x55cc70743800 2024-09-13T23:57:23.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.721+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 106 ==== osd_op_reply(225 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.721+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.721+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:226 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088f800 con 0x55cc70743800 2024-09-13T23:57:23.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.721+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.0 v2:172.21.15.87:6800/3507919120 107 ==== osd_op_reply(226 gc.18 [call] v35'29 uv29 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70743800 2024-09-13T23:57:23.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.721+0000 7fedf4da6f40 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-13T23:57:23.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.721+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:227 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088f000 con 0x55cc7062a400 2024-09-13T23:57:23.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.725+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 44 ==== osd_op_reply(227 gc.19 [call] v35'165 uv165 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.725+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:228 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088fc00 con 0x55cc7062a400 2024-09-13T23:57:23.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.725+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 45 ==== osd_op_reply(228 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.725+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.725+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:229 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088e400 con 0x55cc7062a400 2024-09-13T23:57:23.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.725+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 46 ==== osd_op_reply(229 gc.19 [call out=24b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.725+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:230 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7088e800 con 0x55cc7062a400 2024-09-13T23:57:23.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.725+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 47 ==== osd_op_reply(230 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.725+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:57:23.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.725+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:231 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743400 con 0x55cc7062a400 2024-09-13T23:57:23.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.729+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 48 ==== osd_op_reply(231 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.729+0000 7fedf4da6f40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:57:23.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.729+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:232 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743c00 con 0x55cc7062a400 2024-09-13T23:57:23.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.729+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 <== osd.1 v2:172.21.15.173:6808/3256211813 49 ==== osd_op_reply(232 gc.19 [call] v35'166 uv166 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc7062a400 2024-09-13T23:57:23.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.733+0000 7fedda52d700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:23.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.733+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94336548421632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743000 con 0x55cc70681000 2024-09-13T23:57:23.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.733+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(62 data_loggenerations_metadata [watch unwatch cookie 94336548421632] v35'167 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70681000 2024-09-13T23:57:23.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.733+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:63 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94336546683648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062bc00 con 0x55cc70681400 2024-09-13T23:57:23.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.737+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(63 notify.0 [watch unwatch cookie 94336546683648] v35'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70681400 2024-09-13T23:57:23.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.737+0000 7fedf4da6f40 20 remove_watcher() i=0 2024-09-13T23:57:23.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.737+0000 7fedf4da6f40 2 removed watcher, disabling cache 2024-09-13T23:57:23.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.737+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94336546684800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062b000 con 0x55cc70681000 2024-09-13T23:57:23.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.737+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(64 notify.1 [watch unwatch cookie 94336546684800] v35'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70681000 2024-09-13T23:57:23.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.737+0000 7fedf4da6f40 20 remove_watcher() i=1 2024-09-13T23:57:23.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.737+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94336546685952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062ac00 con 0x55cc70681400 2024-09-13T23:57:23.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.741+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(65 notify.2 [watch unwatch cookie 94336546685952] v35'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70681400 2024-09-13T23:57:23.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.741+0000 7fedf4da6f40 20 remove_watcher() i=2 2024-09-13T23:57:23.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.741+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94336546687104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062a000 con 0x55cc70742000 2024-09-13T23:57:23.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.745+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(66 notify.3 [watch unwatch cookie 94336546687104] v35'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70742000 2024-09-13T23:57:23.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.745+0000 7fedf4da6f40 20 remove_watcher() i=3 2024-09-13T23:57:23.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.745+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94336546688256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062b400 con 0x55cc70681400 2024-09-13T23:57:23.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.745+0000 7fedf355f700 1 -- 172.21.15.173:0/2861660137 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(67 notify.4 [watch unwatch cookie 94336546688256] v35'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cc70739200 con 0x55cc70681400 2024-09-13T23:57:23.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.745+0000 7fedf4da6f40 20 remove_watcher() i=4 2024-09-13T23:57:23.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.745+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94336546689408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062b000 con 0x55cc70681c00 2024-09-13T23:57:23.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.749+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2861660137 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(68 notify.5 [watch unwatch cookie 94336546689408] v35'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cc70739440 con 0x55cc70681c00 2024-09-13T23:57:23.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.749+0000 7fedf4da6f40 20 remove_watcher() i=5 2024-09-13T23:57:23.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.749+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94336546690560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc7062a000 con 0x55cc70681c00 2024-09-13T23:57:23.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2861660137 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(69 notify.6 [watch unwatch cookie 94336546690560] v35'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cc70739440 con 0x55cc70681c00 2024-09-13T23:57:23.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 20 remove_watcher() i=6 2024-09-13T23:57:23.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:70 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94336546691712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cc70743000 con 0x55cc70742000 2024-09-13T23:57:23.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf3d60700 1 -- 172.21.15.173:0/2861660137 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(70 notify.7 [watch unwatch cookie 94336546691712] v35'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cc70738b40 con 0x55cc70742000 2024-09-13T23:57:23.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 20 remove_watcher() i=7 2024-09-13T23:57:23.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55cc70681400 msgr2=0x55cc705b6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/2861660137 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55cc70681400 0x55cc705b6100 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55cc70681000 msgr2=0x55cc705b5b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/2861660137 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55cc70681000 0x55cc705b5b80 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55cc70742000 msgr2=0x55cc705b6c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/2861660137 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55cc70742000 0x55cc705b6c00 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55cc70681c00 msgr2=0x55cc705b6680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/2861660137 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55cc70681c00 0x55cc705b6680 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cc70680c00 msgr2=0x55cc705b5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/2861660137 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cc70680c00 0x55cc705b5600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55cc705af920 tx=0x55cc703d3800 comp rx=0 tx=0).stop 2024-09-13T23:57:23.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf2d5e700 1 -- 172.21.15.173:0/2861660137 reap_dead start 2024-09-13T23:57:23.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf800 msgr2=0x55cc705b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/2861660137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf800 0x55cc705b4b00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x55cc71140240 tx=0x55cc70638cc0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 shutdown_connections 2024-09-13T23:57:23.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/2861660137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf800 0x55cc705b4b00 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 >> 172.21.15.173:0/2861660137 conn(0x55cc702cf400 msgr2=0x55cc703cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:23.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 shutdown_connections 2024-09-13T23:57:23.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 -- 172.21.15.173:0/2861660137 wait complete. 2024-09-13T23:57:23.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55cc70743800 msgr2=0x55cc705b7700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/470361996 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55cc70743800 0x55cc705b7700 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55cc7062a400 msgr2=0x55cc707db080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/470361996 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55cc7062a400 0x55cc707db080 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55cc70742800 msgr2=0x55cc707da580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/470361996 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55cc70742800 0x55cc707da580 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55cc7062b800 msgr2=0x55cc707dab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/470361996 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55cc7062b800 0x55cc707dab00 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.753+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cc70681800 msgr2=0x55cc707da000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.757+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/470361996 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cc70681800 0x55cc707da000 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55cc706d76e0 tx=0x55cc7072b5c0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.757+0000 7fedf355f700 1 -- 172.21.15.173:0/470361996 reap_dead start 2024-09-13T23:57:23.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.757+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc70742400 msgr2=0x55cc705b7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.757+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/470361996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc70742400 0x55cc705b7180 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x55cc7075c390 tx=0x55cc7072a5a0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.757+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 shutdown_connections 2024-09-13T23:57:23.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.757+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/470361996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc70742400 0x55cc705b7180 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.757+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 >> 172.21.15.173:0/470361996 conn(0x55cc7062a800 msgr2=0x55cc703d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:23.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.757+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 shutdown_connections 2024-09-13T23:57:23.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.757+0000 7fedf4da6f40 1 -- 172.21.15.173:0/470361996 wait complete. 2024-09-13T23:57:23.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.757+0000 7fedf4da6f40 1 -- 172.21.15.173:0/623799828 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cc70680000 msgr2=0x55cc705b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.757+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/623799828 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cc70680000 0x55cc705b5080 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55cc711416b0 tx=0x55cc70638240 comp rx=0 tx=0).stop 2024-09-13T23:57:23.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.757+0000 7fedf4da6f40 1 -- 172.21.15.173:0/623799828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf000 msgr2=0x55cc705b4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.757+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/623799828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf000 0x55cc705b4580 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x55cc711400c0 tx=0x55cc703d3a40 comp rx=0 tx=0).stop 2024-09-13T23:57:23.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.757+0000 7fedf4da6f40 1 -- 172.21.15.173:0/623799828 shutdown_connections 2024-09-13T23:57:23.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.757+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/623799828 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cc70680000 0x55cc705b5080 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.757+0000 7fedf4da6f40 1 --2- 172.21.15.173:0/623799828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cc702cf000 0x55cc705b4580 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.757+0000 7fedf4da6f40 1 -- 172.21.15.173:0/623799828 >> 172.21.15.173:0/623799828 conn(0x55cc702cec00 msgr2=0x55cc703cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:23.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.757+0000 7fedf4da6f40 1 -- 172.21.15.173:0/623799828 shutdown_connections 2024-09-13T23:57:23.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.757+0000 7fedf4da6f40 1 -- 172.21.15.173:0/623799828 wait complete. 2024-09-13T23:57:23.767 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-13T23:57:23.767 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-13T23:57:23.768 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-13T23:57:23.808 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:23.809 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:23.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.805+0000 7ffbd6965f40 1 Processor -- start 2024-09-13T23:57:23.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.805+0000 7ffbd6965f40 1 -- start start 2024-09-13T23:57:23.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.805+0000 7ffbd6965f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x559cac9e9400 0x559caccce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.805+0000 7ffbd6965f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559cacaad500 con 0x559cac9e9000 2024-09-13T23:57:23.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.805+0000 7ffbd6965f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x559caca76a00 con 0x559cac9e9400 2024-09-13T23:57:23.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.805+0000 7ffbd511e700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x559cac9e9000 0x559cacae8800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:44886/0 (socket says 172.21.15.173:44886) 2024-09-13T23:57:23.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.805+0000 7ffbd511e700 1 -- 172.21.15.173:0/3424856083 learned_addr learned my addr 172.21.15.173:0/3424856083 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:23.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.805+0000 7ffbd491d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x559cac9e9400 0x559caccce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.805+0000 7ffbd411c700 1 -- 172.21.15.173:0/3424856083 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3318830323 0 0) 0x559cacb44000 con 0x559cac9e9000 2024-09-13T23:57:23.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.805+0000 7ffbd411c700 1 -- 172.21.15.173:0/3424856083 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x559cacaad680 con 0x559cac9e9000 2024-09-13T23:57:23.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.805+0000 7ffbd491d700 1 -- 172.21.15.173:0/3424856083 >> v1:172.21.15.87:6789/0 conn(0x559cac9e9000 legacy=0x559cacae8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.805+0000 7ffbd491d700 1 -- 172.21.15.173:0/3424856083 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559cac9fbd40 con 0x559cac9e9400 2024-09-13T23:57:23.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.805+0000 7ffbd491d700 1 --2- 172.21.15.173:0/3424856083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9400 0x559caccce580 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x559caccc9920 tx=0x559cacaed980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=914b743d1c4d3136 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.805+0000 7ffbd411c700 1 -- 172.21.15.173:0/3424856083 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559caca8d4a0 con 0x559cac9e9400 2024-09-13T23:57:23.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.805+0000 7ffbd411c700 1 -- 172.21.15.173:0/3424856083 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559cacaad680 con 0x559cac9e9400 2024-09-13T23:57:23.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.805+0000 7ffbd411c700 1 -- 172.21.15.173:0/3424856083 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559caca8d600 con 0x559cac9e9400 2024-09-13T23:57:23.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.805+0000 7ffbd6965f40 1 -- 172.21.15.173:0/3424856083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9400 msgr2=0x559caccce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.805+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/3424856083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9400 0x559caccce580 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x559caccc9920 tx=0x559cacaed980 comp rx=0 tx=0).stop 2024-09-13T23:57:23.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.805+0000 7ffbd6965f40 1 -- 172.21.15.173:0/3424856083 shutdown_connections 2024-09-13T23:57:23.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.805+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/3424856083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9400 0x559caccce580 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.805+0000 7ffbd6965f40 1 -- 172.21.15.173:0/3424856083 >> 172.21.15.173:0/3424856083 conn(0x559cac9e8c00 msgr2=0x559cacae8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:23.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.805+0000 7ffbd6965f40 1 -- 172.21.15.173:0/3424856083 shutdown_connections 2024-09-13T23:57:23.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.809+0000 7ffbd6965f40 1 -- 172.21.15.173:0/3424856083 wait complete. 2024-09-13T23:57:23.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.809+0000 7ffbd6965f40 1 Processor -- start 2024-09-13T23:57:23.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.809+0000 7ffbd6965f40 1 -- start start 2024-09-13T23:57:23.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.809+0000 7ffbd6965f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9000 0x559caccce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.809+0000 7ffbd6965f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559caca76500 con 0x559cac9e9000 2024-09-13T23:57:23.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.809+0000 7ffbd511e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9000 0x559caccce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.809+0000 7ffbd511e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9000 0x559caccce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34634/0 (socket says 172.21.15.173:34634) 2024-09-13T23:57:23.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.809+0000 7ffbd511e700 1 -- 172.21.15.173:0/2146561508 learned_addr learned my addr 172.21.15.173:0/2146561508 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:23.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.809+0000 7ffbd511e700 1 -- 172.21.15.173:0/2146561508 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559cac9fbba0 con 0x559cac9e9000 2024-09-13T23:57:23.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.809+0000 7ffbd511e700 1 --2- 172.21.15.173:0/2146561508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9000 0x559caccce580 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x559cad7b3d70 tx=0x559cacaedb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c305689ea41cb1d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.809+0000 7ffbd391b700 1 -- 172.21.15.173:0/2146561508 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559caca8d4a0 con 0x559cac9e9000 2024-09-13T23:57:23.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.809+0000 7ffbd391b700 1 -- 172.21.15.173:0/2146561508 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559cacaadb00 con 0x559cac9e9000 2024-09-13T23:57:23.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.809+0000 7ffbd391b700 1 -- 172.21.15.173:0/2146561508 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559caca8d600 con 0x559cac9e9000 2024-09-13T23:57:23.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.813+0000 7ffbd6965f40 1 -- 172.21.15.173:0/2146561508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9000 msgr2=0x559caccce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.813+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/2146561508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9000 0x559caccce580 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x559cad7b3d70 tx=0x559cacaedb60 comp rx=0 tx=0).stop 2024-09-13T23:57:23.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.813+0000 7ffbd6965f40 1 -- 172.21.15.173:0/2146561508 shutdown_connections 2024-09-13T23:57:23.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.813+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/2146561508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9000 0x559caccce580 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.813+0000 7ffbd6965f40 1 -- 172.21.15.173:0/2146561508 >> 172.21.15.173:0/2146561508 conn(0x559cac9e8c00 msgr2=0x559cacae9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:23.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.813+0000 7ffbd6965f40 1 -- 172.21.15.173:0/2146561508 shutdown_connections 2024-09-13T23:57:23.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.813+0000 7ffbd6965f40 1 -- 172.21.15.173:0/2146561508 wait complete. 2024-09-13T23:57:23.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.813+0000 7ffbd6965f40 1 Processor -- start 2024-09-13T23:57:23.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.813+0000 7ffbd6965f40 1 -- start start 2024-09-13T23:57:23.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.813+0000 7ffbd6965f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9000 0x559caccce580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.813+0000 7ffbd6965f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559caca763c0 con 0x559cac9e9000 2024-09-13T23:57:23.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.813+0000 7ffbd511e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9000 0x559caccce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.813+0000 7ffbd511e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9000 0x559caccce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34646/0 (socket says 172.21.15.173:34646) 2024-09-13T23:57:23.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.813+0000 7ffbd511e700 1 -- 172.21.15.173:0/2049039283 learned_addr learned my addr 172.21.15.173:0/2049039283 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:23.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.813+0000 7ffbd511e700 1 -- 172.21.15.173:0/2049039283 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559cac9fba00 con 0x559cac9e9000 2024-09-13T23:57:23.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.813+0000 7ffbd511e700 1 --2- 172.21.15.173:0/2049039283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9000 0x559caccce580 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x559cad7b3e60 tx=0x559cacaed920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.813+0000 7ffbd2118700 1 -- 172.21.15.173:0/2049039283 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559caca8d8c0 con 0x559cac9e9000 2024-09-13T23:57:23.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.813+0000 7ffbd2118700 1 -- 172.21.15.173:0/2049039283 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559cacaadc80 con 0x559cac9e9000 2024-09-13T23:57:23.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.813+0000 7ffbd2118700 1 -- 172.21.15.173:0/2049039283 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559caca8d4a0 con 0x559cac9e9000 2024-09-13T23:57:23.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.813+0000 7ffbd6965f40 1 -- 172.21.15.173:0/2049039283 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559cac9fb860 con 0x559cac9e9000 2024-09-13T23:57:23.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.817+0000 7ffbd6965f40 1 -- 172.21.15.173:0/2049039283 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559cac9fb6c0 con 0x559cac9e9000 2024-09-13T23:57:23.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.817+0000 7ffbd6965f40 1 Processor -- start 2024-09-13T23:57:23.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.817+0000 7ffbd6965f40 1 -- start start 2024-09-13T23:57:23.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.817+0000 7ffbd6965f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9800 0x559caccceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.817+0000 7ffbd6965f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559caca76000 con 0x559cac9e9800 2024-09-13T23:57:23.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.817+0000 7ffbd2118700 1 -- 172.21.15.173:0/2049039283 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x559cacae2b00 con 0x559cac9e9000 2024-09-13T23:57:23.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.817+0000 7ffbd2118700 1 --2- 172.21.15.173:0/2049039283 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559cacd88000 0x559cacccf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.817+0000 7ffbd591f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9800 0x559caccceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.817+0000 7ffbd2118700 1 -- 172.21.15.173:0/2049039283 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x559caca4f180 con 0x559cac9e9000 2024-09-13T23:57:23.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.817+0000 7ffbd591f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9800 0x559caccceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34652/0 (socket says 172.21.15.173:34652) 2024-09-13T23:57:23.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.817+0000 7ffbd591f700 1 -- 172.21.15.173:0/2861001449 learned_addr learned my addr 172.21.15.173:0/2861001449 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:23.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.817+0000 7ffbd511e700 1 --2- 172.21.15.173:0/2049039283 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559cacd88000 0x559cacccf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.817+0000 7ffbd591f700 1 -- 172.21.15.173:0/2861001449 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559cac9fa000 con 0x559cac9e9800 2024-09-13T23:57:23.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.817+0000 7ffbd511e700 1 --2- 172.21.15.173:0/2049039283 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559cacd88000 0x559cacccf080 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x559cacd174d0 tx=0x559cacd44240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.817+0000 7ffbd591f700 1 --2- 172.21.15.173:0/2861001449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9800 0x559caccceb00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x559caccc9f80 tx=0x559cacd450e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229beb23ca65c98f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.817+0000 7ffbcf913700 1 -- 172.21.15.173:0/2861001449 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559caca8d8c0 con 0x559cac9e9800 2024-09-13T23:57:23.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.817+0000 7ffbcf913700 1 -- 172.21.15.173:0/2861001449 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559cacd9e000 con 0x559cac9e9800 2024-09-13T23:57:23.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.817+0000 7ffbcf913700 1 -- 172.21.15.173:0/2861001449 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559caca8d4a0 con 0x559cac9e9800 2024-09-13T23:57:23.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.821+0000 7ffbd6965f40 1 -- 172.21.15.173:0/2861001449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9800 msgr2=0x559caccceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.821+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/2861001449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9800 0x559caccceb00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x559caccc9f80 tx=0x559cacd450e0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.821+0000 7ffbd6965f40 1 -- 172.21.15.173:0/2861001449 shutdown_connections 2024-09-13T23:57:23.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.821+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/2861001449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9800 0x559caccceb00 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.821+0000 7ffbd6965f40 1 -- 172.21.15.173:0/2861001449 >> 172.21.15.173:0/2861001449 conn(0x559cac9e9400 msgr2=0x559cacae9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:23.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.821+0000 7ffbd6965f40 1 -- 172.21.15.173:0/2861001449 shutdown_connections 2024-09-13T23:57:23.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.821+0000 7ffbd6965f40 1 -- 172.21.15.173:0/2861001449 wait complete. 2024-09-13T23:57:23.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.821+0000 7ffbd6965f40 1 Processor -- start 2024-09-13T23:57:23.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.821+0000 7ffbd6965f40 1 -- start start 2024-09-13T23:57:23.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.821+0000 7ffbd6965f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9800 0x559caccceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.821+0000 7ffbd6965f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559caca0e640 con 0x559cac9e9800 2024-09-13T23:57:23.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.821+0000 7ffbd591f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9800 0x559caccceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.821+0000 7ffbd591f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9800 0x559caccceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34664/0 (socket says 172.21.15.173:34664) 2024-09-13T23:57:23.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.821+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 learned_addr learned my addr 172.21.15.173:0/1347029203 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:23.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.821+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559cac9faea0 con 0x559cac9e9800 2024-09-13T23:57:23.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.821+0000 7ffbd591f700 1 --2- 172.21.15.173:0/1347029203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9800 0x559caccceb00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x559cacd16420 tx=0x559cacd44840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.821+0000 7ffbce110700 1 -- 172.21.15.173:0/1347029203 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559caca8db80 con 0x559cac9e9800 2024-09-13T23:57:23.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.821+0000 7ffbce110700 1 -- 172.21.15.173:0/1347029203 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559cacd9e180 con 0x559cac9e9800 2024-09-13T23:57:23.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.821+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559cac9fa820 con 0x559cac9e9800 2024-09-13T23:57:23.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.821+0000 7ffbce110700 1 -- 172.21.15.173:0/1347029203 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559caca8d8c0 con 0x559cac9e9800 2024-09-13T23:57:23.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.821+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559cac9fa9c0 con 0x559cac9e9800 2024-09-13T23:57:23.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbce110700 1 -- 172.21.15.173:0/1347029203 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x559cacae2dc0 con 0x559cac9e9800 2024-09-13T23:57:23.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbce110700 1 --2- 172.21.15.173:0/1347029203 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559cacd88c00 0x559cacccf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbd6965f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:23.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbce110700 1 -- 172.21.15.173:0/1347029203 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x559caca4f340 con 0x559cac9e9800 2024-09-13T23:57:23.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbd491d700 1 --2- 172.21.15.173:0/1347029203 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559cacd88c00 0x559cacccf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/1347029203 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559cacd89000 0x559cacccfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89400 con 0x559cacd89000 2024-09-13T23:57:23.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbd591f700 1 --2- 172.21.15.173:0/1347029203 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559cacd89000 0x559cacccfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbd591f700 1 --2- 172.21.15.173:0/1347029203 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559cacd89000 0x559cacccfb80 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbd491d700 1 --2- 172.21.15.173:0/1347029203 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559cacd88c00 0x559cacccf600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x559caccc9920 tx=0x559cacaed800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559cace42b40 con 0x559cacd89000 2024-09-13T23:57:23.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbd6965f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:23.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbd6965f40 20 realm 2024-09-13T23:57:23.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbd6965f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:23.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89000 2024-09-13T23:57:23.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559cace42b40 con 0x559cacd89000 2024-09-13T23:57:23.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbd6965f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:23.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbd6965f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:23.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbd6965f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:23.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89c00 con 0x559cacd89000 2024-09-13T23:57:23.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559cace42b40 con 0x559cacd89000 2024-09-13T23:57:23.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbd6965f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:23.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbd6965f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:23.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/1347029203 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559cacd89400 0x559caccd0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.825+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89400 2024-09-13T23:57:23.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.829+0000 7ffbd511e700 1 --2- 172.21.15.173:0/1347029203 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559cacd89400 0x559caccd0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.829+0000 7ffbd511e700 1 --2- 172.21.15.173:0/1347029203 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559cacd89400 0x559caccd0100 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.829+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x559cace43200 con 0x559cacd89400 2024-09-13T23:57:23.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.829+0000 7ffbd6965f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:23.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.829+0000 7ffbd6965f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:23.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.829+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/1347029203 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559cacd89c00 0x559caccd0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.829+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace50000 con 0x559cacd89c00 2024-09-13T23:57:23.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.829+0000 7ffbd491d700 1 --2- 172.21.15.173:0/1347029203 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559cacd89c00 0x559caccd0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.829+0000 7ffbd491d700 1 --2- 172.21.15.173:0/1347029203 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559cacd89c00 0x559caccd0680 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.829+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x559cace43440 con 0x559cacd89c00 2024-09-13T23:57:23.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.829+0000 7ffbd6965f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:23.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.829+0000 7ffbd6965f40 20 searching for the correct realm 2024-09-13T23:57:23.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.829+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace50400 con 0x559cacd89c00 2024-09-13T23:57:23.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.829+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x559cace43440 con 0x559cacd89c00 2024-09-13T23:57:23.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.829+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace50000 con 0x559cacd89400 2024-09-13T23:57:23.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.833+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace43200 con 0x559cacd89400 2024-09-13T23:57:23.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.833+0000 7ffbd511e700 1 --2- 172.21.15.173:0/1347029203 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559cace50000 0x559caccd0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.833+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cace50000 2024-09-13T23:57:23.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.833+0000 7ffbd591f700 1 --2- 172.21.15.173:0/1347029203 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559cace50000 0x559caccd0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.833+0000 7ffbd591f700 1 --2- 172.21.15.173:0/1347029203 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559cace50000 0x559caccd0c00 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.833+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace42b40 con 0x559cace50000 2024-09-13T23:57:23.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.833+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cace50000 2024-09-13T23:57:23.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.833+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x559cace42b40 con 0x559cace50000 2024-09-13T23:57:23.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.833+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89000 2024-09-13T23:57:23.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.833+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace42b40 con 0x559cacd89000 2024-09-13T23:57:23.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.833+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89c00 2024-09-13T23:57:23.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.833+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace43440 con 0x559cacd89c00 2024-09-13T23:57:23.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.833+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89000 2024-09-13T23:57:23.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.833+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace42b40 con 0x559cacd89000 2024-09-13T23:57:23.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.833+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89400 2024-09-13T23:57:23.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.837+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace43200 con 0x559cacd89400 2024-09-13T23:57:23.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.837+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89400 2024-09-13T23:57:23.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.837+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace43200 con 0x559cacd89400 2024-09-13T23:57:23.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.837+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89000 2024-09-13T23:57:23.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.837+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace42b40 con 0x559cacd89000 2024-09-13T23:57:23.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.837+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cace50000 2024-09-13T23:57:23.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.837+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace42b40 con 0x559cace50000 2024-09-13T23:57:23.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.837+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89000 2024-09-13T23:57:23.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.837+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace42b40 con 0x559cacd89000 2024-09-13T23:57:23.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.837+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cace50000 2024-09-13T23:57:23.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.837+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace42b40 con 0x559cace50000 2024-09-13T23:57:23.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.837+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89400 2024-09-13T23:57:23.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.841+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace43200 con 0x559cacd89400 2024-09-13T23:57:23.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.841+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89c00 2024-09-13T23:57:23.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.841+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace43440 con 0x559cacd89c00 2024-09-13T23:57:23.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.841+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89000 2024-09-13T23:57:23.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.841+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace42b40 con 0x559cacd89000 2024-09-13T23:57:23.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.841+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89400 2024-09-13T23:57:23.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.841+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace43200 con 0x559cacd89400 2024-09-13T23:57:23.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.841+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89c00 2024-09-13T23:57:23.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.841+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace43440 con 0x559cacd89c00 2024-09-13T23:57:23.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.841+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89000 2024-09-13T23:57:23.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.841+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace42b40 con 0x559cacd89000 2024-09-13T23:57:23.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.841+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89000 2024-09-13T23:57:23.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.841+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace42b40 con 0x559cacd89000 2024-09-13T23:57:23.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.841+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89000 2024-09-13T23:57:23.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.845+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace42b40 con 0x559cacd89000 2024-09-13T23:57:23.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.845+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89c00 2024-09-13T23:57:23.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.845+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace43440 con 0x559cacd89c00 2024-09-13T23:57:23.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.845+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cace50000 2024-09-13T23:57:23.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.845+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace42b40 con 0x559cace50000 2024-09-13T23:57:23.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.845+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89000 2024-09-13T23:57:23.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.845+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace42b40 con 0x559cacd89000 2024-09-13T23:57:23.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.845+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cace50000 2024-09-13T23:57:23.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.845+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace42b40 con 0x559cace50000 2024-09-13T23:57:23.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.845+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89c00 2024-09-13T23:57:23.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.845+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace43440 con 0x559cacd89c00 2024-09-13T23:57:23.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.845+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cace50000 2024-09-13T23:57:23.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.845+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace42b40 con 0x559cace50000 2024-09-13T23:57:23.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.845+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89400 2024-09-13T23:57:23.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.849+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace43200 con 0x559cacd89400 2024-09-13T23:57:23.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.849+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89400 2024-09-13T23:57:23.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.849+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace43200 con 0x559cacd89400 2024-09-13T23:57:23.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.849+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89c00 2024-09-13T23:57:23.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.849+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace43440 con 0x559cacd89c00 2024-09-13T23:57:23.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.849+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89400 2024-09-13T23:57:23.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.849+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x559cace43200 con 0x559cacd89400 2024-09-13T23:57:23.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.849+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cacd89400 2024-09-13T23:57:23.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.849+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cace43200 con 0x559cacd89400 2024-09-13T23:57:23.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.849+0000 7ffbd6965f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:23.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.849+0000 7ffbd6965f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:23.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.849+0000 7ffbd6965f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:23.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.849+0000 7ffbd6965f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:23.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.849+0000 7ffbd6965f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:23.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.849+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace50800 con 0x559cacd89000 2024-09-13T23:57:23.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.849+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x559cace42b40 con 0x559cacd89000 2024-09-13T23:57:23.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.849+0000 7ffbd6965f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:23.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.849+0000 7ffbd6965f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:23.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.849+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace50c00 con 0x559cacd89400 2024-09-13T23:57:23.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x559cace43200 con 0x559cacd89400 2024-09-13T23:57:23.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd6965f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:23.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd6965f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:23.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace51000 con 0x559cace50000 2024-09-13T23:57:23.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x559cace42b40 con 0x559cace50000 2024-09-13T23:57:23.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd6965f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:23.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd6965f40 20 zone default found 2024-09-13T23:57:23.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd6965f40 4 Realm: () 2024-09-13T23:57:23.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd6965f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:23.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd6965f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:23.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd6965f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:23.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd6965f40 20 zonegroup default 2024-09-13T23:57:23.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd6965f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:23.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace51400 con 0x559cace50000 2024-09-13T23:57:23.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x559cace42b40 con 0x559cace50000 2024-09-13T23:57:23.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd6965f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:23.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd6965f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:23.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace51800 con 0x559cacd89c00 2024-09-13T23:57:23.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x559cace43440 con 0x559cacd89c00 2024-09-13T23:57:23.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd6965f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:23.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd6965f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:23.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace51c00 con 0x559cacd89c00 2024-09-13T23:57:23.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x559cace43440 con 0x559cacd89c00 2024-09-13T23:57:23.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd6965f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:23.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd6965f40 20 started sync module instance, tier type = 2024-09-13T23:57:23.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd6965f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:23.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.853+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace56000 con 0x559cacd89400 2024-09-13T23:57:23.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.857+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v35'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cacd89400 2024-09-13T23:57:23.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.857+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94131402332928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace56400 con 0x559cacd89400 2024-09-13T23:57:23.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.857+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace56800 con 0x559cacd89000 2024-09-13T23:57:23.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.861+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v35'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559cace42b40 con 0x559cacd89000 2024-09-13T23:57:23.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.861+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94131402332928] v35'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cacd89400 2024-09-13T23:57:23.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.861+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94131402334080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace56c00 con 0x559cacd89000 2024-09-13T23:57:23.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.861+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace57000 con 0x559cacd89400 2024-09-13T23:57:23.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.861+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94131402334080] v35'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559cace42b40 con 0x559cacd89000 2024-09-13T23:57:23.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.861+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v35'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cacd89400 2024-09-13T23:57:23.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.865+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94131402335232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace57400 con 0x559cacd89400 2024-09-13T23:57:23.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.865+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace57800 con 0x559cace50000 2024-09-13T23:57:23.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.865+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94131402335232] v35'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cacd89400 2024-09-13T23:57:23.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.865+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v35'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559cace42b40 con 0x559cace50000 2024-09-13T23:57:23.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.865+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94131402336384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace57c00 con 0x559cace50000 2024-09-13T23:57:23.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.865+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace56800 con 0x559cacd89400 2024-09-13T23:57:23.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.869+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94131402336384] v35'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559cace42b40 con 0x559cace50000 2024-09-13T23:57:23.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.869+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v35'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cacd89400 2024-09-13T23:57:23.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.869+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94131402337536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace56000 con 0x559cacd89400 2024-09-13T23:57:23.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.869+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace50800 con 0x559cacd89c00 2024-09-13T23:57:23.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.869+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v35'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559cace43440 con 0x559cacd89c00 2024-09-13T23:57:23.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.869+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94131402338688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace51000 con 0x559cacd89c00 2024-09-13T23:57:23.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.869+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace51400 con 0x559cacd89c00 2024-09-13T23:57:23.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.873+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94131402337536] v35'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cacd89400 2024-09-13T23:57:23.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.873+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94131402338688] v35'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559cace43440 con 0x559cacd89c00 2024-09-13T23:57:23.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.873+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v35'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559cace43440 con 0x559cacd89c00 2024-09-13T23:57:23.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.873+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94131402339840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace50c00 con 0x559cacd89c00 2024-09-13T23:57:23.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.873+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacd89800 con 0x559cace50000 2024-09-13T23:57:23.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.873+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94131402339840] v35'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559cace43440 con 0x559cacd89c00 2024-09-13T23:57:23.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.877+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v35'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559cace42b40 con 0x559cace50000 2024-09-13T23:57:23.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.877+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94131402340992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace56400 con 0x559cace50000 2024-09-13T23:57:23.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.877+0000 7ffbd6965f40 20 add_watcher() i=0 2024-09-13T23:57:23.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.877+0000 7ffbd6965f40 20 add_watcher() i=1 2024-09-13T23:57:23.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.877+0000 7ffbd6965f40 20 add_watcher() i=2 2024-09-13T23:57:23.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.877+0000 7ffbd6965f40 20 add_watcher() i=3 2024-09-13T23:57:23.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.877+0000 7ffbd6965f40 20 add_watcher() i=4 2024-09-13T23:57:23.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.877+0000 7ffbd6965f40 20 add_watcher() i=5 2024-09-13T23:57:23.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.877+0000 7ffbd6965f40 20 add_watcher() i=6 2024-09-13T23:57:23.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.877+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94131402340992] v35'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559cace42b40 con 0x559cace50000 2024-09-13T23:57:23.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.877+0000 7ffbd6965f40 20 add_watcher() i=7 2024-09-13T23:57:23.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.877+0000 7ffbd6965f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:23.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.877+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace57000 con 0x559cacd89000 2024-09-13T23:57:23.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.877+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x559cace42b40 con 0x559cacd89000 2024-09-13T23:57:23.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.877+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94131403997184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace57400 con 0x559cacd89000 2024-09-13T23:57:23.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.881+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94131403997184] v35'168 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x559cace42b40 con 0x559cacd89000 2024-09-13T23:57:23.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.881+0000 7ffbbc0ec700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:23.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.881+0000 7ffbd6965f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:23.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.881+0000 7ffbd6965f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:23.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.881+0000 7ffbd6965f40 1 Processor -- start 2024-09-13T23:57:23.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.881+0000 7ffbd6965f40 1 -- start start 2024-09-13T23:57:23.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.881+0000 7ffbd6965f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cace50400 0x559caccd1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.881+0000 7ffbd6965f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559caca0e780 con 0x559cace50400 2024-09-13T23:57:23.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.881+0000 7ffbd491d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cace50400 0x559caccd1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.881+0000 7ffbd491d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cace50400 0x559caccd1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34678/0 (socket says 172.21.15.173:34678) 2024-09-13T23:57:23.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.881+0000 7ffbd491d700 1 -- 172.21.15.173:0/2532250192 learned_addr learned my addr 172.21.15.173:0/2532250192 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:23.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.881+0000 7ffbd491d700 1 -- 172.21.15.173:0/2532250192 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559cac9fab60 con 0x559cace50400 2024-09-13T23:57:23.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.881+0000 7ffbd491d700 1 --2- 172.21.15.173:0/2532250192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cace50400 0x559caccd1180 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x559cace640c0 tx=0x559cacaed9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4508abd568492f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.881+0000 7ffbbb8eb700 1 -- 172.21.15.173:0/2532250192 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559caca8d760 con 0x559cace50400 2024-09-13T23:57:23.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.881+0000 7ffbbb8eb700 1 -- 172.21.15.173:0/2532250192 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559cacd9e600 con 0x559cace50400 2024-09-13T23:57:23.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.881+0000 7ffbbb8eb700 1 -- 172.21.15.173:0/2532250192 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559cace6e000 con 0x559cace50400 2024-09-13T23:57:23.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.885+0000 7ffbd6965f40 1 -- 172.21.15.173:0/2532250192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cace50400 msgr2=0x559caccd1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:23.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.885+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/2532250192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cace50400 0x559caccd1180 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x559cace640c0 tx=0x559cacaed9e0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.885+0000 7ffbd6965f40 1 -- 172.21.15.173:0/2532250192 shutdown_connections 2024-09-13T23:57:23.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.885+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/2532250192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cace50400 0x559caccd1180 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:23.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.885+0000 7ffbd6965f40 1 -- 172.21.15.173:0/2532250192 >> 172.21.15.173:0/2532250192 conn(0x559cace56800 msgr2=0x559cacaea000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:23.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.885+0000 7ffbd6965f40 1 -- 172.21.15.173:0/2532250192 shutdown_connections 2024-09-13T23:57:23.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.885+0000 7ffbd6965f40 1 -- 172.21.15.173:0/2532250192 wait complete. 2024-09-13T23:57:23.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.885+0000 7ffbd6965f40 1 Processor -- start 2024-09-13T23:57:23.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.885+0000 7ffbd6965f40 1 -- start start 2024-09-13T23:57:23.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.885+0000 7ffbd6965f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cace51800 0x559caccd1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.885+0000 7ffbd6965f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x559caca76000 con 0x559cace51800 2024-09-13T23:57:23.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.885+0000 7ffbd491d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cace51800 0x559caccd1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.885+0000 7ffbd491d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cace51800 0x559caccd1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34688/0 (socket says 172.21.15.173:34688) 2024-09-13T23:57:23.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.885+0000 7ffbd491d700 1 -- 172.21.15.173:0/1392732331 learned_addr learned my addr 172.21.15.173:0/1392732331 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:23.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.885+0000 7ffbd491d700 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559cac9fad00 con 0x559cace51800 2024-09-13T23:57:23.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.885+0000 7ffbd491d700 1 --2- 172.21.15.173:0/1392732331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cace51800 0x559caccd1700 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x559cace64270 tx=0x559cace325a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.885+0000 7ffbba0e8700 1 -- 172.21.15.173:0/1392732331 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559cace6e160 con 0x559cace51800 2024-09-13T23:57:23.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.885+0000 7ffbba0e8700 1 -- 172.21.15.173:0/1392732331 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559cacd9e300 con 0x559cace51800 2024-09-13T23:57:23.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.885+0000 7ffbba0e8700 1 -- 172.21.15.173:0/1392732331 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x559cace6e2c0 con 0x559cace51800 2024-09-13T23:57:23.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.885+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559cac9fa340 con 0x559cace51800 2024-09-13T23:57:23.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.885+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559cac9fbd40 con 0x559cace51800 2024-09-13T23:57:23.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.889+0000 7ffbba0e8700 1 -- 172.21.15.173:0/1392732331 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x559cacae3b80 con 0x559cace51800 2024-09-13T23:57:23.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.889+0000 7ffbba0e8700 1 --2- 172.21.15.173:0/1392732331 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559cacd89800 0x559cacef0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.889+0000 7ffbba0e8700 1 -- 172.21.15.173:0/1392732331 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x559caca4f500 con 0x559cace51800 2024-09-13T23:57:23.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.889+0000 7ffbd591f700 1 --2- 172.21.15.173:0/1392732331 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559cacd89800 0x559cacef0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.889+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/1392732331 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559cace51c00 0x559cacef0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.889+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace50800 con 0x559cace51c00 2024-09-13T23:57:23.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.889+0000 7ffbd511e700 1 --2- 172.21.15.173:0/1392732331 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559cace51c00 0x559cacef0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.889+0000 7ffbd591f700 1 --2- 172.21.15.173:0/1392732331 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559cacd89800 0x559cacef0000 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x559cacded7a0 tx=0x559cace335c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.889+0000 7ffbd511e700 1 --2- 172.21.15.173:0/1392732331 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559cace51c00 0x559cacef0580 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.893+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v35'31 uv30 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:23.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.893+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/1392732331 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559cace56c00 0x559cacef0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.893+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace57800 con 0x559cace56c00 2024-09-13T23:57:23.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.893+0000 7ffbd491d700 1 --2- 172.21.15.173:0/1392732331 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559cace56c00 0x559cacef0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.893+0000 7ffbd491d700 1 --2- 172.21.15.173:0/1392732331 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559cace56c00 0x559cacef0b00 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.893+0000 7ffbd491d700 1 -- 172.21.15.173:0/1392732331 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v35'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559cace43440 con 0x559cace56c00 2024-09-13T23:57:23.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.893+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/1392732331 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559cace57c00 0x559cacef1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.893+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace56400 con 0x559cace57c00 2024-09-13T23:57:23.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.893+0000 7ffbd591f700 1 --2- 172.21.15.173:0/1392732331 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559cace57c00 0x559cacef1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.897+0000 7ffbd591f700 1 --2- 172.21.15.173:0/1392732331 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559cace57c00 0x559cacef1080 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.897+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v35'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:23.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.897+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/1392732331 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559cacf1c000 0x559cacef1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:23.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.897+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1c400 con 0x559cacf1c000 2024-09-13T23:57:23.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.897+0000 7ffbd511e700 1 --2- 172.21.15.173:0/1392732331 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559cacf1c000 0x559cacef1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:23.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.897+0000 7ffbd511e700 1 --2- 172.21.15.173:0/1392732331 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559cacf1c000 0x559cacef1600 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:23.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.901+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v35'169 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:23.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.901+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1c800 con 0x559cace51c00 2024-09-13T23:57:23.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.905+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v35'56 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:23.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.905+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1cc00 con 0x559cace57c00 2024-09-13T23:57:23.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.905+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v35'37 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:23.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.905+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1d000 con 0x559cace51c00 2024-09-13T23:57:23.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.909+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v35'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:23.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.909+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1d400 con 0x559cacf1c000 2024-09-13T23:57:23.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.909+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v35'37 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:23.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.909+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1d800 con 0x559cace51c00 2024-09-13T23:57:23.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.913+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v35'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:23.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.913+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1dc00 con 0x559cace51c00 2024-09-13T23:57:23.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.917+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v35'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:23.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.917+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1c400 con 0x559cace51c00 2024-09-13T23:57:23.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.917+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v35'57 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:23.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.917+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1c800 con 0x559cace57c00 2024-09-13T23:57:23.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.921+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v35'25 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:23.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.921+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1d000 con 0x559cace51c00 2024-09-13T23:57:23.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.921+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v35'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:23.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.921+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace50800 con 0x559cacf1c000 2024-09-13T23:57:23.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.925+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v35'43 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:23.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.925+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace56000 con 0x559cacf1c000 2024-09-13T23:57:23.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.929+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v35'170 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:23.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.929+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace50800 con 0x559cace51c00 2024-09-13T23:57:23.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.933+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v35'50 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:23.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.933+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1d400 con 0x559cace51c00 2024-09-13T23:57:23.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.933+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v35'58 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:23.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.933+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1d800 con 0x559cace57c00 2024-09-13T23:57:23.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.937+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v35'25 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:23.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.937+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1dc00 con 0x559cace51c00 2024-09-13T23:57:23.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.941+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v35'30 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:23.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.941+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1c400 con 0x559cacf1c000 2024-09-13T23:57:23.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.941+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v35'171 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:23.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.941+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1d000 con 0x559cace51c00 2024-09-13T23:57:23.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.945+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v35'51 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:23.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.945+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1cc00 con 0x559cace51c00 2024-09-13T23:57:23.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.949+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v35'32 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:23.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.949+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1c800 con 0x559cace57c00 2024-09-13T23:57:23.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.949+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v35'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:23.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.949+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1d800 con 0x559cace51c00 2024-09-13T23:57:23.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.953+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v35'29 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:23.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.953+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace57000 con 0x559cace57c00 2024-09-13T23:57:23.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.957+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v35'18 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:23.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.957+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace57400 con 0x559cace57c00 2024-09-13T23:57:23.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.957+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v35'38 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:23.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.957+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace56400 con 0x559cace57c00 2024-09-13T23:57:23.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.961+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v35'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:23.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.961+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1d400 con 0x559cace51c00 2024-09-13T23:57:23.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.965+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v35'27 uv26 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:23.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.965+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1dc00 con 0x559cacf1c000 2024-09-13T23:57:23.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.965+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v35'38 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:23.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.965+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1c400 con 0x559cace51c00 2024-09-13T23:57:23.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.969+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v35'52 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:23.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.969+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1d000 con 0x559cacf1c000 2024-09-13T23:57:23.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.973+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v35'44 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:23.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.973+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1cc00 con 0x559cace56c00 2024-09-13T23:57:23.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.973+0000 7ffbd491d700 1 -- 172.21.15.173:0/1392732331 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v35'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x559cace43440 con 0x559cace56c00 2024-09-13T23:57:23.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.977+0000 7ffbb78e3700 20 reqs_thread_entry: start 2024-09-13T23:57:23.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.977+0000 7ffbd6965f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:23.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.977+0000 7ffbd6965f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:23.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.977+0000 7ffbb58df700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:54 2024 2024-09-13T23:57:23.984 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:23.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.977+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1cc00 con 0x559cace51c00 2024-09-13T23:57:23.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.977+0000 7ffbb50bd700 20 reqs_thread_entry: start 2024-09-13T23:57:23.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.977+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(33 gc.0 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:23.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.977+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace57800 con 0x559cace51c00 2024-09-13T23:57:23.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.981+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(34 gc.0 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:23.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.981+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:35 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace51000 con 0x559cace51c00 2024-09-13T23:57:23.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.981+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(35 gc.0 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:23.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.981+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:36 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace51400 con 0x559cace56c00 2024-09-13T23:57:23.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.981+0000 7ffbd491d700 1 -- 172.21.15.173:0/1392732331 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(36 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x559cace43440 con 0x559cace56c00 2024-09-13T23:57:23.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.981+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:37 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace50c00 con 0x559cace56c00 2024-09-13T23:57:23.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.981+0000 7ffbd491d700 1 -- 172.21.15.173:0/1392732331 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(37 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x559cace43440 con 0x559cace56c00 2024-09-13T23:57:23.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.981+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:38 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace51000 con 0x559cace56c00 2024-09-13T23:57:23.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.981+0000 7ffbd491d700 1 -- 172.21.15.173:0/1392732331 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(38 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x559cace43440 con 0x559cace56c00 2024-09-13T23:57:23.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.981+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:39 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace57800 con 0x559cace57c00 2024-09-13T23:57:23.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.985+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(39 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:23.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.985+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:40 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1d800 con 0x559cace57c00 2024-09-13T23:57:23.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.985+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(40 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:23.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.985+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:41 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1d400 con 0x559cace57c00 2024-09-13T23:57:23.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.985+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(41 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:23.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.985+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:42 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1dc00 con 0x559cacf1c000 2024-09-13T23:57:23.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.985+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(42 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:23.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.985+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:43 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1c400 con 0x559cacf1c000 2024-09-13T23:57:23.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.985+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(43 gc.3 [call out=24b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:23.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.985+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:44 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1d000 con 0x559cacf1c000 2024-09-13T23:57:23.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.985+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(44 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:23.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.985+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1cc00 con 0x559cace51c00 2024-09-13T23:57:23.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.989+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(45 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:23.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.989+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:46 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1c800 con 0x559cace51c00 2024-09-13T23:57:23.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.989+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(46 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:23.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.989+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:47 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1d800 con 0x559cace51c00 2024-09-13T23:57:23.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.989+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(47 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:23.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.989+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:48 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1d400 con 0x559cace57c00 2024-09-13T23:57:23.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.989+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(48 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:23.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.989+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:49 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace57000 con 0x559cace57c00 2024-09-13T23:57:23.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.989+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(49 gc.5 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:23.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.989+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:50 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace57400 con 0x559cace57c00 2024-09-13T23:57:23.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.993+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(50 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:23.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.993+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:51 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace56400 con 0x559cace51c00 2024-09-13T23:57:23.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.993+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(51 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:23.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.993+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace57800 con 0x559cace51c00 2024-09-13T23:57:24.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.993+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(52 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.993+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9c000 con 0x559cace51c00 2024-09-13T23:57:24.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.993+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(53 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.993+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:54 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9c400 con 0x559cacf1c000 2024-09-13T23:57:24.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.997+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(54 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:24.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.997+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:55 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9c800 con 0x559cacf1c000 2024-09-13T23:57:24.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.997+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(55 gc.7 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:24.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.997+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:56 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9cc00 con 0x559cacf1c000 2024-09-13T23:57:24.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.997+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(56 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:24.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.997+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:57 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9d000 con 0x559cace51c00 2024-09-13T23:57:24.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.997+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== osd_op_reply(57 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.997+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:58 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9d400 con 0x559cace51c00 2024-09-13T23:57:24.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.997+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== osd_op_reply(58 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:23.997+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:59 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9d800 con 0x559cace51c00 2024-09-13T23:57:24.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.001+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 27 ==== osd_op_reply(59 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.001+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:60 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9dc00 con 0x559cace51c00 2024-09-13T23:57:24.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.001+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 28 ==== osd_op_reply(60 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.001+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:61 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9c000 con 0x559cace51c00 2024-09-13T23:57:24.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.001+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 29 ==== osd_op_reply(61 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.001+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:62 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace56400 con 0x559cace51c00 2024-09-13T23:57:24.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.001+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 30 ==== osd_op_reply(62 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.001+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:63 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace57800 con 0x559cace51c00 2024-09-13T23:57:24.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.005+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 31 ==== osd_op_reply(63 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.005+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1dc00 con 0x559cace51c00 2024-09-13T23:57:24.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.005+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 32 ==== osd_op_reply(64 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.005+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1c400 con 0x559cace51c00 2024-09-13T23:57:24.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.005+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 33 ==== osd_op_reply(65 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.005+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:66 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1d000 con 0x559cace57c00 2024-09-13T23:57:24.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.005+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(66 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:24.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.005+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:67 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1cc00 con 0x559cace57c00 2024-09-13T23:57:24.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.009+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(67 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:24.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.009+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:68 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1c800 con 0x559cace57c00 2024-09-13T23:57:24.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.009+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(68 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:24.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.009+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1d800 con 0x559cace51c00 2024-09-13T23:57:24.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.009+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 34 ==== osd_op_reply(69 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.009+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:70 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace56400 con 0x559cace51c00 2024-09-13T23:57:24.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.009+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 35 ==== osd_op_reply(70 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.009+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace57800 con 0x559cace51c00 2024-09-13T23:57:24.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.013+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 36 ==== osd_op_reply(71 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.013+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:72 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9e000 con 0x559cacf1c000 2024-09-13T23:57:24.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.013+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(72 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:24.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.013+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:73 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9e400 con 0x559cacf1c000 2024-09-13T23:57:24.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.013+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(73 gc.13 [call out=24b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:24.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.013+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:74 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9e800 con 0x559cacf1c000 2024-09-13T23:57:24.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.013+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(74 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:24.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.013+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:75 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9ec00 con 0x559cacf1c000 2024-09-13T23:57:24.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.013+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(75 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:24.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.013+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9f000 con 0x559cacf1c000 2024-09-13T23:57:24.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.017+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(76 gc.14 [call out=24b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:24.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.017+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:77 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9f400 con 0x559cacf1c000 2024-09-13T23:57:24.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.017+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(77 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:24.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.017+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:78 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9f800 con 0x559cace51c00 2024-09-13T23:57:24.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.017+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 37 ==== osd_op_reply(78 gc.15 [call out=15b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.017+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:79 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9fc00 con 0x559cace51c00 2024-09-13T23:57:24.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.017+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 38 ==== osd_op_reply(79 gc.15 [call out=24b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.017+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:80 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9e000 con 0x559cace51c00 2024-09-13T23:57:24.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.017+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 39 ==== osd_op_reply(80 gc.15 [call out=15b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.017+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:81 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9e400 con 0x559cace51c00 2024-09-13T23:57:24.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.021+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 40 ==== osd_op_reply(81 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.021+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:82 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9e800 con 0x559cace51c00 2024-09-13T23:57:24.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.021+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 41 ==== osd_op_reply(82 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.021+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:83 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9ec00 con 0x559cace51c00 2024-09-13T23:57:24.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.021+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 42 ==== osd_op_reply(83 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.021+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:84 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9f000 con 0x559cace57c00 2024-09-13T23:57:24.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.021+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(84 gc.17 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:24.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.021+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:85 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9f400 con 0x559cace57c00 2024-09-13T23:57:24.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.021+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== osd_op_reply(85 gc.17 [call out=24b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:24.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.021+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:86 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace56400 con 0x559cace57c00 2024-09-13T23:57:24.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.025+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 20 ==== osd_op_reply(86 gc.17 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:24.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.025+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:87 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace57800 con 0x559cace51c00 2024-09-13T23:57:24.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.025+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 43 ==== osd_op_reply(87 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.025+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:88 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1dc00 con 0x559cace51c00 2024-09-13T23:57:24.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.025+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 44 ==== osd_op_reply(88 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.025+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:89 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1c400 con 0x559cace51c00 2024-09-13T23:57:24.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.025+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 45 ==== osd_op_reply(89 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.025+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:90 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1d800 con 0x559cacf1c000 2024-09-13T23:57:24.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.025+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(90 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:24.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.025+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:91 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9f000 con 0x559cacf1c000 2024-09-13T23:57:24.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.025+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(91 gc.19 [call out=24b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:24.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.025+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:92 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9f400 con 0x559cacf1c000 2024-09-13T23:57:24.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.029+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(92 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:24.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.029+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:93 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1d400 con 0x559cace51c00 2024-09-13T23:57:24.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.029+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 46 ==== osd_op_reply(93 gc.20 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.029+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:94 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1d000 con 0x559cace51c00 2024-09-13T23:57:24.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.029+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 47 ==== osd_op_reply(94 gc.20 [call out=24b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.029+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:95 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1cc00 con 0x559cace51c00 2024-09-13T23:57:24.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.029+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 48 ==== osd_op_reply(95 gc.20 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.029+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:96 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1c800 con 0x559cace51c00 2024-09-13T23:57:24.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.029+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 49 ==== osd_op_reply(96 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.029+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:97 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace57000 con 0x559cace51c00 2024-09-13T23:57:24.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.033+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 50 ==== osd_op_reply(97 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.033+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:98 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace57400 con 0x559cace51c00 2024-09-13T23:57:24.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.033+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 51 ==== osd_op_reply(98 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.033+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:99 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1dc00 con 0x559cace57c00 2024-09-13T23:57:24.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.033+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 21 ==== osd_op_reply(99 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:24.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.033+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:100 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1c400 con 0x559cace57c00 2024-09-13T23:57:24.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.033+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 22 ==== osd_op_reply(100 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:24.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.033+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:101 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1d800 con 0x559cace57c00 2024-09-13T23:57:24.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.033+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 23 ==== osd_op_reply(101 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:24.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.033+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:102 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace57800 con 0x559cace51c00 2024-09-13T23:57:24.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.037+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 52 ==== osd_op_reply(102 gc.23 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.037+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:103 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9e000 con 0x559cace51c00 2024-09-13T23:57:24.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.037+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 53 ==== osd_op_reply(103 gc.23 [call out=24b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.037+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:104 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9e400 con 0x559cace51c00 2024-09-13T23:57:24.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.037+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 54 ==== osd_op_reply(104 gc.23 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.037+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:105 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9e800 con 0x559cace57c00 2024-09-13T23:57:24.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.037+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 24 ==== osd_op_reply(105 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:24.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.037+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:106 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9ec00 con 0x559cace57c00 2024-09-13T23:57:24.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.037+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 25 ==== osd_op_reply(106 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:24.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.037+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:107 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9f000 con 0x559cace57c00 2024-09-13T23:57:24.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.041+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 26 ==== osd_op_reply(107 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:24.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.041+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:108 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9f400 con 0x559cace57c00 2024-09-13T23:57:24.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.041+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 27 ==== osd_op_reply(108 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:24.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.041+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:109 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9f800 con 0x559cace57c00 2024-09-13T23:57:24.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.041+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 28 ==== osd_op_reply(109 gc.25 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:24.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.041+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:110 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9fc00 con 0x559cace57c00 2024-09-13T23:57:24.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.041+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 29 ==== osd_op_reply(110 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:24.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.041+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:111 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9e800 con 0x559cace57c00 2024-09-13T23:57:24.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.041+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 30 ==== osd_op_reply(111 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:24.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.045+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:112 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9ec00 con 0x559cace57c00 2024-09-13T23:57:24.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.045+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 31 ==== osd_op_reply(112 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:24.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.045+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:113 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9f000 con 0x559cace57c00 2024-09-13T23:57:24.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.045+0000 7ffbd591f700 1 -- 172.21.15.173:0/1392732331 <== osd.3 v2:172.21.15.173:6800/4020038786 32 ==== osd_op_reply(113 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace42b40 con 0x559cace57c00 2024-09-13T23:57:24.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.045+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:114 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9f400 con 0x559cace51c00 2024-09-13T23:57:24.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.045+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 55 ==== osd_op_reply(114 gc.27 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.045+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:115 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9f800 con 0x559cace51c00 2024-09-13T23:57:24.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.045+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 56 ==== osd_op_reply(115 gc.27 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.045+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:116 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1dc00 con 0x559cace51c00 2024-09-13T23:57:24.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.049+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 57 ==== osd_op_reply(116 gc.27 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.049+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:117 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1c400 con 0x559cacf1c000 2024-09-13T23:57:24.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.049+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(117 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:24.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.049+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:118 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1d800 con 0x559cacf1c000 2024-09-13T23:57:24.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.049+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 24 ==== osd_op_reply(118 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:24.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.049+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:119 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace56400 con 0x559cacf1c000 2024-09-13T23:57:24.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.049+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 25 ==== osd_op_reply(119 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:24.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.049+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:120 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1d400 con 0x559cace51c00 2024-09-13T23:57:24.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.049+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 58 ==== osd_op_reply(120 gc.29 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.049+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:121 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1d000 con 0x559cace51c00 2024-09-13T23:57:24.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.049+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 59 ==== osd_op_reply(121 gc.29 [call out=24b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.049+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:122 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1cc00 con 0x559cace51c00 2024-09-13T23:57:24.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.053+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.0 v2:172.21.15.87:6800/3507919120 60 ==== osd_op_reply(122 gc.29 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cace51c00 2024-09-13T23:57:24.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.053+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:123 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1c800 con 0x559cacf1c000 2024-09-13T23:57:24.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.053+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 26 ==== osd_op_reply(123 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:24.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.053+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:124 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1dc00 con 0x559cacf1c000 2024-09-13T23:57:24.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.053+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 27 ==== osd_op_reply(124 gc.30 [call out=24b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:24.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.053+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:125 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf1c400 con 0x559cacf1c000 2024-09-13T23:57:24.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.053+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 <== osd.1 v2:172.21.15.173:6808/3256211813 28 ==== osd_op_reply(125 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43200 con 0x559cacf1c000 2024-09-13T23:57:24.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.053+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:126 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9e000 con 0x559cace56c00 2024-09-13T23:57:24.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.053+0000 7ffbd491d700 1 -- 172.21.15.173:0/1392732331 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(126 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43440 con 0x559cace56c00 2024-09-13T23:57:24.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.053+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:127 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9e400 con 0x559cace56c00 2024-09-13T23:57:24.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.053+0000 7ffbd491d700 1 -- 172.21.15.173:0/1392732331 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(127 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x559cace43440 con 0x559cace56c00 2024-09-13T23:57:24.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.053+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:128 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9f400 con 0x559cace56c00 2024-09-13T23:57:24.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.057+0000 7ffbd491d700 1 -- 172.21.15.173:0/1392732331 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(128 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x559cace43440 con 0x559cace56c00 2024-09-13T23:57:24.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.057+0000 7ffbbc0ec700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:24.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.057+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94131403997184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9f800 con 0x559cacd89000 2024-09-13T23:57:24.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.061+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(62 data_loggenerations_metadata [watch unwatch cookie 94131403997184] v35'172 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x559cace42b40 con 0x559cacd89000 2024-09-13T23:57:24.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.061+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:63 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94131402332928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace57000 con 0x559cacd89400 2024-09-13T23:57:24.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.061+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(63 notify.0 [watch unwatch cookie 94131402332928] v35'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cacd89400 2024-09-13T23:57:24.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.061+0000 7ffbd6965f40 20 remove_watcher() i=0 2024-09-13T23:57:24.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.061+0000 7ffbd6965f40 2 removed watcher, disabling cache 2024-09-13T23:57:24.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.061+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94131402334080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace57400 con 0x559cacd89000 2024-09-13T23:57:24.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.065+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(64 notify.1 [watch unwatch cookie 94131402334080] v35'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559cace42b40 con 0x559cacd89000 2024-09-13T23:57:24.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.065+0000 7ffbd6965f40 20 remove_watcher() i=1 2024-09-13T23:57:24.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.065+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94131402335232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace57800 con 0x559cacd89400 2024-09-13T23:57:24.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.069+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(65 notify.2 [watch unwatch cookie 94131402335232] v35'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cacd89400 2024-09-13T23:57:24.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.069+0000 7ffbd6965f40 20 remove_watcher() i=2 2024-09-13T23:57:24.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.069+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94131402336384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9e000 con 0x559cace50000 2024-09-13T23:57:24.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.069+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(66 notify.3 [watch unwatch cookie 94131402336384] v35'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559cace42b40 con 0x559cace50000 2024-09-13T23:57:24.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.069+0000 7ffbd6965f40 20 remove_watcher() i=3 2024-09-13T23:57:24.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.069+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94131402337536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9e400 con 0x559cacd89400 2024-09-13T23:57:24.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.073+0000 7ffbd511e700 1 -- 172.21.15.173:0/1347029203 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(67 notify.4 [watch unwatch cookie 94131402337536] v35'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559cace43200 con 0x559cacd89400 2024-09-13T23:57:24.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.073+0000 7ffbd6965f40 20 remove_watcher() i=4 2024-09-13T23:57:24.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.073+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94131402338688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cacf9f400 con 0x559cacd89c00 2024-09-13T23:57:24.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.077+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(68 notify.5 [watch unwatch cookie 94131402338688] v35'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559cace43440 con 0x559cacd89c00 2024-09-13T23:57:24.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.077+0000 7ffbd6965f40 20 remove_watcher() i=5 2024-09-13T23:57:24.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.077+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94131402339840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace51400 con 0x559cacd89c00 2024-09-13T23:57:24.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.077+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(69 notify.6 [watch unwatch cookie 94131402339840] v35'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559cace43440 con 0x559cacd89c00 2024-09-13T23:57:24.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.077+0000 7ffbd6965f40 20 remove_watcher() i=6 2024-09-13T23:57:24.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.077+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:70 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94131402340992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x559cace50c00 con 0x559cace50000 2024-09-13T23:57:24.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.081+0000 7ffbd591f700 1 -- 172.21.15.173:0/1347029203 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(70 notify.7 [watch unwatch cookie 94131402340992] v35'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x559cace42b40 con 0x559cace50000 2024-09-13T23:57:24.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.081+0000 7ffbd6965f40 20 remove_watcher() i=7 2024-09-13T23:57:24.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.081+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559cacd89400 msgr2=0x559caccd0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.081+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/1347029203 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559cacd89400 0x559caccd0100 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.081+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559cacd89000 msgr2=0x559cacccfb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.081+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/1347029203 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559cacd89000 0x559cacccfb80 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.081+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559cace50000 msgr2=0x559caccd0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.081+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/1347029203 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559cace50000 0x559caccd0c00 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.081+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559cacd89c00 msgr2=0x559caccd0680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.081+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/1347029203 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559cacd89c00 0x559caccd0680 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.081+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559cacd88c00 msgr2=0x559cacccf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.081+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/1347029203 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559cacd88c00 0x559cacccf600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x559caccc9920 tx=0x559cacaed800 comp rx=0 tx=0).stop 2024-09-13T23:57:24.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.081+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9800 msgr2=0x559caccceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.081+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/1347029203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9800 0x559caccceb00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x559cacd16420 tx=0x559cacd44840 comp rx=0 tx=0).stop 2024-09-13T23:57:24.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.081+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 reap_dead start 2024-09-13T23:57:24.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.081+0000 7ffbd491d700 1 -- 172.21.15.173:0/1347029203 reap_dead start 2024-09-13T23:57:24.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.081+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 shutdown_connections 2024-09-13T23:57:24.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.081+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 >> 172.21.15.173:0/1347029203 conn(0x559cac9e9400 msgr2=0x559cacae9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:24.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.081+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 shutdown_connections 2024-09-13T23:57:24.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.081+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1347029203 wait complete. 2024-09-13T23:57:24.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559cace51c00 msgr2=0x559cacef0580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/1392732331 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x559cace51c00 0x559cacef0580 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559cacf1c000 msgr2=0x559cacef1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/1392732331 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x559cacf1c000 0x559cacef1600 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559cace56c00 msgr2=0x559cacef0b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/1392732331 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x559cace56c00 0x559cacef0b00 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559cace57c00 msgr2=0x559cacef1080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/1392732331 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x559cace57c00 0x559cacef1080 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559cacd89800 msgr2=0x559cacef0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/1392732331 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559cacd89800 0x559cacef0000 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x559cacded7a0 tx=0x559cace335c0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cace51800 msgr2=0x559caccd1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd511e700 1 -- 172.21.15.173:0/1392732331 reap_dead start 2024-09-13T23:57:24.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/1392732331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cace51800 0x559caccd1700 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x559cace64270 tx=0x559cace325a0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 shutdown_connections 2024-09-13T23:57:24.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/1392732331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cace51800 0x559caccd1700 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 >> 172.21.15.173:0/1392732331 conn(0x559cace56800 msgr2=0x559cacaea000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:24.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 shutdown_connections 2024-09-13T23:57:24.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 -- 172.21.15.173:0/1392732331 wait complete. 2024-09-13T23:57:24.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 -- 172.21.15.173:0/2049039283 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559cacd88000 msgr2=0x559cacccf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/2049039283 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559cacd88000 0x559cacccf080 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x559cacd174d0 tx=0x559cacd44240 comp rx=0 tx=0).stop 2024-09-13T23:57:24.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 -- 172.21.15.173:0/2049039283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9000 msgr2=0x559caccce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/2049039283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9000 0x559caccce580 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x559cad7b3e60 tx=0x559cacaed920 comp rx=0 tx=0).stop 2024-09-13T23:57:24.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 -- 172.21.15.173:0/2049039283 shutdown_connections 2024-09-13T23:57:24.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/2049039283 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x559cacd88000 0x559cacccf080 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 --2- 172.21.15.173:0/2049039283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x559cac9e9000 0x559caccce580 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 -- 172.21.15.173:0/2049039283 >> 172.21.15.173:0/2049039283 conn(0x559cac9e8c00 msgr2=0x559cacae9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:24.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 -- 172.21.15.173:0/2049039283 shutdown_connections 2024-09-13T23:57:24.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.085+0000 7ffbd6965f40 1 -- 172.21.15.173:0/2049039283 wait complete. 2024-09-13T23:57:24.096 INFO:teuthology.orchestra.run.smithi173.stdout:[] 2024-09-13T23:57:24.096 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T23:57:24.096 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-13T23:57:24.096 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-13T23:57:24.097 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-13T23:57:24.138 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:24.138 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:24.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.133+0000 7f544841af40 1 Processor -- start 2024-09-13T23:57:24.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.133+0000 7f544841af40 1 -- start start 2024-09-13T23:57:24.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.133+0000 7f544841af40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x560be7b0b000 0x560be7df0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.133+0000 7f544841af40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560be7bcf500 con 0x560be7b0b400 2024-09-13T23:57:24.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.133+0000 7f544841af40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x560be7b98a00 con 0x560be7b0b000 2024-09-13T23:57:24.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.133+0000 7f5446bd3700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x560be7b0b000 0x560be7df0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.133+0000 7f5446bd3700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x560be7b0b000 0x560be7df0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34700/0 (socket says 172.21.15.173:34700) 2024-09-13T23:57:24.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.133+0000 7f5446bd3700 1 -- 172.21.15.173:0/3468386399 learned_addr learned my addr 172.21.15.173:0/3468386399 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:24.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.133+0000 7f5446bd3700 1 -- 172.21.15.173:0/3468386399 >> v1:172.21.15.87:6789/0 conn(0x560be7b0b400 legacy=0x560be7c0a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.133+0000 7f5446bd3700 1 -- 172.21.15.173:0/3468386399 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560be7b1dd40 con 0x560be7b0b000 2024-09-13T23:57:24.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.133+0000 7f5446bd3700 1 --2- 172.21.15.173:0/3468386399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b000 0x560be7df0580 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x560be7deba70 tx=0x560be7c0f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a579e88d3b07e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.133+0000 7f5445bd1700 1 -- 172.21.15.173:0/3468386399 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560be7baf4a0 con 0x560be7b0b000 2024-09-13T23:57:24.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.133+0000 7f5445bd1700 1 -- 172.21.15.173:0/3468386399 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560be7bcf800 con 0x560be7b0b000 2024-09-13T23:57:24.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.133+0000 7f5445bd1700 1 -- 172.21.15.173:0/3468386399 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560be7baf600 con 0x560be7b0b000 2024-09-13T23:57:24.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f544841af40 1 -- 172.21.15.173:0/3468386399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b000 msgr2=0x560be7df0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f544841af40 1 --2- 172.21.15.173:0/3468386399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b000 0x560be7df0580 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x560be7deba70 tx=0x560be7c0f920 comp rx=0 tx=0).stop 2024-09-13T23:57:24.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f544841af40 1 -- 172.21.15.173:0/3468386399 shutdown_connections 2024-09-13T23:57:24.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f544841af40 1 --2- 172.21.15.173:0/3468386399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b000 0x560be7df0580 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f544841af40 1 -- 172.21.15.173:0/3468386399 >> 172.21.15.173:0/3468386399 conn(0x560be7b0ac00 msgr2=0x560be7c0a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:24.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f544841af40 1 -- 172.21.15.173:0/3468386399 shutdown_connections 2024-09-13T23:57:24.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f544841af40 1 -- 172.21.15.173:0/3468386399 wait complete. 2024-09-13T23:57:24.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f544841af40 1 Processor -- start 2024-09-13T23:57:24.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f544841af40 1 -- start start 2024-09-13T23:57:24.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f544841af40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b000 0x560be7df0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f544841af40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560be7b98500 con 0x560be7b0b000 2024-09-13T23:57:24.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f5446bd3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b000 0x560be7df0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f5446bd3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b000 0x560be7df0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34710/0 (socket says 172.21.15.173:34710) 2024-09-13T23:57:24.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f5446bd3700 1 -- 172.21.15.173:0/384799529 learned_addr learned my addr 172.21.15.173:0/384799529 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:24.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f5446bd3700 1 -- 172.21.15.173:0/384799529 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560be7b1dba0 con 0x560be7b0b000 2024-09-13T23:57:24.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f5446bd3700 1 --2- 172.21.15.173:0/384799529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b000 0x560be7df0580 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x560be7deac30 tx=0x560be7c0f800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742a7182cc5c9845 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f54453d0700 1 -- 172.21.15.173:0/384799529 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560be7baf760 con 0x560be7b0b000 2024-09-13T23:57:24.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f54453d0700 1 -- 172.21.15.173:0/384799529 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560be7bcfb00 con 0x560be7b0b000 2024-09-13T23:57:24.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f54453d0700 1 -- 172.21.15.173:0/384799529 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560be7baf4a0 con 0x560be7b0b000 2024-09-13T23:57:24.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f544841af40 1 -- 172.21.15.173:0/384799529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b000 msgr2=0x560be7df0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f544841af40 1 --2- 172.21.15.173:0/384799529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b000 0x560be7df0580 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x560be7deac30 tx=0x560be7c0f800 comp rx=0 tx=0).stop 2024-09-13T23:57:24.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f544841af40 1 -- 172.21.15.173:0/384799529 shutdown_connections 2024-09-13T23:57:24.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f544841af40 1 --2- 172.21.15.173:0/384799529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b000 0x560be7df0580 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f544841af40 1 -- 172.21.15.173:0/384799529 >> 172.21.15.173:0/384799529 conn(0x560be7b0ac00 msgr2=0x560be7c0b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:24.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f544841af40 1 -- 172.21.15.173:0/384799529 shutdown_connections 2024-09-13T23:57:24.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.137+0000 7f544841af40 1 -- 172.21.15.173:0/384799529 wait complete. 2024-09-13T23:57:24.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.141+0000 7f544841af40 1 Processor -- start 2024-09-13T23:57:24.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.141+0000 7f544841af40 1 -- start start 2024-09-13T23:57:24.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.141+0000 7f544841af40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b000 0x560be7df0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.141+0000 7f544841af40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560be7b983c0 con 0x560be7b0b000 2024-09-13T23:57:24.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.141+0000 7f5446bd3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b000 0x560be7df0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.141+0000 7f5446bd3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b000 0x560be7df0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34716/0 (socket says 172.21.15.173:34716) 2024-09-13T23:57:24.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.141+0000 7f5446bd3700 1 -- 172.21.15.173:0/3247140290 learned_addr learned my addr 172.21.15.173:0/3247140290 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:24.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.141+0000 7f5446bd3700 1 -- 172.21.15.173:0/3247140290 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560be7b1da00 con 0x560be7b0b000 2024-09-13T23:57:24.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.141+0000 7f5446bd3700 1 --2- 172.21.15.173:0/3247140290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b000 0x560be7df0580 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x560be7c67f80 tx=0x560be7c0f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.141+0000 7f5443bcd700 1 -- 172.21.15.173:0/3247140290 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560be7baf600 con 0x560be7b0b000 2024-09-13T23:57:24.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.141+0000 7f5443bcd700 1 -- 172.21.15.173:0/3247140290 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560be7bcfc80 con 0x560be7b0b000 2024-09-13T23:57:24.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.141+0000 7f5443bcd700 1 -- 172.21.15.173:0/3247140290 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560be7baf8c0 con 0x560be7b0b000 2024-09-13T23:57:24.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.141+0000 7f544841af40 1 -- 172.21.15.173:0/3247140290 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560be7b1d860 con 0x560be7b0b000 2024-09-13T23:57:24.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.141+0000 7f544841af40 1 -- 172.21.15.173:0/3247140290 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560be7b1d6c0 con 0x560be7b0b000 2024-09-13T23:57:24.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.141+0000 7f544841af40 1 Processor -- start 2024-09-13T23:57:24.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.141+0000 7f544841af40 1 -- start start 2024-09-13T23:57:24.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.145+0000 7f544841af40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b800 0x560be7df0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.145+0000 7f544841af40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560be7b30640 con 0x560be7b0b800 2024-09-13T23:57:24.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.145+0000 7f5443bcd700 1 -- 172.21.15.173:0/3247140290 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x560be7c04b00 con 0x560be7b0b000 2024-09-13T23:57:24.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.145+0000 7f54473d4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b800 0x560be7df0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.145+0000 7f54473d4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b800 0x560be7df0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34720/0 (socket says 172.21.15.173:34720) 2024-09-13T23:57:24.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.145+0000 7f54473d4700 1 -- 172.21.15.173:0/3658976705 learned_addr learned my addr 172.21.15.173:0/3658976705 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:24.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.145+0000 7f5443bcd700 1 --2- 172.21.15.173:0/3247140290 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560be7eb4000 0x560be7df1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.145+0000 7f5443bcd700 1 -- 172.21.15.173:0/3247140290 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x560be7b71180 con 0x560be7b0b000 2024-09-13T23:57:24.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.145+0000 7f54473d4700 1 -- 172.21.15.173:0/3658976705 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560be7b1c000 con 0x560be7b0b800 2024-09-13T23:57:24.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.145+0000 7f5446bd3700 1 --2- 172.21.15.173:0/3247140290 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560be7eb4000 0x560be7df1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.145+0000 7f54473d4700 1 --2- 172.21.15.173:0/3658976705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b800 0x560be7df0b00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x560be7e37b00 tx=0x560be7c0fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318b46231726e53c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.145+0000 7f5446bd3700 1 --2- 172.21.15.173:0/3247140290 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560be7eb4000 0x560be7df1080 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x560be7e37560 tx=0x560be7e72c60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.145+0000 7f54413c8700 1 -- 172.21.15.173:0/3658976705 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560be7baf600 con 0x560be7b0b800 2024-09-13T23:57:24.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.145+0000 7f54413c8700 1 -- 172.21.15.173:0/3658976705 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560be7e96000 con 0x560be7b0b800 2024-09-13T23:57:24.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.145+0000 7f54413c8700 1 -- 172.21.15.173:0/3658976705 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560be7baf8c0 con 0x560be7b0b800 2024-09-13T23:57:24.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.145+0000 7f544841af40 1 -- 172.21.15.173:0/3658976705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b800 msgr2=0x560be7df0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.145+0000 7f544841af40 1 --2- 172.21.15.173:0/3658976705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b800 0x560be7df0b00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x560be7e37b00 tx=0x560be7c0fce0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.145+0000 7f544841af40 1 -- 172.21.15.173:0/3658976705 shutdown_connections 2024-09-13T23:57:24.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.145+0000 7f544841af40 1 --2- 172.21.15.173:0/3658976705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b800 0x560be7df0b00 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.145+0000 7f544841af40 1 -- 172.21.15.173:0/3658976705 >> 172.21.15.173:0/3658976705 conn(0x560be7b0b400 msgr2=0x560be7c0b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:24.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.145+0000 7f544841af40 1 -- 172.21.15.173:0/3658976705 shutdown_connections 2024-09-13T23:57:24.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.145+0000 7f544841af40 1 -- 172.21.15.173:0/3658976705 wait complete. 2024-09-13T23:57:24.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.149+0000 7f544841af40 1 Processor -- start 2024-09-13T23:57:24.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.149+0000 7f544841af40 1 -- start start 2024-09-13T23:57:24.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.149+0000 7f544841af40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b800 0x560be7df0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.149+0000 7f544841af40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560be7b308c0 con 0x560be7b0b800 2024-09-13T23:57:24.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.149+0000 7f54473d4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b800 0x560be7df0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.149+0000 7f54473d4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b800 0x560be7df0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34726/0 (socket says 172.21.15.173:34726) 2024-09-13T23:57:24.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.149+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 learned_addr learned my addr 172.21.15.173:0/1089142586 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:24.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.149+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560be7b1cea0 con 0x560be7b0b800 2024-09-13T23:57:24.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.149+0000 7f54473d4700 1 --2- 172.21.15.173:0/1089142586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b800 0x560be7df0b00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x560be7c67e30 tx=0x560be7c0fbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.149+0000 7f543fbc5700 1 -- 172.21.15.173:0/1089142586 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560be7baf760 con 0x560be7b0b800 2024-09-13T23:57:24.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.149+0000 7f543fbc5700 1 -- 172.21.15.173:0/1089142586 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560be7e96180 con 0x560be7b0b800 2024-09-13T23:57:24.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.149+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560be7b1c820 con 0x560be7b0b800 2024-09-13T23:57:24.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.149+0000 7f543fbc5700 1 -- 172.21.15.173:0/1089142586 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560be7baf600 con 0x560be7b0b800 2024-09-13T23:57:24.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.149+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560be7b1c9c0 con 0x560be7b0b800 2024-09-13T23:57:24.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f544841af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f543fbc5700 1 -- 172.21.15.173:0/1089142586 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x560be7c05080 con 0x560be7b0b800 2024-09-13T23:57:24.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f543fbc5700 1 --2- 172.21.15.173:0/1089142586 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560be7eb4c00 0x560be7df1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f543fbc5700 1 -- 172.21.15.173:0/1089142586 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x560be7b71340 con 0x560be7b0b800 2024-09-13T23:57:24.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f54463d2700 1 --2- 172.21.15.173:0/1089142586 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560be7eb4c00 0x560be7df1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f544841af40 1 --2- 172.21.15.173:0/1089142586 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560be7eb5000 0x560be7df1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5400 con 0x560be7eb5000 2024-09-13T23:57:24.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f54473d4700 1 --2- 172.21.15.173:0/1089142586 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560be7eb5000 0x560be7df1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f54463d2700 1 --2- 172.21.15.173:0/1089142586 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560be7eb4c00 0x560be7df1600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x560be7debf80 tx=0x560be7f640c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f54473d4700 1 --2- 172.21.15.173:0/1089142586 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560be7eb5000 0x560be7df1b80 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x560be7f48b40 con 0x560be7eb5000 2024-09-13T23:57:24.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f544841af40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:24.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f544841af40 20 realm 2024-09-13T23:57:24.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f544841af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5000 2024-09-13T23:57:24.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x560be7f48b40 con 0x560be7eb5000 2024-09-13T23:57:24.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f544841af40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:24.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f544841af40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:24.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f544841af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5c00 con 0x560be7eb5000 2024-09-13T23:57:24.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x560be7f48b40 con 0x560be7eb5000 2024-09-13T23:57:24.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f544841af40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:24.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f544841af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f544841af40 1 --2- 172.21.15.173:0/1089142586 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560be7eb5400 0x560be7df2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5400 2024-09-13T23:57:24.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.153+0000 7f5446bd3700 1 --2- 172.21.15.173:0/1089142586 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560be7eb5400 0x560be7df2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.157+0000 7f5446bd3700 1 --2- 172.21.15.173:0/1089142586 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560be7eb5400 0x560be7df2100 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.157+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x560be7f49200 con 0x560be7eb5400 2024-09-13T23:57:24.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.157+0000 7f544841af40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:24.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.157+0000 7f544841af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.157+0000 7f544841af40 1 --2- 172.21.15.173:0/1089142586 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560be7eb5c00 0x560be7df2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.157+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f78000 con 0x560be7eb5c00 2024-09-13T23:57:24.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.157+0000 7f54463d2700 1 --2- 172.21.15.173:0/1089142586 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560be7eb5c00 0x560be7df2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.157+0000 7f54463d2700 1 --2- 172.21.15.173:0/1089142586 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560be7eb5c00 0x560be7df2680 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.157+0000 7f54463d2700 1 -- 172.21.15.173:0/1089142586 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x560be7f49440 con 0x560be7eb5c00 2024-09-13T23:57:24.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.157+0000 7f544841af40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:24.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.157+0000 7f544841af40 20 searching for the correct realm 2024-09-13T23:57:24.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.157+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f78400 con 0x560be7eb5c00 2024-09-13T23:57:24.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.157+0000 7f54463d2700 1 -- 172.21.15.173:0/1089142586 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x560be7f49440 con 0x560be7eb5c00 2024-09-13T23:57:24.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.157+0000 7f54463d2700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f78000 con 0x560be7eb5400 2024-09-13T23:57:24.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.161+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f49200 con 0x560be7eb5400 2024-09-13T23:57:24.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.161+0000 7f5446bd3700 1 --2- 172.21.15.173:0/1089142586 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560be7f78000 0x560be7df2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.161+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7f78000 2024-09-13T23:57:24.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.161+0000 7f54473d4700 1 --2- 172.21.15.173:0/1089142586 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560be7f78000 0x560be7df2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.161+0000 7f54473d4700 1 --2- 172.21.15.173:0/1089142586 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560be7f78000 0x560be7df2c00 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.161+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f48b40 con 0x560be7f78000 2024-09-13T23:57:24.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.161+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7f78000 2024-09-13T23:57:24.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.161+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x560be7f48b40 con 0x560be7f78000 2024-09-13T23:57:24.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.161+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5000 2024-09-13T23:57:24.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.161+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f48b40 con 0x560be7eb5000 2024-09-13T23:57:24.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.161+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5c00 2024-09-13T23:57:24.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.161+0000 7f54463d2700 1 -- 172.21.15.173:0/1089142586 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f49440 con 0x560be7eb5c00 2024-09-13T23:57:24.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.161+0000 7f54463d2700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5000 2024-09-13T23:57:24.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.165+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f48b40 con 0x560be7eb5000 2024-09-13T23:57:24.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.165+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5400 2024-09-13T23:57:24.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.165+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f49200 con 0x560be7eb5400 2024-09-13T23:57:24.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.165+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5400 2024-09-13T23:57:24.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.165+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f49200 con 0x560be7eb5400 2024-09-13T23:57:24.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.165+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5000 2024-09-13T23:57:24.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.165+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f48b40 con 0x560be7eb5000 2024-09-13T23:57:24.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.165+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7f78000 2024-09-13T23:57:24.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.165+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f48b40 con 0x560be7f78000 2024-09-13T23:57:24.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.165+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5000 2024-09-13T23:57:24.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.165+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f48b40 con 0x560be7eb5000 2024-09-13T23:57:24.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.165+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7f78000 2024-09-13T23:57:24.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.169+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f48b40 con 0x560be7f78000 2024-09-13T23:57:24.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.169+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5400 2024-09-13T23:57:24.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.169+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f49200 con 0x560be7eb5400 2024-09-13T23:57:24.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.169+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5c00 2024-09-13T23:57:24.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.169+0000 7f54463d2700 1 -- 172.21.15.173:0/1089142586 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f49440 con 0x560be7eb5c00 2024-09-13T23:57:24.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.169+0000 7f54463d2700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5000 2024-09-13T23:57:24.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.169+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f48b40 con 0x560be7eb5000 2024-09-13T23:57:24.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.169+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5400 2024-09-13T23:57:24.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.169+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f49200 con 0x560be7eb5400 2024-09-13T23:57:24.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.169+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5c00 2024-09-13T23:57:24.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.169+0000 7f54463d2700 1 -- 172.21.15.173:0/1089142586 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f49440 con 0x560be7eb5c00 2024-09-13T23:57:24.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.169+0000 7f54463d2700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5000 2024-09-13T23:57:24.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.173+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f48b40 con 0x560be7eb5000 2024-09-13T23:57:24.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.173+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5000 2024-09-13T23:57:24.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.173+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f48b40 con 0x560be7eb5000 2024-09-13T23:57:24.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.173+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5000 2024-09-13T23:57:24.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.173+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f48b40 con 0x560be7eb5000 2024-09-13T23:57:24.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.173+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5c00 2024-09-13T23:57:24.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.173+0000 7f54463d2700 1 -- 172.21.15.173:0/1089142586 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f49440 con 0x560be7eb5c00 2024-09-13T23:57:24.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.173+0000 7f54463d2700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7f78000 2024-09-13T23:57:24.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.173+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f48b40 con 0x560be7f78000 2024-09-13T23:57:24.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.173+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5000 2024-09-13T23:57:24.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.173+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f48b40 con 0x560be7eb5000 2024-09-13T23:57:24.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.173+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7f78000 2024-09-13T23:57:24.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.177+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f48b40 con 0x560be7f78000 2024-09-13T23:57:24.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.177+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5c00 2024-09-13T23:57:24.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.177+0000 7f54463d2700 1 -- 172.21.15.173:0/1089142586 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f49440 con 0x560be7eb5c00 2024-09-13T23:57:24.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.177+0000 7f54463d2700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7f78000 2024-09-13T23:57:24.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.177+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f48b40 con 0x560be7f78000 2024-09-13T23:57:24.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.177+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5400 2024-09-13T23:57:24.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.177+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f49200 con 0x560be7eb5400 2024-09-13T23:57:24.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.177+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5400 2024-09-13T23:57:24.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.177+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f49200 con 0x560be7eb5400 2024-09-13T23:57:24.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.177+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5c00 2024-09-13T23:57:24.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.177+0000 7f54463d2700 1 -- 172.21.15.173:0/1089142586 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f49440 con 0x560be7eb5c00 2024-09-13T23:57:24.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.177+0000 7f54463d2700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5400 2024-09-13T23:57:24.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.181+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x560be7f49200 con 0x560be7eb5400 2024-09-13T23:57:24.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.181+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7eb5400 2024-09-13T23:57:24.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.181+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560be7f49200 con 0x560be7eb5400 2024-09-13T23:57:24.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.181+0000 7f544841af40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:24.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.181+0000 7f544841af40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:24.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.181+0000 7f544841af40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:24.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.181+0000 7f544841af40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:24.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.181+0000 7f544841af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.181+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f78800 con 0x560be7eb5000 2024-09-13T23:57:24.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.181+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x560be7f48b40 con 0x560be7eb5000 2024-09-13T23:57:24.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.181+0000 7f544841af40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:24.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.181+0000 7f544841af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.181+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f78c00 con 0x560be7eb5400 2024-09-13T23:57:24.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.181+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x560be7f49200 con 0x560be7eb5400 2024-09-13T23:57:24.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.181+0000 7f544841af40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:24.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.181+0000 7f544841af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.181+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f79000 con 0x560be7f78000 2024-09-13T23:57:24.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.185+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x560be7f48b40 con 0x560be7f78000 2024-09-13T23:57:24.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.185+0000 7f544841af40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:24.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.185+0000 7f544841af40 20 zone default found 2024-09-13T23:57:24.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.185+0000 7f544841af40 4 Realm: () 2024-09-13T23:57:24.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.185+0000 7f544841af40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:24.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.185+0000 7f544841af40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:24.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.185+0000 7f544841af40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:24.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.185+0000 7f544841af40 20 zonegroup default 2024-09-13T23:57:24.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.185+0000 7f544841af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.185+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f79400 con 0x560be7f78000 2024-09-13T23:57:24.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.185+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x560be7f48b40 con 0x560be7f78000 2024-09-13T23:57:24.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.185+0000 7f544841af40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:24.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.185+0000 7f544841af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.185+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f79800 con 0x560be7eb5c00 2024-09-13T23:57:24.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.185+0000 7f54463d2700 1 -- 172.21.15.173:0/1089142586 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x560be7f49440 con 0x560be7eb5c00 2024-09-13T23:57:24.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.185+0000 7f544841af40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:24.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.185+0000 7f544841af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.185+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f79c00 con 0x560be7eb5c00 2024-09-13T23:57:24.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.185+0000 7f54463d2700 1 -- 172.21.15.173:0/1089142586 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x560be7f49440 con 0x560be7eb5c00 2024-09-13T23:57:24.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.185+0000 7f544841af40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:24.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.185+0000 7f544841af40 20 started sync module instance, tier type = 2024-09-13T23:57:24.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.185+0000 7f544841af40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:24.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.185+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f7a000 con 0x560be7eb5400 2024-09-13T23:57:24.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.189+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v35'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7eb5400 2024-09-13T23:57:24.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.189+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94609134746368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f7a400 con 0x560be7eb5400 2024-09-13T23:57:24.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.189+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f7a800 con 0x560be7eb5000 2024-09-13T23:57:24.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.193+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94609134746368] v35'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7eb5400 2024-09-13T23:57:24.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.193+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v35'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560be7f48b40 con 0x560be7eb5000 2024-09-13T23:57:24.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.193+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94609134747520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f7ac00 con 0x560be7eb5000 2024-09-13T23:57:24.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.193+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f7b000 con 0x560be7eb5400 2024-09-13T23:57:24.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.193+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94609134747520] v35'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560be7f48b40 con 0x560be7eb5000 2024-09-13T23:57:24.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.197+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v35'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7eb5400 2024-09-13T23:57:24.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.197+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94609134748672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f7b400 con 0x560be7eb5400 2024-09-13T23:57:24.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.197+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f7b800 con 0x560be7f78000 2024-09-13T23:57:24.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.197+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v35'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560be7f48b40 con 0x560be7f78000 2024-09-13T23:57:24.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.197+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94609134749824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f7bc00 con 0x560be7f78000 2024-09-13T23:57:24.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.197+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f7a800 con 0x560be7eb5400 2024-09-13T23:57:24.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.197+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94609134748672] v35'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7eb5400 2024-09-13T23:57:24.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.201+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94609134749824] v35'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560be7f48b40 con 0x560be7f78000 2024-09-13T23:57:24.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.201+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v35'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7eb5400 2024-09-13T23:57:24.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.201+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94609134750976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f7a000 con 0x560be7eb5400 2024-09-13T23:57:24.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.201+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f78800 con 0x560be7eb5c00 2024-09-13T23:57:24.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.205+0000 7f54463d2700 1 -- 172.21.15.173:0/1089142586 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v35'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560be7f49440 con 0x560be7eb5c00 2024-09-13T23:57:24.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.205+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94609134750976] v35'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7eb5400 2024-09-13T23:57:24.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.205+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94609134752128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f79000 con 0x560be7eb5c00 2024-09-13T23:57:24.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.205+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f79400 con 0x560be7eb5c00 2024-09-13T23:57:24.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.205+0000 7f54463d2700 1 -- 172.21.15.173:0/1089142586 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94609134752128] v35'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560be7f49440 con 0x560be7eb5c00 2024-09-13T23:57:24.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.205+0000 7f54463d2700 1 -- 172.21.15.173:0/1089142586 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v35'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560be7f49440 con 0x560be7eb5c00 2024-09-13T23:57:24.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.205+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94609134753280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f78c00 con 0x560be7eb5c00 2024-09-13T23:57:24.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.205+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7eb5800 con 0x560be7f78000 2024-09-13T23:57:24.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.209+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v35'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560be7f48b40 con 0x560be7f78000 2024-09-13T23:57:24.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.209+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94609134754432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f7a400 con 0x560be7f78000 2024-09-13T23:57:24.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.209+0000 7f544841af40 20 add_watcher() i=0 2024-09-13T23:57:24.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.209+0000 7f544841af40 20 add_watcher() i=1 2024-09-13T23:57:24.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.209+0000 7f544841af40 20 add_watcher() i=2 2024-09-13T23:57:24.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.209+0000 7f544841af40 20 add_watcher() i=3 2024-09-13T23:57:24.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.209+0000 7f544841af40 20 add_watcher() i=4 2024-09-13T23:57:24.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.209+0000 7f544841af40 20 add_watcher() i=5 2024-09-13T23:57:24.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.209+0000 7f54463d2700 1 -- 172.21.15.173:0/1089142586 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94609134753280] v35'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560be7f49440 con 0x560be7eb5c00 2024-09-13T23:57:24.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.209+0000 7f544841af40 20 add_watcher() i=6 2024-09-13T23:57:24.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.209+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94609134754432] v35'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560be7f48b40 con 0x560be7f78000 2024-09-13T23:57:24.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.209+0000 7f544841af40 20 add_watcher() i=7 2024-09-13T23:57:24.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.209+0000 7f544841af40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:24.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.209+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f7b000 con 0x560be7eb5000 2024-09-13T23:57:24.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.209+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x560be7f48b40 con 0x560be7eb5000 2024-09-13T23:57:24.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.209+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94609136418816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f7b400 con 0x560be7eb5000 2024-09-13T23:57:24.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.213+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94609136418816] v35'173 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x560be7f48b40 con 0x560be7eb5000 2024-09-13T23:57:24.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.213+0000 7f542dba1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:24.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.213+0000 7f544841af40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:24.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.213+0000 7f544841af40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:24.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.213+0000 7f544841af40 1 Processor -- start 2024-09-13T23:57:24.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.213+0000 7f544841af40 1 -- start start 2024-09-13T23:57:24.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.213+0000 7f544841af40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7f78400 0x560be7df3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.213+0000 7f544841af40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560be7b983c0 con 0x560be7f78400 2024-09-13T23:57:24.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.213+0000 7f54463d2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7f78400 0x560be7df3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.213+0000 7f54463d2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7f78400 0x560be7df3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34728/0 (socket says 172.21.15.173:34728) 2024-09-13T23:57:24.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.213+0000 7f54463d2700 1 -- 172.21.15.173:0/2928080128 learned_addr learned my addr 172.21.15.173:0/2928080128 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:24.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.213+0000 7f54463d2700 1 -- 172.21.15.173:0/2928080128 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560be7b1cb60 con 0x560be7f78400 2024-09-13T23:57:24.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.217+0000 7f54463d2700 1 --2- 172.21.15.173:0/2928080128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7f78400 0x560be7df3180 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x560be7f8a660 tx=0x560be7e73f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91be9ce2ab9c0cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.217+0000 7f542d3a0700 1 -- 172.21.15.173:0/2928080128 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560be7f92000 con 0x560be7f78400 2024-09-13T23:57:24.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.217+0000 7f542d3a0700 1 -- 172.21.15.173:0/2928080128 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560be7e96600 con 0x560be7f78400 2024-09-13T23:57:24.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.217+0000 7f542d3a0700 1 -- 172.21.15.173:0/2928080128 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560be7f92160 con 0x560be7f78400 2024-09-13T23:57:24.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.217+0000 7f544841af40 1 -- 172.21.15.173:0/2928080128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7f78400 msgr2=0x560be7df3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.217+0000 7f544841af40 1 --2- 172.21.15.173:0/2928080128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7f78400 0x560be7df3180 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x560be7f8a660 tx=0x560be7e73f80 comp rx=0 tx=0).stop 2024-09-13T23:57:24.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.217+0000 7f544841af40 1 -- 172.21.15.173:0/2928080128 shutdown_connections 2024-09-13T23:57:24.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.217+0000 7f544841af40 1 --2- 172.21.15.173:0/2928080128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7f78400 0x560be7df3180 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.217+0000 7f544841af40 1 -- 172.21.15.173:0/2928080128 >> 172.21.15.173:0/2928080128 conn(0x560be7f7a800 msgr2=0x560be7c0c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:24.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.217+0000 7f544841af40 1 -- 172.21.15.173:0/2928080128 shutdown_connections 2024-09-13T23:57:24.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.217+0000 7f544841af40 1 -- 172.21.15.173:0/2928080128 wait complete. 2024-09-13T23:57:24.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.217+0000 7f544841af40 1 Processor -- start 2024-09-13T23:57:24.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.217+0000 7f544841af40 1 -- start start 2024-09-13T23:57:24.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.217+0000 7f544841af40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7f78400 0x560be7df3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.217+0000 7f544841af40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x560be7b98500 con 0x560be7f78400 2024-09-13T23:57:24.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.217+0000 7f54463d2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7f78400 0x560be7df3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.217+0000 7f54463d2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7f78400 0x560be7df3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34744/0 (socket says 172.21.15.173:34744) 2024-09-13T23:57:24.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.217+0000 7f54463d2700 1 -- 172.21.15.173:0/3190025887 learned_addr learned my addr 172.21.15.173:0/3190025887 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:24.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.217+0000 7f54463d2700 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560be7b1cd00 con 0x560be7f78400 2024-09-13T23:57:24.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.217+0000 7f54463d2700 1 --2- 172.21.15.173:0/3190025887 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7f78400 0x560be7df3180 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x560be7f8a870 tx=0x560be7f641e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.217+0000 7f542bb9d700 1 -- 172.21.15.173:0/3190025887 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560be7f922c0 con 0x560be7f78400 2024-09-13T23:57:24.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.221+0000 7f542bb9d700 1 -- 172.21.15.173:0/3190025887 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560be7e96300 con 0x560be7f78400 2024-09-13T23:57:24.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.221+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560be7b1c340 con 0x560be7f78400 2024-09-13T23:57:24.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.221+0000 7f542bb9d700 1 -- 172.21.15.173:0/3190025887 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x560be7f92000 con 0x560be7f78400 2024-09-13T23:57:24.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.221+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560be7b1cb60 con 0x560be7f78400 2024-09-13T23:57:24.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.221+0000 7f542bb9d700 1 -- 172.21.15.173:0/3190025887 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x560be7c05b80 con 0x560be7f78400 2024-09-13T23:57:24.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.221+0000 7f542bb9d700 1 --2- 172.21.15.173:0/3190025887 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560be7eb5800 0x560be800e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.221+0000 7f542bb9d700 1 -- 172.21.15.173:0/3190025887 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x560be7b71500 con 0x560be7f78400 2024-09-13T23:57:24.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.221+0000 7f54473d4700 1 --2- 172.21.15.173:0/3190025887 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560be7eb5800 0x560be800e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.221+0000 7f544841af40 1 --2- 172.21.15.173:0/3190025887 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560be7f79800 0x560be7df3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.221+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f79c00 con 0x560be7f79800 2024-09-13T23:57:24.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.221+0000 7f5446bd3700 1 --2- 172.21.15.173:0/3190025887 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560be7f79800 0x560be7df3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.221+0000 7f54473d4700 1 --2- 172.21.15.173:0/3190025887 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560be7eb5800 0x560be800e000 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x560be7f11860 tx=0x560be7f65380 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.221+0000 7f5446bd3700 1 --2- 172.21.15.173:0/3190025887 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560be7f79800 0x560be7df3700 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.225+0000 7f5446bd3700 1 -- 172.21.15.173:0/3190025887 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v35'32 uv30 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7f79800 2024-09-13T23:57:24.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.225+0000 7f544841af40 1 --2- 172.21.15.173:0/3190025887 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560be7f78800 0x560be800e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.225+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f7ac00 con 0x560be7f78800 2024-09-13T23:57:24.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.225+0000 7f54463d2700 1 --2- 172.21.15.173:0/3190025887 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560be7f78800 0x560be800e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.225+0000 7f54463d2700 1 --2- 172.21.15.173:0/3190025887 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560be7f78800 0x560be800e580 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.229+0000 7f54463d2700 1 -- 172.21.15.173:0/3190025887 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v35'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x560be7f49440 con 0x560be7f78800 2024-09-13T23:57:24.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.229+0000 7f544841af40 1 --2- 172.21.15.173:0/3190025887 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560be7f7b800 0x560be800eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.229+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f7bc00 con 0x560be7f7b800 2024-09-13T23:57:24.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.229+0000 7f54473d4700 1 --2- 172.21.15.173:0/3190025887 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560be7f7b800 0x560be800eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.229+0000 7f54473d4700 1 --2- 172.21.15.173:0/3190025887 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560be7f7b800 0x560be800eb00 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.233+0000 7f54473d4700 1 -- 172.21.15.173:0/3190025887 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v35'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x560be7f48b40 con 0x560be7f7b800 2024-09-13T23:57:24.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.233+0000 7f544841af40 1 --2- 172.21.15.173:0/3190025887 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560be7f7a400 0x560be800f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.233+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be8032000 con 0x560be7f7a400 2024-09-13T23:57:24.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.233+0000 7f5446bd3700 1 --2- 172.21.15.173:0/3190025887 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560be7f7a400 0x560be800f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.233+0000 7f5446bd3700 1 --2- 172.21.15.173:0/3190025887 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560be7f7a400 0x560be800f080 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.237+0000 7f5446bd3700 1 -- 172.21.15.173:0/3190025887 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v35'174 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7f7a400 2024-09-13T23:57:24.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.237+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be8032400 con 0x560be7f79800 2024-09-13T23:57:24.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.237+0000 7f5446bd3700 1 -- 172.21.15.173:0/3190025887 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v35'59 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7f79800 2024-09-13T23:57:24.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.237+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be8032800 con 0x560be7f7b800 2024-09-13T23:57:24.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.241+0000 7f54473d4700 1 -- 172.21.15.173:0/3190025887 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v35'39 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x560be7f48b40 con 0x560be7f7b800 2024-09-13T23:57:24.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.241+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be8032c00 con 0x560be7f79800 2024-09-13T23:57:24.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.245+0000 7f5446bd3700 1 -- 172.21.15.173:0/3190025887 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v35'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7f79800 2024-09-13T23:57:24.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.245+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be8033000 con 0x560be7f7a400 2024-09-13T23:57:24.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.245+0000 7f5446bd3700 1 -- 172.21.15.173:0/3190025887 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v35'39 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7f7a400 2024-09-13T23:57:24.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.245+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be8033400 con 0x560be7f79800 2024-09-13T23:57:24.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.249+0000 7f5446bd3700 1 -- 172.21.15.173:0/3190025887 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v35'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7f79800 2024-09-13T23:57:24.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.249+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be8033800 con 0x560be7f79800 2024-09-13T23:57:24.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.249+0000 7f5446bd3700 1 -- 172.21.15.173:0/3190025887 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v35'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7f79800 2024-09-13T23:57:24.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.249+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be8033c00 con 0x560be7f79800 2024-09-13T23:57:24.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.253+0000 7f5446bd3700 1 -- 172.21.15.173:0/3190025887 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v35'60 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7f79800 2024-09-13T23:57:24.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.253+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be8032000 con 0x560be7f7b800 2024-09-13T23:57:24.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.257+0000 7f54473d4700 1 -- 172.21.15.173:0/3190025887 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v35'26 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560be7f48b40 con 0x560be7f7b800 2024-09-13T23:57:24.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.257+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be8032400 con 0x560be7f79800 2024-09-13T23:57:24.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.257+0000 7f5446bd3700 1 -- 172.21.15.173:0/3190025887 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v35'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7f79800 2024-09-13T23:57:24.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.261+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be8032c00 con 0x560be7f7a400 2024-09-13T23:57:24.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.261+0000 7f5446bd3700 1 -- 172.21.15.173:0/3190025887 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v35'45 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7f7a400 2024-09-13T23:57:24.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.261+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f79c00 con 0x560be7f7a400 2024-09-13T23:57:24.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.265+0000 7f5446bd3700 1 -- 172.21.15.173:0/3190025887 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v35'175 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7f7a400 2024-09-13T23:57:24.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.265+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f7a000 con 0x560be7f79800 2024-09-13T23:57:24.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.269+0000 7f5446bd3700 1 -- 172.21.15.173:0/3190025887 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v35'53 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7f79800 2024-09-13T23:57:24.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.269+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be8033000 con 0x560be7f79800 2024-09-13T23:57:24.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.269+0000 7f5446bd3700 1 -- 172.21.15.173:0/3190025887 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v35'61 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7f79800 2024-09-13T23:57:24.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.269+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be8033400 con 0x560be7f7b800 2024-09-13T23:57:24.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.273+0000 7f54473d4700 1 -- 172.21.15.173:0/3190025887 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v35'26 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560be7f48b40 con 0x560be7f7b800 2024-09-13T23:57:24.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.273+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be8033800 con 0x560be7f79800 2024-09-13T23:57:24.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.273+0000 7f5446bd3700 1 -- 172.21.15.173:0/3190025887 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v35'31 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7f79800 2024-09-13T23:57:24.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.277+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be8033c00 con 0x560be7f7a400 2024-09-13T23:57:24.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.277+0000 7f5446bd3700 1 -- 172.21.15.173:0/3190025887 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v35'176 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7f7a400 2024-09-13T23:57:24.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.277+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be8032400 con 0x560be7f79800 2024-09-13T23:57:24.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.281+0000 7f5446bd3700 1 -- 172.21.15.173:0/3190025887 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v35'54 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7f79800 2024-09-13T23:57:24.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.281+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be8032c00 con 0x560be7f79800 2024-09-13T23:57:24.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.285+0000 7f5446bd3700 1 -- 172.21.15.173:0/3190025887 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v35'33 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7f79800 2024-09-13T23:57:24.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.285+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f7a000 con 0x560be7f7b800 2024-09-13T23:57:24.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.285+0000 7f54473d4700 1 -- 172.21.15.173:0/3190025887 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v35'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560be7f48b40 con 0x560be7f7b800 2024-09-13T23:57:24.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.285+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f7b000 con 0x560be7f79800 2024-09-13T23:57:24.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.289+0000 7f5446bd3700 1 -- 172.21.15.173:0/3190025887 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v35'30 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7f79800 2024-09-13T23:57:24.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.289+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f7b400 con 0x560be7f7b800 2024-09-13T23:57:24.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.293+0000 7f54473d4700 1 -- 172.21.15.173:0/3190025887 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v35'19 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560be7f48b40 con 0x560be7f7b800 2024-09-13T23:57:24.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.293+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f7bc00 con 0x560be7f7b800 2024-09-13T23:57:24.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.293+0000 7f54473d4700 1 -- 172.21.15.173:0/3190025887 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v35'40 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560be7f48b40 con 0x560be7f7b800 2024-09-13T23:57:24.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.293+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be7f79c00 con 0x560be7f7b800 2024-09-13T23:57:24.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.297+0000 7f54473d4700 1 -- 172.21.15.173:0/3190025887 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v35'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560be7f48b40 con 0x560be7f7b800 2024-09-13T23:57:24.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.297+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be8062000 con 0x560be7f79800 2024-09-13T23:57:24.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.301+0000 7f5446bd3700 1 -- 172.21.15.173:0/3190025887 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v35'28 uv26 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7f79800 2024-09-13T23:57:24.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.301+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be8062400 con 0x560be7f7a400 2024-09-13T23:57:24.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.301+0000 7f5446bd3700 1 -- 172.21.15.173:0/3190025887 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v35'40 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7f7a400 2024-09-13T23:57:24.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.301+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be8062800 con 0x560be7f79800 2024-09-13T23:57:24.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.305+0000 7f5446bd3700 1 -- 172.21.15.173:0/3190025887 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v35'55 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7f79800 2024-09-13T23:57:24.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.305+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be8062c00 con 0x560be7f7a400 2024-09-13T23:57:24.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.305+0000 7f5446bd3700 1 -- 172.21.15.173:0/3190025887 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v35'46 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7f7a400 2024-09-13T23:57:24.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.309+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be8063000 con 0x560be7f78800 2024-09-13T23:57:24.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.309+0000 7f54463d2700 1 -- 172.21.15.173:0/3190025887 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v35'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x560be7f49440 con 0x560be7f78800 2024-09-13T23:57:24.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.313+0000 7f5429398700 20 reqs_thread_entry: start 2024-09-13T23:57:24.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.313+0000 7f544841af40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:24.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.313+0000 7f544841af40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:24.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.313+0000 7f5427394700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:54 2024 2024-09-13T23:57:24.319 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:24.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.313+0000 7f544841af40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:57:24.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.313+0000 7f544841af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.313+0000 7f5426b93700 20 reqs_thread_entry: start 2024-09-13T23:57:24.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.313+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be8063c00 con 0x560be7eb5000 2024-09-13T23:57:24.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.313+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv16 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x560be7f48b40 con 0x560be7eb5000 2024-09-13T23:57:24.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.313+0000 7f544841af40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:57:24.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.313+0000 7f544841af40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:57:24.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.313+0000 7f544841af40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:24.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.313+0000 7f544841af40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:24.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.313+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be80bc000 con 0x560be7f78000 2024-09-13T23:57:24.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.317+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x560be7f48b40 con 0x560be7f78000 2024-09-13T23:57:24.322 INFO:teuthology.orchestra.run.smithi173.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-13T23:57:24.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.317+0000 7f542dba1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:24.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.317+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94609136418816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be80bd000 con 0x560be7eb5000 2024-09-13T23:57:24.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.321+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94609136418816] v35'177 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x560be7f48b40 con 0x560be7eb5000 2024-09-13T23:57:24.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.321+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94609134746368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be80bd400 con 0x560be7eb5400 2024-09-13T23:57:24.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.321+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94609134746368] v35'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7eb5400 2024-09-13T23:57:24.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.321+0000 7f544841af40 20 remove_watcher() i=0 2024-09-13T23:57:24.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.321+0000 7f544841af40 2 removed watcher, disabling cache 2024-09-13T23:57:24.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.321+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94609134747520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be80bd800 con 0x560be7eb5000 2024-09-13T23:57:24.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.325+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94609134747520] v35'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560be7f48b40 con 0x560be7eb5000 2024-09-13T23:57:24.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.325+0000 7f544841af40 20 remove_watcher() i=1 2024-09-13T23:57:24.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.325+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94609134748672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be80bdc00 con 0x560be7eb5400 2024-09-13T23:57:24.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.325+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94609134748672] v35'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7eb5400 2024-09-13T23:57:24.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.325+0000 7f544841af40 20 remove_watcher() i=2 2024-09-13T23:57:24.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.325+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94609134749824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be80bc000 con 0x560be7f78000 2024-09-13T23:57:24.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.329+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94609134749824] v35'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560be7f48b40 con 0x560be7f78000 2024-09-13T23:57:24.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.329+0000 7f544841af40 20 remove_watcher() i=3 2024-09-13T23:57:24.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.329+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94609134750976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be80bd000 con 0x560be7eb5400 2024-09-13T23:57:24.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.333+0000 7f5446bd3700 1 -- 172.21.15.173:0/1089142586 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94609134750976] v35'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560be7f49200 con 0x560be7eb5400 2024-09-13T23:57:24.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.333+0000 7f544841af40 20 remove_watcher() i=4 2024-09-13T23:57:24.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.333+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94609134752128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be80bcc00 con 0x560be7eb5c00 2024-09-13T23:57:24.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.333+0000 7f54463d2700 1 -- 172.21.15.173:0/1089142586 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94609134752128] v35'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560be7f49440 con 0x560be7eb5c00 2024-09-13T23:57:24.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.333+0000 7f544841af40 20 remove_watcher() i=5 2024-09-13T23:57:24.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.333+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94609134753280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be80bc800 con 0x560be7eb5c00 2024-09-13T23:57:24.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.337+0000 7f54463d2700 1 -- 172.21.15.173:0/1089142586 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94609134753280] v35'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560be7f49440 con 0x560be7eb5c00 2024-09-13T23:57:24.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.337+0000 7f544841af40 20 remove_watcher() i=6 2024-09-13T23:57:24.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.337+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94609134754432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x560be80bc400 con 0x560be7f78000 2024-09-13T23:57:24.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.337+0000 7f54473d4700 1 -- 172.21.15.173:0/1089142586 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94609134754432] v35'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x560be7f48b40 con 0x560be7f78000 2024-09-13T23:57:24.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.337+0000 7f544841af40 20 remove_watcher() i=7 2024-09-13T23:57:24.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.337+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560be7eb5400 msgr2=0x560be7df2100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.337+0000 7f544841af40 1 --2- 172.21.15.173:0/1089142586 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560be7eb5400 0x560be7df2100 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.337+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560be7eb5000 msgr2=0x560be7df1b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.337+0000 7f544841af40 1 --2- 172.21.15.173:0/1089142586 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560be7eb5000 0x560be7df1b80 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.337+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560be7f78000 msgr2=0x560be7df2c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.337+0000 7f544841af40 1 --2- 172.21.15.173:0/1089142586 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560be7f78000 0x560be7df2c00 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.337+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560be7eb5c00 msgr2=0x560be7df2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.337+0000 7f544841af40 1 --2- 172.21.15.173:0/1089142586 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560be7eb5c00 0x560be7df2680 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560be7eb4c00 msgr2=0x560be7df1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 --2- 172.21.15.173:0/1089142586 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560be7eb4c00 0x560be7df1600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x560be7debf80 tx=0x560be7f640c0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b800 msgr2=0x560be7df0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 --2- 172.21.15.173:0/1089142586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b800 0x560be7df0b00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x560be7c67e30 tx=0x560be7c0fbc0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f54463d2700 1 -- 172.21.15.173:0/1089142586 reap_dead start 2024-09-13T23:57:24.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 shutdown_connections 2024-09-13T23:57:24.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 --2- 172.21.15.173:0/1089142586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b800 0x560be7df0b00 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 >> 172.21.15.173:0/1089142586 conn(0x560be7b0b400 msgr2=0x560be7c0b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:24.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 shutdown_connections 2024-09-13T23:57:24.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 -- 172.21.15.173:0/1089142586 wait complete. 2024-09-13T23:57:24.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560be7f79800 msgr2=0x560be7df3700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 --2- 172.21.15.173:0/3190025887 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x560be7f79800 0x560be7df3700 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560be7f7a400 msgr2=0x560be800f080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 --2- 172.21.15.173:0/3190025887 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x560be7f7a400 0x560be800f080 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560be7f78800 msgr2=0x560be800e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 --2- 172.21.15.173:0/3190025887 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x560be7f78800 0x560be800e580 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560be7f7b800 msgr2=0x560be800eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 --2- 172.21.15.173:0/3190025887 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x560be7f7b800 0x560be800eb00 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560be7eb5800 msgr2=0x560be800e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 --2- 172.21.15.173:0/3190025887 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560be7eb5800 0x560be800e000 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x560be7f11860 tx=0x560be7f65380 comp rx=0 tx=0).stop 2024-09-13T23:57:24.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7f78400 msgr2=0x560be7df3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 --2- 172.21.15.173:0/3190025887 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7f78400 0x560be7df3180 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x560be7f8a870 tx=0x560be7f641e0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f5446bd3700 1 -- 172.21.15.173:0/3190025887 reap_dead start 2024-09-13T23:57:24.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 shutdown_connections 2024-09-13T23:57:24.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 --2- 172.21.15.173:0/3190025887 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7f78400 0x560be7df3180 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 >> 172.21.15.173:0/3190025887 conn(0x560be7f7a800 msgr2=0x560be7c0c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:24.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 shutdown_connections 2024-09-13T23:57:24.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 -- 172.21.15.173:0/3190025887 wait complete. 2024-09-13T23:57:24.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 -- 172.21.15.173:0/3247140290 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560be7eb4000 msgr2=0x560be7df1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 --2- 172.21.15.173:0/3247140290 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560be7eb4000 0x560be7df1080 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x560be7e37560 tx=0x560be7e72c60 comp rx=0 tx=0).stop 2024-09-13T23:57:24.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 -- 172.21.15.173:0/3247140290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b000 msgr2=0x560be7df0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 --2- 172.21.15.173:0/3247140290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b000 0x560be7df0580 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x560be7c67f80 tx=0x560be7c0f920 comp rx=0 tx=0).stop 2024-09-13T23:57:24.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 -- 172.21.15.173:0/3247140290 shutdown_connections 2024-09-13T23:57:24.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 --2- 172.21.15.173:0/3247140290 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x560be7eb4000 0x560be7df1080 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 --2- 172.21.15.173:0/3247140290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560be7b0b000 0x560be7df0580 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 -- 172.21.15.173:0/3247140290 >> 172.21.15.173:0/3247140290 conn(0x560be7b0ac00 msgr2=0x560be7c0b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:24.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 -- 172.21.15.173:0/3247140290 shutdown_connections 2024-09-13T23:57:24.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.341+0000 7f544841af40 1 -- 172.21.15.173:0/3247140290 wait complete. 2024-09-13T23:57:24.353 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T23:57:24.369 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-13T23:57:24.378 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:57:24.450 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:57:24.471 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:57:24.521 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-13T23:57:24.533 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:57:24.533 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T23:57:24.533 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T23:57:24.533 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-13T23:57:24.574 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:24.574 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:24.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.569+0000 7f85e3a3af40 1 Processor -- start 2024-09-13T23:57:24.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.569+0000 7f85e3a3af40 1 -- start start 2024-09-13T23:57:24.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.569+0000 7f85e3a3af40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x564d5739b400 0x564d57680580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.569+0000 7f85e3a3af40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564d5745f500 con 0x564d5739b000 2024-09-13T23:57:24.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.569+0000 7f85e3a3af40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x564d57428a00 con 0x564d5739b400 2024-09-13T23:57:24.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.569+0000 7f85e19f2700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x564d5739b400 0x564d57680580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.569+0000 7f85e21f3700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x564d5739b000 0x564d5749a800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:44900/0 (socket says 172.21.15.173:44900) 2024-09-13T23:57:24.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.569+0000 7f85e21f3700 1 -- 172.21.15.173:0/2302021389 learned_addr learned my addr 172.21.15.173:0/2302021389 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:24.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.569+0000 7f85e19f2700 1 -- 172.21.15.173:0/2302021389 >> v1:172.21.15.87:6789/0 conn(0x564d5739b000 legacy=0x564d5749a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.569+0000 7f85e11f1700 1 -- 172.21.15.173:0/2302021389 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198748518 0 0) 0x564d574f6000 con 0x564d5739b000 2024-09-13T23:57:24.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.569+0000 7f85e19f2700 1 -- 172.21.15.173:0/2302021389 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d573add40 con 0x564d5739b400 2024-09-13T23:57:24.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.569+0000 7f85e19f2700 1 --2- 172.21.15.173:0/2302021389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b400 0x564d57680580 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x564d5767b920 tx=0x564d5749f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ccb66bd08871c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.573+0000 7f85e11f1700 1 -- 172.21.15.173:0/2302021389 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d5743f4a0 con 0x564d5739b400 2024-09-13T23:57:24.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.573+0000 7f85e11f1700 1 -- 172.21.15.173:0/2302021389 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564d5745f800 con 0x564d5739b400 2024-09-13T23:57:24.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.573+0000 7f85e11f1700 1 -- 172.21.15.173:0/2302021389 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d5743f600 con 0x564d5739b400 2024-09-13T23:57:24.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.573+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2302021389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b400 msgr2=0x564d57680580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.573+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/2302021389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b400 0x564d57680580 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x564d5767b920 tx=0x564d5749f920 comp rx=0 tx=0).stop 2024-09-13T23:57:24.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.573+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2302021389 shutdown_connections 2024-09-13T23:57:24.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.573+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/2302021389 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b400 0x564d57680580 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.573+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2302021389 >> 172.21.15.173:0/2302021389 conn(0x564d5739ac00 msgr2=0x564d5749a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:24.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.573+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2302021389 shutdown_connections 2024-09-13T23:57:24.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.573+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2302021389 wait complete. 2024-09-13T23:57:24.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.573+0000 7f85e3a3af40 1 Processor -- start 2024-09-13T23:57:24.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.573+0000 7f85e3a3af40 1 -- start start 2024-09-13T23:57:24.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.573+0000 7f85e3a3af40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b000 0x564d57680580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.573+0000 7f85e3a3af40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d57428500 con 0x564d5739b000 2024-09-13T23:57:24.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.573+0000 7f85e21f3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b000 0x564d57680580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.573+0000 7f85e21f3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b000 0x564d57680580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34766/0 (socket says 172.21.15.173:34766) 2024-09-13T23:57:24.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.573+0000 7f85e21f3700 1 -- 172.21.15.173:0/3868844232 learned_addr learned my addr 172.21.15.173:0/3868844232 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:24.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.573+0000 7f85e21f3700 1 -- 172.21.15.173:0/3868844232 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d573adba0 con 0x564d5739b000 2024-09-13T23:57:24.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.573+0000 7f85e21f3700 1 --2- 172.21.15.173:0/3868844232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b000 0x564d57680580 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x564d58165d70 tx=0x564d5749fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eccd8c23a2290f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.573+0000 7f85e09f0700 1 -- 172.21.15.173:0/3868844232 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d5743f4a0 con 0x564d5739b000 2024-09-13T23:57:24.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.573+0000 7f85e09f0700 1 -- 172.21.15.173:0/3868844232 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564d5745fb00 con 0x564d5739b000 2024-09-13T23:57:24.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.573+0000 7f85e09f0700 1 -- 172.21.15.173:0/3868844232 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d5743f600 con 0x564d5739b000 2024-09-13T23:57:24.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.577+0000 7f85e3a3af40 1 -- 172.21.15.173:0/3868844232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b000 msgr2=0x564d57680580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.577+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/3868844232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b000 0x564d57680580 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x564d58165d70 tx=0x564d5749fb60 comp rx=0 tx=0).stop 2024-09-13T23:57:24.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.577+0000 7f85e3a3af40 1 -- 172.21.15.173:0/3868844232 shutdown_connections 2024-09-13T23:57:24.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.577+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/3868844232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b000 0x564d57680580 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.577+0000 7f85e3a3af40 1 -- 172.21.15.173:0/3868844232 >> 172.21.15.173:0/3868844232 conn(0x564d5739ac00 msgr2=0x564d5749b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:24.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.577+0000 7f85e3a3af40 1 -- 172.21.15.173:0/3868844232 shutdown_connections 2024-09-13T23:57:24.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.577+0000 7f85e3a3af40 1 -- 172.21.15.173:0/3868844232 wait complete. 2024-09-13T23:57:24.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.577+0000 7f85e3a3af40 1 Processor -- start 2024-09-13T23:57:24.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.577+0000 7f85e3a3af40 1 -- start start 2024-09-13T23:57:24.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.577+0000 7f85e3a3af40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b000 0x564d57680580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.577+0000 7f85e3a3af40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d574283c0 con 0x564d5739b000 2024-09-13T23:57:24.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.577+0000 7f85e21f3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b000 0x564d57680580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.577+0000 7f85e21f3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b000 0x564d57680580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34782/0 (socket says 172.21.15.173:34782) 2024-09-13T23:57:24.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.577+0000 7f85e21f3700 1 -- 172.21.15.173:0/2000478174 learned_addr learned my addr 172.21.15.173:0/2000478174 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:24.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.577+0000 7f85e21f3700 1 -- 172.21.15.173:0/2000478174 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d573ada00 con 0x564d5739b000 2024-09-13T23:57:24.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.577+0000 7f85e21f3700 1 --2- 172.21.15.173:0/2000478174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b000 0x564d57680580 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x564d58165e00 tx=0x564d5749fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.581+0000 7f85df1ed700 1 -- 172.21.15.173:0/2000478174 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d5743f8c0 con 0x564d5739b000 2024-09-13T23:57:24.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.581+0000 7f85df1ed700 1 -- 172.21.15.173:0/2000478174 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564d5745fc80 con 0x564d5739b000 2024-09-13T23:57:24.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.581+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2000478174 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564d573ad860 con 0x564d5739b000 2024-09-13T23:57:24.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.581+0000 7f85df1ed700 1 -- 172.21.15.173:0/2000478174 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d5743f4a0 con 0x564d5739b000 2024-09-13T23:57:24.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.581+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2000478174 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d573ad6c0 con 0x564d5739b000 2024-09-13T23:57:24.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.581+0000 7f85df1ed700 1 -- 172.21.15.173:0/2000478174 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x564d57494b00 con 0x564d5739b000 2024-09-13T23:57:24.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.581+0000 7f85e3a3af40 1 Processor -- start 2024-09-13T23:57:24.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.581+0000 7f85e3a3af40 1 -- start start 2024-09-13T23:57:24.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.581+0000 7f85df1ed700 1 --2- 172.21.15.173:0/2000478174 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d5773c000 0x564d57681080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.581+0000 7f85df1ed700 1 -- 172.21.15.173:0/2000478174 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x564d57401180 con 0x564d5739b000 2024-09-13T23:57:24.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.581+0000 7f85e29f4700 1 --2- 172.21.15.173:0/2000478174 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d5773c000 0x564d57681080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.581+0000 7f85e3a3af40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b800 0x564d57680b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.581+0000 7f85e3a3af40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d573c0640 con 0x564d5739b800 2024-09-13T23:57:24.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.581+0000 7f85e21f3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b800 0x564d57680b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.581+0000 7f85e21f3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b800 0x564d57680b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34796/0 (socket says 172.21.15.173:34796) 2024-09-13T23:57:24.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.581+0000 7f85e21f3700 1 -- 172.21.15.173:0/1354905914 learned_addr learned my addr 172.21.15.173:0/1354905914 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:24.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.581+0000 7f85e29f4700 1 --2- 172.21.15.173:0/2000478174 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d5773c000 0x564d57681080 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x564d58165dd0 tx=0x564d576f4de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.581+0000 7f85e21f3700 1 -- 172.21.15.173:0/1354905914 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d573ac000 con 0x564d5739b800 2024-09-13T23:57:24.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.585+0000 7f85e21f3700 1 --2- 172.21.15.173:0/1354905914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b800 0x564d57680b00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x564d576c2390 tx=0x564d576f4240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36dadee9db5979c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.585+0000 7f85dc9e8700 1 -- 172.21.15.173:0/1354905914 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d5743f600 con 0x564d5739b800 2024-09-13T23:57:24.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.585+0000 7f85dc9e8700 1 -- 172.21.15.173:0/1354905914 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564d5745fc80 con 0x564d5739b800 2024-09-13T23:57:24.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.585+0000 7f85dc9e8700 1 -- 172.21.15.173:0/1354905914 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d5743fa20 con 0x564d5739b800 2024-09-13T23:57:24.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.585+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1354905914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b800 msgr2=0x564d57680b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.585+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/1354905914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b800 0x564d57680b00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x564d576c2390 tx=0x564d576f4240 comp rx=0 tx=0).stop 2024-09-13T23:57:24.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.585+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1354905914 shutdown_connections 2024-09-13T23:57:24.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.585+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/1354905914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b800 0x564d57680b00 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.585+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1354905914 >> 172.21.15.173:0/1354905914 conn(0x564d5739b400 msgr2=0x564d5749b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:24.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.585+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1354905914 shutdown_connections 2024-09-13T23:57:24.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.585+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1354905914 wait complete. 2024-09-13T23:57:24.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.585+0000 7f85e3a3af40 1 Processor -- start 2024-09-13T23:57:24.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.585+0000 7f85e3a3af40 1 -- start start 2024-09-13T23:57:24.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.585+0000 7f85e3a3af40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b800 0x564d57680b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.585+0000 7f85e3a3af40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d573c08c0 con 0x564d5739b800 2024-09-13T23:57:24.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.585+0000 7f85e21f3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b800 0x564d57680b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.585+0000 7f85e21f3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b800 0x564d57680b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34812/0 (socket says 172.21.15.173:34812) 2024-09-13T23:57:24.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.585+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 learned_addr learned my addr 172.21.15.173:0/1481024254 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:24.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.585+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d573acea0 con 0x564d5739b800 2024-09-13T23:57:24.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.589+0000 7f85e21f3700 1 --2- 172.21.15.173:0/1481024254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b800 0x564d57680b00 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x564d5773ee10 tx=0x564d576f4fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.589+0000 7f85db1e5700 1 -- 172.21.15.173:0/1481024254 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d5743f600 con 0x564d5739b800 2024-09-13T23:57:24.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.589+0000 7f85db1e5700 1 -- 172.21.15.173:0/1481024254 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564d57764000 con 0x564d5739b800 2024-09-13T23:57:24.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.589+0000 7f85db1e5700 1 -- 172.21.15.173:0/1481024254 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d5743fa20 con 0x564d5739b800 2024-09-13T23:57:24.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.589+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564d573ac820 con 0x564d5739b800 2024-09-13T23:57:24.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.589+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d573ac9c0 con 0x564d5739b800 2024-09-13T23:57:24.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.589+0000 7f85db1e5700 1 -- 172.21.15.173:0/1481024254 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x564d57494dc0 con 0x564d5739b800 2024-09-13T23:57:24.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.589+0000 7f85db1e5700 1 --2- 172.21.15.173:0/1481024254 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d5773d000 0x564d57681600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.589+0000 7f85db1e5700 1 -- 172.21.15.173:0/1481024254 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x564d57401340 con 0x564d5739b800 2024-09-13T23:57:24.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.589+0000 7f85e19f2700 1 --2- 172.21.15.173:0/1481024254 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d5773d000 0x564d57681600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.589+0000 7f85e19f2700 1 --2- 172.21.15.173:0/1481024254 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d5773d000 0x564d57681600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x564d5767b920 tx=0x564d5749f800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.589+0000 7f85e3a3af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.589+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/1481024254 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564d5773d400 0x564d57681b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.589+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d5773d800 con 0x564d5773d400 2024-09-13T23:57:24.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.589+0000 7f85e29f4700 1 --2- 172.21.15.173:0/1481024254 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564d5773d400 0x564d57681b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.589+0000 7f85e29f4700 1 --2- 172.21.15.173:0/1481024254 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564d5773d400 0x564d57681b80 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.593+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564d577d2b40 con 0x564d5773d400 2024-09-13T23:57:24.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.593+0000 7f85e3a3af40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:24.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.593+0000 7f85e3a3af40 20 realm 2024-09-13T23:57:24.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.593+0000 7f85e3a3af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.593+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d5773dc00 con 0x564d5773d400 2024-09-13T23:57:24.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.593+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564d577d2b40 con 0x564d5773d400 2024-09-13T23:57:24.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.593+0000 7f85e3a3af40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:24.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.593+0000 7f85e3a3af40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:24.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.593+0000 7f85e3a3af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.593+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d5773d800 con 0x564d5773d400 2024-09-13T23:57:24.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.593+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564d577d2b40 con 0x564d5773d400 2024-09-13T23:57:24.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.593+0000 7f85e3a3af40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:24.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.593+0000 7f85e3a3af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.593+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/1481024254 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564d5773dc00 0x564d57682100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.593+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d5773dc00 2024-09-13T23:57:24.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.593+0000 7f85e21f3700 1 --2- 172.21.15.173:0/1481024254 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564d5773dc00 0x564d57682100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.593+0000 7f85e21f3700 1 --2- 172.21.15.173:0/1481024254 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564d5773dc00 0x564d57682100 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.593+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x564d577d3200 con 0x564d5773dc00 2024-09-13T23:57:24.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.593+0000 7f85e3a3af40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:24.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.593+0000 7f85e3a3af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.593+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/1481024254 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564d577d8400 0x564d57682680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.593+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8800 con 0x564d577d8400 2024-09-13T23:57:24.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.593+0000 7f85e19f2700 1 --2- 172.21.15.173:0/1481024254 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564d577d8400 0x564d57682680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.593+0000 7f85e19f2700 1 --2- 172.21.15.173:0/1481024254 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564d577d8400 0x564d57682680 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.597+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x564d577d3440 con 0x564d577d8400 2024-09-13T23:57:24.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.597+0000 7f85e3a3af40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:24.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.597+0000 7f85e3a3af40 20 searching for the correct realm 2024-09-13T23:57:24.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.597+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8c00 con 0x564d577d8400 2024-09-13T23:57:24.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.597+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x564d577d3440 con 0x564d577d8400 2024-09-13T23:57:24.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.597+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8800 con 0x564d5773dc00 2024-09-13T23:57:24.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.597+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d3200 con 0x564d5773dc00 2024-09-13T23:57:24.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.597+0000 7f85e21f3700 1 --2- 172.21.15.173:0/1481024254 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564d577d8800 0x564d57682c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.597+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d577d8800 2024-09-13T23:57:24.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.597+0000 7f85e29f4700 1 --2- 172.21.15.173:0/1481024254 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564d577d8800 0x564d57682c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.597+0000 7f85e29f4700 1 --2- 172.21.15.173:0/1481024254 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564d577d8800 0x564d57682c00 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.597+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d2b40 con 0x564d577d8800 2024-09-13T23:57:24.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.597+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d577d8800 2024-09-13T23:57:24.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.597+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x564d577d2b40 con 0x564d577d8800 2024-09-13T23:57:24.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.597+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d5773d400 2024-09-13T23:57:24.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.597+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d2b40 con 0x564d5773d400 2024-09-13T23:57:24.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.597+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d577d8400 2024-09-13T23:57:24.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.601+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d3440 con 0x564d577d8400 2024-09-13T23:57:24.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.601+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d5773d400 2024-09-13T23:57:24.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.601+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d2b40 con 0x564d5773d400 2024-09-13T23:57:24.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.601+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d5773dc00 2024-09-13T23:57:24.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.601+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d3200 con 0x564d5773dc00 2024-09-13T23:57:24.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.601+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d5773dc00 2024-09-13T23:57:24.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.601+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d3200 con 0x564d5773dc00 2024-09-13T23:57:24.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.601+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d5773d400 2024-09-13T23:57:24.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.601+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d2b40 con 0x564d5773d400 2024-09-13T23:57:24.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.601+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d577d8800 2024-09-13T23:57:24.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.601+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d2b40 con 0x564d577d8800 2024-09-13T23:57:24.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.601+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d5773d400 2024-09-13T23:57:24.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.601+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d2b40 con 0x564d5773d400 2024-09-13T23:57:24.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.601+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d577d8800 2024-09-13T23:57:24.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.605+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d2b40 con 0x564d577d8800 2024-09-13T23:57:24.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.605+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d5773dc00 2024-09-13T23:57:24.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.605+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d3200 con 0x564d5773dc00 2024-09-13T23:57:24.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.605+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d577d8400 2024-09-13T23:57:24.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.605+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d3440 con 0x564d577d8400 2024-09-13T23:57:24.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.605+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d5773d400 2024-09-13T23:57:24.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.605+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d2b40 con 0x564d5773d400 2024-09-13T23:57:24.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.605+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d5773dc00 2024-09-13T23:57:24.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.605+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d3200 con 0x564d5773dc00 2024-09-13T23:57:24.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.605+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d577d8400 2024-09-13T23:57:24.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.605+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d3440 con 0x564d577d8400 2024-09-13T23:57:24.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.605+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d5773d400 2024-09-13T23:57:24.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.605+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d2b40 con 0x564d5773d400 2024-09-13T23:57:24.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.605+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d5773d400 2024-09-13T23:57:24.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.609+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d2b40 con 0x564d5773d400 2024-09-13T23:57:24.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.609+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d5773d400 2024-09-13T23:57:24.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.609+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d2b40 con 0x564d5773d400 2024-09-13T23:57:24.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.609+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d577d8400 2024-09-13T23:57:24.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.609+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d3440 con 0x564d577d8400 2024-09-13T23:57:24.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.609+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d577d8800 2024-09-13T23:57:24.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.609+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d2b40 con 0x564d577d8800 2024-09-13T23:57:24.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.609+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d5773d400 2024-09-13T23:57:24.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.609+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d2b40 con 0x564d5773d400 2024-09-13T23:57:24.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.609+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d577d8800 2024-09-13T23:57:24.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.609+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d2b40 con 0x564d577d8800 2024-09-13T23:57:24.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.609+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d577d8400 2024-09-13T23:57:24.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.609+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d3440 con 0x564d577d8400 2024-09-13T23:57:24.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.609+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d577d8800 2024-09-13T23:57:24.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.609+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d2b40 con 0x564d577d8800 2024-09-13T23:57:24.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.609+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d5773dc00 2024-09-13T23:57:24.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.613+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d3200 con 0x564d5773dc00 2024-09-13T23:57:24.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.613+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d5773dc00 2024-09-13T23:57:24.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.613+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d3200 con 0x564d5773dc00 2024-09-13T23:57:24.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.613+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d577d8400 2024-09-13T23:57:24.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.613+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d3440 con 0x564d577d8400 2024-09-13T23:57:24.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.613+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d5773dc00 2024-09-13T23:57:24.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.613+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x564d577d3200 con 0x564d5773dc00 2024-09-13T23:57:24.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.613+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d5773dc00 2024-09-13T23:57:24.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.613+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564d577d3200 con 0x564d5773dc00 2024-09-13T23:57:24.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.613+0000 7f85e3a3af40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:24.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.613+0000 7f85e3a3af40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:24.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.613+0000 7f85e3a3af40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:24.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.613+0000 7f85e3a3af40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:24.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.613+0000 7f85e3a3af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.613+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d9000 con 0x564d5773d400 2024-09-13T23:57:24.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.613+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564d577d2b40 con 0x564d5773d400 2024-09-13T23:57:24.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.613+0000 7f85e3a3af40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:24.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.613+0000 7f85e3a3af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.613+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d9400 con 0x564d5773dc00 2024-09-13T23:57:24.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x564d577d3200 con 0x564d5773dc00 2024-09-13T23:57:24.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e3a3af40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:24.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e3a3af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d9800 con 0x564d577d8800 2024-09-13T23:57:24.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x564d577d2b40 con 0x564d577d8800 2024-09-13T23:57:24.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e3a3af40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:24.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e3a3af40 20 zone default found 2024-09-13T23:57:24.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e3a3af40 4 Realm: () 2024-09-13T23:57:24.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e3a3af40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:24.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e3a3af40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:24.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e3a3af40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:24.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e3a3af40 20 zonegroup default 2024-09-13T23:57:24.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e3a3af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d9c00 con 0x564d577d8800 2024-09-13T23:57:24.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x564d577d2b40 con 0x564d577d8800 2024-09-13T23:57:24.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e3a3af40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:24.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e3a3af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d9000 con 0x564d577d8400 2024-09-13T23:57:24.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x564d577d3440 con 0x564d577d8400 2024-09-13T23:57:24.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e3a3af40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:24.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e3a3af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d9800 con 0x564d577d8400 2024-09-13T23:57:24.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x564d577d3440 con 0x564d577d8400 2024-09-13T23:57:24.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e3a3af40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:24.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e3a3af40 20 started sync module instance, tier type = 2024-09-13T23:57:24.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e3a3af40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:24.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.617+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d5773d800 con 0x564d5773dc00 2024-09-13T23:57:24.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.621+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v35'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d577d3200 con 0x564d5773dc00 2024-09-13T23:57:24.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.621+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94890178870016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d5773c800 con 0x564d5773dc00 2024-09-13T23:57:24.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.621+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d5773d800 con 0x564d5773d400 2024-09-13T23:57:24.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.625+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94890178870016] v35'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d577d3200 con 0x564d5773dc00 2024-09-13T23:57:24.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.625+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v35'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d577d2b40 con 0x564d5773d400 2024-09-13T23:57:24.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.625+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94890178871168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8000 con 0x564d5773d400 2024-09-13T23:57:24.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.625+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d9400 con 0x564d5773dc00 2024-09-13T23:57:24.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.625+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94890178871168] v35'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d577d2b40 con 0x564d5773d400 2024-09-13T23:57:24.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.625+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v35'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d577d3200 con 0x564d5773dc00 2024-09-13T23:57:24.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.625+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94890178872320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577e2000 con 0x564d5773dc00 2024-09-13T23:57:24.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.625+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577e2400 con 0x564d577d8800 2024-09-13T23:57:24.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.629+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94890178872320] v35'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d577d3200 con 0x564d5773dc00 2024-09-13T23:57:24.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.629+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v35'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d577d2b40 con 0x564d577d8800 2024-09-13T23:57:24.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.629+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94890178873472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577e2800 con 0x564d577d8800 2024-09-13T23:57:24.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.629+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577e2c00 con 0x564d5773dc00 2024-09-13T23:57:24.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.633+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94890178873472] v35'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d577d2b40 con 0x564d577d8800 2024-09-13T23:57:24.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.633+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v35'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d577d3200 con 0x564d5773dc00 2024-09-13T23:57:24.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.633+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94890178874624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577e3000 con 0x564d5773dc00 2024-09-13T23:57:24.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.633+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577e3400 con 0x564d577d8400 2024-09-13T23:57:24.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.637+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v35'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d577d3440 con 0x564d577d8400 2024-09-13T23:57:24.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.637+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94890178875776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577e3800 con 0x564d577d8400 2024-09-13T23:57:24.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.637+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94890178874624] v35'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d577d3200 con 0x564d5773dc00 2024-09-13T23:57:24.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.637+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577e3c00 con 0x564d577d8400 2024-09-13T23:57:24.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.637+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94890178875776] v35'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d577d3440 con 0x564d577d8400 2024-09-13T23:57:24.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.637+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v35'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d577d3440 con 0x564d577d8400 2024-09-13T23:57:24.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.637+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94890178876928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577e3400 con 0x564d577d8400 2024-09-13T23:57:24.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.637+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577e2000 con 0x564d577d8800 2024-09-13T23:57:24.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.641+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94890178876928] v35'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d577d3440 con 0x564d577d8400 2024-09-13T23:57:24.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.641+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v35'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d577d2b40 con 0x564d577d8800 2024-09-13T23:57:24.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.641+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94890178878080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577e2c00 con 0x564d577d8800 2024-09-13T23:57:24.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.641+0000 7f85e3a3af40 20 add_watcher() i=0 2024-09-13T23:57:24.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.641+0000 7f85e3a3af40 20 add_watcher() i=1 2024-09-13T23:57:24.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.641+0000 7f85e3a3af40 20 add_watcher() i=2 2024-09-13T23:57:24.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.641+0000 7f85e3a3af40 20 add_watcher() i=3 2024-09-13T23:57:24.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.641+0000 7f85e3a3af40 20 add_watcher() i=4 2024-09-13T23:57:24.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.641+0000 7f85e3a3af40 20 add_watcher() i=5 2024-09-13T23:57:24.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.641+0000 7f85e3a3af40 20 add_watcher() i=6 2024-09-13T23:57:24.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.641+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94890178878080] v35'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d577d2b40 con 0x564d577d8800 2024-09-13T23:57:24.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.641+0000 7f85e3a3af40 20 add_watcher() i=7 2024-09-13T23:57:24.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.641+0000 7f85e3a3af40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:24.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.641+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d8c00 con 0x564d5773d400 2024-09-13T23:57:24.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.641+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x564d577d2b40 con 0x564d5773d400 2024-09-13T23:57:24.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.641+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94890180395008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d9000 con 0x564d5773d400 2024-09-13T23:57:24.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.645+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94890180395008] v35'178 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x564d577d2b40 con 0x564d5773d400 2024-09-13T23:57:24.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.645+0000 7f85c91c1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:24.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.645+0000 7f85e3a3af40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:24.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.645+0000 7f85e3a3af40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:24.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.645+0000 7f85e3a3af40 1 Processor -- start 2024-09-13T23:57:24.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.645+0000 7f85e3a3af40 1 -- start start 2024-09-13T23:57:24.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.645+0000 7f85e3a3af40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d577d9400 0x564d57683180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.645+0000 7f85e3a3af40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d574283c0 con 0x564d577d9400 2024-09-13T23:57:24.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.645+0000 7f85e19f2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d577d9400 0x564d57683180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.645+0000 7f85e19f2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d577d9400 0x564d57683180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34824/0 (socket says 172.21.15.173:34824) 2024-09-13T23:57:24.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.645+0000 7f85e19f2700 1 -- 172.21.15.173:0/2862792141 learned_addr learned my addr 172.21.15.173:0/2862792141 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:24.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.645+0000 7f85e19f2700 1 -- 172.21.15.173:0/2862792141 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d573acb60 con 0x564d577d9400 2024-09-13T23:57:24.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.645+0000 7f85e19f2700 1 --2- 172.21.15.173:0/2862792141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d577d9400 0x564d57683180 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x564d577f46c0 tx=0x564d5749f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8bf9db3f53fb26 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.649+0000 7f85c89c0700 1 -- 172.21.15.173:0/2862792141 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d5743f760 con 0x564d577d9400 2024-09-13T23:57:24.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.649+0000 7f85c89c0700 1 -- 172.21.15.173:0/2862792141 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564d57764900 con 0x564d577d9400 2024-09-13T23:57:24.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.649+0000 7f85c89c0700 1 -- 172.21.15.173:0/2862792141 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d577ea160 con 0x564d577d9400 2024-09-13T23:57:24.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.649+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2862792141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d577d9400 msgr2=0x564d57683180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.649+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/2862792141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d577d9400 0x564d57683180 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x564d577f46c0 tx=0x564d5749f980 comp rx=0 tx=0).stop 2024-09-13T23:57:24.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.649+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2862792141 shutdown_connections 2024-09-13T23:57:24.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.649+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/2862792141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d577d9400 0x564d57683180 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.649+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2862792141 >> 172.21.15.173:0/2862792141 conn(0x564d577d9800 msgr2=0x564d5749c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:24.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.649+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2862792141 shutdown_connections 2024-09-13T23:57:24.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.649+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2862792141 wait complete. 2024-09-13T23:57:24.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.649+0000 7f85e3a3af40 1 Processor -- start 2024-09-13T23:57:24.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.649+0000 7f85e3a3af40 1 -- start start 2024-09-13T23:57:24.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.649+0000 7f85e3a3af40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d577d9400 0x564d57683180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.649+0000 7f85e3a3af40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d57428500 con 0x564d577d9400 2024-09-13T23:57:24.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.649+0000 7f85e19f2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d577d9400 0x564d57683180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.649+0000 7f85e19f2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d577d9400 0x564d57683180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34840/0 (socket says 172.21.15.173:34840) 2024-09-13T23:57:24.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.649+0000 7f85e19f2700 1 -- 172.21.15.173:0/2266223838 learned_addr learned my addr 172.21.15.173:0/2266223838 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:24.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.649+0000 7f85e19f2700 1 -- 172.21.15.173:0/2266223838 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d573acd00 con 0x564d577d9400 2024-09-13T23:57:24.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.649+0000 7f85e19f2700 1 --2- 172.21.15.173:0/2266223838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d577d9400 0x564d57683180 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x564d577f48d0 tx=0x564d577b45a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.649+0000 7f85c71bd700 1 -- 172.21.15.173:0/2266223838 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d577ea2c0 con 0x564d577d9400 2024-09-13T23:57:24.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.649+0000 7f85c71bd700 1 -- 172.21.15.173:0/2266223838 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564d57764600 con 0x564d577d9400 2024-09-13T23:57:24.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.649+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2266223838 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564d573ac340 con 0x564d577d9400 2024-09-13T23:57:24.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.649+0000 7f85c71bd700 1 -- 172.21.15.173:0/2266223838 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564d577ea420 con 0x564d577d9400 2024-09-13T23:57:24.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.649+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2266223838 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d573add40 con 0x564d577d9400 2024-09-13T23:57:24.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.653+0000 7f85c71bd700 1 -- 172.21.15.173:0/2266223838 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x564d57495b80 con 0x564d577d9400 2024-09-13T23:57:24.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.653+0000 7f85c71bd700 1 --2- 172.21.15.173:0/2266223838 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d577d8c00 0x564d57876000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.653+0000 7f85c71bd700 1 -- 172.21.15.173:0/2266223838 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x564d574016c0 con 0x564d577d9400 2024-09-13T23:57:24.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.653+0000 7f85e29f4700 1 --2- 172.21.15.173:0/2266223838 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d577d8c00 0x564d57876000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.653+0000 7f85e3a3af40 5 note: GC not initialized 2024-09-13T23:57:24.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.653+0000 7f85e29f4700 1 --2- 172.21.15.173:0/2266223838 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d577d8c00 0x564d57876000 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x564d5777fd10 tx=0x564d5749ff20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.653+0000 7f85e3a3af40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:24.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.653+0000 7f85e3a3af40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:24.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.653+0000 7f85c29b4700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:55 2024 2024-09-13T23:57:24.661 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:24.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.653+0000 7f85e3a3af40 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:57:24.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.653+0000 7f85e3a3af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.653+0000 7f85c2192700 20 reqs_thread_entry: start 2024-09-13T23:57:24.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.653+0000 7f85c49b8700 20 reqs_thread_entry: start 2024-09-13T23:57:24.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.653+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577e2800 con 0x564d577d8800 2024-09-13T23:57:24.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.657+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x564d577d2b40 con 0x564d577d8800 2024-09-13T23:57:24.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.657+0000 7f85e3a3af40 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:57:24.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.657+0000 7f85e3a3af40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:57:24.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.657+0000 7f85e3a3af40 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:57:24.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.657+0000 7f85e3a3af40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 : miss 2024-09-13T23:57:24.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.657+0000 7f85e3a3af40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.657+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:63 8.0 8:05e2f469:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577e2000 con 0x564d577d8400 2024-09-13T23:57:24.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.657+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(63 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x564d577d3440 con 0x564d577d8400 2024-09-13T23:57:24.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.657+0000 7f85e3a3af40 20 rados_obj.operate() r=0 bl.length=352 2024-09-13T23:57:24.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.657+0000 7f85e3a3af40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 info.flags=0x17 2024-09-13T23:57:24.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.657+0000 7f85e3a3af40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 to cache LRU end 2024-09-13T23:57:24.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.657+0000 7f85e3a3af40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:24.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.657+0000 7f85e3a3af40 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:57:24.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.657+0000 7f85e3a3af40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 2024-09-13T23:57:24.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.657+0000 7f85e3a3af40 20 get_obj_state: rctx=0x564d5742b810 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x564d578e61e8 s->prefetch_data=0 2024-09-13T23:57:24.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.657+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:64 3.12s0 3:4b709470:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577e2c00 con 0x564d577d8800 2024-09-13T23:57:24.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.657+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(64 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=849b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 262+0+865 (crc 0 0 0) 0x564d577d2b40 con 0x564d577d8800 2024-09-13T23:57:24.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.657+0000 7f85e3a3af40 10 manifest: total_size = 5 2024-09-13T23:57:24.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.657+0000 7f85e3a3af40 20 get_obj_state: setting s->obj_tag to _AyuJrV1THHiIGN-QcB2h4hIjZK9QTnk 2024-09-13T23:57:24.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.661+0000 7f85c91c1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:24.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.661+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94890180395008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577e3000 con 0x564d5773d400 2024-09-13T23:57:24.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.661+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94890180395008] v35'179 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x564d577d2b40 con 0x564d5773d400 2024-09-13T23:57:24.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.661+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94890178870016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577e2400 con 0x564d5773dc00 2024-09-13T23:57:24.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.665+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94890178870016] v35'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d577d3200 con 0x564d5773dc00 2024-09-13T23:57:24.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.665+0000 7f85e3a3af40 20 remove_watcher() i=0 2024-09-13T23:57:24.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.665+0000 7f85e3a3af40 2 removed watcher, disabling cache 2024-09-13T23:57:24.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.665+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94890178871168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577d9000 con 0x564d5773d400 2024-09-13T23:57:24.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.665+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94890178871168] v35'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d577d2b40 con 0x564d5773d400 2024-09-13T23:57:24.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.665+0000 7f85e3a3af40 20 remove_watcher() i=1 2024-09-13T23:57:24.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.665+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94890178872320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577c8000 con 0x564d5773dc00 2024-09-13T23:57:24.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.669+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94890178872320] v35'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d577d3200 con 0x564d5773dc00 2024-09-13T23:57:24.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.669+0000 7f85e3a3af40 20 remove_watcher() i=2 2024-09-13T23:57:24.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.669+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94890178873472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577c8400 con 0x564d577d8800 2024-09-13T23:57:24.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.673+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94890178873472] v35'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d577d2b40 con 0x564d577d8800 2024-09-13T23:57:24.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.673+0000 7f85e3a3af40 20 remove_watcher() i=3 2024-09-13T23:57:24.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.673+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94890178874624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577c8800 con 0x564d5773dc00 2024-09-13T23:57:24.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.673+0000 7f85e21f3700 1 -- 172.21.15.173:0/1481024254 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94890178874624] v35'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d577d3200 con 0x564d5773dc00 2024-09-13T23:57:24.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.673+0000 7f85e3a3af40 20 remove_watcher() i=4 2024-09-13T23:57:24.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.673+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94890178875776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577c8c00 con 0x564d577d8400 2024-09-13T23:57:24.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.677+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94890178875776] v35'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d577d3440 con 0x564d577d8400 2024-09-13T23:57:24.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.677+0000 7f85e3a3af40 20 remove_watcher() i=5 2024-09-13T23:57:24.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.677+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94890178876928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577c9000 con 0x564d577d8400 2024-09-13T23:57:24.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.677+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94890178876928] v35'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d577d3440 con 0x564d577d8400 2024-09-13T23:57:24.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.677+0000 7f85e3a3af40 20 remove_watcher() i=6 2024-09-13T23:57:24.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.677+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94890178878080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564d577c9400 con 0x564d577d8800 2024-09-13T23:57:24.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.681+0000 7f85e29f4700 1 -- 172.21.15.173:0/1481024254 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94890178878080] v35'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564d577d2b40 con 0x564d577d8800 2024-09-13T23:57:24.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.681+0000 7f85e3a3af40 20 remove_watcher() i=7 2024-09-13T23:57:24.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.681+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564d5773dc00 msgr2=0x564d57682100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.681+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/1481024254 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564d5773dc00 0x564d57682100 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.681+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564d5773d400 msgr2=0x564d57681b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.681+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/1481024254 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564d5773d400 0x564d57681b80 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.681+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564d577d8800 msgr2=0x564d57682c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.681+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/1481024254 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564d577d8800 0x564d57682c00 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.681+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564d577d8400 msgr2=0x564d57682680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.681+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/1481024254 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564d577d8400 0x564d57682680 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.681+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d5773d000 msgr2=0x564d57681600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.681+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/1481024254 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d5773d000 0x564d57681600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x564d5767b920 tx=0x564d5749f800 comp rx=0 tx=0).stop 2024-09-13T23:57:24.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.681+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b800 msgr2=0x564d57680b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.681+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/1481024254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b800 0x564d57680b00 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x564d5773ee10 tx=0x564d576f4fc0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.681+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 reap_dead start 2024-09-13T23:57:24.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.681+0000 7f85e19f2700 1 -- 172.21.15.173:0/1481024254 reap_dead start 2024-09-13T23:57:24.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.681+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 shutdown_connections 2024-09-13T23:57:24.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.681+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 >> 172.21.15.173:0/1481024254 conn(0x564d5739b400 msgr2=0x564d5749b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:24.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.681+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 shutdown_connections 2024-09-13T23:57:24.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.681+0000 7f85e3a3af40 1 -- 172.21.15.173:0/1481024254 wait complete. 2024-09-13T23:57:24.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.685+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2266223838 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d577d8c00 msgr2=0x564d57876000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.685+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/2266223838 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d577d8c00 0x564d57876000 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x564d5777fd10 tx=0x564d5749ff20 comp rx=0 tx=0).stop 2024-09-13T23:57:24.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.685+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2266223838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d577d9400 msgr2=0x564d57683180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.685+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/2266223838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d577d9400 0x564d57683180 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x564d577f48d0 tx=0x564d577b45a0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.685+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2266223838 shutdown_connections 2024-09-13T23:57:24.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.685+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/2266223838 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d577d8c00 0x564d57876000 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.685+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/2266223838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d577d9400 0x564d57683180 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.685+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2266223838 >> 172.21.15.173:0/2266223838 conn(0x564d577d9800 msgr2=0x564d5749c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:24.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.685+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2266223838 shutdown_connections 2024-09-13T23:57:24.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.685+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2266223838 wait complete. 2024-09-13T23:57:24.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.685+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2000478174 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d5773c000 msgr2=0x564d57681080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.685+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/2000478174 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d5773c000 0x564d57681080 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x564d58165dd0 tx=0x564d576f4de0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.685+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2000478174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b000 msgr2=0x564d57680580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.685+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/2000478174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b000 0x564d57680580 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x564d58165e00 tx=0x564d5749fa40 comp rx=0 tx=0).stop 2024-09-13T23:57:24.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.685+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2000478174 shutdown_connections 2024-09-13T23:57:24.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.685+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/2000478174 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564d5773c000 0x564d57681080 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.685+0000 7f85e3a3af40 1 --2- 172.21.15.173:0/2000478174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564d5739b000 0x564d57680580 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.685+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2000478174 >> 172.21.15.173:0/2000478174 conn(0x564d5739ac00 msgr2=0x564d5749b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:24.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.685+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2000478174 shutdown_connections 2024-09-13T23:57:24.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.685+0000 7f85e3a3af40 1 -- 172.21.15.173:0/2000478174 wait complete. 2024-09-13T23:57:24.697 INFO:teuthology.orchestra.run.smithi173.stdout:fooFoofooFooFULL_CONTROL 2024-09-13T23:57:24.697 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-13T23:57:24.700 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-13T23:57:24.712 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:57:24.712 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T23:57:24.712 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T23:57:24.712 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-13T23:57:24.782 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:24.783 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:24.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.777+0000 7fdabbd15f40 1 Processor -- start 2024-09-13T23:57:24.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.777+0000 7fdabbd15f40 1 -- start start 2024-09-13T23:57:24.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.777+0000 7fdabbd15f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55d871f91400 0x55d872276580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.777+0000 7fdabbd15f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d872055500 con 0x55d871f91000 2024-09-13T23:57:24.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.777+0000 7fdabbd15f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d87201ea00 con 0x55d871f91400 2024-09-13T23:57:24.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.777+0000 7fdab9ccd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55d871f91400 0x55d872276580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.777+0000 7fdaba4ce700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55d871f91000 0x55d872090800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:44914/0 (socket says 172.21.15.173:44914) 2024-09-13T23:57:24.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.777+0000 7fdaba4ce700 1 -- 172.21.15.173:0/224508336 learned_addr learned my addr 172.21.15.173:0/224508336 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:24.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.777+0000 7fdab9ccd700 1 -- 172.21.15.173:0/224508336 >> v1:172.21.15.87:6789/0 conn(0x55d871f91000 legacy=0x55d872090800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.777+0000 7fdab9ccd700 1 -- 172.21.15.173:0/224508336 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d871fa3d40 con 0x55d871f91400 2024-09-13T23:57:24.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.781+0000 7fdab9ccd700 1 --2- 172.21.15.173:0/224508336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91400 0x55d872276580 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x55d872271920 tx=0x55d872095920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5795d88d022b23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.781+0000 7fdab94cc700 1 -- 172.21.15.173:0/224508336 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d8720354a0 con 0x55d871f91400 2024-09-13T23:57:24.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.781+0000 7fdab94cc700 1 -- 172.21.15.173:0/224508336 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d872055800 con 0x55d871f91400 2024-09-13T23:57:24.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.781+0000 7fdab94cc700 1 -- 172.21.15.173:0/224508336 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d872035600 con 0x55d871f91400 2024-09-13T23:57:24.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.781+0000 7fdabbd15f40 1 -- 172.21.15.173:0/224508336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91400 msgr2=0x55d872276580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.781+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/224508336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91400 0x55d872276580 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x55d872271920 tx=0x55d872095920 comp rx=0 tx=0).stop 2024-09-13T23:57:24.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.781+0000 7fdabbd15f40 1 -- 172.21.15.173:0/224508336 shutdown_connections 2024-09-13T23:57:24.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.781+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/224508336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91400 0x55d872276580 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.781+0000 7fdabbd15f40 1 -- 172.21.15.173:0/224508336 >> 172.21.15.173:0/224508336 conn(0x55d871f90c00 msgr2=0x55d872090000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:24.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.781+0000 7fdabbd15f40 1 -- 172.21.15.173:0/224508336 shutdown_connections 2024-09-13T23:57:24.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.781+0000 7fdabbd15f40 1 -- 172.21.15.173:0/224508336 wait complete. 2024-09-13T23:57:24.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.781+0000 7fdabbd15f40 1 Processor -- start 2024-09-13T23:57:24.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.781+0000 7fdabbd15f40 1 -- start start 2024-09-13T23:57:24.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.781+0000 7fdabbd15f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91000 0x55d872276580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.781+0000 7fdabbd15f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d87201e500 con 0x55d871f91000 2024-09-13T23:57:24.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.781+0000 7fdaba4ce700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91000 0x55d872276580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.781+0000 7fdaba4ce700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91000 0x55d872276580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34858/0 (socket says 172.21.15.173:34858) 2024-09-13T23:57:24.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.781+0000 7fdaba4ce700 1 -- 172.21.15.173:0/102091668 learned_addr learned my addr 172.21.15.173:0/102091668 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:24.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.781+0000 7fdaba4ce700 1 -- 172.21.15.173:0/102091668 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d871fa3ba0 con 0x55d871f91000 2024-09-13T23:57:24.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.781+0000 7fdaba4ce700 1 --2- 172.21.15.173:0/102091668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91000 0x55d872276580 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x55d8720ede60 tx=0x55d872095b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5bc76f8195ea701 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.781+0000 7fdab8ccb700 1 -- 172.21.15.173:0/102091668 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d8720351e0 con 0x55d871f91000 2024-09-13T23:57:24.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.785+0000 7fdab8ccb700 1 -- 172.21.15.173:0/102091668 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d872055b00 con 0x55d871f91000 2024-09-13T23:57:24.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.785+0000 7fdab8ccb700 1 -- 172.21.15.173:0/102091668 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d8720354a0 con 0x55d871f91000 2024-09-13T23:57:24.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.785+0000 7fdabbd15f40 1 -- 172.21.15.173:0/102091668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91000 msgr2=0x55d872276580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.785+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/102091668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91000 0x55d872276580 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x55d8720ede60 tx=0x55d872095b60 comp rx=0 tx=0).stop 2024-09-13T23:57:24.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.785+0000 7fdabbd15f40 1 -- 172.21.15.173:0/102091668 shutdown_connections 2024-09-13T23:57:24.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.785+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/102091668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91000 0x55d872276580 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.785+0000 7fdabbd15f40 1 -- 172.21.15.173:0/102091668 >> 172.21.15.173:0/102091668 conn(0x55d871f90c00 msgr2=0x55d872091000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:24.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.785+0000 7fdabbd15f40 1 -- 172.21.15.173:0/102091668 shutdown_connections 2024-09-13T23:57:24.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.785+0000 7fdabbd15f40 1 -- 172.21.15.173:0/102091668 wait complete. 2024-09-13T23:57:24.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.785+0000 7fdabbd15f40 1 Processor -- start 2024-09-13T23:57:24.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.785+0000 7fdabbd15f40 1 -- start start 2024-09-13T23:57:24.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.785+0000 7fdabbd15f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91400 0x55d872276b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.785+0000 7fdabbd15f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d87201e3c0 con 0x55d871f91400 2024-09-13T23:57:24.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.785+0000 7fdaba4ce700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91400 0x55d872276b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.785+0000 7fdaba4ce700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91400 0x55d872276b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34872/0 (socket says 172.21.15.173:34872) 2024-09-13T23:57:24.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.785+0000 7fdaba4ce700 1 -- 172.21.15.173:0/1278800725 learned_addr learned my addr 172.21.15.173:0/1278800725 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:24.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.785+0000 7fdaba4ce700 1 -- 172.21.15.173:0/1278800725 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d871fa3a00 con 0x55d871f91400 2024-09-13T23:57:24.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.785+0000 7fdaba4ce700 1 --2- 172.21.15.173:0/1278800725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91400 0x55d872276b00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x55d8720edf50 tx=0x55d872095a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.785+0000 7fdab74c8700 1 -- 172.21.15.173:0/1278800725 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d872035600 con 0x55d871f91400 2024-09-13T23:57:24.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.785+0000 7fdab74c8700 1 -- 172.21.15.173:0/1278800725 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d872055c80 con 0x55d871f91400 2024-09-13T23:57:24.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.785+0000 7fdabbd15f40 1 -- 172.21.15.173:0/1278800725 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d871fa3860 con 0x55d871f91400 2024-09-13T23:57:24.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.785+0000 7fdab74c8700 1 -- 172.21.15.173:0/1278800725 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d8720351e0 con 0x55d871f91400 2024-09-13T23:57:24.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.785+0000 7fdabbd15f40 1 -- 172.21.15.173:0/1278800725 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d871fa36c0 con 0x55d871f91400 2024-09-13T23:57:24.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.789+0000 7fdabbd15f40 1 Processor -- start 2024-09-13T23:57:24.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.789+0000 7fdabbd15f40 1 -- start start 2024-09-13T23:57:24.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.789+0000 7fdabbd15f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91c00 0x55d872277080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.789+0000 7fdabbd15f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d871fb6640 con 0x55d871f91c00 2024-09-13T23:57:24.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.789+0000 7fdab74c8700 1 -- 172.21.15.173:0/1278800725 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55d87208ab00 con 0x55d871f91400 2024-09-13T23:57:24.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.789+0000 7fdab74c8700 1 --2- 172.21.15.173:0/1278800725 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d872348000 0x55d872278100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.789+0000 7fdab74c8700 1 -- 172.21.15.173:0/1278800725 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55d871ff7180 con 0x55d871f91400 2024-09-13T23:57:24.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.789+0000 7fdabaccf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91c00 0x55d872277080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.789+0000 7fdabaccf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91c00 0x55d872277080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34888/0 (socket says 172.21.15.173:34888) 2024-09-13T23:57:24.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.789+0000 7fdaba4ce700 1 --2- 172.21.15.173:0/1278800725 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d872348000 0x55d872278100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.789+0000 7fdabaccf700 1 -- 172.21.15.173:0/3227211054 learned_addr learned my addr 172.21.15.173:0/3227211054 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:24.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.789+0000 7fdabaccf700 1 -- 172.21.15.173:0/3227211054 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d871fa2000 con 0x55d871f91c00 2024-09-13T23:57:24.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.789+0000 7fdaba4ce700 1 --2- 172.21.15.173:0/1278800725 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d872348000 0x55d872278100 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55d8722c8000 tx=0x55d872302240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.789+0000 7fdabaccf700 1 --2- 172.21.15.173:0/3227211054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91c00 0x55d872277080 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x55d8722c8330 tx=0x55d8723030e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea390af2651b03fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.789+0000 7fdab4cc3700 1 -- 172.21.15.173:0/3227211054 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d872035600 con 0x55d871f91c00 2024-09-13T23:57:24.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.789+0000 7fdab4cc3700 1 -- 172.21.15.173:0/3227211054 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d87235e000 con 0x55d871f91c00 2024-09-13T23:57:24.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.789+0000 7fdab4cc3700 1 -- 172.21.15.173:0/3227211054 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d8720351e0 con 0x55d871f91c00 2024-09-13T23:57:24.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.793+0000 7fdabbd15f40 1 -- 172.21.15.173:0/3227211054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91c00 msgr2=0x55d872277080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.793+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/3227211054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91c00 0x55d872277080 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x55d8722c8330 tx=0x55d8723030e0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.793+0000 7fdabbd15f40 1 -- 172.21.15.173:0/3227211054 shutdown_connections 2024-09-13T23:57:24.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.793+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/3227211054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91c00 0x55d872277080 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.793+0000 7fdabbd15f40 1 -- 172.21.15.173:0/3227211054 >> 172.21.15.173:0/3227211054 conn(0x55d871f91800 msgr2=0x55d872091800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:24.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.793+0000 7fdabbd15f40 1 -- 172.21.15.173:0/3227211054 shutdown_connections 2024-09-13T23:57:24.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.793+0000 7fdabbd15f40 1 -- 172.21.15.173:0/3227211054 wait complete. 2024-09-13T23:57:24.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.793+0000 7fdabbd15f40 1 Processor -- start 2024-09-13T23:57:24.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.793+0000 7fdabbd15f40 1 -- start start 2024-09-13T23:57:24.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.793+0000 7fdabbd15f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91c00 0x55d872277080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.793+0000 7fdabbd15f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d871fb68c0 con 0x55d871f91c00 2024-09-13T23:57:24.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.793+0000 7fdabaccf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91c00 0x55d872277080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.793+0000 7fdabaccf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91c00 0x55d872277080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34900/0 (socket says 172.21.15.173:34900) 2024-09-13T23:57:24.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.793+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 learned_addr learned my addr 172.21.15.173:0/2013017309 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:24.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.793+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d871fa2ea0 con 0x55d871f91c00 2024-09-13T23:57:24.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.793+0000 7fdabaccf700 1 --2- 172.21.15.173:0/2013017309 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91c00 0x55d872277080 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x55d8720edec0 tx=0x55d872302cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.793+0000 7fdab34c0700 1 -- 172.21.15.173:0/2013017309 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d872035a20 con 0x55d871f91c00 2024-09-13T23:57:24.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.793+0000 7fdab34c0700 1 -- 172.21.15.173:0/2013017309 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d87235e180 con 0x55d871f91c00 2024-09-13T23:57:24.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.793+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d871fa2820 con 0x55d871f91c00 2024-09-13T23:57:24.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.793+0000 7fdab34c0700 1 -- 172.21.15.173:0/2013017309 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d872035600 con 0x55d871f91c00 2024-09-13T23:57:24.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.793+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d871fa29c0 con 0x55d871f91c00 2024-09-13T23:57:24.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdab34c0700 1 -- 172.21.15.173:0/2013017309 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55d87208adc0 con 0x55d871f91c00 2024-09-13T23:57:24.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdabbd15f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdab34c0700 1 --2- 172.21.15.173:0/2013017309 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d872348c00 0x55d872278680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdab34c0700 1 -- 172.21.15.173:0/2013017309 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55d871ff7340 con 0x55d871f91c00 2024-09-13T23:57:24.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdab9ccd700 1 --2- 172.21.15.173:0/2013017309 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d872348c00 0x55d872278680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/2013017309 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55d872349000 0x55d872277600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349400 con 0x55d872349000 2024-09-13T23:57:24.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdabaccf700 1 --2- 172.21.15.173:0/2013017309 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55d872349000 0x55d872277600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdab9ccd700 1 --2- 172.21.15.173:0/2013017309 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d872348c00 0x55d872278680 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55d872271920 tx=0x55d872095800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdabaccf700 1 --2- 172.21.15.173:0/2013017309 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55d872349000 0x55d872277600 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872349000 2024-09-13T23:57:24.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdabbd15f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:24.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdabbd15f40 20 realm 2024-09-13T23:57:24.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdabbd15f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349000 2024-09-13T23:57:24.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872349000 2024-09-13T23:57:24.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdabbd15f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:24.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdabbd15f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:24.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdabbd15f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349c00 con 0x55d872349000 2024-09-13T23:57:24.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872349000 2024-09-13T23:57:24.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdabbd15f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:24.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdabbd15f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/2013017309 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55d872349400 0x55d872277b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.797+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349400 2024-09-13T23:57:24.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.801+0000 7fdaba4ce700 1 --2- 172.21.15.173:0/2013017309 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55d872349400 0x55d872277b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.801+0000 7fdaba4ce700 1 --2- 172.21.15.173:0/2013017309 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55d872349400 0x55d872277b80 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.801+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55d8723f7200 con 0x55d872349400 2024-09-13T23:57:24.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.801+0000 7fdabbd15f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:24.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.801+0000 7fdabbd15f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.801+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/2013017309 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55d872349c00 0x55d872278c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.801+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872406000 con 0x55d872349c00 2024-09-13T23:57:24.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.801+0000 7fdab9ccd700 1 --2- 172.21.15.173:0/2013017309 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55d872349c00 0x55d872278c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.801+0000 7fdab9ccd700 1 --2- 172.21.15.173:0/2013017309 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55d872349c00 0x55d872278c00 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.801+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55d8723f7440 con 0x55d872349c00 2024-09-13T23:57:24.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.801+0000 7fdabbd15f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:24.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.801+0000 7fdabbd15f40 20 searching for the correct realm 2024-09-13T23:57:24.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.801+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872406400 con 0x55d872349c00 2024-09-13T23:57:24.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.805+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55d8723f7440 con 0x55d872349c00 2024-09-13T23:57:24.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.805+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872406000 con 0x55d872349400 2024-09-13T23:57:24.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.805+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f7200 con 0x55d872349400 2024-09-13T23:57:24.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.805+0000 7fdaba4ce700 1 --2- 172.21.15.173:0/2013017309 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55d872406000 0x55d872276580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.805+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872406000 2024-09-13T23:57:24.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.805+0000 7fdabaccf700 1 --2- 172.21.15.173:0/2013017309 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55d872406000 0x55d872276580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.805+0000 7fdabaccf700 1 --2- 172.21.15.173:0/2013017309 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55d872406000 0x55d872276580 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.805+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872406000 2024-09-13T23:57:24.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.805+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872406000 2024-09-13T23:57:24.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.805+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872406000 2024-09-13T23:57:24.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.805+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349000 2024-09-13T23:57:24.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.805+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872349000 2024-09-13T23:57:24.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.805+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349c00 2024-09-13T23:57:24.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.805+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f7440 con 0x55d872349c00 2024-09-13T23:57:24.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.805+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349000 2024-09-13T23:57:24.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.809+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872349000 2024-09-13T23:57:24.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.809+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349400 2024-09-13T23:57:24.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.809+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f7200 con 0x55d872349400 2024-09-13T23:57:24.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.809+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349400 2024-09-13T23:57:24.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.809+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f7200 con 0x55d872349400 2024-09-13T23:57:24.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.809+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349000 2024-09-13T23:57:24.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.809+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872349000 2024-09-13T23:57:24.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.809+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872406000 2024-09-13T23:57:24.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.809+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872406000 2024-09-13T23:57:24.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.809+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349000 2024-09-13T23:57:24.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.809+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872349000 2024-09-13T23:57:24.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.809+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872406000 2024-09-13T23:57:24.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.809+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872406000 2024-09-13T23:57:24.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.809+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349400 2024-09-13T23:57:24.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.813+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f7200 con 0x55d872349400 2024-09-13T23:57:24.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.813+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349c00 2024-09-13T23:57:24.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.813+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f7440 con 0x55d872349c00 2024-09-13T23:57:24.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.813+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349000 2024-09-13T23:57:24.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.813+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872349000 2024-09-13T23:57:24.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.813+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349400 2024-09-13T23:57:24.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.813+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f7200 con 0x55d872349400 2024-09-13T23:57:24.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.813+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349c00 2024-09-13T23:57:24.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.813+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f7440 con 0x55d872349c00 2024-09-13T23:57:24.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.813+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349000 2024-09-13T23:57:24.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.813+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872349000 2024-09-13T23:57:24.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.813+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349000 2024-09-13T23:57:24.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.817+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872349000 2024-09-13T23:57:24.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.817+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349000 2024-09-13T23:57:24.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.817+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872349000 2024-09-13T23:57:24.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.817+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349c00 2024-09-13T23:57:24.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.817+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f7440 con 0x55d872349c00 2024-09-13T23:57:24.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.817+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872406000 2024-09-13T23:57:24.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.817+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872406000 2024-09-13T23:57:24.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.817+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349000 2024-09-13T23:57:24.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.817+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872349000 2024-09-13T23:57:24.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.817+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872406000 2024-09-13T23:57:24.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.817+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872406000 2024-09-13T23:57:24.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.817+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349c00 2024-09-13T23:57:24.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.817+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f7440 con 0x55d872349c00 2024-09-13T23:57:24.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.817+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872406000 2024-09-13T23:57:24.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.821+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872406000 2024-09-13T23:57:24.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.821+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349400 2024-09-13T23:57:24.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.821+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f7200 con 0x55d872349400 2024-09-13T23:57:24.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.821+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349400 2024-09-13T23:57:24.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.821+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f7200 con 0x55d872349400 2024-09-13T23:57:24.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.821+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349c00 2024-09-13T23:57:24.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.821+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f7440 con 0x55d872349c00 2024-09-13T23:57:24.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.821+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349400 2024-09-13T23:57:24.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.821+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55d8723f7200 con 0x55d872349400 2024-09-13T23:57:24.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.821+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872349400 2024-09-13T23:57:24.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.821+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d8723f7200 con 0x55d872349400 2024-09-13T23:57:24.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.821+0000 7fdabbd15f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:24.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.821+0000 7fdabbd15f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:24.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.821+0000 7fdabbd15f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:24.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.821+0000 7fdabbd15f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:24.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.821+0000 7fdabbd15f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.821+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872406800 con 0x55d872349000 2024-09-13T23:57:24.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.821+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872349000 2024-09-13T23:57:24.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:24.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872406c00 con 0x55d872349400 2024-09-13T23:57:24.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55d8723f7200 con 0x55d872349400 2024-09-13T23:57:24.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:24.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872407000 con 0x55d872406000 2024-09-13T23:57:24.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872406000 2024-09-13T23:57:24.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:24.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 20 zone default found 2024-09-13T23:57:24.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 4 Realm: () 2024-09-13T23:57:24.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:24.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:24.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:24.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 20 zonegroup default 2024-09-13T23:57:24.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872407400 con 0x55d872406000 2024-09-13T23:57:24.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872406000 2024-09-13T23:57:24.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:24.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872407800 con 0x55d872349c00 2024-09-13T23:57:24.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55d8723f7440 con 0x55d872349c00 2024-09-13T23:57:24.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:24.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872407c00 con 0x55d872349c00 2024-09-13T23:57:24.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55d8723f7440 con 0x55d872349c00 2024-09-13T23:57:24.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:24.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 20 started sync module instance, tier type = 2024-09-13T23:57:24.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:24.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.825+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d8722da000 con 0x55d872349400 2024-09-13T23:57:24.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.829+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v35'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d8723f7200 con 0x55d872349400 2024-09-13T23:57:24.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.829+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94388116445952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d8722da400 con 0x55d872349400 2024-09-13T23:57:24.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.829+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d8722da800 con 0x55d872349000 2024-09-13T23:57:24.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.833+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v35'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872349000 2024-09-13T23:57:24.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.833+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94388116447104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d8722dac00 con 0x55d872349000 2024-09-13T23:57:24.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.833+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d8722db000 con 0x55d872349400 2024-09-13T23:57:24.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.833+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94388116445952] v35'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d8723f7200 con 0x55d872349400 2024-09-13T23:57:24.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.833+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94388116447104] v35'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872349000 2024-09-13T23:57:24.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.837+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v35'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d8723f7200 con 0x55d872349400 2024-09-13T23:57:24.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.837+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94388116448256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d8722db400 con 0x55d872349400 2024-09-13T23:57:24.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.837+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d8722db800 con 0x55d872406000 2024-09-13T23:57:24.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.837+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94388116448256] v35'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d8723f7200 con 0x55d872349400 2024-09-13T23:57:24.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.837+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v35'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872406000 2024-09-13T23:57:24.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.837+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94388116449408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d8722dbc00 con 0x55d872406000 2024-09-13T23:57:24.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.837+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d8722da800 con 0x55d872349400 2024-09-13T23:57:24.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.841+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94388116449408] v35'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872406000 2024-09-13T23:57:24.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.841+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v35'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d8723f7200 con 0x55d872349400 2024-09-13T23:57:24.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.841+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94388116450560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d8722da000 con 0x55d872349400 2024-09-13T23:57:24.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.841+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d8722da400 con 0x55d872349c00 2024-09-13T23:57:24.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.845+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v35'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d8723f7440 con 0x55d872349c00 2024-09-13T23:57:24.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.845+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94388116451712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872406800 con 0x55d872349c00 2024-09-13T23:57:24.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.845+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872407000 con 0x55d872349c00 2024-09-13T23:57:24.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.845+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94388116450560] v35'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d8723f7200 con 0x55d872349400 2024-09-13T23:57:24.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.845+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94388116451712] v35'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d8723f7440 con 0x55d872349c00 2024-09-13T23:57:24.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.845+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v35'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d8723f7440 con 0x55d872349c00 2024-09-13T23:57:24.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.845+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94388116452864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872407400 con 0x55d872349c00 2024-09-13T23:57:24.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.845+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872406c00 con 0x55d872406000 2024-09-13T23:57:24.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.849+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94388116452864] v35'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d8723f7440 con 0x55d872349c00 2024-09-13T23:57:24.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.849+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v35'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872406000 2024-09-13T23:57:24.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.849+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94388116454016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872406000 2024-09-13T23:57:24.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.849+0000 7fdabbd15f40 20 add_watcher() i=0 2024-09-13T23:57:24.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.849+0000 7fdabbd15f40 20 add_watcher() i=1 2024-09-13T23:57:24.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.849+0000 7fdabbd15f40 20 add_watcher() i=2 2024-09-13T23:57:24.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.849+0000 7fdabbd15f40 20 add_watcher() i=3 2024-09-13T23:57:24.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.849+0000 7fdabbd15f40 20 add_watcher() i=4 2024-09-13T23:57:24.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.849+0000 7fdabbd15f40 20 add_watcher() i=5 2024-09-13T23:57:24.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.849+0000 7fdabbd15f40 20 add_watcher() i=6 2024-09-13T23:57:24.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.849+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94388116454016] v35'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872406000 2024-09-13T23:57:24.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.849+0000 7fdabbd15f40 20 add_watcher() i=7 2024-09-13T23:57:24.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.849+0000 7fdabbd15f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:24.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.849+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d8722dac00 con 0x55d872349000 2024-09-13T23:57:24.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.849+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872349000 2024-09-13T23:57:24.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.849+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94388118192128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d8722db800 con 0x55d872349000 2024-09-13T23:57:24.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.853+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94388118192128] v35'180 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872349000 2024-09-13T23:57:24.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.853+0000 7fdaa149c700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:24.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.853+0000 7fdabbd15f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:24.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.853+0000 7fdabbd15f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:24.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.853+0000 7fdabbd15f40 1 Processor -- start 2024-09-13T23:57:24.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.853+0000 7fdabbd15f40 1 -- start start 2024-09-13T23:57:24.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.853+0000 7fdabbd15f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8722da400 0x55d872279180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.853+0000 7fdabbd15f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d87201e3c0 con 0x55d8722da400 2024-09-13T23:57:24.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.853+0000 7fdab9ccd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8722da400 0x55d872279180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.853+0000 7fdab9ccd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8722da400 0x55d872279180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34916/0 (socket says 172.21.15.173:34916) 2024-09-13T23:57:24.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.853+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2328533257 learned_addr learned my addr 172.21.15.173:0/2328533257 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:24.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.853+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2328533257 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d871fa2b60 con 0x55d8722da400 2024-09-13T23:57:24.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.857+0000 7fdab9ccd700 1 --2- 172.21.15.173:0/2328533257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8722da400 0x55d872279180 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x55d8723a0150 tx=0x55d872095980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aae932c0bc66bbd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.857+0000 7fdaa0c9b700 1 -- 172.21.15.173:0/2328533257 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d872035760 con 0x55d8722da400 2024-09-13T23:57:24.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.857+0000 7fdaa0c9b700 1 -- 172.21.15.173:0/2328533257 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d87235e600 con 0x55d8722da400 2024-09-13T23:57:24.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.857+0000 7fdaa0c9b700 1 -- 172.21.15.173:0/2328533257 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d87242a000 con 0x55d8722da400 2024-09-13T23:57:24.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.857+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2328533257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8722da400 msgr2=0x55d872279180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.857+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/2328533257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8722da400 0x55d872279180 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x55d8723a0150 tx=0x55d872095980 comp rx=0 tx=0).stop 2024-09-13T23:57:24.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.857+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2328533257 shutdown_connections 2024-09-13T23:57:24.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.857+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/2328533257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8722da400 0x55d872279180 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.857+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2328533257 >> 172.21.15.173:0/2328533257 conn(0x55d8722dbc00 msgr2=0x55d872092000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:24.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.857+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2328533257 shutdown_connections 2024-09-13T23:57:24.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.857+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2328533257 wait complete. 2024-09-13T23:57:24.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.857+0000 7fdabbd15f40 1 Processor -- start 2024-09-13T23:57:24.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.857+0000 7fdabbd15f40 1 -- start start 2024-09-13T23:57:24.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.857+0000 7fdabbd15f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8722da400 0x55d872279180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.857+0000 7fdabbd15f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d87201e500 con 0x55d8722da400 2024-09-13T23:57:24.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.857+0000 7fdab9ccd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8722da400 0x55d872279180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.857+0000 7fdab9ccd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8722da400 0x55d872279180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34926/0 (socket says 172.21.15.173:34926) 2024-09-13T23:57:24.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.857+0000 7fdab9ccd700 1 -- 172.21.15.173:0/829195986 learned_addr learned my addr 172.21.15.173:0/829195986 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:24.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.857+0000 7fdab9ccd700 1 -- 172.21.15.173:0/829195986 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d871fa2d00 con 0x55d8722da400 2024-09-13T23:57:24.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.857+0000 7fdab9ccd700 1 --2- 172.21.15.173:0/829195986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8722da400 0x55d872279180 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x55d87241c780 tx=0x55d8723ee5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.861+0000 7fda9f498700 1 -- 172.21.15.173:0/829195986 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d87242a160 con 0x55d8722da400 2024-09-13T23:57:24.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.861+0000 7fda9f498700 1 -- 172.21.15.173:0/829195986 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d87235e300 con 0x55d8722da400 2024-09-13T23:57:24.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.861+0000 7fda9f498700 1 -- 172.21.15.173:0/829195986 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d87242a2c0 con 0x55d8722da400 2024-09-13T23:57:24.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.861+0000 7fdabbd15f40 1 -- 172.21.15.173:0/829195986 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d871fa2340 con 0x55d8722da400 2024-09-13T23:57:24.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.861+0000 7fdabbd15f40 1 -- 172.21.15.173:0/829195986 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d871fa3d40 con 0x55d8722da400 2024-09-13T23:57:24.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.861+0000 7fda9f498700 1 -- 172.21.15.173:0/829195986 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55d87208bb80 con 0x55d8722da400 2024-09-13T23:57:24.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.861+0000 7fda9f498700 1 --2- 172.21.15.173:0/829195986 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d87249e000 0x55d8724a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:24.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.861+0000 7fda9f498700 1 -- 172.21.15.173:0/829195986 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55d871ff7500 con 0x55d8722da400 2024-09-13T23:57:24.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.861+0000 7fdabbd15f40 5 note: GC not initialized 2024-09-13T23:57:24.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.861+0000 7fdabaccf700 1 --2- 172.21.15.173:0/829195986 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d87249e000 0x55d8724a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:24.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.861+0000 7fdabaccf700 1 --2- 172.21.15.173:0/829195986 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d87249e000 0x55d8724a4000 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55d8723a0090 tx=0x55d8723ef5c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:24.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.861+0000 7fda9cc93700 20 reqs_thread_entry: start 2024-09-13T23:57:24.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fdabbd15f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:24.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fdabbd15f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:24.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fda9ac8f700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:55 2024 2024-09-13T23:57:24.873 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:24.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fda9a46d700 20 reqs_thread_entry: start 2024-09-13T23:57:24.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fdabbd15f40 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:57:24.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fdabbd15f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d872349800 con 0x55d872406000 2024-09-13T23:57:24.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872406000 2024-09-13T23:57:24.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fdabbd15f40 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:57:24.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fdabbd15f40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:57:24.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fdabbd15f40 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:57:24.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fdabbd15f40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 : miss 2024-09-13T23:57:24.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fdabbd15f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:24.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:63 8.0 8:05e2f469:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d87249e400 con 0x55d872349c00 2024-09-13T23:57:24.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(63 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x55d8723f7440 con 0x55d872349c00 2024-09-13T23:57:24.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fdabbd15f40 20 rados_obj.operate() r=0 bl.length=352 2024-09-13T23:57:24.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fdabbd15f40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 info.flags=0x17 2024-09-13T23:57:24.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fdabbd15f40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 to cache LRU end 2024-09-13T23:57:24.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fdabbd15f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:24.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fdabbd15f40 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:57:24.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fdabbd15f40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 2024-09-13T23:57:24.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fdabbd15f40 20 get_obj_state: rctx=0x55d872021730 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55d8725081e8 s->prefetch_data=0 2024-09-13T23:57:24.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:64 3.12s0 3:4b709470:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d87249e800 con 0x55d872406000 2024-09-13T23:57:24.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(64 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+927 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872406000 2024-09-13T23:57:24.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fdabbd15f40 10 manifest: total_size = 5 2024-09-13T23:57:24.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.865+0000 7fdabbd15f40 20 get_obj_state: setting s->obj_tag to _KrUD1oH0URv5J5tkeS4amnpJZ8OgT3o 2024-09-13T23:57:24.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.869+0000 7fdaa149c700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:24.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.869+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94388118192128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d87249ec00 con 0x55d872349000 2024-09-13T23:57:24.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.869+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94388118192128] v35'181 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872349000 2024-09-13T23:57:24.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.869+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94388116445952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d87249f000 con 0x55d872349400 2024-09-13T23:57:24.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.873+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94388116445952] v35'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d8723f7200 con 0x55d872349400 2024-09-13T23:57:24.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.873+0000 7fdabbd15f40 20 remove_watcher() i=0 2024-09-13T23:57:24.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.873+0000 7fdabbd15f40 2 removed watcher, disabling cache 2024-09-13T23:57:24.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.873+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94388116447104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d87249f400 con 0x55d872349000 2024-09-13T23:57:24.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.873+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94388116447104] v35'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872349000 2024-09-13T23:57:24.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.873+0000 7fdabbd15f40 20 remove_watcher() i=1 2024-09-13T23:57:24.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.873+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94388116448256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d87249f800 con 0x55d872349400 2024-09-13T23:57:24.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.877+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94388116448256] v35'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d8723f7200 con 0x55d872349400 2024-09-13T23:57:24.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.877+0000 7fdabbd15f40 20 remove_watcher() i=2 2024-09-13T23:57:24.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.877+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94388116449408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d87249fc00 con 0x55d872406000 2024-09-13T23:57:24.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.881+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94388116449408] v35'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872406000 2024-09-13T23:57:24.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.881+0000 7fdabbd15f40 20 remove_watcher() i=3 2024-09-13T23:57:24.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.881+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94388116450560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d87249e800 con 0x55d872349400 2024-09-13T23:57:24.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.885+0000 7fdaba4ce700 1 -- 172.21.15.173:0/2013017309 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94388116450560] v35'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d8723f7200 con 0x55d872349400 2024-09-13T23:57:24.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.885+0000 7fdabbd15f40 20 remove_watcher() i=4 2024-09-13T23:57:24.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.885+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94388116451712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d87249ec00 con 0x55d872349c00 2024-09-13T23:57:24.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.885+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94388116451712] v35'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d8723f7440 con 0x55d872349c00 2024-09-13T23:57:24.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.885+0000 7fdabbd15f40 20 remove_watcher() i=5 2024-09-13T23:57:24.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.885+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94388116452864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d87249f400 con 0x55d872349c00 2024-09-13T23:57:24.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.889+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94388116452864] v35'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d8723f7440 con 0x55d872349c00 2024-09-13T23:57:24.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.889+0000 7fdabbd15f40 20 remove_watcher() i=6 2024-09-13T23:57:24.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.889+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94388116454016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d87249f000 con 0x55d872406000 2024-09-13T23:57:24.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabaccf700 1 -- 172.21.15.173:0/2013017309 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94388116454016] v35'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d8723f6b40 con 0x55d872406000 2024-09-13T23:57:24.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 20 remove_watcher() i=7 2024-09-13T23:57:24.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55d872349400 msgr2=0x55d872277b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/2013017309 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55d872349400 0x55d872277b80 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55d872349000 msgr2=0x55d872277600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/2013017309 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55d872349000 0x55d872277600 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55d872406000 msgr2=0x55d872276580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/2013017309 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55d872406000 0x55d872276580 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55d872349c00 msgr2=0x55d872278c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/2013017309 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55d872349c00 0x55d872278c00 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d872348c00 msgr2=0x55d872278680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/2013017309 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d872348c00 0x55d872278680 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55d872271920 tx=0x55d872095800 comp rx=0 tx=0).stop 2024-09-13T23:57:24.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91c00 msgr2=0x55d872277080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdab9ccd700 1 -- 172.21.15.173:0/2013017309 reap_dead start 2024-09-13T23:57:24.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/2013017309 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91c00 0x55d872277080 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x55d8720edec0 tx=0x55d872302cc0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 shutdown_connections 2024-09-13T23:57:24.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/2013017309 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91c00 0x55d872277080 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 >> 172.21.15.173:0/2013017309 conn(0x55d871f91800 msgr2=0x55d872091800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:24.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 shutdown_connections 2024-09-13T23:57:24.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 -- 172.21.15.173:0/2013017309 wait complete. 2024-09-13T23:57:24.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 -- 172.21.15.173:0/829195986 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d87249e000 msgr2=0x55d8724a4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/829195986 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d87249e000 0x55d8724a4000 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55d8723a0090 tx=0x55d8723ef5c0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 -- 172.21.15.173:0/829195986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8722da400 msgr2=0x55d872279180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/829195986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8722da400 0x55d872279180 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x55d87241c780 tx=0x55d8723ee5a0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 -- 172.21.15.173:0/829195986 shutdown_connections 2024-09-13T23:57:24.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/829195986 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d87249e000 0x55d8724a4000 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/829195986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d8722da400 0x55d872279180 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 -- 172.21.15.173:0/829195986 >> 172.21.15.173:0/829195986 conn(0x55d8722dbc00 msgr2=0x55d872092000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:24.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 -- 172.21.15.173:0/829195986 shutdown_connections 2024-09-13T23:57:24.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 -- 172.21.15.173:0/829195986 wait complete. 2024-09-13T23:57:24.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 -- 172.21.15.173:0/1278800725 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d872348000 msgr2=0x55d872278100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/1278800725 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d872348000 0x55d872278100 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55d8722c8000 tx=0x55d872302240 comp rx=0 tx=0).stop 2024-09-13T23:57:24.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 -- 172.21.15.173:0/1278800725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91400 msgr2=0x55d872276b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:24.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/1278800725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91400 0x55d872276b00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x55d8720edf50 tx=0x55d872095a40 comp rx=0 tx=0).stop 2024-09-13T23:57:24.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 -- 172.21.15.173:0/1278800725 shutdown_connections 2024-09-13T23:57:24.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/1278800725 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d872348000 0x55d872278100 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 --2- 172.21.15.173:0/1278800725 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d871f91400 0x55d872276b00 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:24.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 -- 172.21.15.173:0/1278800725 >> 172.21.15.173:0/1278800725 conn(0x55d871f90c00 msgr2=0x55d872091000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:24.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 -- 172.21.15.173:0/1278800725 shutdown_connections 2024-09-13T23:57:24.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:24.893+0000 7fdabbd15f40 1 -- 172.21.15.173:0/1278800725 wait complete. 2024-09-13T23:57:24.905 INFO:teuthology.orchestra.run.smithi173.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-13T23:57:24.905 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-13T23:57:24.908 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-13T23:57:24.912 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:57:24.984 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-13T23:57:24.984 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-13T23:57:24.984 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T23:57:24.984 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-13T23:57:24.985 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-13T23:57:24.985 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-13T23:57:24.985 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-13T23:57:25.024 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:25.025 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:25.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.017+0000 7fc1e0a26f40 1 Processor -- start 2024-09-13T23:57:25.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.017+0000 7fc1e0a26f40 1 -- start start 2024-09-13T23:57:25.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.017+0000 7fc1e0a26f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x56180c907400 0x56180cbec580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.017+0000 7fc1e0a26f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56180c9cb500 con 0x56180c907000 2024-09-13T23:57:25.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.017+0000 7fc1e0a26f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x56180c994a00 con 0x56180c907400 2024-09-13T23:57:25.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.021+0000 7fc1de9de700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x56180c907400 0x56180cbec580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.021+0000 7fc1de9de700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x56180c907400 0x56180cbec580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34942/0 (socket says 172.21.15.173:34942) 2024-09-13T23:57:25.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.021+0000 7fc1de9de700 1 -- 172.21.15.173:0/1063923570 learned_addr learned my addr 172.21.15.173:0/1063923570 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.021+0000 7fc1df1df700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x56180c907000 0x56180ca06800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:44920/0 (socket says 172.21.15.173:44920) 2024-09-13T23:57:25.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.021+0000 7fc1de9de700 1 -- 172.21.15.173:0/1063923570 >> v1:172.21.15.87:6789/0 conn(0x56180c907000 legacy=0x56180ca06800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.021+0000 7fc1de9de700 1 -- 172.21.15.173:0/1063923570 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56180c919d40 con 0x56180c907400 2024-09-13T23:57:25.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.021+0000 7fc1de9de700 1 --2- 172.21.15.173:0/1063923570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907400 0x56180cbec580 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x56180cbe7920 tx=0x56180ca0b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363025684d100497 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.021+0000 7fc1de1dd700 1 -- 172.21.15.173:0/1063923570 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56180c9ab4a0 con 0x56180c907400 2024-09-13T23:57:25.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.021+0000 7fc1de1dd700 1 -- 172.21.15.173:0/1063923570 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56180c9cb800 con 0x56180c907400 2024-09-13T23:57:25.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.021+0000 7fc1de1dd700 1 -- 172.21.15.173:0/1063923570 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56180c9ab600 con 0x56180c907400 2024-09-13T23:57:25.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.021+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/1063923570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907400 msgr2=0x56180cbec580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.021+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/1063923570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907400 0x56180cbec580 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x56180cbe7920 tx=0x56180ca0b920 comp rx=0 tx=0).stop 2024-09-13T23:57:25.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.021+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/1063923570 shutdown_connections 2024-09-13T23:57:25.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.021+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/1063923570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907400 0x56180cbec580 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.021+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/1063923570 >> 172.21.15.173:0/1063923570 conn(0x56180c906c00 msgr2=0x56180ca06000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.021+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/1063923570 shutdown_connections 2024-09-13T23:57:25.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.021+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/1063923570 wait complete. 2024-09-13T23:57:25.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.021+0000 7fc1e0a26f40 1 Processor -- start 2024-09-13T23:57:25.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.021+0000 7fc1e0a26f40 1 -- start start 2024-09-13T23:57:25.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.021+0000 7fc1e0a26f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907000 0x56180cbec580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.021+0000 7fc1e0a26f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56180c994500 con 0x56180c907000 2024-09-13T23:57:25.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.025+0000 7fc1df1df700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907000 0x56180cbec580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.025+0000 7fc1df1df700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907000 0x56180cbec580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34954/0 (socket says 172.21.15.173:34954) 2024-09-13T23:57:25.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.025+0000 7fc1df1df700 1 -- 172.21.15.173:0/2839543495 learned_addr learned my addr 172.21.15.173:0/2839543495 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.025+0000 7fc1df1df700 1 -- 172.21.15.173:0/2839543495 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56180c919ba0 con 0x56180c907000 2024-09-13T23:57:25.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.025+0000 7fc1df1df700 1 --2- 172.21.15.173:0/2839543495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907000 0x56180cbec580 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x56180ca63e90 tx=0x56180ca0bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a176071411cb432 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.025+0000 7fc1dd9dc700 1 -- 172.21.15.173:0/2839543495 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56180c9ab4a0 con 0x56180c907000 2024-09-13T23:57:25.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.025+0000 7fc1dd9dc700 1 -- 172.21.15.173:0/2839543495 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56180c9cbb00 con 0x56180c907000 2024-09-13T23:57:25.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.025+0000 7fc1dd9dc700 1 -- 172.21.15.173:0/2839543495 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56180c9ab600 con 0x56180c907000 2024-09-13T23:57:25.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.025+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2839543495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907000 msgr2=0x56180cbec580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.025+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/2839543495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907000 0x56180cbec580 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x56180ca63e90 tx=0x56180ca0bb60 comp rx=0 tx=0).stop 2024-09-13T23:57:25.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.025+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2839543495 shutdown_connections 2024-09-13T23:57:25.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.025+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/2839543495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907000 0x56180cbec580 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.025+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2839543495 >> 172.21.15.173:0/2839543495 conn(0x56180c906c00 msgr2=0x56180ca07000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.025+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2839543495 shutdown_connections 2024-09-13T23:57:25.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.025+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2839543495 wait complete. 2024-09-13T23:57:25.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.025+0000 7fc1e0a26f40 1 Processor -- start 2024-09-13T23:57:25.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.025+0000 7fc1e0a26f40 1 -- start start 2024-09-13T23:57:25.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.025+0000 7fc1e0a26f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907000 0x56180cbec580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.025+0000 7fc1e0a26f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56180c9943c0 con 0x56180c907000 2024-09-13T23:57:25.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.025+0000 7fc1df1df700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907000 0x56180cbec580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.025+0000 7fc1df1df700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907000 0x56180cbec580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34966/0 (socket says 172.21.15.173:34966) 2024-09-13T23:57:25.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.025+0000 7fc1df1df700 1 -- 172.21.15.173:0/2441792993 learned_addr learned my addr 172.21.15.173:0/2441792993 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.025+0000 7fc1df1df700 1 -- 172.21.15.173:0/2441792993 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56180c919a00 con 0x56180c907000 2024-09-13T23:57:25.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.029+0000 7fc1df1df700 1 --2- 172.21.15.173:0/2441792993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907000 0x56180cbec580 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x56180ca63fb0 tx=0x56180ca0ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.029+0000 7fc1dc1d9700 1 -- 172.21.15.173:0/2441792993 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56180c9ab8c0 con 0x56180c907000 2024-09-13T23:57:25.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.029+0000 7fc1dc1d9700 1 -- 172.21.15.173:0/2441792993 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56180c9cbc80 con 0x56180c907000 2024-09-13T23:57:25.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.029+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2441792993 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56180c919860 con 0x56180c907000 2024-09-13T23:57:25.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.029+0000 7fc1dc1d9700 1 -- 172.21.15.173:0/2441792993 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56180c9ab4a0 con 0x56180c907000 2024-09-13T23:57:25.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.029+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2441792993 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56180c9196c0 con 0x56180c907000 2024-09-13T23:57:25.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.029+0000 7fc1e0a26f40 1 Processor -- start 2024-09-13T23:57:25.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.029+0000 7fc1dc1d9700 1 -- 172.21.15.173:0/2441792993 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x56180ca00b00 con 0x56180c907000 2024-09-13T23:57:25.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.029+0000 7fc1e0a26f40 1 -- start start 2024-09-13T23:57:25.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.029+0000 7fc1e0a26f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907800 0x56180cbecb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.029+0000 7fc1e0a26f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56180c92c640 con 0x56180c907800 2024-09-13T23:57:25.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.029+0000 7fc1dc1d9700 1 --2- 172.21.15.173:0/2441792993 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56180ccac000 0x56180cbed080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.029+0000 7fc1dc1d9700 1 -- 172.21.15.173:0/2441792993 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x56180c96d180 con 0x56180c907000 2024-09-13T23:57:25.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.029+0000 7fc1df1df700 1 --2- 172.21.15.173:0/2441792993 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56180ccac000 0x56180cbed080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.029+0000 7fc1df9e0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907800 0x56180cbecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.029+0000 7fc1df9e0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907800 0x56180cbecb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34980/0 (socket says 172.21.15.173:34980) 2024-09-13T23:57:25.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.029+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3598554642 learned_addr learned my addr 172.21.15.173:0/3598554642 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.029+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3598554642 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56180c918000 con 0x56180c907800 2024-09-13T23:57:25.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.029+0000 7fc1df1df700 1 --2- 172.21.15.173:0/2441792993 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56180ccac000 0x56180cbed080 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x56180cc8e450 tx=0x56180cc66240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.029+0000 7fc1df9e0700 1 --2- 172.21.15.173:0/3598554642 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907800 0x56180cbecb00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x56180d77e330 tx=0x56180cc670e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d93922f108d815 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.033+0000 7fc1d99d4700 1 -- 172.21.15.173:0/3598554642 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56180c9ab8c0 con 0x56180c907800 2024-09-13T23:57:25.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.033+0000 7fc1d99d4700 1 -- 172.21.15.173:0/3598554642 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56180ccc0000 con 0x56180c907800 2024-09-13T23:57:25.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.033+0000 7fc1d99d4700 1 -- 172.21.15.173:0/3598554642 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56180c9ab4a0 con 0x56180c907800 2024-09-13T23:57:25.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.033+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3598554642 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907800 msgr2=0x56180cbecb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.033+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/3598554642 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907800 0x56180cbecb00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x56180d77e330 tx=0x56180cc670e0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.033+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3598554642 shutdown_connections 2024-09-13T23:57:25.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.033+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/3598554642 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907800 0x56180cbecb00 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.033+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3598554642 >> 172.21.15.173:0/3598554642 conn(0x56180c907400 msgr2=0x56180ca07800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.033+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3598554642 shutdown_connections 2024-09-13T23:57:25.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.033+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3598554642 wait complete. 2024-09-13T23:57:25.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.033+0000 7fc1e0a26f40 1 Processor -- start 2024-09-13T23:57:25.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.033+0000 7fc1e0a26f40 1 -- start start 2024-09-13T23:57:25.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.033+0000 7fc1e0a26f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907800 0x56180cbecb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.033+0000 7fc1e0a26f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56180c92c8c0 con 0x56180c907800 2024-09-13T23:57:25.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.033+0000 7fc1df9e0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907800 0x56180cbecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.033+0000 7fc1df9e0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907800 0x56180cbecb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:34988/0 (socket says 172.21.15.173:34988) 2024-09-13T23:57:25.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.033+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 learned_addr learned my addr 172.21.15.173:0/3468523891 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.033+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56180c918ea0 con 0x56180c907800 2024-09-13T23:57:25.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.033+0000 7fc1df9e0700 1 --2- 172.21.15.173:0/3468523891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907800 0x56180cbecb00 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x56180d77e960 tx=0x56180cc66cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.037+0000 7fc1d81d1700 1 -- 172.21.15.173:0/3468523891 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56180c9abb80 con 0x56180c907800 2024-09-13T23:57:25.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.037+0000 7fc1d81d1700 1 -- 172.21.15.173:0/3468523891 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56180ccc0180 con 0x56180c907800 2024-09-13T23:57:25.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.037+0000 7fc1d81d1700 1 -- 172.21.15.173:0/3468523891 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56180c9ab8c0 con 0x56180c907800 2024-09-13T23:57:25.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.037+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56180c918820 con 0x56180c907800 2024-09-13T23:57:25.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.037+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56180c9189c0 con 0x56180c907800 2024-09-13T23:57:25.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.037+0000 7fc1d81d1700 1 -- 172.21.15.173:0/3468523891 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x56180ca00dc0 con 0x56180c907800 2024-09-13T23:57:25.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.037+0000 7fc1d81d1700 1 --2- 172.21.15.173:0/3468523891 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56180ccacc00 0x56180cbed600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.037+0000 7fc1d81d1700 1 -- 172.21.15.173:0/3468523891 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x56180c96d340 con 0x56180c907800 2024-09-13T23:57:25.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.037+0000 7fc1de9de700 1 --2- 172.21.15.173:0/3468523891 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56180ccacc00 0x56180cbed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.037+0000 7fc1e0a26f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.037+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/3468523891 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56180ccad000 0x56180cbedb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.037+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad400 con 0x56180ccad000 2024-09-13T23:57:25.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.037+0000 7fc1df9e0700 1 --2- 172.21.15.173:0/3468523891 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56180ccad000 0x56180cbedb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.037+0000 7fc1de9de700 1 --2- 172.21.15.173:0/3468523891 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56180ccacc00 0x56180cbed600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x56180cbe7920 tx=0x56180ca0b800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.037+0000 7fc1df9e0700 1 --2- 172.21.15.173:0/3468523891 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56180ccad000 0x56180cbedb80 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.037+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.037+0000 7fc1e0a26f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.037+0000 7fc1e0a26f40 20 realm 2024-09-13T23:57:25.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.037+0000 7fc1e0a26f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.037+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccad000 2024-09-13T23:57:25.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.041+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.041+0000 7fc1e0a26f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.041+0000 7fc1e0a26f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:25.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.041+0000 7fc1e0a26f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.041+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccadc00 con 0x56180ccad000 2024-09-13T23:57:25.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.041+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.041+0000 7fc1e0a26f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.041+0000 7fc1e0a26f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.041+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/3468523891 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56180ccad400 0x56180cbee100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.041+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccad400 2024-09-13T23:57:25.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.041+0000 7fc1df1df700 1 --2- 172.21.15.173:0/3468523891 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56180ccad400 0x56180cbee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.041+0000 7fc1df1df700 1 --2- 172.21.15.173:0/3468523891 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56180ccad400 0x56180cbee100 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.041+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.041+0000 7fc1e0a26f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:25.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.041+0000 7fc1e0a26f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.041+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/3468523891 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56180ccadc00 0x56180cbee680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.041+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cd6c000 con 0x56180ccadc00 2024-09-13T23:57:25.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.041+0000 7fc1de9de700 1 --2- 172.21.15.173:0/3468523891 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56180ccadc00 0x56180cbee680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.041+0000 7fc1de9de700 1 --2- 172.21.15.173:0/3468523891 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56180ccadc00 0x56180cbee680 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.045+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x56180cd65440 con 0x56180ccadc00 2024-09-13T23:57:25.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.045+0000 7fc1e0a26f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:25.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.045+0000 7fc1e0a26f40 20 searching for the correct realm 2024-09-13T23:57:25.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.045+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cd6c400 con 0x56180ccadc00 2024-09-13T23:57:25.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.045+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x56180cd65440 con 0x56180ccadc00 2024-09-13T23:57:25.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.045+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cd6c000 con 0x56180ccad400 2024-09-13T23:57:25.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.045+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.045+0000 7fc1df1df700 1 --2- 172.21.15.173:0/3468523891 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56180cd6c000 0x56180cbeec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.045+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180cd6c000 2024-09-13T23:57:25.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.045+0000 7fc1df9e0700 1 --2- 172.21.15.173:0/3468523891 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56180cd6c000 0x56180cbeec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.045+0000 7fc1df9e0700 1 --2- 172.21.15.173:0/3468523891 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56180cd6c000 0x56180cbeec00 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.045+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.045+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180cd6c000 2024-09-13T23:57:25.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.045+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.045+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccad000 2024-09-13T23:57:25.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.045+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.045+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccadc00 2024-09-13T23:57:25.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.049+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd65440 con 0x56180ccadc00 2024-09-13T23:57:25.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.049+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccad000 2024-09-13T23:57:25.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.049+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.049+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccad400 2024-09-13T23:57:25.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.049+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.049+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccad400 2024-09-13T23:57:25.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.049+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.049+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccad000 2024-09-13T23:57:25.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.049+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.049+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180cd6c000 2024-09-13T23:57:25.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.049+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.049+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccad000 2024-09-13T23:57:25.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.049+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.049+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180cd6c000 2024-09-13T23:57:25.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.053+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.053+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccad400 2024-09-13T23:57:25.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.053+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.053+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccadc00 2024-09-13T23:57:25.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.053+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd65440 con 0x56180ccadc00 2024-09-13T23:57:25.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.053+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccad000 2024-09-13T23:57:25.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.053+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.053+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccad400 2024-09-13T23:57:25.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.053+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.053+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccadc00 2024-09-13T23:57:25.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.053+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd65440 con 0x56180ccadc00 2024-09-13T23:57:25.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.053+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccad000 2024-09-13T23:57:25.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.053+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.053+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccad000 2024-09-13T23:57:25.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.057+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.057+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccad000 2024-09-13T23:57:25.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.057+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.057+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccadc00 2024-09-13T23:57:25.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.057+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd65440 con 0x56180ccadc00 2024-09-13T23:57:25.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.057+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180cd6c000 2024-09-13T23:57:25.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.057+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.057+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccad000 2024-09-13T23:57:25.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.057+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.057+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180cd6c000 2024-09-13T23:57:25.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.057+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.057+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccadc00 2024-09-13T23:57:25.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.057+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd65440 con 0x56180ccadc00 2024-09-13T23:57:25.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.061+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180cd6c000 2024-09-13T23:57:25.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.061+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.061+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccad400 2024-09-13T23:57:25.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.061+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.061+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccad400 2024-09-13T23:57:25.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.061+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.061+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccadc00 2024-09-13T23:57:25.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.061+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd65440 con 0x56180ccadc00 2024-09-13T23:57:25.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.061+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccad400 2024-09-13T23:57:25.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.061+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.061+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180ccad400 2024-09-13T23:57:25.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.061+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.061+0000 7fc1e0a26f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:25.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:25.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:25.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:25.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cd6c800 con 0x56180ccad000 2024-09-13T23:57:25.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cd6cc00 con 0x56180ccad400 2024-09-13T23:57:25.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:25.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cd6d000 con 0x56180cd6c000 2024-09-13T23:57:25.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:25.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 20 zone default found 2024-09-13T23:57:25.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 4 Realm: () 2024-09-13T23:57:25.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:25.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:25.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:25.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 20 zonegroup default 2024-09-13T23:57:25.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cd6d400 con 0x56180cd6c000 2024-09-13T23:57:25.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cd6d800 con 0x56180ccadc00 2024-09-13T23:57:25.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x56180cd65440 con 0x56180ccadc00 2024-09-13T23:57:25.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.065+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cd6dc00 con 0x56180ccadc00 2024-09-13T23:57:25.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.069+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x56180cd65440 con 0x56180ccadc00 2024-09-13T23:57:25.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.069+0000 7fc1e0a26f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.069+0000 7fc1e0a26f40 20 started sync module instance, tier type = 2024-09-13T23:57:25.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.069+0000 7fc1e0a26f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:25.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.069+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5a000 con 0x56180ccad400 2024-09-13T23:57:25.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.069+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v35'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.069+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94661292997376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5a400 con 0x56180ccad400 2024-09-13T23:57:25.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.069+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5a800 con 0x56180ccad000 2024-09-13T23:57:25.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.073+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94661292997376] v35'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.073+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v35'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.073+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94661292998528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5ac00 con 0x56180ccad000 2024-09-13T23:57:25.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.073+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5b000 con 0x56180ccad400 2024-09-13T23:57:25.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.077+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94661292998528] v35'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.077+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v35'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.077+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94661292999680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5b400 con 0x56180ccad400 2024-09-13T23:57:25.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.077+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5b800 con 0x56180cd6c000 2024-09-13T23:57:25.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.077+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94661292999680] v35'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.077+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v35'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.077+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94661293000832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5bc00 con 0x56180cd6c000 2024-09-13T23:57:25.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.077+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5a800 con 0x56180ccad400 2024-09-13T23:57:25.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.081+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94661293000832] v35'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.081+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v35'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.081+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94661293001984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5a000 con 0x56180ccad400 2024-09-13T23:57:25.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.081+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cd6c800 con 0x56180ccadc00 2024-09-13T23:57:25.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.081+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v35'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd65440 con 0x56180ccadc00 2024-09-13T23:57:25.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.081+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94661293003136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cd6d000 con 0x56180ccadc00 2024-09-13T23:57:25.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.085+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cd6d400 con 0x56180ccadc00 2024-09-13T23:57:25.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.085+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94661293001984] v35'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.085+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94661293003136] v35'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd65440 con 0x56180ccadc00 2024-09-13T23:57:25.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.085+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v35'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd65440 con 0x56180ccadc00 2024-09-13T23:57:25.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.085+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94661293004288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cd6cc00 con 0x56180ccadc00 2024-09-13T23:57:25.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.085+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ccad800 con 0x56180cd6c000 2024-09-13T23:57:25.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.089+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v35'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.089+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94661293004288] v35'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd65440 con 0x56180ccadc00 2024-09-13T23:57:25.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.089+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94661293005440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5a400 con 0x56180cd6c000 2024-09-13T23:57:25.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.089+0000 7fc1e0a26f40 20 add_watcher() i=0 2024-09-13T23:57:25.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.089+0000 7fc1e0a26f40 20 add_watcher() i=1 2024-09-13T23:57:25.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.089+0000 7fc1e0a26f40 20 add_watcher() i=2 2024-09-13T23:57:25.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.089+0000 7fc1e0a26f40 20 add_watcher() i=3 2024-09-13T23:57:25.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.089+0000 7fc1e0a26f40 20 add_watcher() i=4 2024-09-13T23:57:25.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.089+0000 7fc1e0a26f40 20 add_watcher() i=5 2024-09-13T23:57:25.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.089+0000 7fc1e0a26f40 20 add_watcher() i=6 2024-09-13T23:57:25.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.089+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94661293005440] v35'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.089+0000 7fc1e0a26f40 20 add_watcher() i=7 2024-09-13T23:57:25.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.089+0000 7fc1e0a26f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:25.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.089+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5b000 con 0x56180ccad000 2024-09-13T23:57:25.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.089+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.089+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94661294678016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5b400 con 0x56180ccad000 2024-09-13T23:57:25.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.093+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94661294678016] v35'182 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.093+0000 7fc1c61ad700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:25.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.093+0000 7fc1e0a26f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:25.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.093+0000 7fc1e0a26f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:25.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.093+0000 7fc1e0a26f40 1 Processor -- start 2024-09-13T23:57:25.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.093+0000 7fc1e0a26f40 1 -- start start 2024-09-13T23:57:25.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.093+0000 7fc1e0a26f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180cd6c400 0x56180cbef180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.093+0000 7fc1e0a26f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56180c9943c0 con 0x56180cd6c400 2024-09-13T23:57:25.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.093+0000 7fc1de9de700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180cd6c400 0x56180cbef180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.093+0000 7fc1de9de700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180cd6c400 0x56180cbef180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35004/0 (socket says 172.21.15.173:35004) 2024-09-13T23:57:25.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.093+0000 7fc1de9de700 1 -- 172.21.15.173:0/675747386 learned_addr learned my addr 172.21.15.173:0/675747386 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.093+0000 7fc1de9de700 1 -- 172.21.15.173:0/675747386 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56180c918b60 con 0x56180cd6c400 2024-09-13T23:57:25.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.093+0000 7fc1de9de700 1 --2- 172.21.15.173:0/675747386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180cd6c400 0x56180cbef180 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x56180cd860f0 tx=0x56180ca0b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823ea3a9b3dd5ca3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.093+0000 7fc1c59ac700 1 -- 172.21.15.173:0/675747386 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56180c9ab760 con 0x56180cd6c400 2024-09-13T23:57:25.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.093+0000 7fc1c59ac700 1 -- 172.21.15.173:0/675747386 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56180ccc0600 con 0x56180cd6c400 2024-09-13T23:57:25.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.093+0000 7fc1c59ac700 1 -- 172.21.15.173:0/675747386 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56180cd90000 con 0x56180cd6c400 2024-09-13T23:57:25.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.097+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/675747386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180cd6c400 msgr2=0x56180cbef180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.097+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/675747386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180cd6c400 0x56180cbef180 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x56180cd860f0 tx=0x56180ca0b980 comp rx=0 tx=0).stop 2024-09-13T23:57:25.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.097+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/675747386 shutdown_connections 2024-09-13T23:57:25.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.097+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/675747386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180cd6c400 0x56180cbef180 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.097+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/675747386 >> 172.21.15.173:0/675747386 conn(0x56180cc5a800 msgr2=0x56180ca08000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.097+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/675747386 shutdown_connections 2024-09-13T23:57:25.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.097+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/675747386 wait complete. 2024-09-13T23:57:25.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.097+0000 7fc1e0a26f40 1 Processor -- start 2024-09-13T23:57:25.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.097+0000 7fc1e0a26f40 1 -- start start 2024-09-13T23:57:25.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.097+0000 7fc1e0a26f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180cd6c400 0x56180cbef180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.097+0000 7fc1e0a26f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56180c994500 con 0x56180cd6c400 2024-09-13T23:57:25.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.097+0000 7fc1de9de700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180cd6c400 0x56180cbef180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.097+0000 7fc1de9de700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180cd6c400 0x56180cbef180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35008/0 (socket says 172.21.15.173:35008) 2024-09-13T23:57:25.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.097+0000 7fc1de9de700 1 -- 172.21.15.173:0/2368674266 learned_addr learned my addr 172.21.15.173:0/2368674266 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.097+0000 7fc1de9de700 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56180c918d00 con 0x56180cd6c400 2024-09-13T23:57:25.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.097+0000 7fc1de9de700 1 --2- 172.21.15.173:0/2368674266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180cd6c400 0x56180cbef180 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x56180cd86390 tx=0x56180cd525a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.097+0000 7fc1c41a9700 1 -- 172.21.15.173:0/2368674266 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56180cd90160 con 0x56180cd6c400 2024-09-13T23:57:25.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.097+0000 7fc1c41a9700 1 -- 172.21.15.173:0/2368674266 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56180ccc0300 con 0x56180cd6c400 2024-09-13T23:57:25.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.097+0000 7fc1c41a9700 1 -- 172.21.15.173:0/2368674266 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56180cd902c0 con 0x56180cd6c400 2024-09-13T23:57:25.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.097+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56180c918340 con 0x56180cd6c400 2024-09-13T23:57:25.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.097+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56180c919d40 con 0x56180cd6c400 2024-09-13T23:57:25.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.101+0000 7fc1c41a9700 1 -- 172.21.15.173:0/2368674266 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x56180ca01b80 con 0x56180cd6c400 2024-09-13T23:57:25.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.101+0000 7fc1c41a9700 1 --2- 172.21.15.173:0/2368674266 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56180ccad800 0x56180ce0a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.101+0000 7fc1c41a9700 1 -- 172.21.15.173:0/2368674266 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x56180c96d500 con 0x56180cd6c400 2024-09-13T23:57:25.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.101+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/2368674266 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56180cd6d800 0x56180cbef700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.101+0000 7fc1df9e0700 1 --2- 172.21.15.173:0/2368674266 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56180ccad800 0x56180ce0a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.101+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cd6dc00 con 0x56180cd6d800 2024-09-13T23:57:25.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.101+0000 7fc1df1df700 1 --2- 172.21.15.173:0/2368674266 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56180cd6d800 0x56180cbef700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.101+0000 7fc1df9e0700 1 --2- 172.21.15.173:0/2368674266 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56180ccad800 0x56180ce0a000 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x56180cd056e0 tx=0x56180cd535c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.101+0000 7fc1df1df700 1 --2- 172.21.15.173:0/2368674266 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56180cd6d800 0x56180cbef700 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.105+0000 7fc1df1df700 1 -- 172.21.15.173:0/2368674266 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v35'33 uv30 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180cd6d800 2024-09-13T23:57:25.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.105+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/2368674266 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56180cd6c800 0x56180ce0a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.105+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5ac00 con 0x56180cd6c800 2024-09-13T23:57:25.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.105+0000 7fc1de9de700 1 --2- 172.21.15.173:0/2368674266 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56180cd6c800 0x56180ce0a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.105+0000 7fc1de9de700 1 --2- 172.21.15.173:0/2368674266 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56180cd6c800 0x56180ce0a580 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.105+0000 7fc1de9de700 1 -- 172.21.15.173:0/2368674266 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v35'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x56180cd65440 con 0x56180cd6c800 2024-09-13T23:57:25.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.105+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/2368674266 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56180cc5b800 0x56180ce0ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.105+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5bc00 con 0x56180cc5b800 2024-09-13T23:57:25.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.105+0000 7fc1df9e0700 1 --2- 172.21.15.173:0/2368674266 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56180cc5b800 0x56180ce0ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.109+0000 7fc1df9e0700 1 --2- 172.21.15.173:0/2368674266 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56180cc5b800 0x56180ce0ab00 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.109+0000 7fc1df9e0700 1 -- 172.21.15.173:0/2368674266 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v35'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180cc5b800 2024-09-13T23:57:25.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.109+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/2368674266 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56180cc5a400 0x56180ce0b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.109+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce2c000 con 0x56180cc5a400 2024-09-13T23:57:25.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.109+0000 7fc1df1df700 1 --2- 172.21.15.173:0/2368674266 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56180cc5a400 0x56180ce0b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.109+0000 7fc1df1df700 1 --2- 172.21.15.173:0/2368674266 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56180cc5a400 0x56180ce0b080 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.113+0000 7fc1df1df700 1 -- 172.21.15.173:0/2368674266 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v35'183 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180cc5a400 2024-09-13T23:57:25.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.113+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce2c400 con 0x56180cd6d800 2024-09-13T23:57:25.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.117+0000 7fc1df1df700 1 -- 172.21.15.173:0/2368674266 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v35'62 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180cd6d800 2024-09-13T23:57:25.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.117+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce2c800 con 0x56180cc5b800 2024-09-13T23:57:25.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.117+0000 7fc1df9e0700 1 -- 172.21.15.173:0/2368674266 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v35'41 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180cc5b800 2024-09-13T23:57:25.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.117+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce2cc00 con 0x56180cd6d800 2024-09-13T23:57:25.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.121+0000 7fc1df1df700 1 -- 172.21.15.173:0/2368674266 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v35'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180cd6d800 2024-09-13T23:57:25.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.121+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce2d000 con 0x56180cc5a400 2024-09-13T23:57:25.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.125+0000 7fc1df1df700 1 -- 172.21.15.173:0/2368674266 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v35'41 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180cc5a400 2024-09-13T23:57:25.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.125+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce2d400 con 0x56180cd6d800 2024-09-13T23:57:25.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.125+0000 7fc1df1df700 1 -- 172.21.15.173:0/2368674266 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v35'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180cd6d800 2024-09-13T23:57:25.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.125+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce2d800 con 0x56180cd6d800 2024-09-13T23:57:25.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.129+0000 7fc1df1df700 1 -- 172.21.15.173:0/2368674266 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v35'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180cd6d800 2024-09-13T23:57:25.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.129+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce2dc00 con 0x56180cd6d800 2024-09-13T23:57:25.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.133+0000 7fc1df1df700 1 -- 172.21.15.173:0/2368674266 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v35'63 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180cd6d800 2024-09-13T23:57:25.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.133+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce2c000 con 0x56180cc5b800 2024-09-13T23:57:25.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.137+0000 7fc1df9e0700 1 -- 172.21.15.173:0/2368674266 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v35'27 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180cc5b800 2024-09-13T23:57:25.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.137+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce2c400 con 0x56180cd6d800 2024-09-13T23:57:25.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.137+0000 7fc1df1df700 1 -- 172.21.15.173:0/2368674266 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v35'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180cd6d800 2024-09-13T23:57:25.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.137+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce2cc00 con 0x56180cc5a400 2024-09-13T23:57:25.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.141+0000 7fc1df1df700 1 -- 172.21.15.173:0/2368674266 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v35'47 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180cc5a400 2024-09-13T23:57:25.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.141+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cd6dc00 con 0x56180cc5a400 2024-09-13T23:57:25.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.141+0000 7fc1df1df700 1 -- 172.21.15.173:0/2368674266 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v35'184 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180cc5a400 2024-09-13T23:57:25.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.145+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5a000 con 0x56180cd6d800 2024-09-13T23:57:25.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.145+0000 7fc1df1df700 1 -- 172.21.15.173:0/2368674266 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v35'56 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180cd6d800 2024-09-13T23:57:25.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.145+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce2d000 con 0x56180cd6d800 2024-09-13T23:57:25.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.149+0000 7fc1df1df700 1 -- 172.21.15.173:0/2368674266 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v35'64 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180cd6d800 2024-09-13T23:57:25.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.149+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce2d400 con 0x56180cc5b800 2024-09-13T23:57:25.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.153+0000 7fc1df9e0700 1 -- 172.21.15.173:0/2368674266 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v35'27 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180cc5b800 2024-09-13T23:57:25.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.153+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce2d800 con 0x56180cd6d800 2024-09-13T23:57:25.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.153+0000 7fc1df1df700 1 -- 172.21.15.173:0/2368674266 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v35'32 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180cd6d800 2024-09-13T23:57:25.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.153+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce2dc00 con 0x56180cc5a400 2024-09-13T23:57:25.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.157+0000 7fc1df1df700 1 -- 172.21.15.173:0/2368674266 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v35'185 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180cc5a400 2024-09-13T23:57:25.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.157+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce2c400 con 0x56180cd6d800 2024-09-13T23:57:25.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.161+0000 7fc1df1df700 1 -- 172.21.15.173:0/2368674266 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v35'57 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180cd6d800 2024-09-13T23:57:25.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.161+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce2cc00 con 0x56180cd6d800 2024-09-13T23:57:25.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.161+0000 7fc1df1df700 1 -- 172.21.15.173:0/2368674266 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v35'34 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180cd6d800 2024-09-13T23:57:25.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.161+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5a000 con 0x56180cc5b800 2024-09-13T23:57:25.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.165+0000 7fc1df9e0700 1 -- 172.21.15.173:0/2368674266 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v35'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180cc5b800 2024-09-13T23:57:25.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.165+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5b000 con 0x56180cd6d800 2024-09-13T23:57:25.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.169+0000 7fc1df1df700 1 -- 172.21.15.173:0/2368674266 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v35'31 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180cd6d800 2024-09-13T23:57:25.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.169+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5b400 con 0x56180cc5b800 2024-09-13T23:57:25.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.169+0000 7fc1df9e0700 1 -- 172.21.15.173:0/2368674266 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v35'20 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180cc5b800 2024-09-13T23:57:25.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.169+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5bc00 con 0x56180cc5b800 2024-09-13T23:57:25.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.173+0000 7fc1df9e0700 1 -- 172.21.15.173:0/2368674266 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v35'42 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180cc5b800 2024-09-13T23:57:25.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.173+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cd6dc00 con 0x56180cc5b800 2024-09-13T23:57:25.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.177+0000 7fc1df9e0700 1 -- 172.21.15.173:0/2368674266 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v35'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180cc5b800 2024-09-13T23:57:25.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.177+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5c000 con 0x56180cd6d800 2024-09-13T23:57:25.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.177+0000 7fc1df1df700 1 -- 172.21.15.173:0/2368674266 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v35'29 uv26 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180cd6d800 2024-09-13T23:57:25.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.177+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5c400 con 0x56180cc5a400 2024-09-13T23:57:25.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.181+0000 7fc1df1df700 1 -- 172.21.15.173:0/2368674266 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v35'42 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180cc5a400 2024-09-13T23:57:25.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.181+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5c800 con 0x56180cd6d800 2024-09-13T23:57:25.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.185+0000 7fc1df1df700 1 -- 172.21.15.173:0/2368674266 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v35'58 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180cd6d800 2024-09-13T23:57:25.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.185+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5cc00 con 0x56180cc5a400 2024-09-13T23:57:25.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.185+0000 7fc1df1df700 1 -- 172.21.15.173:0/2368674266 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v35'48 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180cc5a400 2024-09-13T23:57:25.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.185+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5d000 con 0x56180cd6c800 2024-09-13T23:57:25.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.189+0000 7fc1de9de700 1 -- 172.21.15.173:0/2368674266 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v35'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x56180cd65440 con 0x56180cd6c800 2024-09-13T23:57:25.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.189+0000 7fc1c19a4700 20 reqs_thread_entry: start 2024-09-13T23:57:25.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.193+0000 7fc1e0a26f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:25.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.193+0000 7fc1e0a26f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:25.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.193+0000 7fc1bf9a0700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:55 2024 2024-09-13T23:57:25.198 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:25.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.193+0000 7fc1bf17e700 20 reqs_thread_entry: start 2024-09-13T23:57:25.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.193+0000 7fc1e0a26f40 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:57:25.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.193+0000 7fc1e0a26f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.193+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5dc00 con 0x56180cd6c000 2024-09-13T23:57:25.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.193+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.193+0000 7fc1e0a26f40 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:57:25.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.193+0000 7fc1e0a26f40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:57:25.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.193+0000 7fc1e0a26f40 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:57:25.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.193+0000 7fc1e0a26f40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 : miss 2024-09-13T23:57:25.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.193+0000 7fc1e0a26f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.193+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:63 8.0 8:05e2f469:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ceba000 con 0x56180ccadc00 2024-09-13T23:57:25.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.193+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(63 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x56180cd65440 con 0x56180ccadc00 2024-09-13T23:57:25.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.193+0000 7fc1e0a26f40 20 rados_obj.operate() r=0 bl.length=352 2024-09-13T23:57:25.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.193+0000 7fc1e0a26f40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 info.flags=0x17 2024-09-13T23:57:25.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.193+0000 7fc1e0a26f40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 to cache LRU end 2024-09-13T23:57:25.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.193+0000 7fc1e0a26f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:25.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.193+0000 7fc1e0a26f40 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:57:25.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.193+0000 7fc1e0a26f40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 2024-09-13T23:57:25.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.193+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 4.2b 4:d57f2d30:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ceba400 con 0x56180ccad400 2024-09-13T23:57:25.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.197+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(64 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.197+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:65 4.15 4:aaf67c7b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ceba800 con 0x56180ccadc00 2024-09-13T23:57:25.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.197+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(65 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x56180cd65440 con 0x56180ccadc00 2024-09-13T23:57:25.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.197+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 4.28 4:1613359b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cebac00 con 0x56180ccad400 2024-09-13T23:57:25.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.197+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(66 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.2 [call out=425b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.197+0000 7fc1e0a26f40 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-13T23:57:25.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.197+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 4.3e 4:7dca22ea:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cebb000 con 0x56180ccad400 2024-09-13T23:57:25.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.197+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(67 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.3 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.197+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:68 4.36 4:6f6c54df:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cebb400 con 0x56180ccad000 2024-09-13T23:57:25.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.197+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(68 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.197+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 4.8 4:10285c9b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cebb800 con 0x56180ccadc00 2024-09-13T23:57:25.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.201+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(69 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x56180cd65440 con 0x56180ccadc00 2024-09-13T23:57:25.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.201+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:70 4.d 4:b108c65f:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cebbc00 con 0x56180ccad400 2024-09-13T23:57:25.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.201+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(70 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.6 [call out=426b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+426 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.201+0000 7fc1e0a26f40 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-13T23:57:25.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.201+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:71 4.1c 4:381ea2d8:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ceba400 con 0x56180cd6c000 2024-09-13T23:57:25.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.201+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(71 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.201+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:72 4.19 4:9ac035f5:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cebac00 con 0x56180ccadc00 2024-09-13T23:57:25.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.201+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(72 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.8 [call out=423b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+423 (crc 0 0 0) 0x56180cd65440 con 0x56180ccadc00 2024-09-13T23:57:25.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.201+0000 7fc1e0a26f40 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-13T23:57:25.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.201+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:73 4.35 4:ad228511:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cebb000 con 0x56180ccad000 2024-09-13T23:57:25.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.205+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(73 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.205+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:74 4.1f 4:fb646659:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ceba000 con 0x56180ccad400 2024-09-13T23:57:25.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.205+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(74 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.10 [call out=697b] v0'0 uv9 ondisk = 0) v8 ==== 195+0+697 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.205+0000 7fc1e0a26f40 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-13T23:57:25.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.205+0000 7fc1e0a26f40 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-13T23:57:25.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.205+0000 7fc1e0a26f40 20 get_obj_state: rctx=0x56180c9978f0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x56180cebc1e8 s->prefetch_data=0 2024-09-13T23:57:25.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.205+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:75 3.1s0 3:838dc6f8:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ceba000 con 0x56180ccad000 2024-09-13T23:57:25.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.205+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(75 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.205+0000 7fc1e0a26f40 10 manifest: total_size = 6 2024-09-13T23:57:25.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.205+0000 7fc1e0a26f40 20 get_obj_state: setting s->obj_tag to d342d0db-d035-4a54-bae7-2e0f76db6818.4232.5141852224329744664 2024-09-13T23:57:25.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.205+0000 7fc1e0a26f40 20 get_obj_state: rctx=0x56180c9978f0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x56180cebc1e8 s->prefetch_data=0 2024-09-13T23:57:25.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.205+0000 7fc1e0a26f40 20 prepare_atomic_modification: state is not atomic. state=0x56180cebc1e8 2024-09-13T23:57:25.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.205+0000 7fc1e0a26f40 20 bucket index object: default.rgw.buckets.index:.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.2 2024-09-13T23:57:25.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.205+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:76 4.28 4:1613359b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5c000 con 0x56180ccad400 2024-09-13T23:57:25.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.209+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(76 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.2 [stat,call,call] v35'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.209+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:77 3.1s0 3:838dc6f8:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5c400 con 0x56180ccad000 2024-09-13T23:57:25.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.213+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(77 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5_9c8454ddf7aa50116496bac348d7550d [call] v35'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.213+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:78 4.28 4:1613359b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5cc00 con 0x56180ccad400 2024-09-13T23:57:25.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.213+0000 7fc1e0a26f40 20 get_obj_state: rctx=0x56180c9978f0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x56180cebc1e8 s->prefetch_data=0 2024-09-13T23:57:25.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.213+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:79 3.17s0 3:e9d26b8d:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5d000 con 0x56180ccad000 2024-09-13T23:57:25.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.213+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(79 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.213+0000 7fc1e0a26f40 10 manifest: total_size = 3 2024-09-13T23:57:25.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.213+0000 7fc1e0a26f40 20 get_obj_state: setting s->obj_tag to d342d0db-d035-4a54-bae7-2e0f76db6818.4232.15446145756273582022 2024-09-13T23:57:25.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.213+0000 7fc1e0a26f40 20 get_obj_state: rctx=0x56180c9978f0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x56180cebc1e8 s->prefetch_data=0 2024-09-13T23:57:25.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.213+0000 7fc1e0a26f40 20 prepare_atomic_modification: state is not atomic. state=0x56180cebc1e8 2024-09-13T23:57:25.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.213+0000 7fc1e0a26f40 20 bucket index object: default.rgw.buckets.index:.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.6 2024-09-13T23:57:25.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.213+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:80 4.d 4:b108c65f:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5b000 con 0x56180ccad400 2024-09-13T23:57:25.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.213+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(78 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.2 [stat,call,call] v35'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.213+0000 7fc1d99d4700 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-13T23:57:25.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.217+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== osd_op_reply(80 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.6 [stat,call,call] v35'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.217+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:81 3.17s0 3:e9d26b8d:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5ac00 con 0x56180ccad000 2024-09-13T23:57:25.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.221+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(81 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5_b1b9a972ccd8c962a473909b97007eb4 [call] v35'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.221+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:82 4.d 4:b108c65f:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cd6d400 con 0x56180ccad400 2024-09-13T23:57:25.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.221+0000 7fc1e0a26f40 20 get_obj_state: rctx=0x56180c9978f0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x56180cebc1e8 s->prefetch_data=0 2024-09-13T23:57:25.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.221+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:83 3.3cs0 3:3cb1d34e:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cebb400 con 0x56180cd6c000 2024-09-13T23:57:25.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.221+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(83 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=873b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+889 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.221+0000 7fc1e0a26f40 10 manifest: total_size = 4 2024-09-13T23:57:25.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.221+0000 7fc1e0a26f40 20 get_obj_state: setting s->obj_tag to d342d0db-d035-4a54-bae7-2e0f76db6818.4232.39881516532676925 2024-09-13T23:57:25.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.221+0000 7fc1e0a26f40 20 get_obj_state: rctx=0x56180c9978f0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x56180cebc1e8 s->prefetch_data=0 2024-09-13T23:57:25.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.221+0000 7fc1e0a26f40 20 prepare_atomic_modification: state is not atomic. state=0x56180cebc1e8 2024-09-13T23:57:25.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.221+0000 7fc1e0a26f40 20 bucket index object: default.rgw.buckets.index:.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.8 2024-09-13T23:57:25.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.221+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:84 4.19 4:9ac035f5:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ceba400 con 0x56180ccadc00 2024-09-13T23:57:25.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.221+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== osd_op_reply(82 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.6 [stat,call,call] v35'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.221+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== osd_op_reply(84 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.8 [stat,call,call] v35'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x56180cd65440 con 0x56180ccadc00 2024-09-13T23:57:25.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.221+0000 7fc1d91d3700 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-13T23:57:25.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.225+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:85 3.3cs0 3:3cb1d34e:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5dc00 con 0x56180cd6c000 2024-09-13T23:57:25.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.225+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(85 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v35'4 uv4 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.225+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:86 4.19 4:9ac035f5:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5a000 con 0x56180ccadc00 2024-09-13T23:57:25.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.225+0000 7fc1e0a26f40 20 get_obj_state: rctx=0x56180c9978f0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x56180cebc1e8 s->prefetch_data=0 2024-09-13T23:57:25.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.225+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:87 3.18s0 3:1b49f1ed:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5b400 con 0x56180ccadc00 2024-09-13T23:57:25.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.225+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 20 ==== osd_op_reply(87 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x56180cd65680 con 0x56180ccadc00 2024-09-13T23:57:25.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.225+0000 7fc1e0a26f40 10 manifest: total_size = 5 2024-09-13T23:57:25.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.225+0000 7fc1e0a26f40 20 get_obj_state: setting s->obj_tag to d342d0db-d035-4a54-bae7-2e0f76db6818.4232.6185971656258285376 2024-09-13T23:57:25.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.225+0000 7fc1e0a26f40 20 get_obj_state: rctx=0x56180c9978f0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x56180cebc1e8 s->prefetch_data=0 2024-09-13T23:57:25.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.225+0000 7fc1e0a26f40 20 prepare_atomic_modification: state is not atomic. state=0x56180cebc1e8 2024-09-13T23:57:25.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.225+0000 7fc1e0a26f40 20 bucket index object: default.rgw.buckets.index:.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.10 2024-09-13T23:57:25.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.225+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:88 4.1f 4:fb646659:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5bc00 con 0x56180ccad400 2024-09-13T23:57:25.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.229+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 21 ==== osd_op_reply(86 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.8 [stat,call,call] v35'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x56180cd65680 con 0x56180ccadc00 2024-09-13T23:57:25.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.229+0000 7fc1d99d4700 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-13T23:57:25.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.229+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 27 ==== osd_op_reply(88 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.10 [stat,call,call] v35'10 uv10 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.229+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:89 3.18s0 3:1b49f1ed:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5a000 con 0x56180ccadc00 2024-09-13T23:57:25.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.233+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 22 ==== osd_op_reply(89 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5_24d27c169c2c881eb09a065116f2aa5c [call] v35'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x56180cd65680 con 0x56180ccadc00 2024-09-13T23:57:25.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.233+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:90 4.1f 4:fb646659:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ceba800 con 0x56180ccad400 2024-09-13T23:57:25.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.233+0000 7fc1e0a26f40 20 get_obj_state: rctx=0x56180c9978f0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x56180cebc1e8 s->prefetch_data=0 2024-09-13T23:57:25.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.233+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:91 3.12s0 3:4b709470:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cebb800 con 0x56180cd6c000 2024-09-13T23:57:25.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.233+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 18 ==== osd_op_reply(91 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+927 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.233+0000 7fc1e0a26f40 10 manifest: total_size = 5 2024-09-13T23:57:25.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.233+0000 7fc1e0a26f40 20 get_obj_state: setting s->obj_tag to _KrUD1oH0URv5J5tkeS4amnpJZ8OgT3o 2024-09-13T23:57:25.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.233+0000 7fc1e0a26f40 20 get_obj_state: rctx=0x56180c9978f0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x56180cebc1e8 s->prefetch_data=0 2024-09-13T23:57:25.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.233+0000 7fc1e0a26f40 20 prepare_atomic_modification: state is not atomic. state=0x56180cebc1e8 2024-09-13T23:57:25.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.233+0000 7fc1e0a26f40 20 bucket index object: default.rgw.buckets.index:.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.10 2024-09-13T23:57:25.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.233+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:92 4.1f 4:fb646659:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cebac00 con 0x56180ccad400 2024-09-13T23:57:25.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.237+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 28 ==== osd_op_reply(90 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.10 [stat,call,call] v35'11 uv11 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.237+0000 7fc1d91d3700 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-13T23:57:25.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.237+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 29 ==== osd_op_reply(92 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.10 [stat,call,call] v35'12 uv12 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.237+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:93 3.12s0 3:4b709470:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ceba400 con 0x56180cd6c000 2024-09-13T23:57:25.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 19 ==== osd_op_reply(93 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5_bb3aec0fdcdbc2974890f805c585d432 [call] v35'4 uv4 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:94 4.1f 4:fb646659:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ceba000 con 0x56180ccad400 2024-09-13T23:57:25.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1e0a26f40 20 list_objects_ordered: starting attempt 1 2024-09-13T23:57:25.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1e0a26f40 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T23:57:25.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:95 4.2b 4:d57f2d30:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cebb400 con 0x56180ccad400 2024-09-13T23:57:25.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:96 4.15 4:aaf67c7b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cebb800 con 0x56180ccadc00 2024-09-13T23:57:25.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:97 4.28 4:1613359b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5c400 con 0x56180ccad400 2024-09-13T23:57:25.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:98 4.3e 4:7dca22ea:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5d000 con 0x56180ccad400 2024-09-13T23:57:25.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:99 4.36 4:6f6c54df:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5dc00 con 0x56180ccad000 2024-09-13T23:57:25.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:100 4.8 4:10285c9b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5b400 con 0x56180ccadc00 2024-09-13T23:57:25.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:101 4.d 4:b108c65f:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5ac00 con 0x56180ccad400 2024-09-13T23:57:25.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:102 4.1c 4:381ea2d8:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cd6d000 con 0x56180cd6c000 2024-09-13T23:57:25.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:103 4.19 4:9ac035f5:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cebbc00 con 0x56180ccadc00 2024-09-13T23:57:25.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:104 4.35 4:ad228511:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ceba800 con 0x56180ccad000 2024-09-13T23:57:25.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:105 4.1f 4:fb646659:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cebac00 con 0x56180ccad400 2024-09-13T23:57:25.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 24 ==== osd_op_reply(104 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 25 ==== osd_op_reply(99 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 20 ==== osd_op_reply(102 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 23 ==== osd_op_reply(96 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x56180cd65680 con 0x56180ccadc00 2024-09-13T23:57:25.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 30 ==== osd_op_reply(98 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.3 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 24 ==== osd_op_reply(100 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x56180cd65680 con 0x56180ccadc00 2024-09-13T23:57:25.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 25 ==== osd_op_reply(103 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.8 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x56180cd65680 con 0x56180ccadc00 2024-09-13T23:57:25.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 31 ==== osd_op_reply(97 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.2 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 32 ==== osd_op_reply(95 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 33 ==== osd_op_reply(101 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.6 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 34 ==== osd_op_reply(94 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.10 [stat,call,call] v35'13 uv13 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1d99d4700 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-13T23:57:25.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 35 ==== osd_op_reply(105 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.10 [call out=124b] v0'0 uv13 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1e0a26f40 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T23:57:25.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1e0a26f40 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T23:57:25.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1e0a26f40 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T23:57:25.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1e0a26f40 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T23:57:25.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1e0a26f40 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5])"; uploads.size()=0; is_truncated=0 2024-09-13T23:57:25.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1e0a26f40 10 lifecycle: RGWRados::convert_old_bucket_info(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5]) 2024-09-13T23:57:25.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1e0a26f40 10 lifecycle: cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x17, cached=0x11) 2024-09-13T23:57:25.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1e0a26f40 20 lifecycle: rados->read ofs=0 len=0 2024-09-13T23:57:25.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.241+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:106 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ceba000 con 0x56180cd6c000 2024-09-13T23:57:25.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.245+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 21 ==== osd_op_reply(106 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv33 ondisk = 0) v8 ==== 275+0+304 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.245+0000 7fc1e0a26f40 20 lifecycle: rados_obj.operate() r=0 bl.length=165 2024-09-13T23:57:25.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.245+0000 7fc1e0a26f40 10 lifecycle: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T23:57:25.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.245+0000 7fc1e0a26f40 10 lifecycle: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:57:25.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.245+0000 7fc1e0a26f40 10 lifecycle: updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:25.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.245+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:107 8.0 8:05e2f469:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.5:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5bc00 con 0x56180ccadc00 2024-09-13T23:57:25.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.245+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 26 ==== osd_op_reply(107 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 [delete,create,call,call,writefull 0~352,setxattr (123)] v35'2 uv2 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x56180cd65680 con 0x56180ccadc00 2024-09-13T23:57:25.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.245+0000 7fc1e0a26f40 10 lifecycle: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 info.flags=0x17 2024-09-13T23:57:25.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.245+0000 7fc1e0a26f40 10 lifecycle: moving default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 to cache LRU end 2024-09-13T23:57:25.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.245+0000 7fc1e0a26f40 10 lifecycle: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:57:25.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.245+0000 7fc1e0a26f40 10 lifecycle: distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5, ofs0, ns] 2024-09-13T23:57:25.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.245+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [notify cookie 94661294681472 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5c000 con 0x56180ccad400 2024-09-13T23:57:25.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.249+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 36 ==== watch-notify(notify (1) cookie 94661292999680 notify 150323855396 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x56180cc65380 con 0x56180ccad400 2024-09-13T23:57:25.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.249+0000 7fc1d99d4700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855396 cookie 94661292999680 notifier 4711 bl.length()=725 2024-09-13T23:57:25.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.249+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 37 ==== osd_op_reply(108 notify.2 [notify cookie 94661294681472 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.249+0000 7fc1d99d4700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 info.flags=0x17 2024-09-13T23:57:25.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.249+0000 7fc1d99d4700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 to cache LRU end 2024-09-13T23:57:25.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.249+0000 7fc1d99d4700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:57:25.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.249+0000 7fc1d99d4700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5a000 con 0x56180ccad400 2024-09-13T23:57:25.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.249+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 38 ==== osd_op_reply(109 notify.2 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.249+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 39 ==== watch-notify(notify_complete (2) cookie 94661294681472 notify 150323855396 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56180cc65520 con 0x56180ccad400 2024-09-13T23:57:25.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.249+0000 7fc1e0a26f40 20 lifecycle: handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5]): orig_sources= new_sources= 2024-09-13T23:57:25.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.249+0000 7fc1e0a26f40 20 lifecycle: handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5]): potential sources added=[] removed=[] 2024-09-13T23:57:25.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.249+0000 7fc1e0a26f40 20 lifecycle: handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5]): orig_dests= new_dests= 2024-09-13T23:57:25.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.249+0000 7fc1e0a26f40 20 lifecycle: handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5]): potential dests added=[] removed=[] 2024-09-13T23:57:25.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.249+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:33 6.1f 6:ffe20264:lc::lc.0:head [call lock.lock in=65b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5cc00 con 0x56180cc5b800 2024-09-13T23:57:25.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.253+0000 7fc1df9e0700 1 -- 172.21.15.173:0/2368674266 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(33 lc.0 [call] v35'30 uv30 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180cc5b800 2024-09-13T23:57:25.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.253+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:34 6.1f 6:ffe20264:lc::lc.0:head [call rgw.lc_rm_entry in=92b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cebb800 con 0x56180cc5b800 2024-09-13T23:57:25.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.253+0000 7fc1df9e0700 1 -- 172.21.15.173:0/2368674266 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(34 lc.0 [call] v35'31 uv31 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180cc5b800 2024-09-13T23:57:25.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.253+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 6.1f 6:ffe20264:lc::lc.0:head [call lock.unlock in=49b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cebbc00 con 0x56180cc5b800 2024-09-13T23:57:25.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.257+0000 7fc1df9e0700 1 -- 172.21.15.173:0/2368674266 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(35 lc.0 [call] v35'32 uv32 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180cc5b800 2024-09-13T23:57:25.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.257+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:110 4.2b 4:d57f2d30:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cebb000 con 0x56180ccad400 2024-09-13T23:57:25.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.257+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:111 4.15 4:aaf67c7b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cd6d400 con 0x56180ccadc00 2024-09-13T23:57:25.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.257+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:112 4.28 4:1613359b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cd6dc00 con 0x56180ccad400 2024-09-13T23:57:25.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.257+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:113 4.3e 4:7dca22ea:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5c800 con 0x56180ccad400 2024-09-13T23:57:25.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.257+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:114 4.36 4:6f6c54df:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5bc00 con 0x56180ccad000 2024-09-13T23:57:25.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.257+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:115 4.8 4:10285c9b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5c400 con 0x56180ccadc00 2024-09-13T23:57:25.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.257+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:116 4.d 4:b108c65f:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5d000 con 0x56180ccad400 2024-09-13T23:57:25.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.257+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:117 4.1c 4:381ea2d8:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5c000 con 0x56180cd6c000 2024-09-13T23:57:25.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.257+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:118 4.19 4:9ac035f5:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5c800 con 0x56180ccadc00 2024-09-13T23:57:25.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.257+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:119 4.35 4:ad228511:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cd6dc00 con 0x56180ccad000 2024-09-13T23:57:25.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.257+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:120 4.1f 4:fb646659:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cebb400 con 0x56180ccad400 2024-09-13T23:57:25.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.257+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 40 ==== osd_op_reply(110 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.257+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 26 ==== osd_op_reply(114 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.257+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 41 ==== osd_op_reply(113 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.3 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.257+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 42 ==== osd_op_reply(112 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.2 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.257+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 43 ==== osd_op_reply(116 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.6 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.257+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 22 ==== osd_op_reply(117 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.257+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 44 ==== osd_op_reply(120 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.10 [call out=124b] v0'0 uv13 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.257+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 27 ==== osd_op_reply(119 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.257+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 27 ==== osd_op_reply(111 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x56180cd65680 con 0x56180ccadc00 2024-09-13T23:57:25.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.257+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 28 ==== osd_op_reply(115 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x56180cd65680 con 0x56180ccadc00 2024-09-13T23:57:25.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.257+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 29 ==== osd_op_reply(118 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.8 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x56180cd65680 con 0x56180ccadc00 2024-09-13T23:57:25.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.257+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:121 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cebac00 con 0x56180cd6c000 2024-09-13T23:57:25.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.261+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 23 ==== osd_op_reply(121 foo.buckets [call] v35'36 uv36 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.261+0000 7fc1e0a26f40 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x17) 2024-09-13T23:57:25.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.261+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:122 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cebb000 con 0x56180cd6c000 2024-09-13T23:57:25.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.261+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 24 ==== osd_op_reply(122 myfoo [call,call,delete] v35'37 uv37 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.261+0000 7fc1e0a26f40 10 removing default.rgw.meta+root+myfoo from cache 2024-09-13T23:57:25.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.261+0000 7fc1e0a26f40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T23:57:25.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.261+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:123 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94661294681472 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5ac00 con 0x56180ccadc00 2024-09-13T23:57:25.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.261+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 30 ==== watch-notify(notify (1) cookie 94661293004288 notify 150323855381 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x56180cdd09c0 con 0x56180ccadc00 2024-09-13T23:57:25.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.261+0000 7fc1d91d3700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855381 cookie 94661293004288 notifier 4711 bl.length()=149 2024-09-13T23:57:25.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.261+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 31 ==== osd_op_reply(123 notify.6 [notify cookie 94661294681472 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x56180cd65680 con 0x56180ccadc00 2024-09-13T23:57:25.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.261+0000 7fc1d91d3700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:124 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5dc00 con 0x56180ccadc00 2024-09-13T23:57:25.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.261+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 32 ==== watch-notify(notify_complete (2) cookie 94661294681472 notify 150323855381 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56180cdd0b60 con 0x56180ccadc00 2024-09-13T23:57:25.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.265+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 33 ==== osd_op_reply(124 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd65680 con 0x56180ccadc00 2024-09-13T23:57:25.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.265+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:125 8.0 8:05e2f469:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5a000 con 0x56180ccadc00 2024-09-13T23:57:25.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.265+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 34 ==== osd_op_reply(125 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 [call,call,delete] v35'3 uv3 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x56180cd65680 con 0x56180ccadc00 2024-09-13T23:57:25.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.265+0000 7fc1e0a26f40 10 removing default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 from cache 2024-09-13T23:57:25.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.265+0000 7fc1e0a26f40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5, ofs0, ns] 2024-09-13T23:57:25.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.265+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:126 7.15 7:a93a5511:::notify.2:head [notify cookie 94661294681472 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5bc00 con 0x56180ccad400 2024-09-13T23:57:25.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.265+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 45 ==== watch-notify(notify (1) cookie 94661292999680 notify 150323855397 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x56180cc65520 con 0x56180ccad400 2024-09-13T23:57:25.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.265+0000 7fc1d91d3700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855397 cookie 94661292999680 notifier 4711 bl.length()=206 2024-09-13T23:57:25.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.265+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 46 ==== osd_op_reply(126 notify.2 [notify cookie 94661294681472 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.265+0000 7fc1d91d3700 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:127 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cd6d000 con 0x56180ccad400 2024-09-13T23:57:25.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.269+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 47 ==== watch-notify(notify_complete (2) cookie 94661294681472 notify 150323855397 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56180cc656c0 con 0x56180ccad400 2024-09-13T23:57:25.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.269+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 48 ==== osd_op_reply(127 notify.2 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.269+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:128 4.2b 4:d57f2d30:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ceba400 con 0x56180ccad400 2024-09-13T23:57:25.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.269+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:129 4.15 4:aaf67c7b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ceba800 con 0x56180ccadc00 2024-09-13T23:57:25.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.269+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:130 4.28 4:1613359b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ceba000 con 0x56180ccad400 2024-09-13T23:57:25.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.269+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:131 4.3e 4:7dca22ea:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cebb800 con 0x56180ccad400 2024-09-13T23:57:25.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.269+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:132 4.36 4:6f6c54df:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cebbc00 con 0x56180ccad000 2024-09-13T23:57:25.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.269+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:133 4.8 4:10285c9b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5cc00 con 0x56180ccadc00 2024-09-13T23:57:25.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.269+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:134 4.d 4:b108c65f:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ceda000 con 0x56180ccad400 2024-09-13T23:57:25.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.269+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:135 4.1c 4:381ea2d8:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ceda400 con 0x56180cd6c000 2024-09-13T23:57:25.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.269+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:136 4.19 4:9ac035f5:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ceda800 con 0x56180ccadc00 2024-09-13T23:57:25.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.269+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:137 4.35 4:ad228511:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cedac00 con 0x56180ccad000 2024-09-13T23:57:25.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.269+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:138 4.1f 4:fb646659:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cedb000 con 0x56180ccad400 2024-09-13T23:57:25.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.269+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 25 ==== osd_op_reply(135 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.7 [delete] v35'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.273+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 49 ==== osd_op_reply(134 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.6 [delete] v35'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.273+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 50 ==== osd_op_reply(131 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.3 [delete] v35'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.273+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 51 ==== osd_op_reply(130 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.2 [delete] v35'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.273+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 28 ==== osd_op_reply(132 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.4 [delete] v35'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.273+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 52 ==== osd_op_reply(128 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.0 [delete] v35'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.273+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 53 ==== osd_op_reply(138 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.10 [delete] v35'14 uv14 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.273+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 29 ==== osd_op_reply(137 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.9 [delete] v35'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.273+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 35 ==== osd_op_reply(136 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.8 [delete] v35'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x56180cd65680 con 0x56180ccadc00 2024-09-13T23:57:25.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.273+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 36 ==== osd_op_reply(133 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.5 [delete] v35'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x56180cd65680 con 0x56180ccadc00 2024-09-13T23:57:25.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.273+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 37 ==== osd_op_reply(129 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5.1 [delete] v35'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x56180cd65680 con 0x56180ccadc00 2024-09-13T23:57:25.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.273+0000 7fc1e0a26f40 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 : miss 2024-09-13T23:57:25.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.273+0000 7fc1e0a26f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.273+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:139 6.c 6:36d5deba:::pubsub..bucket.myfoo%2fd342d0db-d035-4a54-bae7-2e0f76db6818.4234.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cedb400 con 0x56180ccadc00 2024-09-13T23:57:25.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.273+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 38 ==== osd_op_reply(139 pubsub..bucket.myfoo/d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x56180cd65680 con 0x56180ccadc00 2024-09-13T23:57:25.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.273+0000 7fc1e0a26f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.273+0000 7fc1e0a26f40 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 info.flags=0x0 2024-09-13T23:57:25.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.273+0000 7fc1e0a26f40 10 adding default.rgw.log++pubsub..bucket.myfoo/d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 to cache LRU end 2024-09-13T23:57:25.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.273+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:140 6.c 6:36d5deba:::pubsub..bucket.myfoo%2fd342d0db-d035-4a54-bae7-2e0f76db6818.4234.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cedb800 con 0x56180ccadc00 2024-09-13T23:57:25.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.273+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 39 ==== osd_op_reply(140 pubsub..bucket.myfoo/d342d0db-d035-4a54-bae7-2e0f76db6818.4234.5 [delete] v35'11 uv10 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x56180cd65680 con 0x56180ccadc00 2024-09-13T23:57:25.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.273+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:141 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cedbc00 con 0x56180cd6c000 2024-09-13T23:57:25.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.277+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 26 ==== osd_op_reply(141 foo.buckets [call] v35'38 uv38 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.277+0000 7fc1c61ad700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:25.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.277+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:142 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94661294678016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5c400 con 0x56180ccad000 2024-09-13T23:57:25.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.281+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 30 ==== osd_op_reply(142 data_loggenerations_metadata [watch unwatch cookie 94661294678016] v35'186 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.281+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:143 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94661292997376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5c800 con 0x56180ccad400 2024-09-13T23:57:25.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.281+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 54 ==== osd_op_reply(143 notify.0 [watch unwatch cookie 94661292997376] v35'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.281+0000 7fc1e0a26f40 20 remove_watcher() i=0 2024-09-13T23:57:25.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.281+0000 7fc1e0a26f40 2 removed watcher, disabling cache 2024-09-13T23:57:25.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.281+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:144 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94661292998528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5dc00 con 0x56180ccad000 2024-09-13T23:57:25.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.285+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.1 v2:172.21.15.173:6808/3256211813 31 ==== osd_op_reply(144 notify.1 [watch unwatch cookie 94661292998528] v35'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180ccad000 2024-09-13T23:57:25.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.285+0000 7fc1e0a26f40 20 remove_watcher() i=1 2024-09-13T23:57:25.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.285+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:145 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94661292999680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5cc00 con 0x56180ccad400 2024-09-13T23:57:25.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.289+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 55 ==== osd_op_reply(145 notify.2 [watch unwatch cookie 94661292999680] v35'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.289+0000 7fc1e0a26f40 20 remove_watcher() i=2 2024-09-13T23:57:25.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.289+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:146 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94661293000832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ceba800 con 0x56180cd6c000 2024-09-13T23:57:25.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.289+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 27 ==== osd_op_reply(146 notify.3 [watch unwatch cookie 94661293000832] v35'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.289+0000 7fc1e0a26f40 20 remove_watcher() i=3 2024-09-13T23:57:25.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.289+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:147 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94661293001984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5ac00 con 0x56180ccad400 2024-09-13T23:57:25.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.293+0000 7fc1df1df700 1 -- 172.21.15.173:0/3468523891 <== osd.0 v2:172.21.15.87:6800/3507919120 56 ==== osd_op_reply(147 notify.4 [watch unwatch cookie 94661293001984] v35'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd65200 con 0x56180ccad400 2024-09-13T23:57:25.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.293+0000 7fc1e0a26f40 20 remove_watcher() i=4 2024-09-13T23:57:25.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.293+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:148 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94661293003136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cc5a000 con 0x56180ccadc00 2024-09-13T23:57:25.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.293+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 40 ==== osd_op_reply(148 notify.5 [watch unwatch cookie 94661293003136] v35'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd65680 con 0x56180ccadc00 2024-09-13T23:57:25.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.293+0000 7fc1e0a26f40 20 remove_watcher() i=5 2024-09-13T23:57:25.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.293+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:149 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94661293004288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180cd6d400 con 0x56180ccadc00 2024-09-13T23:57:25.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.297+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 <== osd.3 v2:172.21.15.173:6800/4020038786 41 ==== osd_op_reply(149 notify.6 [watch unwatch cookie 94661293004288] v35'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd65680 con 0x56180ccadc00 2024-09-13T23:57:25.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.297+0000 7fc1e0a26f40 20 remove_watcher() i=6 2024-09-13T23:57:25.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.297+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:150 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94661293005440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56180ce5d000 con 0x56180cd6c000 2024-09-13T23:57:25.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.297+0000 7fc1df9e0700 1 -- 172.21.15.173:0/3468523891 <== osd.2 v2:172.21.15.173:6809/889985573 28 ==== osd_op_reply(150 notify.7 [watch unwatch cookie 94661293005440] v35'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56180cd64b40 con 0x56180cd6c000 2024-09-13T23:57:25.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.297+0000 7fc1e0a26f40 20 remove_watcher() i=7 2024-09-13T23:57:25.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.297+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56180ccad400 msgr2=0x56180cbee100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.297+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/3468523891 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56180ccad400 0x56180cbee100 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.297+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56180ccad000 msgr2=0x56180cbedb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.297+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/3468523891 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56180ccad000 0x56180cbedb80 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.297+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56180cd6c000 msgr2=0x56180cbeec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.297+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/3468523891 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56180cd6c000 0x56180cbeec00 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.297+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56180ccadc00 msgr2=0x56180cbee680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.297+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/3468523891 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56180ccadc00 0x56180cbee680 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.297+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56180ccacc00 msgr2=0x56180cbed600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.297+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/3468523891 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56180ccacc00 0x56180cbed600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x56180cbe7920 tx=0x56180ca0b800 comp rx=0 tx=0).stop 2024-09-13T23:57:25.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.297+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907800 msgr2=0x56180cbecb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.297+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/3468523891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907800 0x56180cbecb00 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x56180d77e960 tx=0x56180cc66cc0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.297+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 reap_dead start 2024-09-13T23:57:25.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.297+0000 7fc1de9de700 1 -- 172.21.15.173:0/3468523891 reap_dead start 2024-09-13T23:57:25.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.297+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 shutdown_connections 2024-09-13T23:57:25.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.297+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 >> 172.21.15.173:0/3468523891 conn(0x56180c907400 msgr2=0x56180ca07800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.297+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 shutdown_connections 2024-09-13T23:57:25.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.297+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/3468523891 wait complete. 2024-09-13T23:57:25.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56180cd6d800 msgr2=0x56180cbef700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/2368674266 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56180cd6d800 0x56180cbef700 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56180cc5a400 msgr2=0x56180ce0b080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/2368674266 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56180cc5a400 0x56180ce0b080 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56180cd6c800 msgr2=0x56180ce0a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/2368674266 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56180cd6c800 0x56180ce0a580 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56180cc5b800 msgr2=0x56180ce0ab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/2368674266 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56180cc5b800 0x56180ce0ab00 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56180ccad800 msgr2=0x56180ce0a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/2368674266 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56180ccad800 0x56180ce0a000 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x56180cd056e0 tx=0x56180cd535c0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180cd6c400 msgr2=0x56180cbef180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/2368674266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180cd6c400 0x56180cbef180 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x56180cd86390 tx=0x56180cd525a0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1df1df700 1 -- 172.21.15.173:0/2368674266 reap_dead start 2024-09-13T23:57:25.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 shutdown_connections 2024-09-13T23:57:25.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/2368674266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180cd6c400 0x56180cbef180 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 >> 172.21.15.173:0/2368674266 conn(0x56180cc5a800 msgr2=0x56180ca08000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 shutdown_connections 2024-09-13T23:57:25.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2368674266 wait complete. 2024-09-13T23:57:25.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2441792993 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56180ccac000 msgr2=0x56180cbed080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/2441792993 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56180ccac000 0x56180cbed080 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x56180cc8e450 tx=0x56180cc66240 comp rx=0 tx=0).stop 2024-09-13T23:57:25.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2441792993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907000 msgr2=0x56180cbec580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/2441792993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907000 0x56180cbec580 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x56180ca63fb0 tx=0x56180ca0ba40 comp rx=0 tx=0).stop 2024-09-13T23:57:25.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2441792993 shutdown_connections 2024-09-13T23:57:25.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/2441792993 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56180ccac000 0x56180cbed080 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 --2- 172.21.15.173:0/2441792993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56180c907000 0x56180cbec580 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2441792993 >> 172.21.15.173:0/2441792993 conn(0x56180c906c00 msgr2=0x56180ca07000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2441792993 shutdown_connections 2024-09-13T23:57:25.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.301+0000 7fc1e0a26f40 1 -- 172.21.15.173:0/2441792993 wait complete. 2024-09-13T23:57:25.312 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T23:57:25.312 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T23:57:25.312 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-13T23:57:25.351 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:25.351 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:25.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.345+0000 7f1af6c7ff40 1 Processor -- start 2024-09-13T23:57:25.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.345+0000 7f1af6c7ff40 1 -- start start 2024-09-13T23:57:25.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.345+0000 7f1af6c7ff40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x56268dd2b400 0x56268e010580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.345+0000 7f1af6c7ff40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56268ddef500 con 0x56268dd2b000 2024-09-13T23:57:25.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.345+0000 7f1af6c7ff40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x56268ddb8a00 con 0x56268dd2b400 2024-09-13T23:57:25.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.345+0000 7f1af4c37700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x56268dd2b400 0x56268e010580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.345+0000 7f1af5438700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x56268dd2b000 0x56268de2a800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:44924/0 (socket says 172.21.15.173:44924) 2024-09-13T23:57:25.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.345+0000 7f1af4c37700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x56268dd2b400 0x56268e010580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35012/0 (socket says 172.21.15.173:35012) 2024-09-13T23:57:25.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.345+0000 7f1af5438700 1 -- 172.21.15.173:0/2991175422 learned_addr learned my addr 172.21.15.173:0/2991175422 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:25.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.345+0000 7f1af4436700 1 -- 172.21.15.173:0/2991175422 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954438403 0 0) 0x56268de86000 con 0x56268dd2b000 2024-09-13T23:57:25.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.345+0000 7f1af4436700 1 -- 172.21.15.173:0/2991175422 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x56268ddef680 con 0x56268dd2b000 2024-09-13T23:57:25.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.345+0000 7f1af4c37700 1 -- 172.21.15.173:0/2991175422 >> v1:172.21.15.87:6789/0 conn(0x56268dd2b000 legacy=0x56268de2a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.345+0000 7f1af4c37700 1 -- 172.21.15.173:0/2991175422 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56268dd3dd40 con 0x56268dd2b400 2024-09-13T23:57:25.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.349+0000 7f1af4c37700 1 --2- 172.21.15.173:0/2991175422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b400 0x56268e010580 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x56268e00b920 tx=0x56268de2f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16849944dcc2f5b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.349+0000 7f1af4436700 1 -- 172.21.15.173:0/2991175422 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56268ddcf4a0 con 0x56268dd2b400 2024-09-13T23:57:25.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.349+0000 7f1af4436700 1 -- 172.21.15.173:0/2991175422 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56268ddef500 con 0x56268dd2b400 2024-09-13T23:57:25.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.349+0000 7f1af4436700 1 -- 172.21.15.173:0/2991175422 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56268ddcf600 con 0x56268dd2b400 2024-09-13T23:57:25.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.349+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2991175422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b400 msgr2=0x56268e010580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.349+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/2991175422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b400 0x56268e010580 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x56268e00b920 tx=0x56268de2f980 comp rx=0 tx=0).stop 2024-09-13T23:57:25.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.349+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2991175422 shutdown_connections 2024-09-13T23:57:25.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.349+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/2991175422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b400 0x56268e010580 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.349+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2991175422 >> 172.21.15.173:0/2991175422 conn(0x56268dd2ac00 msgr2=0x56268de2a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.349+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2991175422 shutdown_connections 2024-09-13T23:57:25.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.349+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2991175422 wait complete. 2024-09-13T23:57:25.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.349+0000 7f1af6c7ff40 1 Processor -- start 2024-09-13T23:57:25.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.349+0000 7f1af6c7ff40 1 -- start start 2024-09-13T23:57:25.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.349+0000 7f1af6c7ff40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b000 0x56268e010580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.349+0000 7f1af6c7ff40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56268ddb8500 con 0x56268dd2b000 2024-09-13T23:57:25.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.349+0000 7f1af5438700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b000 0x56268e010580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.349+0000 7f1af5438700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b000 0x56268e010580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35016/0 (socket says 172.21.15.173:35016) 2024-09-13T23:57:25.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.349+0000 7f1af5438700 1 -- 172.21.15.173:0/2513663845 learned_addr learned my addr 172.21.15.173:0/2513663845 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.349+0000 7f1af5438700 1 -- 172.21.15.173:0/2513663845 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56268dd3dba0 con 0x56268dd2b000 2024-09-13T23:57:25.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.349+0000 7f1af5438700 1 --2- 172.21.15.173:0/2513663845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b000 0x56268e010580 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x56268eaf5d70 tx=0x56268de2fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f948922c31cad834 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.349+0000 7f1af3c35700 1 -- 172.21.15.173:0/2513663845 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56268ddcf4a0 con 0x56268dd2b000 2024-09-13T23:57:25.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.353+0000 7f1af3c35700 1 -- 172.21.15.173:0/2513663845 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56268ddefb00 con 0x56268dd2b000 2024-09-13T23:57:25.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.353+0000 7f1af3c35700 1 -- 172.21.15.173:0/2513663845 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56268ddcf600 con 0x56268dd2b000 2024-09-13T23:57:25.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.353+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2513663845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b000 msgr2=0x56268e010580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.353+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/2513663845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b000 0x56268e010580 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x56268eaf5d70 tx=0x56268de2fb60 comp rx=0 tx=0).stop 2024-09-13T23:57:25.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.353+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2513663845 shutdown_connections 2024-09-13T23:57:25.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.353+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/2513663845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b000 0x56268e010580 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.353+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2513663845 >> 172.21.15.173:0/2513663845 conn(0x56268dd2ac00 msgr2=0x56268de2b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.353+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2513663845 shutdown_connections 2024-09-13T23:57:25.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.353+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2513663845 wait complete. 2024-09-13T23:57:25.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.353+0000 7f1af6c7ff40 1 Processor -- start 2024-09-13T23:57:25.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.353+0000 7f1af6c7ff40 1 -- start start 2024-09-13T23:57:25.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.353+0000 7f1af6c7ff40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b000 0x56268e010580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.353+0000 7f1af6c7ff40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56268ddb83c0 con 0x56268dd2b000 2024-09-13T23:57:25.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.353+0000 7f1af5438700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b000 0x56268e010580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.353+0000 7f1af5438700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b000 0x56268e010580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35026/0 (socket says 172.21.15.173:35026) 2024-09-13T23:57:25.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.353+0000 7f1af5438700 1 -- 172.21.15.173:0/337479696 learned_addr learned my addr 172.21.15.173:0/337479696 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.353+0000 7f1af5438700 1 -- 172.21.15.173:0/337479696 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56268dd3da00 con 0x56268dd2b000 2024-09-13T23:57:25.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.353+0000 7f1af5438700 1 --2- 172.21.15.173:0/337479696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b000 0x56268e010580 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x56268eaf5e60 tx=0x56268de2f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.353+0000 7f1af2432700 1 -- 172.21.15.173:0/337479696 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56268ddcf8c0 con 0x56268dd2b000 2024-09-13T23:57:25.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.353+0000 7f1af2432700 1 -- 172.21.15.173:0/337479696 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56268ddefc80 con 0x56268dd2b000 2024-09-13T23:57:25.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.353+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/337479696 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56268dd3d860 con 0x56268dd2b000 2024-09-13T23:57:25.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.353+0000 7f1af2432700 1 -- 172.21.15.173:0/337479696 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56268ddcf4a0 con 0x56268dd2b000 2024-09-13T23:57:25.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.353+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/337479696 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56268dd3d6c0 con 0x56268dd2b000 2024-09-13T23:57:25.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.357+0000 7f1af6c7ff40 1 Processor -- start 2024-09-13T23:57:25.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.357+0000 7f1af2432700 1 -- 172.21.15.173:0/337479696 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x56268de24b00 con 0x56268dd2b000 2024-09-13T23:57:25.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.357+0000 7f1af6c7ff40 1 -- start start 2024-09-13T23:57:25.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.357+0000 7f1af2432700 1 --2- 172.21.15.173:0/337479696 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56268e0d0000 0x56268e011080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.357+0000 7f1af2432700 1 -- 172.21.15.173:0/337479696 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x56268dd91180 con 0x56268dd2b000 2024-09-13T23:57:25.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.357+0000 7f1af6c7ff40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b800 0x56268e010b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.357+0000 7f1af6c7ff40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56268dd50640 con 0x56268dd2b800 2024-09-13T23:57:25.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.357+0000 7f1af5c39700 1 --2- 172.21.15.173:0/337479696 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56268e0d0000 0x56268e011080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.357+0000 7f1af5438700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b800 0x56268e010b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.357+0000 7f1af5438700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b800 0x56268e010b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35042/0 (socket says 172.21.15.173:35042) 2024-09-13T23:57:25.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.357+0000 7f1af5438700 1 -- 172.21.15.173:0/4121345873 learned_addr learned my addr 172.21.15.173:0/4121345873 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.357+0000 7f1af5438700 1 -- 172.21.15.173:0/4121345873 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56268dd3c000 con 0x56268dd2b800 2024-09-13T23:57:25.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.357+0000 7f1af5c39700 1 --2- 172.21.15.173:0/337479696 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56268e0d0000 0x56268e011080 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x56268e052d80 tx=0x56268e08ade0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.357+0000 7f1af5438700 1 --2- 172.21.15.173:0/4121345873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b800 0x56268e010b00 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x56268e052300 tx=0x56268e08a240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbca47488af62665 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.357+0000 7f1aefc2d700 1 -- 172.21.15.173:0/4121345873 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56268ddcf600 con 0x56268dd2b800 2024-09-13T23:57:25.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.357+0000 7f1aefc2d700 1 -- 172.21.15.173:0/4121345873 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56268ddefc80 con 0x56268dd2b800 2024-09-13T23:57:25.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.357+0000 7f1aefc2d700 1 -- 172.21.15.173:0/4121345873 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56268ddcfa20 con 0x56268dd2b800 2024-09-13T23:57:25.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.361+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/4121345873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b800 msgr2=0x56268e010b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.361+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/4121345873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b800 0x56268e010b00 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x56268e052300 tx=0x56268e08a240 comp rx=0 tx=0).stop 2024-09-13T23:57:25.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.361+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/4121345873 shutdown_connections 2024-09-13T23:57:25.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.361+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/4121345873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b800 0x56268e010b00 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.361+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/4121345873 >> 172.21.15.173:0/4121345873 conn(0x56268dd2b400 msgr2=0x56268de2b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.361+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/4121345873 shutdown_connections 2024-09-13T23:57:25.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.361+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/4121345873 wait complete. 2024-09-13T23:57:25.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.361+0000 7f1af6c7ff40 1 Processor -- start 2024-09-13T23:57:25.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.361+0000 7f1af6c7ff40 1 -- start start 2024-09-13T23:57:25.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.361+0000 7f1af6c7ff40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b800 0x56268e010b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.361+0000 7f1af6c7ff40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56268dd508c0 con 0x56268dd2b800 2024-09-13T23:57:25.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.361+0000 7f1af5438700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b800 0x56268e010b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.361+0000 7f1af5438700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b800 0x56268e010b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35044/0 (socket says 172.21.15.173:35044) 2024-09-13T23:57:25.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.361+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 learned_addr learned my addr 172.21.15.173:0/2578038917 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.361+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56268dd3cea0 con 0x56268dd2b800 2024-09-13T23:57:25.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.361+0000 7f1af5438700 1 --2- 172.21.15.173:0/2578038917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b800 0x56268e010b00 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x56268e0b8a50 tx=0x56268e08afc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.361+0000 7f1aee42a700 1 -- 172.21.15.173:0/2578038917 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56268ddcf600 con 0x56268dd2b800 2024-09-13T23:57:25.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.361+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56268dd3c820 con 0x56268dd2b800 2024-09-13T23:57:25.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.361+0000 7f1aee42a700 1 -- 172.21.15.173:0/2578038917 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56268e0f2000 con 0x56268dd2b800 2024-09-13T23:57:25.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.361+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56268dd3c9c0 con 0x56268dd2b800 2024-09-13T23:57:25.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.361+0000 7f1aee42a700 1 -- 172.21.15.173:0/2578038917 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56268ddcfa20 con 0x56268dd2b800 2024-09-13T23:57:25.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1af6c7ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1aee42a700 1 -- 172.21.15.173:0/2578038917 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x56268de24dc0 con 0x56268dd2b800 2024-09-13T23:57:25.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1aee42a700 1 --2- 172.21.15.173:0/2578038917 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56268e0d1000 0x56268e011600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1aee42a700 1 -- 172.21.15.173:0/2578038917 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x56268dd91340 con 0x56268dd2b800 2024-09-13T23:57:25.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/2578038917 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56268e0d1400 0x56268e011b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1af4c37700 1 --2- 172.21.15.173:0/2578038917 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56268e0d1000 0x56268e011600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e0d1800 con 0x56268e0d1400 2024-09-13T23:57:25.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1af5c39700 1 --2- 172.21.15.173:0/2578038917 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56268e0d1400 0x56268e011b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1af4c37700 1 --2- 172.21.15.173:0/2578038917 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56268e0d1000 0x56268e011600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x56268e00b920 tx=0x56268de2f800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1af5c39700 1 --2- 172.21.15.173:0/2578038917 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56268e0d1400 0x56268e011b80 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56268e142b40 con 0x56268e0d1400 2024-09-13T23:57:25.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1af6c7ff40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1af6c7ff40 20 realm 2024-09-13T23:57:25.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1af6c7ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e0d1c00 con 0x56268e0d1400 2024-09-13T23:57:25.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56268e142b40 con 0x56268e0d1400 2024-09-13T23:57:25.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1af6c7ff40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1af6c7ff40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:25.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1af6c7ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e0d1800 con 0x56268e0d1400 2024-09-13T23:57:25.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56268e142b40 con 0x56268e0d1400 2024-09-13T23:57:25.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1af6c7ff40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1af6c7ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/2578038917 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56268e0d1c00 0x56268e012100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.365+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e0d1c00 2024-09-13T23:57:25.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.369+0000 7f1af5438700 1 --2- 172.21.15.173:0/2578038917 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56268e0d1c00 0x56268e012100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.369+0000 7f1af5438700 1 --2- 172.21.15.173:0/2578038917 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56268e0d1c00 0x56268e012100 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.369+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x56268e143200 con 0x56268e0d1c00 2024-09-13T23:57:25.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.369+0000 7f1af6c7ff40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:25.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.369+0000 7f1af6c7ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.369+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/2578038917 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56268e162400 0x56268e012680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.369+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162800 con 0x56268e162400 2024-09-13T23:57:25.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.369+0000 7f1af4c37700 1 --2- 172.21.15.173:0/2578038917 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56268e162400 0x56268e012680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.369+0000 7f1af4c37700 1 --2- 172.21.15.173:0/2578038917 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56268e162400 0x56268e012680 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.369+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x56268e143440 con 0x56268e162400 2024-09-13T23:57:25.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.369+0000 7f1af6c7ff40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:25.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.369+0000 7f1af6c7ff40 20 searching for the correct realm 2024-09-13T23:57:25.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.369+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162c00 con 0x56268e162400 2024-09-13T23:57:25.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.369+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x56268e143440 con 0x56268e162400 2024-09-13T23:57:25.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.369+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162800 con 0x56268e0d1c00 2024-09-13T23:57:25.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.373+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e143200 con 0x56268e0d1c00 2024-09-13T23:57:25.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.373+0000 7f1af5438700 1 --2- 172.21.15.173:0/2578038917 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56268e162800 0x56268e012c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.373+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e162800 2024-09-13T23:57:25.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.373+0000 7f1af5c39700 1 --2- 172.21.15.173:0/2578038917 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56268e162800 0x56268e012c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.373+0000 7f1af5c39700 1 --2- 172.21.15.173:0/2578038917 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56268e162800 0x56268e012c00 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.373+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e142b40 con 0x56268e162800 2024-09-13T23:57:25.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.373+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e162800 2024-09-13T23:57:25.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.373+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x56268e142b40 con 0x56268e162800 2024-09-13T23:57:25.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.373+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e0d1400 2024-09-13T23:57:25.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.373+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e142b40 con 0x56268e0d1400 2024-09-13T23:57:25.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.373+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e162400 2024-09-13T23:57:25.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.373+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e143440 con 0x56268e162400 2024-09-13T23:57:25.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.373+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e0d1400 2024-09-13T23:57:25.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.373+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e142b40 con 0x56268e0d1400 2024-09-13T23:57:25.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.373+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e0d1c00 2024-09-13T23:57:25.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.377+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e143200 con 0x56268e0d1c00 2024-09-13T23:57:25.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.377+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e0d1c00 2024-09-13T23:57:25.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.377+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e143200 con 0x56268e0d1c00 2024-09-13T23:57:25.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.377+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e0d1400 2024-09-13T23:57:25.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.377+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e142b40 con 0x56268e0d1400 2024-09-13T23:57:25.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.377+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e162800 2024-09-13T23:57:25.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.377+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e142b40 con 0x56268e162800 2024-09-13T23:57:25.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.377+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e0d1400 2024-09-13T23:57:25.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.377+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e142b40 con 0x56268e0d1400 2024-09-13T23:57:25.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.377+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e162800 2024-09-13T23:57:25.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.377+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e142b40 con 0x56268e162800 2024-09-13T23:57:25.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.377+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e0d1c00 2024-09-13T23:57:25.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.381+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e143200 con 0x56268e0d1c00 2024-09-13T23:57:25.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.381+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e162400 2024-09-13T23:57:25.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.381+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e143440 con 0x56268e162400 2024-09-13T23:57:25.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.381+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e0d1400 2024-09-13T23:57:25.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.381+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e142b40 con 0x56268e0d1400 2024-09-13T23:57:25.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.381+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e0d1c00 2024-09-13T23:57:25.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.381+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e143200 con 0x56268e0d1c00 2024-09-13T23:57:25.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.381+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e162400 2024-09-13T23:57:25.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.381+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e143440 con 0x56268e162400 2024-09-13T23:57:25.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.381+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e0d1400 2024-09-13T23:57:25.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.381+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e142b40 con 0x56268e0d1400 2024-09-13T23:57:25.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.381+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e0d1400 2024-09-13T23:57:25.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.381+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e142b40 con 0x56268e0d1400 2024-09-13T23:57:25.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.385+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e0d1400 2024-09-13T23:57:25.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.385+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e142b40 con 0x56268e0d1400 2024-09-13T23:57:25.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.385+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e162400 2024-09-13T23:57:25.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.385+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e143440 con 0x56268e162400 2024-09-13T23:57:25.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.385+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e162800 2024-09-13T23:57:25.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.385+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e142b40 con 0x56268e162800 2024-09-13T23:57:25.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.385+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e0d1400 2024-09-13T23:57:25.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.385+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e142b40 con 0x56268e0d1400 2024-09-13T23:57:25.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.385+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e162800 2024-09-13T23:57:25.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.385+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e142b40 con 0x56268e162800 2024-09-13T23:57:25.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.385+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e162400 2024-09-13T23:57:25.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.385+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e143440 con 0x56268e162400 2024-09-13T23:57:25.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.385+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e162800 2024-09-13T23:57:25.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.389+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e142b40 con 0x56268e162800 2024-09-13T23:57:25.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.389+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e0d1c00 2024-09-13T23:57:25.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.389+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e143200 con 0x56268e0d1c00 2024-09-13T23:57:25.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.389+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e0d1c00 2024-09-13T23:57:25.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.389+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e143200 con 0x56268e0d1c00 2024-09-13T23:57:25.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.389+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e162400 2024-09-13T23:57:25.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.389+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e143440 con 0x56268e162400 2024-09-13T23:57:25.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.389+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e0d1c00 2024-09-13T23:57:25.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.389+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x56268e143200 con 0x56268e0d1c00 2024-09-13T23:57:25.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.389+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e0d1c00 2024-09-13T23:57:25.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56268e143200 con 0x56268e0d1c00 2024-09-13T23:57:25.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:25.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:25.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:25.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:25.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e163000 con 0x56268e0d1400 2024-09-13T23:57:25.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56268e142b40 con 0x56268e0d1400 2024-09-13T23:57:25.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e163400 con 0x56268e0d1c00 2024-09-13T23:57:25.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x56268e143200 con 0x56268e0d1c00 2024-09-13T23:57:25.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:25.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e163800 con 0x56268e162800 2024-09-13T23:57:25.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x56268e142b40 con 0x56268e162800 2024-09-13T23:57:25.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:25.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 20 zone default found 2024-09-13T23:57:25.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 4 Realm: () 2024-09-13T23:57:25.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:25.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:25.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:25.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 20 zonegroup default 2024-09-13T23:57:25.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e163c00 con 0x56268e162800 2024-09-13T23:57:25.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x56268e142b40 con 0x56268e162800 2024-09-13T23:57:25.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e163000 con 0x56268e162400 2024-09-13T23:57:25.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x56268e143440 con 0x56268e162400 2024-09-13T23:57:25.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.393+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e163800 con 0x56268e162400 2024-09-13T23:57:25.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.397+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x56268e143440 con 0x56268e162400 2024-09-13T23:57:25.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.397+0000 7f1af6c7ff40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.397+0000 7f1af6c7ff40 20 started sync module instance, tier type = 2024-09-13T23:57:25.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.397+0000 7f1af6c7ff40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:25.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.397+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e0d1800 con 0x56268e0d1c00 2024-09-13T23:57:25.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.397+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v35'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e143200 con 0x56268e0d1c00 2024-09-13T23:57:25.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.397+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94723591142144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e0d0800 con 0x56268e0d1c00 2024-09-13T23:57:25.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.397+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e0d1800 con 0x56268e0d1400 2024-09-13T23:57:25.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.401+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94723591142144] v35'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e143200 con 0x56268e0d1c00 2024-09-13T23:57:25.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.401+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v35'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e142b40 con 0x56268e0d1400 2024-09-13T23:57:25.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.401+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94723591143296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162000 con 0x56268e0d1400 2024-09-13T23:57:25.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.401+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e163400 con 0x56268e0d1c00 2024-09-13T23:57:25.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.405+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94723591143296] v35'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e142b40 con 0x56268e0d1400 2024-09-13T23:57:25.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.405+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v35'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e143200 con 0x56268e0d1c00 2024-09-13T23:57:25.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.405+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94723591144448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e166000 con 0x56268e0d1c00 2024-09-13T23:57:25.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.405+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e166400 con 0x56268e162800 2024-09-13T23:57:25.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.409+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94723591144448] v35'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e143200 con 0x56268e0d1c00 2024-09-13T23:57:25.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.409+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v35'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e142b40 con 0x56268e162800 2024-09-13T23:57:25.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.409+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94723591145600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e166800 con 0x56268e162800 2024-09-13T23:57:25.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.409+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e166c00 con 0x56268e0d1c00 2024-09-13T23:57:25.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.409+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94723591145600] v35'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e142b40 con 0x56268e162800 2024-09-13T23:57:25.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.413+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v35'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e143200 con 0x56268e0d1c00 2024-09-13T23:57:25.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.413+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94723591146752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e167000 con 0x56268e0d1c00 2024-09-13T23:57:25.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.413+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e167400 con 0x56268e162400 2024-09-13T23:57:25.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.413+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v35'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e143440 con 0x56268e162400 2024-09-13T23:57:25.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.413+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94723591147904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e167800 con 0x56268e162400 2024-09-13T23:57:25.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.413+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e167c00 con 0x56268e162400 2024-09-13T23:57:25.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.413+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94723591146752] v35'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e143200 con 0x56268e0d1c00 2024-09-13T23:57:25.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.417+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94723591147904] v35'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e143440 con 0x56268e162400 2024-09-13T23:57:25.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.417+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v35'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e143440 con 0x56268e162400 2024-09-13T23:57:25.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.417+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94723591149056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e167400 con 0x56268e162400 2024-09-13T23:57:25.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.417+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e166000 con 0x56268e162800 2024-09-13T23:57:25.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.417+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v35'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e142b40 con 0x56268e162800 2024-09-13T23:57:25.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.417+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94723591149056] v35'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e143440 con 0x56268e162400 2024-09-13T23:57:25.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.417+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94723591150208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e166c00 con 0x56268e162800 2024-09-13T23:57:25.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.417+0000 7f1af6c7ff40 20 add_watcher() i=0 2024-09-13T23:57:25.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.417+0000 7f1af6c7ff40 20 add_watcher() i=1 2024-09-13T23:57:25.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.417+0000 7f1af6c7ff40 20 add_watcher() i=2 2024-09-13T23:57:25.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.417+0000 7f1af6c7ff40 20 add_watcher() i=3 2024-09-13T23:57:25.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.417+0000 7f1af6c7ff40 20 add_watcher() i=4 2024-09-13T23:57:25.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.417+0000 7f1af6c7ff40 20 add_watcher() i=5 2024-09-13T23:57:25.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.417+0000 7f1af6c7ff40 20 add_watcher() i=6 2024-09-13T23:57:25.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.421+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94723591150208] v35'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e142b40 con 0x56268e162800 2024-09-13T23:57:25.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.421+0000 7f1af6c7ff40 20 add_watcher() i=7 2024-09-13T23:57:25.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.421+0000 7f1af6c7ff40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:25.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.421+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e162c00 con 0x56268e0d1400 2024-09-13T23:57:25.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.421+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x56268e142b40 con 0x56268e0d1400 2024-09-13T23:57:25.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.421+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94723592617984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e163000 con 0x56268e0d1400 2024-09-13T23:57:25.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.421+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94723592617984] v35'187 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x56268e142b40 con 0x56268e0d1400 2024-09-13T23:57:25.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.425+0000 7f1adc406700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:25.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.425+0000 7f1af6c7ff40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:25.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.425+0000 7f1af6c7ff40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:25.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.425+0000 7f1af6c7ff40 1 Processor -- start 2024-09-13T23:57:25.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.425+0000 7f1af6c7ff40 1 -- start start 2024-09-13T23:57:25.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.425+0000 7f1af6c7ff40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268e163400 0x56268e013180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.425+0000 7f1af6c7ff40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56268ddb83c0 con 0x56268e163400 2024-09-13T23:57:25.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.425+0000 7f1af4c37700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268e163400 0x56268e013180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.425+0000 7f1af4c37700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268e163400 0x56268e013180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35058/0 (socket says 172.21.15.173:35058) 2024-09-13T23:57:25.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.425+0000 7f1af4c37700 1 -- 172.21.15.173:0/2527673495 learned_addr learned my addr 172.21.15.173:0/2527673495 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.425+0000 7f1af4c37700 1 -- 172.21.15.173:0/2527673495 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56268dd3cb60 con 0x56268e163400 2024-09-13T23:57:25.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.425+0000 7f1af4c37700 1 --2- 172.21.15.173:0/2527673495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268e163400 0x56268e013180 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x56268e178000 tx=0x56268de2f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4686665b296e3cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.425+0000 7f1adbc05700 1 -- 172.21.15.173:0/2527673495 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56268ddcf760 con 0x56268e163400 2024-09-13T23:57:25.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.425+0000 7f1adbc05700 1 -- 172.21.15.173:0/2527673495 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56268e0f2a80 con 0x56268e163400 2024-09-13T23:57:25.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.425+0000 7f1adbc05700 1 -- 172.21.15.173:0/2527673495 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56268e16e160 con 0x56268e163400 2024-09-13T23:57:25.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.425+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2527673495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268e163400 msgr2=0x56268e013180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.425+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/2527673495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268e163400 0x56268e013180 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x56268e178000 tx=0x56268de2f9e0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.425+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2527673495 shutdown_connections 2024-09-13T23:57:25.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.425+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/2527673495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268e163400 0x56268e013180 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.425+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2527673495 >> 172.21.15.173:0/2527673495 conn(0x56268e163800 msgr2=0x56268de2c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.425+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2527673495 shutdown_connections 2024-09-13T23:57:25.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.425+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2527673495 wait complete. 2024-09-13T23:57:25.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.429+0000 7f1af6c7ff40 1 Processor -- start 2024-09-13T23:57:25.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.429+0000 7f1af6c7ff40 1 -- start start 2024-09-13T23:57:25.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.429+0000 7f1af6c7ff40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268e163400 0x56268e013180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.429+0000 7f1af6c7ff40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56268ddb8500 con 0x56268e163400 2024-09-13T23:57:25.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.429+0000 7f1af4c37700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268e163400 0x56268e013180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.429+0000 7f1af4c37700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268e163400 0x56268e013180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35072/0 (socket says 172.21.15.173:35072) 2024-09-13T23:57:25.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.429+0000 7f1af4c37700 1 -- 172.21.15.173:0/2752519711 learned_addr learned my addr 172.21.15.173:0/2752519711 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.429+0000 7f1af4c37700 1 -- 172.21.15.173:0/2752519711 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56268dd3cd00 con 0x56268e163400 2024-09-13T23:57:25.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.429+0000 7f1af4c37700 1 --2- 172.21.15.173:0/2752519711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268e163400 0x56268e013180 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x56268e178210 tx=0x56268e14e5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.429+0000 7f1ada402700 1 -- 172.21.15.173:0/2752519711 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56268e16e2c0 con 0x56268e163400 2024-09-13T23:57:25.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.429+0000 7f1ada402700 1 -- 172.21.15.173:0/2752519711 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56268e0f2780 con 0x56268e163400 2024-09-13T23:57:25.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.429+0000 7f1ada402700 1 -- 172.21.15.173:0/2752519711 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56268e16e420 con 0x56268e163400 2024-09-13T23:57:25.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.429+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2752519711 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56268dd3c340 con 0x56268e163400 2024-09-13T23:57:25.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.429+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2752519711 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56268dd3dd40 con 0x56268e163400 2024-09-13T23:57:25.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.429+0000 7f1ada402700 1 -- 172.21.15.173:0/2752519711 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x56268de25b80 con 0x56268e163400 2024-09-13T23:57:25.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.433+0000 7f1ada402700 1 --2- 172.21.15.173:0/2752519711 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56268e162c00 0x56268e1fe000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.433+0000 7f1ada402700 1 -- 172.21.15.173:0/2752519711 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x56268dd916c0 con 0x56268e163400 2024-09-13T23:57:25.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.433+0000 7f1af6c7ff40 5 note: GC not initialized 2024-09-13T23:57:25.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.433+0000 7f1af5c39700 1 --2- 172.21.15.173:0/2752519711 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56268e162c00 0x56268e1fe000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.433+0000 7f1af5c39700 1 --2- 172.21.15.173:0/2752519711 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56268e162c00 0x56268e1fe000 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x56268e111710 tx=0x56268e08ad80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.433+0000 7f1ad7bfd700 20 reqs_thread_entry: start 2024-09-13T23:57:25.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.433+0000 7f1af6c7ff40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:25.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.433+0000 7f1af6c7ff40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:25.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.433+0000 7f1ad53f8700 20 reqs_thread_entry: start 2024-09-13T23:57:25.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.433+0000 7f1af6c7ff40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:57:25.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.433+0000 7f1af6c7ff40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.433+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e0d0800 con 0x56268e0d1400 2024-09-13T23:57:25.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.433+0000 7f1ad5bf9700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:55 2024 2024-09-13T23:57:25.441 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:25.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.433+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv16 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x56268e142b40 con 0x56268e0d1400 2024-09-13T23:57:25.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.433+0000 7f1af6c7ff40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:57:25.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.433+0000 7f1af6c7ff40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:57:25.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.433+0000 7f1af6c7ff40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:25.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.433+0000 7f1af6c7ff40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:25.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.433+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~369 in=369b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e166800 con 0x56268e0d1400 2024-09-13T23:57:25.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.437+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~369] v35'17 uv17 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x56268e142b40 con 0x56268e0d1400 2024-09-13T23:57:25.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.437+0000 7f1af6c7ff40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:57:25.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.437+0000 7f1af6c7ff40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:25.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.437+0000 7f1af6c7ff40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:57:25.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.437+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94723592620288 in=557b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e166000 con 0x56268e0d1c00 2024-09-13T23:57:25.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.437+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== watch-notify(notify (1) cookie 94723591146752 notify 150323855398 ret 0) v3 ==== 587+0+0 (crc 0 0 0) 0x56268dd3d860 con 0x56268e0d1c00 2024-09-13T23:57:25.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.437+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(64 notify.4 [notify cookie 94723592620288 out=8b] v0'0 uv180 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x56268e143200 con 0x56268e0d1c00 2024-09-13T23:57:25.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.437+0000 7f1aefc2d700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855398 cookie 94723591146752 notifier 4719 bl.length()=545 2024-09-13T23:57:25.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.437+0000 7f1aefc2d700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:57:25.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.437+0000 7f1aefc2d700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:25.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.437+0000 7f1aefc2d700 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e268000 con 0x56268e0d1c00 2024-09-13T23:57:25.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.441+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e143200 con 0x56268e0d1c00 2024-09-13T23:57:25.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.441+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== watch-notify(notify_complete (2) cookie 94723592620288 notify 150323855398 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56268e050000 con 0x56268e0d1c00 2024-09-13T23:57:25.446 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:25.446 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "foo", 2024-09-13T23:57:25.446 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Foo", 2024-09-13T23:57:25.446 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "foo@foo.com", 2024-09-13T23:57:25.446 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:57:25.446 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:57:25.446 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [], 2024-09-13T23:57:25.446 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:57:25.446 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:25.447 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:57:25.447 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-09-13T23:57:25.447 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-09-13T23:57:25.447 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:25.447 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:25.447 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [], 2024-09-13T23:57:25.447 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [ 2024-09-13T23:57:25.447 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:25.447 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "user", 2024-09-13T23:57:25.447 INFO:teuthology.orchestra.run.smithi173.stdout: "perm": "read" 2024-09-13T23:57:25.447 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:25.447 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:25.447 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:57:25.447 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:57:25.448 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:57:25.448 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:57:25.448 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:57:25.448 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:25.448 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:25.448 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:25.448 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:25.448 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:25.448 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:25.448 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:57:25.448 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:25.448 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:25.448 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:25.448 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:25.449 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:25.449 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:25.449 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:57:25.449 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:57:25.449 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:57:25.449 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:25.449 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:57:25.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.441+0000 7f1adc406700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:25.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.441+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94723592617984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e166c00 con 0x56268e0d1400 2024-09-13T23:57:25.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.445+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94723592617984] v35'188 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x56268e142b40 con 0x56268e0d1400 2024-09-13T23:57:25.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.445+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94723591142144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e167000 con 0x56268e0d1c00 2024-09-13T23:57:25.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.445+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94723591142144] v35'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e143200 con 0x56268e0d1c00 2024-09-13T23:57:25.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.445+0000 7f1af6c7ff40 20 remove_watcher() i=0 2024-09-13T23:57:25.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.445+0000 7f1af6c7ff40 2 removed watcher, disabling cache 2024-09-13T23:57:25.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.445+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94723591143296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e166400 con 0x56268e0d1400 2024-09-13T23:57:25.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.449+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94723591143296] v35'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e142b40 con 0x56268e0d1400 2024-09-13T23:57:25.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.449+0000 7f1af6c7ff40 20 remove_watcher() i=1 2024-09-13T23:57:25.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.449+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94723591144448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e163000 con 0x56268e0d1c00 2024-09-13T23:57:25.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.453+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94723591144448] v35'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e143200 con 0x56268e0d1c00 2024-09-13T23:57:25.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.453+0000 7f1af6c7ff40 20 remove_watcher() i=2 2024-09-13T23:57:25.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.453+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94723591145600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e268800 con 0x56268e162800 2024-09-13T23:57:25.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.453+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94723591145600] v35'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e142b40 con 0x56268e162800 2024-09-13T23:57:25.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.453+0000 7f1af6c7ff40 20 remove_watcher() i=3 2024-09-13T23:57:25.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.453+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94723591146752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e268c00 con 0x56268e0d1c00 2024-09-13T23:57:25.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.457+0000 7f1af5438700 1 -- 172.21.15.173:0/2578038917 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94723591146752] v35'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e143200 con 0x56268e0d1c00 2024-09-13T23:57:25.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.457+0000 7f1af6c7ff40 20 remove_watcher() i=4 2024-09-13T23:57:25.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.457+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94723591147904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e269000 con 0x56268e162400 2024-09-13T23:57:25.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.457+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94723591147904] v35'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e143440 con 0x56268e162400 2024-09-13T23:57:25.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.461+0000 7f1af6c7ff40 20 remove_watcher() i=5 2024-09-13T23:57:25.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.461+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94723591149056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e269400 con 0x56268e162400 2024-09-13T23:57:25.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.461+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94723591149056] v35'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e143440 con 0x56268e162400 2024-09-13T23:57:25.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.461+0000 7f1af6c7ff40 20 remove_watcher() i=6 2024-09-13T23:57:25.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.461+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94723591150208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56268e269800 con 0x56268e162800 2024-09-13T23:57:25.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af5c39700 1 -- 172.21.15.173:0/2578038917 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94723591150208] v35'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56268e142b40 con 0x56268e162800 2024-09-13T23:57:25.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 20 remove_watcher() i=7 2024-09-13T23:57:25.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56268e0d1c00 msgr2=0x56268e012100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/2578038917 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56268e0d1c00 0x56268e012100 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56268e0d1400 msgr2=0x56268e011b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/2578038917 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56268e0d1400 0x56268e011b80 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56268e162800 msgr2=0x56268e012c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/2578038917 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56268e162800 0x56268e012c00 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56268e162400 msgr2=0x56268e012680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/2578038917 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56268e162400 0x56268e012680 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56268e0d1000 msgr2=0x56268e011600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/2578038917 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56268e0d1000 0x56268e011600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x56268e00b920 tx=0x56268de2f800 comp rx=0 tx=0).stop 2024-09-13T23:57:25.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b800 msgr2=0x56268e010b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/2578038917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b800 0x56268e010b00 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x56268e0b8a50 tx=0x56268e08afc0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 reap_dead start 2024-09-13T23:57:25.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af4c37700 1 -- 172.21.15.173:0/2578038917 reap_dead start 2024-09-13T23:57:25.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 shutdown_connections 2024-09-13T23:57:25.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 >> 172.21.15.173:0/2578038917 conn(0x56268dd2b400 msgr2=0x56268de2b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 shutdown_connections 2024-09-13T23:57:25.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2578038917 wait complete. 2024-09-13T23:57:25.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2752519711 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56268e162c00 msgr2=0x56268e1fe000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/2752519711 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56268e162c00 0x56268e1fe000 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x56268e111710 tx=0x56268e08ad80 comp rx=0 tx=0).stop 2024-09-13T23:57:25.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2752519711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268e163400 msgr2=0x56268e013180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/2752519711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268e163400 0x56268e013180 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x56268e178210 tx=0x56268e14e5a0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2752519711 shutdown_connections 2024-09-13T23:57:25.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/2752519711 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56268e162c00 0x56268e1fe000 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/2752519711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268e163400 0x56268e013180 secure :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0x56268e178210 tx=0x56268e14e5a0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2752519711 >> 172.21.15.173:0/2752519711 conn(0x56268e163800 msgr2=0x56268de2c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2752519711 shutdown_connections 2024-09-13T23:57:25.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/2752519711 wait complete. 2024-09-13T23:57:25.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/337479696 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56268e0d0000 msgr2=0x56268e011080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/337479696 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56268e0d0000 0x56268e011080 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x56268e052d80 tx=0x56268e08ade0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/337479696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b000 msgr2=0x56268e010580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/337479696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b000 0x56268e010580 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x56268eaf5e60 tx=0x56268de2f920 comp rx=0 tx=0).stop 2024-09-13T23:57:25.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/337479696 shutdown_connections 2024-09-13T23:57:25.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/337479696 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56268e0d0000 0x56268e011080 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 --2- 172.21.15.173:0/337479696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56268dd2b000 0x56268e010580 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/337479696 >> 172.21.15.173:0/337479696 conn(0x56268dd2ac00 msgr2=0x56268de2b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/337479696 shutdown_connections 2024-09-13T23:57:25.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.465+0000 7f1af6c7ff40 1 -- 172.21.15.173:0/337479696 wait complete. 2024-09-13T23:57:25.478 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:57:25.478 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T23:57:25.479 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T23:57:25.479 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-13T23:57:25.564 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:25.564 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:25.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.557+0000 7f4265ae0f40 1 Processor -- start 2024-09-13T23:57:25.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.557+0000 7f4265ae0f40 1 -- start start 2024-09-13T23:57:25.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.557+0000 7f4265ae0f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x557ff6979000 0x557ff6c5e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.557+0000 7f4265ae0f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557ff6a3d500 con 0x557ff6979400 2024-09-13T23:57:25.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.557+0000 7f4265ae0f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x557ff6a06a00 con 0x557ff6979000 2024-09-13T23:57:25.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.557+0000 7f4264299700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x557ff6979000 0x557ff6c5e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.557+0000 7f4263a98700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x557ff6979400 0x557ff6a78800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:44936/0 (socket says 172.21.15.173:44936) 2024-09-13T23:57:25.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.557+0000 7f4263a98700 1 -- 172.21.15.173:0/1854095257 learned_addr learned my addr 172.21.15.173:0/1854095257 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:25.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.561+0000 7f4264299700 1 -- 172.21.15.173:0/1854095257 >> v1:172.21.15.87:6789/0 conn(0x557ff6979400 legacy=0x557ff6a78800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.561+0000 7f4264299700 1 -- 172.21.15.173:0/1854095257 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ff698bd40 con 0x557ff6979000 2024-09-13T23:57:25.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.561+0000 7f4264299700 1 --2- 172.21.15.173:0/1854095257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979000 0x557ff6c5e580 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x557ff6c59a70 tx=0x557ff6a7d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=537a8bd0d6f9b9a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.561+0000 7f4263297700 1 -- 172.21.15.173:0/1854095257 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557ff6a1d4a0 con 0x557ff6979000 2024-09-13T23:57:25.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.561+0000 7f4263297700 1 -- 172.21.15.173:0/1854095257 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557ff6a3d800 con 0x557ff6979000 2024-09-13T23:57:25.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.561+0000 7f4263297700 1 -- 172.21.15.173:0/1854095257 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557ff6a1d600 con 0x557ff6979000 2024-09-13T23:57:25.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.561+0000 7f4265ae0f40 1 -- 172.21.15.173:0/1854095257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979000 msgr2=0x557ff6c5e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.561+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/1854095257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979000 0x557ff6c5e580 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x557ff6c59a70 tx=0x557ff6a7d920 comp rx=0 tx=0).stop 2024-09-13T23:57:25.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.561+0000 7f4265ae0f40 1 -- 172.21.15.173:0/1854095257 shutdown_connections 2024-09-13T23:57:25.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.561+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/1854095257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979000 0x557ff6c5e580 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.561+0000 7f4265ae0f40 1 -- 172.21.15.173:0/1854095257 >> 172.21.15.173:0/1854095257 conn(0x557ff6978c00 msgr2=0x557ff6a78000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.561+0000 7f4265ae0f40 1 -- 172.21.15.173:0/1854095257 shutdown_connections 2024-09-13T23:57:25.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.561+0000 7f4265ae0f40 1 -- 172.21.15.173:0/1854095257 wait complete. 2024-09-13T23:57:25.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.561+0000 7f4265ae0f40 1 Processor -- start 2024-09-13T23:57:25.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.561+0000 7f4265ae0f40 1 -- start start 2024-09-13T23:57:25.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.561+0000 7f4265ae0f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979000 0x557ff6c5e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.561+0000 7f4265ae0f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ff6a06500 con 0x557ff6979000 2024-09-13T23:57:25.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.561+0000 7f4264299700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979000 0x557ff6c5e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.561+0000 7f4264299700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979000 0x557ff6c5e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35098/0 (socket says 172.21.15.173:35098) 2024-09-13T23:57:25.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.561+0000 7f4264299700 1 -- 172.21.15.173:0/800139939 learned_addr learned my addr 172.21.15.173:0/800139939 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4264299700 1 -- 172.21.15.173:0/800139939 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ff698bba0 con 0x557ff6979000 2024-09-13T23:57:25.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4264299700 1 --2- 172.21.15.173:0/800139939 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979000 0x557ff6c5e580 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x557ff77dd800 tx=0x557ff6a7d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ebdc0a15c91916 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4262a96700 1 -- 172.21.15.173:0/800139939 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557ff6a1d760 con 0x557ff6979000 2024-09-13T23:57:25.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4262a96700 1 -- 172.21.15.173:0/800139939 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557ff6a3db00 con 0x557ff6979000 2024-09-13T23:57:25.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4262a96700 1 -- 172.21.15.173:0/800139939 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557ff6a1d4a0 con 0x557ff6979000 2024-09-13T23:57:25.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4265ae0f40 1 -- 172.21.15.173:0/800139939 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979000 msgr2=0x557ff6c5e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/800139939 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979000 0x557ff6c5e580 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x557ff77dd800 tx=0x557ff6a7d800 comp rx=0 tx=0).stop 2024-09-13T23:57:25.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4265ae0f40 1 -- 172.21.15.173:0/800139939 shutdown_connections 2024-09-13T23:57:25.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/800139939 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979000 0x557ff6c5e580 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4265ae0f40 1 -- 172.21.15.173:0/800139939 >> 172.21.15.173:0/800139939 conn(0x557ff6978c00 msgr2=0x557ff6a79000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4265ae0f40 1 -- 172.21.15.173:0/800139939 shutdown_connections 2024-09-13T23:57:25.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4265ae0f40 1 -- 172.21.15.173:0/800139939 wait complete. 2024-09-13T23:57:25.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4265ae0f40 1 Processor -- start 2024-09-13T23:57:25.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4265ae0f40 1 -- start start 2024-09-13T23:57:25.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4265ae0f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979000 0x557ff6c5e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4265ae0f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ff6a063c0 con 0x557ff6979000 2024-09-13T23:57:25.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4264299700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979000 0x557ff6c5e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4264299700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979000 0x557ff6c5e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35114/0 (socket says 172.21.15.173:35114) 2024-09-13T23:57:25.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4264299700 1 -- 172.21.15.173:0/668735778 learned_addr learned my addr 172.21.15.173:0/668735778 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4264299700 1 -- 172.21.15.173:0/668735778 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ff698ba00 con 0x557ff6979000 2024-09-13T23:57:25.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4264299700 1 --2- 172.21.15.173:0/668735778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979000 0x557ff6c5e580 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x557ff77dd6b0 tx=0x557ff6a7d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4261293700 1 -- 172.21.15.173:0/668735778 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557ff6a1d600 con 0x557ff6979000 2024-09-13T23:57:25.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4261293700 1 -- 172.21.15.173:0/668735778 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557ff6a3dc80 con 0x557ff6979000 2024-09-13T23:57:25.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4265ae0f40 1 -- 172.21.15.173:0/668735778 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557ff698b860 con 0x557ff6979000 2024-09-13T23:57:25.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4261293700 1 -- 172.21.15.173:0/668735778 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557ff6a1d8c0 con 0x557ff6979000 2024-09-13T23:57:25.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.565+0000 7f4265ae0f40 1 -- 172.21.15.173:0/668735778 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ff698b6c0 con 0x557ff6979000 2024-09-13T23:57:25.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.569+0000 7f4265ae0f40 1 Processor -- start 2024-09-13T23:57:25.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.569+0000 7f4265ae0f40 1 -- start start 2024-09-13T23:57:25.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.569+0000 7f4261293700 1 -- 172.21.15.173:0/668735778 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x557ff6a72b00 con 0x557ff6979000 2024-09-13T23:57:25.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.569+0000 7f4265ae0f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979800 0x557ff6c5eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.569+0000 7f4265ae0f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ff699e640 con 0x557ff6979800 2024-09-13T23:57:25.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.569+0000 7f4261293700 1 --2- 172.21.15.173:0/668735778 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x557ff6d20000 0x557ff6c5f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.569+0000 7f4261293700 1 -- 172.21.15.173:0/668735778 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x557ff69df180 con 0x557ff6979000 2024-09-13T23:57:25.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.569+0000 7f4264a9a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979800 0x557ff6c5eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.569+0000 7f4264299700 1 --2- 172.21.15.173:0/668735778 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x557ff6d20000 0x557ff6c5f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.569+0000 7f4264a9a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979800 0x557ff6c5eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35122/0 (socket says 172.21.15.173:35122) 2024-09-13T23:57:25.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.569+0000 7f4264a9a700 1 -- 172.21.15.173:0/3146931742 learned_addr learned my addr 172.21.15.173:0/3146931742 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.569+0000 7f4264a9a700 1 -- 172.21.15.173:0/3146931742 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ff698a000 con 0x557ff6979800 2024-09-13T23:57:25.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.569+0000 7f4264299700 1 --2- 172.21.15.173:0/668735778 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x557ff6d20000 0x557ff6c5f080 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x557ff77ed080 tx=0x557ff6ce6b40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.569+0000 7f4264a9a700 1 --2- 172.21.15.173:0/3146931742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979800 0x557ff6c5eb00 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x557ff77ec3f0 tx=0x557ff6ce6e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53483f9e0b7199c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.569+0000 7f425ea8e700 1 -- 172.21.15.173:0/3146931742 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557ff6a1d600 con 0x557ff6979800 2024-09-13T23:57:25.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.569+0000 7f425ea8e700 1 -- 172.21.15.173:0/3146931742 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557ff6d32000 con 0x557ff6979800 2024-09-13T23:57:25.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.569+0000 7f425ea8e700 1 -- 172.21.15.173:0/3146931742 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557ff6a1d8c0 con 0x557ff6979800 2024-09-13T23:57:25.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.573+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3146931742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979800 msgr2=0x557ff6c5eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.573+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/3146931742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979800 0x557ff6c5eb00 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x557ff77ec3f0 tx=0x557ff6ce6e40 comp rx=0 tx=0).stop 2024-09-13T23:57:25.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.573+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3146931742 shutdown_connections 2024-09-13T23:57:25.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.573+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/3146931742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979800 0x557ff6c5eb00 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.573+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3146931742 >> 172.21.15.173:0/3146931742 conn(0x557ff6979400 msgr2=0x557ff6a79800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.573+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3146931742 shutdown_connections 2024-09-13T23:57:25.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.573+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3146931742 wait complete. 2024-09-13T23:57:25.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.573+0000 7f4265ae0f40 1 Processor -- start 2024-09-13T23:57:25.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.573+0000 7f4265ae0f40 1 -- start start 2024-09-13T23:57:25.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.573+0000 7f4265ae0f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979800 0x557ff6c5eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.573+0000 7f4265ae0f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ff699e8c0 con 0x557ff6979800 2024-09-13T23:57:25.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.573+0000 7f4264a9a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979800 0x557ff6c5eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.573+0000 7f4264a9a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979800 0x557ff6c5eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35134/0 (socket says 172.21.15.173:35134) 2024-09-13T23:57:25.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.573+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 learned_addr learned my addr 172.21.15.173:0/3233267157 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.573+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ff698aea0 con 0x557ff6979800 2024-09-13T23:57:25.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.573+0000 7f4264a9a700 1 --2- 172.21.15.173:0/3233267157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979800 0x557ff6c5eb00 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x557ff77ec240 tx=0x557ff6ce6a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.573+0000 7f425d28b700 1 -- 172.21.15.173:0/3233267157 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557ff6a1d760 con 0x557ff6979800 2024-09-13T23:57:25.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.573+0000 7f425d28b700 1 -- 172.21.15.173:0/3233267157 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557ff6d32180 con 0x557ff6979800 2024-09-13T23:57:25.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.573+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557ff698a820 con 0x557ff6979800 2024-09-13T23:57:25.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.573+0000 7f425d28b700 1 -- 172.21.15.173:0/3233267157 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557ff6a1d600 con 0x557ff6979800 2024-09-13T23:57:25.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.573+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ff698a9c0 con 0x557ff6979800 2024-09-13T23:57:25.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.577+0000 7f425d28b700 1 -- 172.21.15.173:0/3233267157 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x557ff6a72dc0 con 0x557ff6979800 2024-09-13T23:57:25.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.577+0000 7f4265ae0f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.577+0000 7f425d28b700 1 --2- 172.21.15.173:0/3233267157 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x557ff6d20c00 0x557ff6c5f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.577+0000 7f425d28b700 1 -- 172.21.15.173:0/3233267157 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x557ff69df340 con 0x557ff6979800 2024-09-13T23:57:25.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.577+0000 7f4263a98700 1 --2- 172.21.15.173:0/3233267157 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x557ff6d20c00 0x557ff6c5f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.577+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/3233267157 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x557ff6d21000 0x557ff6c5fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.577+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21400 con 0x557ff6d21000 2024-09-13T23:57:25.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.577+0000 7f4264a9a700 1 --2- 172.21.15.173:0/3233267157 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x557ff6d21000 0x557ff6c5fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.577+0000 7f4263a98700 1 --2- 172.21.15.173:0/3233267157 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x557ff6d20c00 0x557ff6c5f600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x557ff6d23b30 tx=0x557ff6dd40c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.577+0000 7f4264a9a700 1 --2- 172.21.15.173:0/3233267157 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x557ff6d21000 0x557ff6c5fb80 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.577+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6d21000 2024-09-13T23:57:25.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.577+0000 7f4265ae0f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.577+0000 7f4265ae0f40 20 realm 2024-09-13T23:57:25.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.577+0000 7f4265ae0f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.577+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21000 2024-09-13T23:57:25.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.577+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6d21000 2024-09-13T23:57:25.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.577+0000 7f4265ae0f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.577+0000 7f4265ae0f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:25.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.581+0000 7f4265ae0f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.581+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21c00 con 0x557ff6d21000 2024-09-13T23:57:25.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.581+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6d21000 2024-09-13T23:57:25.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.581+0000 7f4265ae0f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.581+0000 7f4265ae0f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.581+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/3233267157 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x557ff6d21400 0x557ff6c60100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.581+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21400 2024-09-13T23:57:25.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.581+0000 7f4264299700 1 --2- 172.21.15.173:0/3233267157 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x557ff6d21400 0x557ff6c60100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.581+0000 7f4264299700 1 --2- 172.21.15.173:0/3233267157 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x557ff6d21400 0x557ff6c60100 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.581+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x557ff6ddb200 con 0x557ff6d21400 2024-09-13T23:57:25.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.581+0000 7f4265ae0f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:25.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.581+0000 7f4265ae0f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.581+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/3233267157 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x557ff6d21c00 0x557ff6c60680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.581+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6dea000 con 0x557ff6d21c00 2024-09-13T23:57:25.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.581+0000 7f4263a98700 1 --2- 172.21.15.173:0/3233267157 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x557ff6d21c00 0x557ff6c60680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.581+0000 7f4263a98700 1 --2- 172.21.15.173:0/3233267157 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x557ff6d21c00 0x557ff6c60680 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.585+0000 7f4263a98700 1 -- 172.21.15.173:0/3233267157 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x557ff6ddb440 con 0x557ff6d21c00 2024-09-13T23:57:25.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.585+0000 7f4265ae0f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:25.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.585+0000 7f4265ae0f40 20 searching for the correct realm 2024-09-13T23:57:25.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.585+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6dea400 con 0x557ff6d21c00 2024-09-13T23:57:25.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.585+0000 7f4263a98700 1 -- 172.21.15.173:0/3233267157 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x557ff6ddb440 con 0x557ff6d21c00 2024-09-13T23:57:25.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.585+0000 7f4263a98700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6dea000 con 0x557ff6d21400 2024-09-13T23:57:25.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.585+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddb200 con 0x557ff6d21400 2024-09-13T23:57:25.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.585+0000 7f4264299700 1 --2- 172.21.15.173:0/3233267157 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x557ff6dea000 0x557ff6c60c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.585+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6dea000 2024-09-13T23:57:25.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.585+0000 7f4264a9a700 1 --2- 172.21.15.173:0/3233267157 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x557ff6dea000 0x557ff6c60c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.585+0000 7f4264a9a700 1 --2- 172.21.15.173:0/3233267157 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x557ff6dea000 0x557ff6c60c00 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.585+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6dea000 2024-09-13T23:57:25.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.585+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6dea000 2024-09-13T23:57:25.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.585+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6dea000 2024-09-13T23:57:25.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.585+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21000 2024-09-13T23:57:25.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.589+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6d21000 2024-09-13T23:57:25.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.589+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21c00 2024-09-13T23:57:25.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.589+0000 7f4263a98700 1 -- 172.21.15.173:0/3233267157 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddb440 con 0x557ff6d21c00 2024-09-13T23:57:25.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.589+0000 7f4263a98700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21000 2024-09-13T23:57:25.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.589+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6d21000 2024-09-13T23:57:25.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.589+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21400 2024-09-13T23:57:25.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.589+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddb200 con 0x557ff6d21400 2024-09-13T23:57:25.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.589+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21400 2024-09-13T23:57:25.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.589+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddb200 con 0x557ff6d21400 2024-09-13T23:57:25.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.589+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21000 2024-09-13T23:57:25.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.589+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6d21000 2024-09-13T23:57:25.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.589+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6dea000 2024-09-13T23:57:25.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.589+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6dea000 2024-09-13T23:57:25.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.589+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21000 2024-09-13T23:57:25.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.593+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6d21000 2024-09-13T23:57:25.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.593+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6dea000 2024-09-13T23:57:25.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.593+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6dea000 2024-09-13T23:57:25.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.593+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21400 2024-09-13T23:57:25.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.593+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddb200 con 0x557ff6d21400 2024-09-13T23:57:25.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.593+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21c00 2024-09-13T23:57:25.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.593+0000 7f4263a98700 1 -- 172.21.15.173:0/3233267157 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddb440 con 0x557ff6d21c00 2024-09-13T23:57:25.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.593+0000 7f4263a98700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21000 2024-09-13T23:57:25.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.593+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6d21000 2024-09-13T23:57:25.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.593+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21400 2024-09-13T23:57:25.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.593+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddb200 con 0x557ff6d21400 2024-09-13T23:57:25.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.593+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21c00 2024-09-13T23:57:25.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.593+0000 7f4263a98700 1 -- 172.21.15.173:0/3233267157 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddb440 con 0x557ff6d21c00 2024-09-13T23:57:25.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.597+0000 7f4263a98700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21000 2024-09-13T23:57:25.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.597+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6d21000 2024-09-13T23:57:25.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.597+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21000 2024-09-13T23:57:25.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.597+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6d21000 2024-09-13T23:57:25.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.597+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21000 2024-09-13T23:57:25.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.597+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6d21000 2024-09-13T23:57:25.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.597+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21c00 2024-09-13T23:57:25.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.597+0000 7f4263a98700 1 -- 172.21.15.173:0/3233267157 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddb440 con 0x557ff6d21c00 2024-09-13T23:57:25.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.597+0000 7f4263a98700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6dea000 2024-09-13T23:57:25.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.597+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6dea000 2024-09-13T23:57:25.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.597+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21000 2024-09-13T23:57:25.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.597+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6d21000 2024-09-13T23:57:25.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.597+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6dea000 2024-09-13T23:57:25.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.601+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6dea000 2024-09-13T23:57:25.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.601+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21c00 2024-09-13T23:57:25.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.601+0000 7f4263a98700 1 -- 172.21.15.173:0/3233267157 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddb440 con 0x557ff6d21c00 2024-09-13T23:57:25.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.601+0000 7f4263a98700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6dea000 2024-09-13T23:57:25.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.601+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6dea000 2024-09-13T23:57:25.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.601+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21400 2024-09-13T23:57:25.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.601+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddb200 con 0x557ff6d21400 2024-09-13T23:57:25.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.601+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21400 2024-09-13T23:57:25.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.601+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddb200 con 0x557ff6d21400 2024-09-13T23:57:25.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.601+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21c00 2024-09-13T23:57:25.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.601+0000 7f4263a98700 1 -- 172.21.15.173:0/3233267157 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddb440 con 0x557ff6d21c00 2024-09-13T23:57:25.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.601+0000 7f4263a98700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21400 2024-09-13T23:57:25.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x557ff6ddb200 con 0x557ff6d21400 2024-09-13T23:57:25.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6d21400 2024-09-13T23:57:25.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557ff6ddb200 con 0x557ff6d21400 2024-09-13T23:57:25.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4265ae0f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:25.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4265ae0f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:25.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4265ae0f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:25.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4265ae0f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:25.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4265ae0f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6dea800 con 0x557ff6d21000 2024-09-13T23:57:25.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6d21000 2024-09-13T23:57:25.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4265ae0f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4265ae0f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6deac00 con 0x557ff6d21400 2024-09-13T23:57:25.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x557ff6ddb200 con 0x557ff6d21400 2024-09-13T23:57:25.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4265ae0f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:25.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4265ae0f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6deb000 con 0x557ff6dea000 2024-09-13T23:57:25.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6dea000 2024-09-13T23:57:25.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4265ae0f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:25.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4265ae0f40 20 zone default found 2024-09-13T23:57:25.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4265ae0f40 4 Realm: () 2024-09-13T23:57:25.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4265ae0f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:25.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4265ae0f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:25.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4265ae0f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:25.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4265ae0f40 20 zonegroup default 2024-09-13T23:57:25.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4265ae0f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6deb400 con 0x557ff6dea000 2024-09-13T23:57:25.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6dea000 2024-09-13T23:57:25.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4265ae0f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4265ae0f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.605+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6deb800 con 0x557ff6d21c00 2024-09-13T23:57:25.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.609+0000 7f4263a98700 1 -- 172.21.15.173:0/3233267157 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x557ff6ddb440 con 0x557ff6d21c00 2024-09-13T23:57:25.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.609+0000 7f4265ae0f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.609+0000 7f4265ae0f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.609+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6debc00 con 0x557ff6d21c00 2024-09-13T23:57:25.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.609+0000 7f4263a98700 1 -- 172.21.15.173:0/3233267157 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x557ff6ddb440 con 0x557ff6d21c00 2024-09-13T23:57:25.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.609+0000 7f4265ae0f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.609+0000 7f4265ae0f40 20 started sync module instance, tier type = 2024-09-13T23:57:25.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.609+0000 7f4265ae0f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:25.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.609+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6df0000 con 0x557ff6d21400 2024-09-13T23:57:25.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.613+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v35'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddb200 con 0x557ff6d21400 2024-09-13T23:57:25.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.613+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94008089336576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6df0400 con 0x557ff6d21400 2024-09-13T23:57:25.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.613+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6df0800 con 0x557ff6d21000 2024-09-13T23:57:25.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.613+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v35'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6d21000 2024-09-13T23:57:25.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.613+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94008089337728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6df0c00 con 0x557ff6d21000 2024-09-13T23:57:25.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.613+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6df1000 con 0x557ff6d21400 2024-09-13T23:57:25.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.613+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94008089336576] v35'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddb200 con 0x557ff6d21400 2024-09-13T23:57:25.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.617+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94008089337728] v35'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6d21000 2024-09-13T23:57:25.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.617+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v35'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddb200 con 0x557ff6d21400 2024-09-13T23:57:25.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.617+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94008089338880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6df1400 con 0x557ff6d21400 2024-09-13T23:57:25.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.617+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6df1800 con 0x557ff6dea000 2024-09-13T23:57:25.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.621+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94008089338880] v35'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddb200 con 0x557ff6d21400 2024-09-13T23:57:25.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.621+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v35'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6dea000 2024-09-13T23:57:25.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.621+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94008089340032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6df1c00 con 0x557ff6dea000 2024-09-13T23:57:25.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.621+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6df0800 con 0x557ff6d21400 2024-09-13T23:57:25.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.621+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94008089340032] v35'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6dea000 2024-09-13T23:57:25.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.621+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v35'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddb200 con 0x557ff6d21400 2024-09-13T23:57:25.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.621+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94008089341184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6df0000 con 0x557ff6d21400 2024-09-13T23:57:25.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.621+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6dea800 con 0x557ff6d21c00 2024-09-13T23:57:25.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.625+0000 7f4263a98700 1 -- 172.21.15.173:0/3233267157 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v35'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddb440 con 0x557ff6d21c00 2024-09-13T23:57:25.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.625+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94008089342336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6deb000 con 0x557ff6d21c00 2024-09-13T23:57:25.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.625+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6deb400 con 0x557ff6d21c00 2024-09-13T23:57:25.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.625+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94008089341184] v35'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddb200 con 0x557ff6d21400 2024-09-13T23:57:25.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.625+0000 7f4263a98700 1 -- 172.21.15.173:0/3233267157 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94008089342336] v35'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddb440 con 0x557ff6d21c00 2024-09-13T23:57:25.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.625+0000 7f4263a98700 1 -- 172.21.15.173:0/3233267157 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v35'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddb440 con 0x557ff6d21c00 2024-09-13T23:57:25.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.625+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94008089343488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6deac00 con 0x557ff6d21c00 2024-09-13T23:57:25.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.625+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6d21800 con 0x557ff6dea000 2024-09-13T23:57:25.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.629+0000 7f4263a98700 1 -- 172.21.15.173:0/3233267157 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94008089343488] v35'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddb440 con 0x557ff6d21c00 2024-09-13T23:57:25.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.629+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v35'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6dea000 2024-09-13T23:57:25.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.629+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94008089344640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6df0400 con 0x557ff6dea000 2024-09-13T23:57:25.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.629+0000 7f4265ae0f40 20 add_watcher() i=0 2024-09-13T23:57:25.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.629+0000 7f4265ae0f40 20 add_watcher() i=1 2024-09-13T23:57:25.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.629+0000 7f4265ae0f40 20 add_watcher() i=2 2024-09-13T23:57:25.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.629+0000 7f4265ae0f40 20 add_watcher() i=3 2024-09-13T23:57:25.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.629+0000 7f4265ae0f40 20 add_watcher() i=4 2024-09-13T23:57:25.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.629+0000 7f4265ae0f40 20 add_watcher() i=5 2024-09-13T23:57:25.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.629+0000 7f4265ae0f40 20 add_watcher() i=6 2024-09-13T23:57:25.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.629+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94008089344640] v35'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6dea000 2024-09-13T23:57:25.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.629+0000 7f4265ae0f40 20 add_watcher() i=7 2024-09-13T23:57:25.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.629+0000 7f4265ae0f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:25.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.629+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6df1000 con 0x557ff6d21000 2024-09-13T23:57:25.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.633+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6d21000 2024-09-13T23:57:25.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.633+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94008091041792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6df1400 con 0x557ff6d21000 2024-09-13T23:57:25.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.633+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94008091041792] v35'189 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6d21000 2024-09-13T23:57:25.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.633+0000 7f424b267700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:25.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.633+0000 7f4265ae0f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:25.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.633+0000 7f4265ae0f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:25.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.633+0000 7f4265ae0f40 1 Processor -- start 2024-09-13T23:57:25.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.633+0000 7f4265ae0f40 1 -- start start 2024-09-13T23:57:25.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.633+0000 7f4265ae0f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6dea400 0x557ff6c61180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.633+0000 7f4265ae0f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ff6a063c0 con 0x557ff6dea400 2024-09-13T23:57:25.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.637+0000 7f4263a98700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6dea400 0x557ff6c61180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.637+0000 7f4263a98700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6dea400 0x557ff6c61180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35150/0 (socket says 172.21.15.173:35150) 2024-09-13T23:57:25.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.637+0000 7f4263a98700 1 -- 172.21.15.173:0/803099089 learned_addr learned my addr 172.21.15.173:0/803099089 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.637+0000 7f4263a98700 1 -- 172.21.15.173:0/803099089 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ff698ab60 con 0x557ff6dea400 2024-09-13T23:57:25.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.637+0000 7f4263a98700 1 --2- 172.21.15.173:0/803099089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6dea400 0x557ff6c61180 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x557ff6dfe090 tx=0x557ff6ce7f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da0aeced1e69754d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.637+0000 7f424aa66700 1 -- 172.21.15.173:0/803099089 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557ff6e06000 con 0x557ff6dea400 2024-09-13T23:57:25.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.637+0000 7f424aa66700 1 -- 172.21.15.173:0/803099089 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557ff6d32600 con 0x557ff6dea400 2024-09-13T23:57:25.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.637+0000 7f424aa66700 1 -- 172.21.15.173:0/803099089 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557ff6e06160 con 0x557ff6dea400 2024-09-13T23:57:25.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.637+0000 7f4265ae0f40 1 -- 172.21.15.173:0/803099089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6dea400 msgr2=0x557ff6c61180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.637+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/803099089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6dea400 0x557ff6c61180 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x557ff6dfe090 tx=0x557ff6ce7f80 comp rx=0 tx=0).stop 2024-09-13T23:57:25.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.637+0000 7f4265ae0f40 1 -- 172.21.15.173:0/803099089 shutdown_connections 2024-09-13T23:57:25.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.637+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/803099089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6dea400 0x557ff6c61180 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.637+0000 7f4265ae0f40 1 -- 172.21.15.173:0/803099089 >> 172.21.15.173:0/803099089 conn(0x557ff6df0800 msgr2=0x557ff6a7a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.637+0000 7f4265ae0f40 1 -- 172.21.15.173:0/803099089 shutdown_connections 2024-09-13T23:57:25.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.637+0000 7f4265ae0f40 1 -- 172.21.15.173:0/803099089 wait complete. 2024-09-13T23:57:25.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.637+0000 7f4265ae0f40 1 Processor -- start 2024-09-13T23:57:25.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.637+0000 7f4265ae0f40 1 -- start start 2024-09-13T23:57:25.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.637+0000 7f4265ae0f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6dea400 0x557ff6c61180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.637+0000 7f4265ae0f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ff6a06500 con 0x557ff6dea400 2024-09-13T23:57:25.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.641+0000 7f4263a98700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6dea400 0x557ff6c61180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.641+0000 7f4263a98700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6dea400 0x557ff6c61180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35160/0 (socket says 172.21.15.173:35160) 2024-09-13T23:57:25.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.641+0000 7f4263a98700 1 -- 172.21.15.173:0/1211831107 learned_addr learned my addr 172.21.15.173:0/1211831107 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.641+0000 7f4263a98700 1 -- 172.21.15.173:0/1211831107 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ff698ad00 con 0x557ff6dea400 2024-09-13T23:57:25.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.641+0000 7f4263a98700 1 --2- 172.21.15.173:0/1211831107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6dea400 0x557ff6c61180 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x557ff6dfe2a0 tx=0x557ff6dd41e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.641+0000 7f4249263700 1 -- 172.21.15.173:0/1211831107 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557ff6e062c0 con 0x557ff6dea400 2024-09-13T23:57:25.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.641+0000 7f4249263700 1 -- 172.21.15.173:0/1211831107 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557ff6d32300 con 0x557ff6dea400 2024-09-13T23:57:25.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.641+0000 7f4249263700 1 -- 172.21.15.173:0/1211831107 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x557ff6e06000 con 0x557ff6dea400 2024-09-13T23:57:25.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.641+0000 7f4265ae0f40 1 -- 172.21.15.173:0/1211831107 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557ff698a340 con 0x557ff6dea400 2024-09-13T23:57:25.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.641+0000 7f4265ae0f40 1 -- 172.21.15.173:0/1211831107 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ff698ab60 con 0x557ff6dea400 2024-09-13T23:57:25.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.641+0000 7f4249263700 1 -- 172.21.15.173:0/1211831107 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x557ff6a73b80 con 0x557ff6dea400 2024-09-13T23:57:25.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.641+0000 7f4249263700 1 --2- 172.21.15.173:0/1211831107 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x557ff6d21800 0x557ff6e88000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.641+0000 7f4249263700 1 -- 172.21.15.173:0/1211831107 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x557ff69df500 con 0x557ff6dea400 2024-09-13T23:57:25.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.641+0000 7f4265ae0f40 5 note: GC not initialized 2024-09-13T23:57:25.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.641+0000 7f4264a9a700 1 --2- 172.21.15.173:0/1211831107 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x557ff6d21800 0x557ff6e88000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.645+0000 7f4264a9a700 1 --2- 172.21.15.173:0/1211831107 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x557ff6d21800 0x557ff6e88000 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x557ff77ecd80 tx=0x557ff6dd5380 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.645+0000 7f4246a5e700 20 reqs_thread_entry: start 2024-09-13T23:57:25.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.645+0000 7f4265ae0f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:25.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.645+0000 7f4265ae0f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:25.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.645+0000 7f4244a5a700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:55 2024 2024-09-13T23:57:25.651 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:25.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.645+0000 7f4244238700 20 reqs_thread_entry: start 2024-09-13T23:57:25.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.645+0000 7f4265ae0f40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:57:25.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.645+0000 7f4265ae0f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.645+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6dea800 con 0x557ff6d21000 2024-09-13T23:57:25.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.645+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(62 foo [call out=48b,read 0~369 out=369b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 231+0+492 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6d21000 2024-09-13T23:57:25.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.645+0000 7f4265ae0f40 20 rados_obj.operate() r=0 bl.length=369 2024-09-13T23:57:25.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.645+0000 7f4265ae0f40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:57:25.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.645+0000 7f4265ae0f40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:25.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.645+0000 7f4265ae0f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:25.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.645+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6df1800 con 0x557ff6d21000 2024-09-13T23:57:25.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.649+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~357] v35'18 uv18 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6d21000 2024-09-13T23:57:25.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.649+0000 7f4265ae0f40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:57:25.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.649+0000 7f4265ae0f40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:25.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.649+0000 7f4265ae0f40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:57:25.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.649+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94008091044096 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6df1c00 con 0x557ff6d21400 2024-09-13T23:57:25.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.649+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== watch-notify(notify (1) cookie 94008089341184 notify 150323855399 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x557ff6cda680 con 0x557ff6d21400 2024-09-13T23:57:25.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.649+0000 7f425ea8e700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855399 cookie 94008089341184 notifier 4727 bl.length()=533 2024-09-13T23:57:25.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.649+0000 7f425ea8e700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:57:25.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.649+0000 7f425ea8e700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:25.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.649+0000 7f425ea8e700 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6ef2000 con 0x557ff6d21400 2024-09-13T23:57:25.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.649+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(64 notify.4 [notify cookie 94008091044096 out=8b] v0'0 uv183 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x557ff6ddb200 con 0x557ff6d21400 2024-09-13T23:57:25.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.649+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddb200 con 0x557ff6d21400 2024-09-13T23:57:25.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.649+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== watch-notify(notify_complete (2) cookie 94008091044096 notify 150323855399 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557ff6cda820 con 0x557ff6d21400 2024-09-13T23:57:25.657 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:57:25.657 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "foo", 2024-09-13T23:57:25.657 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Foo", 2024-09-13T23:57:25.657 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "foo@foo.com", 2024-09-13T23:57:25.657 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:57:25.657 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:57:25.658 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [], 2024-09-13T23:57:25.658 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:57:25.658 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:57:25.658 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:57:25.658 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2024-09-13T23:57:25.658 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2024-09-13T23:57:25.658 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:57:25.658 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:57:25.658 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [], 2024-09-13T23:57:25.658 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:57:25.658 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:57:25.658 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:57:25.658 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:57:25.658 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:57:25.659 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:57:25.659 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:25.659 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:25.659 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:25.659 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:25.659 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:25.659 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:25.659 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:57:25.659 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:57:25.659 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:57:25.659 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:57:25.659 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:57:25.659 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:57:25.659 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:57:25.659 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:57:25.660 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:57:25.660 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:57:25.660 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:57:25.660 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:57:25.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.653+0000 7f424b267700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:25.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.653+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94008091041792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6ef2800 con 0x557ff6d21000 2024-09-13T23:57:25.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.657+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94008091041792] v35'190 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6d21000 2024-09-13T23:57:25.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.657+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94008089336576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6ef2c00 con 0x557ff6d21400 2024-09-13T23:57:25.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.657+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94008089336576] v35'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddb200 con 0x557ff6d21400 2024-09-13T23:57:25.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.657+0000 7f4265ae0f40 20 remove_watcher() i=0 2024-09-13T23:57:25.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.657+0000 7f4265ae0f40 2 removed watcher, disabling cache 2024-09-13T23:57:25.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.657+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94008089337728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6ef3000 con 0x557ff6d21000 2024-09-13T23:57:25.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.661+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94008089337728] v35'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6d21000 2024-09-13T23:57:25.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.661+0000 7f4265ae0f40 20 remove_watcher() i=1 2024-09-13T23:57:25.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.661+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94008089338880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6ef3400 con 0x557ff6d21400 2024-09-13T23:57:25.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.661+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94008089338880] v35'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddb200 con 0x557ff6d21400 2024-09-13T23:57:25.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.661+0000 7f4265ae0f40 20 remove_watcher() i=2 2024-09-13T23:57:25.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.661+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94008089340032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6ef3800 con 0x557ff6dea000 2024-09-13T23:57:25.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.665+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94008089340032] v35'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6dea000 2024-09-13T23:57:25.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.665+0000 7f4265ae0f40 20 remove_watcher() i=3 2024-09-13T23:57:25.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.665+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94008089341184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6ef3c00 con 0x557ff6d21400 2024-09-13T23:57:25.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.669+0000 7f4264299700 1 -- 172.21.15.173:0/3233267157 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94008089341184] v35'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddb200 con 0x557ff6d21400 2024-09-13T23:57:25.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.669+0000 7f4265ae0f40 20 remove_watcher() i=4 2024-09-13T23:57:25.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.669+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94008089342336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6df0400 con 0x557ff6d21c00 2024-09-13T23:57:25.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.669+0000 7f4263a98700 1 -- 172.21.15.173:0/3233267157 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94008089342336] v35'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddb440 con 0x557ff6d21c00 2024-09-13T23:57:25.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.669+0000 7f4265ae0f40 20 remove_watcher() i=5 2024-09-13T23:57:25.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.669+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94008089343488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6ef2000 con 0x557ff6d21c00 2024-09-13T23:57:25.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.673+0000 7f4263a98700 1 -- 172.21.15.173:0/3233267157 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94008089343488] v35'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddb440 con 0x557ff6d21c00 2024-09-13T23:57:25.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.673+0000 7f4265ae0f40 20 remove_watcher() i=6 2024-09-13T23:57:25.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.673+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94008089344640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x557ff6ef2c00 con 0x557ff6dea000 2024-09-13T23:57:25.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4264a9a700 1 -- 172.21.15.173:0/3233267157 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94008089344640] v35'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x557ff6ddab40 con 0x557ff6dea000 2024-09-13T23:57:25.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 20 remove_watcher() i=7 2024-09-13T23:57:25.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x557ff6d21400 msgr2=0x557ff6c60100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/3233267157 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x557ff6d21400 0x557ff6c60100 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x557ff6d21000 msgr2=0x557ff6c5fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/3233267157 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x557ff6d21000 0x557ff6c5fb80 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x557ff6dea000 msgr2=0x557ff6c60c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/3233267157 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x557ff6dea000 0x557ff6c60c00 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x557ff6d21c00 msgr2=0x557ff6c60680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/3233267157 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x557ff6d21c00 0x557ff6c60680 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x557ff6d20c00 msgr2=0x557ff6c5f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/3233267157 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x557ff6d20c00 0x557ff6c5f600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x557ff6d23b30 tx=0x557ff6dd40c0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979800 msgr2=0x557ff6c5eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/3233267157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979800 0x557ff6c5eb00 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x557ff77ec240 tx=0x557ff6ce6a20 comp rx=0 tx=0).stop 2024-09-13T23:57:25.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4263a98700 1 -- 172.21.15.173:0/3233267157 reap_dead start 2024-09-13T23:57:25.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 shutdown_connections 2024-09-13T23:57:25.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/3233267157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979800 0x557ff6c5eb00 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 >> 172.21.15.173:0/3233267157 conn(0x557ff6979400 msgr2=0x557ff6a79800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 shutdown_connections 2024-09-13T23:57:25.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 -- 172.21.15.173:0/3233267157 wait complete. 2024-09-13T23:57:25.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 -- 172.21.15.173:0/1211831107 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x557ff6d21800 msgr2=0x557ff6e88000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/1211831107 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x557ff6d21800 0x557ff6e88000 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x557ff77ecd80 tx=0x557ff6dd5380 comp rx=0 tx=0).stop 2024-09-13T23:57:25.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 -- 172.21.15.173:0/1211831107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6dea400 msgr2=0x557ff6c61180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/1211831107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6dea400 0x557ff6c61180 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x557ff6dfe2a0 tx=0x557ff6dd41e0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 -- 172.21.15.173:0/1211831107 shutdown_connections 2024-09-13T23:57:25.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/1211831107 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x557ff6d21800 0x557ff6e88000 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/1211831107 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6dea400 0x557ff6c61180 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 -- 172.21.15.173:0/1211831107 >> 172.21.15.173:0/1211831107 conn(0x557ff6df0800 msgr2=0x557ff6a7a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 -- 172.21.15.173:0/1211831107 shutdown_connections 2024-09-13T23:57:25.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 -- 172.21.15.173:0/1211831107 wait complete. 2024-09-13T23:57:25.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 -- 172.21.15.173:0/668735778 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x557ff6d20000 msgr2=0x557ff6c5f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/668735778 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x557ff6d20000 0x557ff6c5f080 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x557ff77ed080 tx=0x557ff6ce6b40 comp rx=0 tx=0).stop 2024-09-13T23:57:25.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 -- 172.21.15.173:0/668735778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979000 msgr2=0x557ff6c5e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/668735778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979000 0x557ff6c5e580 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x557ff77dd6b0 tx=0x557ff6a7d920 comp rx=0 tx=0).stop 2024-09-13T23:57:25.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 -- 172.21.15.173:0/668735778 shutdown_connections 2024-09-13T23:57:25.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/668735778 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x557ff6d20000 0x557ff6c5f080 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 --2- 172.21.15.173:0/668735778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557ff6979000 0x557ff6c5e580 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 -- 172.21.15.173:0/668735778 >> 172.21.15.173:0/668735778 conn(0x557ff6978c00 msgr2=0x557ff6a79000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 -- 172.21.15.173:0/668735778 shutdown_connections 2024-09-13T23:57:25.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.677+0000 7f4265ae0f40 1 -- 172.21.15.173:0/668735778 wait complete. 2024-09-13T23:57:25.688 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:57:25.706 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:57:25.706 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-13T23:57:25.706 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-13T23:57:25.707 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-13T23:57:25.746 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:57:25.746 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:57:25.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.741+0000 7f9d53c24f40 1 Processor -- start 2024-09-13T23:57:25.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.741+0000 7f9d53c24f40 1 -- start start 2024-09-13T23:57:25.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.741+0000 7f9d53c24f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55d9832df400 0x55d9835c4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.741+0000 7f9d53c24f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d9833a3500 con 0x55d9832df000 2024-09-13T23:57:25.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.741+0000 7f9d53c24f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d98336ca00 con 0x55d9832df400 2024-09-13T23:57:25.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.741+0000 7f9d51bdc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55d9832df400 0x55d9835c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.741+0000 7f9d523dd700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55d9832df000 0x55d9833de800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:44950/0 (socket says 172.21.15.173:44950) 2024-09-13T23:57:25.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.741+0000 7f9d523dd700 1 -- 172.21.15.173:0/124717719 learned_addr learned my addr 172.21.15.173:0/124717719 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:57:25.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.741+0000 7f9d51bdc700 1 -- 172.21.15.173:0/124717719 >> v1:172.21.15.87:6789/0 conn(0x55d9832df000 legacy=0x55d9833de800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.741+0000 7f9d513db700 1 -- 172.21.15.173:0/124717719 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618790159 0 0) 0x55d98343a000 con 0x55d9832df000 2024-09-13T23:57:25.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.741+0000 7f9d51bdc700 1 -- 172.21.15.173:0/124717719 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9832f1d40 con 0x55d9832df400 2024-09-13T23:57:25.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.741+0000 7f9d51bdc700 1 --2- 172.21.15.173:0/124717719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df400 0x55d9835c4580 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x55d9835bf920 tx=0x55d9833e3920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181b82c58bdf37f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.741+0000 7f9d513db700 1 -- 172.21.15.173:0/124717719 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d9833834a0 con 0x55d9832df400 2024-09-13T23:57:25.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.741+0000 7f9d513db700 1 -- 172.21.15.173:0/124717719 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d9833a3800 con 0x55d9832df400 2024-09-13T23:57:25.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.741+0000 7f9d513db700 1 -- 172.21.15.173:0/124717719 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d983383600 con 0x55d9832df400 2024-09-13T23:57:25.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.741+0000 7f9d53c24f40 1 -- 172.21.15.173:0/124717719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df400 msgr2=0x55d9835c4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.741+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/124717719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df400 0x55d9835c4580 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x55d9835bf920 tx=0x55d9833e3920 comp rx=0 tx=0).stop 2024-09-13T23:57:25.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.745+0000 7f9d53c24f40 1 -- 172.21.15.173:0/124717719 shutdown_connections 2024-09-13T23:57:25.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.745+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/124717719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df400 0x55d9835c4580 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.745+0000 7f9d53c24f40 1 -- 172.21.15.173:0/124717719 >> 172.21.15.173:0/124717719 conn(0x55d9832dec00 msgr2=0x55d9833de000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.745+0000 7f9d53c24f40 1 -- 172.21.15.173:0/124717719 shutdown_connections 2024-09-13T23:57:25.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.745+0000 7f9d53c24f40 1 -- 172.21.15.173:0/124717719 wait complete. 2024-09-13T23:57:25.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.745+0000 7f9d53c24f40 1 Processor -- start 2024-09-13T23:57:25.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.745+0000 7f9d53c24f40 1 -- start start 2024-09-13T23:57:25.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.745+0000 7f9d53c24f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df000 0x55d9835c4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.745+0000 7f9d53c24f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d98336c500 con 0x55d9832df000 2024-09-13T23:57:25.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.745+0000 7f9d523dd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df000 0x55d9835c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.745+0000 7f9d523dd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df000 0x55d9835c4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35186/0 (socket says 172.21.15.173:35186) 2024-09-13T23:57:25.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.745+0000 7f9d523dd700 1 -- 172.21.15.173:0/962022685 learned_addr learned my addr 172.21.15.173:0/962022685 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.745+0000 7f9d523dd700 1 -- 172.21.15.173:0/962022685 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9832f1ba0 con 0x55d9832df000 2024-09-13T23:57:25.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.745+0000 7f9d523dd700 1 --2- 172.21.15.173:0/962022685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df000 0x55d9835c4580 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x55d9840a9d70 tx=0x55d9833e3b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dddc5f6b668b0ba3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.745+0000 7f9d50bda700 1 -- 172.21.15.173:0/962022685 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d9833834a0 con 0x55d9832df000 2024-09-13T23:57:25.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.745+0000 7f9d50bda700 1 -- 172.21.15.173:0/962022685 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d9833a3b00 con 0x55d9832df000 2024-09-13T23:57:25.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.745+0000 7f9d50bda700 1 -- 172.21.15.173:0/962022685 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d983383600 con 0x55d9832df000 2024-09-13T23:57:25.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.745+0000 7f9d53c24f40 1 -- 172.21.15.173:0/962022685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df000 msgr2=0x55d9835c4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.745+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/962022685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df000 0x55d9835c4580 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x55d9840a9d70 tx=0x55d9833e3b60 comp rx=0 tx=0).stop 2024-09-13T23:57:25.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.745+0000 7f9d53c24f40 1 -- 172.21.15.173:0/962022685 shutdown_connections 2024-09-13T23:57:25.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.745+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/962022685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df000 0x55d9835c4580 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.745+0000 7f9d53c24f40 1 -- 172.21.15.173:0/962022685 >> 172.21.15.173:0/962022685 conn(0x55d9832dec00 msgr2=0x55d9833df000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.745+0000 7f9d53c24f40 1 -- 172.21.15.173:0/962022685 shutdown_connections 2024-09-13T23:57:25.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.745+0000 7f9d53c24f40 1 -- 172.21.15.173:0/962022685 wait complete. 2024-09-13T23:57:25.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.749+0000 7f9d53c24f40 1 Processor -- start 2024-09-13T23:57:25.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.749+0000 7f9d53c24f40 1 -- start start 2024-09-13T23:57:25.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.749+0000 7f9d53c24f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df000 0x55d9835c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.749+0000 7f9d53c24f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d98336c3c0 con 0x55d9832df000 2024-09-13T23:57:25.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.749+0000 7f9d523dd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df000 0x55d9835c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.749+0000 7f9d523dd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df000 0x55d9835c4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35196/0 (socket says 172.21.15.173:35196) 2024-09-13T23:57:25.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.749+0000 7f9d523dd700 1 -- 172.21.15.173:0/1906138947 learned_addr learned my addr 172.21.15.173:0/1906138947 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.749+0000 7f9d523dd700 1 -- 172.21.15.173:0/1906138947 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9832f1a00 con 0x55d9832df000 2024-09-13T23:57:25.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.749+0000 7f9d523dd700 1 --2- 172.21.15.173:0/1906138947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df000 0x55d9835c4580 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x55d9840a9e00 tx=0x55d9833e3a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.749+0000 7f9d4f3d7700 1 -- 172.21.15.173:0/1906138947 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d9833838c0 con 0x55d9832df000 2024-09-13T23:57:25.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.749+0000 7f9d4f3d7700 1 -- 172.21.15.173:0/1906138947 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d9833a3c80 con 0x55d9832df000 2024-09-13T23:57:25.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.749+0000 7f9d53c24f40 1 -- 172.21.15.173:0/1906138947 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d9832f1860 con 0x55d9832df000 2024-09-13T23:57:25.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.749+0000 7f9d4f3d7700 1 -- 172.21.15.173:0/1906138947 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d9833834a0 con 0x55d9832df000 2024-09-13T23:57:25.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.749+0000 7f9d53c24f40 1 -- 172.21.15.173:0/1906138947 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d9832f16c0 con 0x55d9832df000 2024-09-13T23:57:25.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.749+0000 7f9d53c24f40 1 Processor -- start 2024-09-13T23:57:25.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.749+0000 7f9d53c24f40 1 -- start start 2024-09-13T23:57:25.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.749+0000 7f9d53c24f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df800 0x55d9835c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.749+0000 7f9d53c24f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d983304640 con 0x55d9832df800 2024-09-13T23:57:25.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.749+0000 7f9d4f3d7700 1 -- 172.21.15.173:0/1906138947 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55d9833d8b00 con 0x55d9832df000 2024-09-13T23:57:25.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.753+0000 7f9d4f3d7700 1 --2- 172.21.15.173:0/1906138947 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d983682000 0x55d9835c5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.753+0000 7f9d52bde700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df800 0x55d9835c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.753+0000 7f9d4f3d7700 1 -- 172.21.15.173:0/1906138947 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55d983345180 con 0x55d9832df000 2024-09-13T23:57:25.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.753+0000 7f9d52bde700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df800 0x55d9835c4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35204/0 (socket says 172.21.15.173:35204) 2024-09-13T23:57:25.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.753+0000 7f9d52bde700 1 -- 172.21.15.173:0/1900045907 learned_addr learned my addr 172.21.15.173:0/1900045907 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.753+0000 7f9d523dd700 1 --2- 172.21.15.173:0/1906138947 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d983682000 0x55d9835c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.753+0000 7f9d52bde700 1 -- 172.21.15.173:0/1900045907 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9832f0000 con 0x55d9832df800 2024-09-13T23:57:25.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.753+0000 7f9d523dd700 1 --2- 172.21.15.173:0/1906138947 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d983682000 0x55d9835c5080 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x55d9836114d0 tx=0x55d98363e240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.753+0000 7f9d52bde700 1 --2- 172.21.15.173:0/1900045907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df800 0x55d9835c4b00 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x55d9835bff80 tx=0x55d98363f0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95dc7c8da57aceaa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.753+0000 7f9d4cbd2700 1 -- 172.21.15.173:0/1900045907 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d9833838c0 con 0x55d9832df800 2024-09-13T23:57:25.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.753+0000 7f9d4cbd2700 1 -- 172.21.15.173:0/1900045907 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d983698000 con 0x55d9832df800 2024-09-13T23:57:25.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.753+0000 7f9d4cbd2700 1 -- 172.21.15.173:0/1900045907 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d9833834a0 con 0x55d9832df800 2024-09-13T23:57:25.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.753+0000 7f9d53c24f40 1 -- 172.21.15.173:0/1900045907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df800 msgr2=0x55d9835c4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.753+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/1900045907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df800 0x55d9835c4b00 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x55d9835bff80 tx=0x55d98363f0e0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.753+0000 7f9d53c24f40 1 -- 172.21.15.173:0/1900045907 shutdown_connections 2024-09-13T23:57:25.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.753+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/1900045907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df800 0x55d9835c4b00 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.753+0000 7f9d53c24f40 1 -- 172.21.15.173:0/1900045907 >> 172.21.15.173:0/1900045907 conn(0x55d9832df400 msgr2=0x55d9833df800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.753+0000 7f9d53c24f40 1 -- 172.21.15.173:0/1900045907 shutdown_connections 2024-09-13T23:57:25.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.753+0000 7f9d53c24f40 1 -- 172.21.15.173:0/1900045907 wait complete. 2024-09-13T23:57:25.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.757+0000 7f9d53c24f40 1 Processor -- start 2024-09-13T23:57:25.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.757+0000 7f9d53c24f40 1 -- start start 2024-09-13T23:57:25.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.757+0000 7f9d53c24f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df800 0x55d9835c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.757+0000 7f9d53c24f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9833048c0 con 0x55d9832df800 2024-09-13T23:57:25.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.757+0000 7f9d52bde700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df800 0x55d9835c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.757+0000 7f9d52bde700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df800 0x55d9835c4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35214/0 (socket says 172.21.15.173:35214) 2024-09-13T23:57:25.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.757+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 learned_addr learned my addr 172.21.15.173:0/3124270632 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.757+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9832f0ea0 con 0x55d9832df800 2024-09-13T23:57:25.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.757+0000 7f9d52bde700 1 --2- 172.21.15.173:0/3124270632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df800 0x55d9835c4b00 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x55d9836100f0 tx=0x55d9833e3bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.757+0000 7f9d4b3cf700 1 -- 172.21.15.173:0/3124270632 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d983383b80 con 0x55d9832df800 2024-09-13T23:57:25.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.757+0000 7f9d4b3cf700 1 -- 172.21.15.173:0/3124270632 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d983698180 con 0x55d9832df800 2024-09-13T23:57:25.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.757+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d9832f0820 con 0x55d9832df800 2024-09-13T23:57:25.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.757+0000 7f9d4b3cf700 1 -- 172.21.15.173:0/3124270632 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d9833838c0 con 0x55d9832df800 2024-09-13T23:57:25.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.757+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d9832f09c0 con 0x55d9832df800 2024-09-13T23:57:25.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.761+0000 7f9d4b3cf700 1 -- 172.21.15.173:0/3124270632 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55d9833d8dc0 con 0x55d9832df800 2024-09-13T23:57:25.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.761+0000 7f9d53c24f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.761+0000 7f9d4b3cf700 1 --2- 172.21.15.173:0/3124270632 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d983682c00 0x55d9835c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.761+0000 7f9d4b3cf700 1 -- 172.21.15.173:0/3124270632 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55d983345340 con 0x55d9832df800 2024-09-13T23:57:25.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.761+0000 7f9d51bdc700 1 --2- 172.21.15.173:0/3124270632 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d983682c00 0x55d9835c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.761+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/3124270632 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55d983683000 0x55d9835c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.761+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683400 con 0x55d983683000 2024-09-13T23:57:25.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.761+0000 7f9d52bde700 1 --2- 172.21.15.173:0/3124270632 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55d983683000 0x55d9835c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.761+0000 7f9d51bdc700 1 --2- 172.21.15.173:0/3124270632 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d983682c00 0x55d9835c5600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55d9835bf920 tx=0x55d9833e3800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.761+0000 7f9d52bde700 1 --2- 172.21.15.173:0/3124270632 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55d983683000 0x55d9835c5b80 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.761+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55d98373ab40 con 0x55d983683000 2024-09-13T23:57:25.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.761+0000 7f9d53c24f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.761+0000 7f9d53c24f40 20 realm 2024-09-13T23:57:25.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.761+0000 7f9d53c24f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.761+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683000 2024-09-13T23:57:25.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.761+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55d98373ab40 con 0x55d983683000 2024-09-13T23:57:25.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.765+0000 7f9d53c24f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.765+0000 7f9d53c24f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:57:25.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.765+0000 7f9d53c24f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.765+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683c00 con 0x55d983683000 2024-09-13T23:57:25.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.765+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55d98373ab40 con 0x55d983683000 2024-09-13T23:57:25.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.765+0000 7f9d53c24f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.765+0000 7f9d53c24f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.765+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/3124270632 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55d983683400 0x55d9835c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.765+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683400 2024-09-13T23:57:25.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.765+0000 7f9d523dd700 1 --2- 172.21.15.173:0/3124270632 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55d983683400 0x55d9835c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.765+0000 7f9d523dd700 1 --2- 172.21.15.173:0/3124270632 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55d983683400 0x55d9835c6100 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.765+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55d98373b200 con 0x55d983683400 2024-09-13T23:57:25.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.765+0000 7f9d53c24f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:25.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.765+0000 7f9d53c24f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.765+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/3124270632 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55d983683c00 0x55d9835c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.765+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983748000 con 0x55d983683c00 2024-09-13T23:57:25.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.765+0000 7f9d51bdc700 1 --2- 172.21.15.173:0/3124270632 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55d983683c00 0x55d9835c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.765+0000 7f9d51bdc700 1 --2- 172.21.15.173:0/3124270632 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55d983683c00 0x55d9835c6680 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.765+0000 7f9d51bdc700 1 -- 172.21.15.173:0/3124270632 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55d98373b440 con 0x55d983683c00 2024-09-13T23:57:25.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.765+0000 7f9d53c24f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:57:25.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.765+0000 7f9d53c24f40 20 searching for the correct realm 2024-09-13T23:57:25.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.765+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983748400 con 0x55d983683c00 2024-09-13T23:57:25.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.769+0000 7f9d51bdc700 1 -- 172.21.15.173:0/3124270632 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55d98373b440 con 0x55d983683c00 2024-09-13T23:57:25.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.769+0000 7f9d51bdc700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983748000 con 0x55d983683400 2024-09-13T23:57:25.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.769+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373b200 con 0x55d983683400 2024-09-13T23:57:25.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.769+0000 7f9d523dd700 1 --2- 172.21.15.173:0/3124270632 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55d983748000 0x55d9835c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.769+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983748000 2024-09-13T23:57:25.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.769+0000 7f9d52bde700 1 --2- 172.21.15.173:0/3124270632 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55d983748000 0x55d9835c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.769+0000 7f9d52bde700 1 --2- 172.21.15.173:0/3124270632 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55d983748000 0x55d9835c6c00 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.769+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373ab40 con 0x55d983748000 2024-09-13T23:57:25.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.769+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983748000 2024-09-13T23:57:25.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.769+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55d98373ab40 con 0x55d983748000 2024-09-13T23:57:25.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.769+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683000 2024-09-13T23:57:25.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.769+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373ab40 con 0x55d983683000 2024-09-13T23:57:25.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.769+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683c00 2024-09-13T23:57:25.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.773+0000 7f9d51bdc700 1 -- 172.21.15.173:0/3124270632 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373b440 con 0x55d983683c00 2024-09-13T23:57:25.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.773+0000 7f9d51bdc700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683000 2024-09-13T23:57:25.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.773+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373ab40 con 0x55d983683000 2024-09-13T23:57:25.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.773+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683400 2024-09-13T23:57:25.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.773+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373b200 con 0x55d983683400 2024-09-13T23:57:25.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.773+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683400 2024-09-13T23:57:25.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.773+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373b200 con 0x55d983683400 2024-09-13T23:57:25.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.773+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683000 2024-09-13T23:57:25.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.773+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373ab40 con 0x55d983683000 2024-09-13T23:57:25.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.773+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983748000 2024-09-13T23:57:25.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.773+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373ab40 con 0x55d983748000 2024-09-13T23:57:25.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.773+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683000 2024-09-13T23:57:25.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.773+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373ab40 con 0x55d983683000 2024-09-13T23:57:25.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.773+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983748000 2024-09-13T23:57:25.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.773+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373ab40 con 0x55d983748000 2024-09-13T23:57:25.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.773+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683400 2024-09-13T23:57:25.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.777+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373b200 con 0x55d983683400 2024-09-13T23:57:25.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.777+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683c00 2024-09-13T23:57:25.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.777+0000 7f9d51bdc700 1 -- 172.21.15.173:0/3124270632 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373b440 con 0x55d983683c00 2024-09-13T23:57:25.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.777+0000 7f9d51bdc700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683000 2024-09-13T23:57:25.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.777+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373ab40 con 0x55d983683000 2024-09-13T23:57:25.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.777+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683400 2024-09-13T23:57:25.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.777+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373b200 con 0x55d983683400 2024-09-13T23:57:25.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.777+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683c00 2024-09-13T23:57:25.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.777+0000 7f9d51bdc700 1 -- 172.21.15.173:0/3124270632 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373b440 con 0x55d983683c00 2024-09-13T23:57:25.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.777+0000 7f9d51bdc700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683000 2024-09-13T23:57:25.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.777+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373ab40 con 0x55d983683000 2024-09-13T23:57:25.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.777+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683000 2024-09-13T23:57:25.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.781+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373ab40 con 0x55d983683000 2024-09-13T23:57:25.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.781+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683000 2024-09-13T23:57:25.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.781+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373ab40 con 0x55d983683000 2024-09-13T23:57:25.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.781+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683c00 2024-09-13T23:57:25.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.781+0000 7f9d51bdc700 1 -- 172.21.15.173:0/3124270632 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373b440 con 0x55d983683c00 2024-09-13T23:57:25.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.781+0000 7f9d51bdc700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983748000 2024-09-13T23:57:25.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.781+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373ab40 con 0x55d983748000 2024-09-13T23:57:25.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.781+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683000 2024-09-13T23:57:25.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.781+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373ab40 con 0x55d983683000 2024-09-13T23:57:25.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.781+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983748000 2024-09-13T23:57:25.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.781+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373ab40 con 0x55d983748000 2024-09-13T23:57:25.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.781+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683c00 2024-09-13T23:57:25.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.781+0000 7f9d51bdc700 1 -- 172.21.15.173:0/3124270632 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373b440 con 0x55d983683c00 2024-09-13T23:57:25.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.781+0000 7f9d51bdc700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983748000 2024-09-13T23:57:25.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.785+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373ab40 con 0x55d983748000 2024-09-13T23:57:25.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.785+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683400 2024-09-13T23:57:25.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.785+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373b200 con 0x55d983683400 2024-09-13T23:57:25.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.785+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683400 2024-09-13T23:57:25.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.785+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373b200 con 0x55d983683400 2024-09-13T23:57:25.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.785+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683c00 2024-09-13T23:57:25.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.785+0000 7f9d51bdc700 1 -- 172.21.15.173:0/3124270632 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373b440 con 0x55d983683c00 2024-09-13T23:57:25.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.785+0000 7f9d51bdc700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683400 2024-09-13T23:57:25.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.785+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55d98373b200 con 0x55d983683400 2024-09-13T23:57:25.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.785+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983683400 2024-09-13T23:57:25.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d98373b200 con 0x55d983683400 2024-09-13T23:57:25.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:57:25.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:57:25.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:57:25.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:57:25.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983748800 con 0x55d983683000 2024-09-13T23:57:25.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55d98373ab40 con 0x55d983683000 2024-09-13T23:57:25.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983748c00 con 0x55d983683400 2024-09-13T23:57:25.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55d98373b200 con 0x55d983683400 2024-09-13T23:57:25.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:57:25.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983749000 con 0x55d983748000 2024-09-13T23:57:25.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55d98373ab40 con 0x55d983748000 2024-09-13T23:57:25.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:57:25.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 20 zone default found 2024-09-13T23:57:25.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 4 Realm: () 2024-09-13T23:57:25.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:57:25.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:57:25.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:57:25.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 20 zonegroup default 2024-09-13T23:57:25.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983749400 con 0x55d983748000 2024-09-13T23:57:25.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55d98373ab40 con 0x55d983748000 2024-09-13T23:57:25.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983749800 con 0x55d983683c00 2024-09-13T23:57:25.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d51bdc700 1 -- 172.21.15.173:0/3124270632 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55d98373b440 con 0x55d983683c00 2024-09-13T23:57:25.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.789+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983749c00 con 0x55d983683c00 2024-09-13T23:57:25.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.793+0000 7f9d51bdc700 1 -- 172.21.15.173:0/3124270632 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55d98373b440 con 0x55d983683c00 2024-09-13T23:57:25.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.793+0000 7f9d53c24f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:57:25.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.793+0000 7f9d53c24f40 20 started sync module instance, tier type = 2024-09-13T23:57:25.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.793+0000 7f9d53c24f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:57:25.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.793+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983752000 con 0x55d983683400 2024-09-13T23:57:25.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.793+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v35'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983683400 2024-09-13T23:57:25.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.793+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94392700091136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983752400 con 0x55d983683400 2024-09-13T23:57:25.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.793+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983752800 con 0x55d983683000 2024-09-13T23:57:25.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.797+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94392700091136] v35'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983683400 2024-09-13T23:57:25.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.797+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v35'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d98373ab40 con 0x55d983683000 2024-09-13T23:57:25.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.797+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94392700092288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983752c00 con 0x55d983683000 2024-09-13T23:57:25.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.797+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983753000 con 0x55d983683400 2024-09-13T23:57:25.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.801+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94392700092288] v35'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d98373ab40 con 0x55d983683000 2024-09-13T23:57:25.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.801+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v35'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983683400 2024-09-13T23:57:25.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.801+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94392700093440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983753400 con 0x55d983683400 2024-09-13T23:57:25.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.801+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983753800 con 0x55d983748000 2024-09-13T23:57:25.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.805+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v35'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d98373ab40 con 0x55d983748000 2024-09-13T23:57:25.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.805+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94392700094592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983753c00 con 0x55d983748000 2024-09-13T23:57:25.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.805+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983752800 con 0x55d983683400 2024-09-13T23:57:25.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.805+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94392700093440] v35'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983683400 2024-09-13T23:57:25.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.805+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94392700094592] v35'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d98373ab40 con 0x55d983748000 2024-09-13T23:57:25.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.805+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v35'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983683400 2024-09-13T23:57:25.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.805+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94392700095744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983752000 con 0x55d983683400 2024-09-13T23:57:25.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.805+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983748800 con 0x55d983683c00 2024-09-13T23:57:25.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.809+0000 7f9d51bdc700 1 -- 172.21.15.173:0/3124270632 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v35'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d98373b440 con 0x55d983683c00 2024-09-13T23:57:25.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.809+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94392700096896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983749000 con 0x55d983683c00 2024-09-13T23:57:25.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.809+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983749400 con 0x55d983683c00 2024-09-13T23:57:25.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.809+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94392700095744] v35'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983683400 2024-09-13T23:57:25.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.809+0000 7f9d51bdc700 1 -- 172.21.15.173:0/3124270632 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94392700096896] v35'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d98373b440 con 0x55d983683c00 2024-09-13T23:57:25.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.809+0000 7f9d51bdc700 1 -- 172.21.15.173:0/3124270632 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v35'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d98373b440 con 0x55d983683c00 2024-09-13T23:57:25.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.809+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94392700098048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983748c00 con 0x55d983683c00 2024-09-13T23:57:25.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.809+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983683800 con 0x55d983748000 2024-09-13T23:57:25.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.813+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v35'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d98373ab40 con 0x55d983748000 2024-09-13T23:57:25.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.813+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94392700099200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983752400 con 0x55d983748000 2024-09-13T23:57:25.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.813+0000 7f9d53c24f40 20 add_watcher() i=0 2024-09-13T23:57:25.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.813+0000 7f9d53c24f40 20 add_watcher() i=1 2024-09-13T23:57:25.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.813+0000 7f9d53c24f40 20 add_watcher() i=2 2024-09-13T23:57:25.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.813+0000 7f9d53c24f40 20 add_watcher() i=3 2024-09-13T23:57:25.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.813+0000 7f9d53c24f40 20 add_watcher() i=4 2024-09-13T23:57:25.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.813+0000 7f9d53c24f40 20 add_watcher() i=5 2024-09-13T23:57:25.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.813+0000 7f9d51bdc700 1 -- 172.21.15.173:0/3124270632 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94392700098048] v35'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d98373b440 con 0x55d983683c00 2024-09-13T23:57:25.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.813+0000 7f9d53c24f40 20 add_watcher() i=6 2024-09-13T23:57:25.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.813+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94392700099200] v35'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d98373ab40 con 0x55d983748000 2024-09-13T23:57:25.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.813+0000 7f9d53c24f40 20 add_watcher() i=7 2024-09-13T23:57:25.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.813+0000 7f9d53c24f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:57:25.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.813+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983753000 con 0x55d983683000 2024-09-13T23:57:25.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.813+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55d98373ab40 con 0x55d983683000 2024-09-13T23:57:25.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.813+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94392701779968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983753400 con 0x55d983683000 2024-09-13T23:57:25.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.817+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94392701779968] v35'191 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55d98373ab40 con 0x55d983683000 2024-09-13T23:57:25.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.817+0000 7f9d53c24f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:57:25.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.817+0000 7f9d53c24f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:57:25.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.817+0000 7f9d53c24f40 1 Processor -- start 2024-09-13T23:57:25.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.817+0000 7f9d393ab700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:25.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.817+0000 7f9d53c24f40 1 -- start start 2024-09-13T23:57:25.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.817+0000 7f9d53c24f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d983748400 0x55d9835c7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.817+0000 7f9d53c24f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d98336c3c0 con 0x55d983748400 2024-09-13T23:57:25.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.817+0000 7f9d51bdc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d983748400 0x55d9835c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.817+0000 7f9d51bdc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d983748400 0x55d9835c7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35218/0 (socket says 172.21.15.173:35218) 2024-09-13T23:57:25.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.817+0000 7f9d51bdc700 1 -- 172.21.15.173:0/2684406366 learned_addr learned my addr 172.21.15.173:0/2684406366 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.817+0000 7f9d51bdc700 1 -- 172.21.15.173:0/2684406366 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9832f0b60 con 0x55d983748400 2024-09-13T23:57:25.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.821+0000 7f9d51bdc700 1 --2- 172.21.15.173:0/2684406366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d983748400 0x55d9835c7180 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x55d9836e13e0 tx=0x55d9833e3980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c615c79668ab35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.821+0000 7f9d38baa700 1 -- 172.21.15.173:0/2684406366 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d983383760 con 0x55d983748400 2024-09-13T23:57:25.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.821+0000 7f9d38baa700 1 -- 172.21.15.173:0/2684406366 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d983698600 con 0x55d983748400 2024-09-13T23:57:25.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.821+0000 7f9d38baa700 1 -- 172.21.15.173:0/2684406366 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d983766000 con 0x55d983748400 2024-09-13T23:57:25.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.821+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2684406366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d983748400 msgr2=0x55d9835c7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.821+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/2684406366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d983748400 0x55d9835c7180 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x55d9836e13e0 tx=0x55d9833e3980 comp rx=0 tx=0).stop 2024-09-13T23:57:25.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.821+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2684406366 shutdown_connections 2024-09-13T23:57:25.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.821+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/2684406366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d983748400 0x55d9835c7180 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.821+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2684406366 >> 172.21.15.173:0/2684406366 conn(0x55d983752800 msgr2=0x55d9833e0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.821+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2684406366 shutdown_connections 2024-09-13T23:57:25.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.821+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2684406366 wait complete. 2024-09-13T23:57:25.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.821+0000 7f9d53c24f40 1 Processor -- start 2024-09-13T23:57:25.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.821+0000 7f9d53c24f40 1 -- start start 2024-09-13T23:57:25.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.821+0000 7f9d53c24f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d983748400 0x55d9835c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.821+0000 7f9d53c24f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d98336c500 con 0x55d983748400 2024-09-13T23:57:25.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.821+0000 7f9d51bdc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d983748400 0x55d9835c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.821+0000 7f9d51bdc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d983748400 0x55d9835c7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:35224/0 (socket says 172.21.15.173:35224) 2024-09-13T23:57:25.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.821+0000 7f9d51bdc700 1 -- 172.21.15.173:0/2096136808 learned_addr learned my addr 172.21.15.173:0/2096136808 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:57:25.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.821+0000 7f9d51bdc700 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9832f0d00 con 0x55d983748400 2024-09-13T23:57:25.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.821+0000 7f9d51bdc700 1 --2- 172.21.15.173:0/2096136808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d983748400 0x55d9835c7180 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x55d983667a10 tx=0x55d9837325a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.825+0000 7f9d373a7700 1 -- 172.21.15.173:0/2096136808 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d983766160 con 0x55d983748400 2024-09-13T23:57:25.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.825+0000 7f9d373a7700 1 -- 172.21.15.173:0/2096136808 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d983698300 con 0x55d983748400 2024-09-13T23:57:25.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.825+0000 7f9d373a7700 1 -- 172.21.15.173:0/2096136808 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55d9837662c0 con 0x55d983748400 2024-09-13T23:57:25.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.825+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d9832f0340 con 0x55d983748400 2024-09-13T23:57:25.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.825+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d9832f1d40 con 0x55d983748400 2024-09-13T23:57:25.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.825+0000 7f9d373a7700 1 -- 172.21.15.173:0/2096136808 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55d9833d9b80 con 0x55d983748400 2024-09-13T23:57:25.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.825+0000 7f9d373a7700 1 --2- 172.21.15.173:0/2096136808 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d983683800 0x55d9837e4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.825+0000 7f9d373a7700 1 -- 172.21.15.173:0/2096136808 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55d983345500 con 0x55d983748400 2024-09-13T23:57:25.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.825+0000 7f9d52bde700 1 --2- 172.21.15.173:0/2096136808 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d983683800 0x55d9837e4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.825+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/2096136808 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55d983749800 0x55d9835c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.825+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983749c00 con 0x55d983749800 2024-09-13T23:57:25.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.825+0000 7f9d523dd700 1 --2- 172.21.15.173:0/2096136808 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55d983749800 0x55d9835c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.825+0000 7f9d52bde700 1 --2- 172.21.15.173:0/2096136808 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d983683800 0x55d9837e4000 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55d983761320 tx=0x55d9837335c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.825+0000 7f9d523dd700 1 --2- 172.21.15.173:0/2096136808 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55d983749800 0x55d9835c7700 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.829+0000 7f9d523dd700 1 -- 172.21.15.173:0/2096136808 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v35'34 uv30 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983749800 2024-09-13T23:57:25.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.829+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/2096136808 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55d983748800 0x55d9837e4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.829+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983752c00 con 0x55d983748800 2024-09-13T23:57:25.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.829+0000 7f9d51bdc700 1 --2- 172.21.15.173:0/2096136808 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55d983748800 0x55d9837e4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.829+0000 7f9d51bdc700 1 --2- 172.21.15.173:0/2096136808 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55d983748800 0x55d9837e4580 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.829+0000 7f9d51bdc700 1 -- 172.21.15.173:0/2096136808 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v35'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55d98373b440 con 0x55d983748800 2024-09-13T23:57:25.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.829+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/2096136808 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55d983753800 0x55d9837e4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.829+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983753c00 con 0x55d983753800 2024-09-13T23:57:25.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.833+0000 7f9d52bde700 1 --2- 172.21.15.173:0/2096136808 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55d983753800 0x55d9837e4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.833+0000 7f9d52bde700 1 --2- 172.21.15.173:0/2096136808 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55d983753800 0x55d9837e4b00 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.833+0000 7f9d52bde700 1 -- 172.21.15.173:0/2096136808 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v35'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55d98373ab40 con 0x55d983753800 2024-09-13T23:57:25.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.833+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/2096136808 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55d983752400 0x55d9837e5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:57:25.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.833+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983802000 con 0x55d983752400 2024-09-13T23:57:25.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.833+0000 7f9d523dd700 1 --2- 172.21.15.173:0/2096136808 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55d983752400 0x55d9837e5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:57:25.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.837+0000 7f9d523dd700 1 --2- 172.21.15.173:0/2096136808 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55d983752400 0x55d9837e5080 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:57:25.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.837+0000 7f9d523dd700 1 -- 172.21.15.173:0/2096136808 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v35'192 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983752400 2024-09-13T23:57:25.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.837+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983802400 con 0x55d983749800 2024-09-13T23:57:25.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.841+0000 7f9d523dd700 1 -- 172.21.15.173:0/2096136808 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v35'65 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983749800 2024-09-13T23:57:25.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.841+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983802800 con 0x55d983753800 2024-09-13T23:57:25.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.841+0000 7f9d52bde700 1 -- 172.21.15.173:0/2096136808 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v35'43 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55d98373ab40 con 0x55d983753800 2024-09-13T23:57:25.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.841+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983802c00 con 0x55d983749800 2024-09-13T23:57:25.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.845+0000 7f9d523dd700 1 -- 172.21.15.173:0/2096136808 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v35'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983749800 2024-09-13T23:57:25.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.845+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983803000 con 0x55d983752400 2024-09-13T23:57:25.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.849+0000 7f9d523dd700 1 -- 172.21.15.173:0/2096136808 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v35'43 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983752400 2024-09-13T23:57:25.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.849+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983803400 con 0x55d983749800 2024-09-13T23:57:25.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.849+0000 7f9d523dd700 1 -- 172.21.15.173:0/2096136808 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v35'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983749800 2024-09-13T23:57:25.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.849+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983803800 con 0x55d983749800 2024-09-13T23:57:25.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.853+0000 7f9d523dd700 1 -- 172.21.15.173:0/2096136808 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v35'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983749800 2024-09-13T23:57:25.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.853+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983803c00 con 0x55d983749800 2024-09-13T23:57:25.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.857+0000 7f9d523dd700 1 -- 172.21.15.173:0/2096136808 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v35'66 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983749800 2024-09-13T23:57:25.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.857+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983802000 con 0x55d983753800 2024-09-13T23:57:25.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.857+0000 7f9d52bde700 1 -- 172.21.15.173:0/2096136808 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v35'28 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d98373ab40 con 0x55d983753800 2024-09-13T23:57:25.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.857+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983802400 con 0x55d983749800 2024-09-13T23:57:25.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.861+0000 7f9d523dd700 1 -- 172.21.15.173:0/2096136808 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v35'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983749800 2024-09-13T23:57:25.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.861+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983802c00 con 0x55d983752400 2024-09-13T23:57:25.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.861+0000 7f9d523dd700 1 -- 172.21.15.173:0/2096136808 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v35'49 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983752400 2024-09-13T23:57:25.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.865+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983749c00 con 0x55d983752400 2024-09-13T23:57:25.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.865+0000 7f9d523dd700 1 -- 172.21.15.173:0/2096136808 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v35'193 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983752400 2024-09-13T23:57:25.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.865+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983752000 con 0x55d983749800 2024-09-13T23:57:25.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.869+0000 7f9d523dd700 1 -- 172.21.15.173:0/2096136808 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v35'59 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983749800 2024-09-13T23:57:25.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.869+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983803000 con 0x55d983749800 2024-09-13T23:57:25.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.869+0000 7f9d523dd700 1 -- 172.21.15.173:0/2096136808 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v35'67 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983749800 2024-09-13T23:57:25.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.869+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983803400 con 0x55d983753800 2024-09-13T23:57:25.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.873+0000 7f9d52bde700 1 -- 172.21.15.173:0/2096136808 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v35'28 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d98373ab40 con 0x55d983753800 2024-09-13T23:57:25.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.873+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983803800 con 0x55d983749800 2024-09-13T23:57:25.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.877+0000 7f9d523dd700 1 -- 172.21.15.173:0/2096136808 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v35'33 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983749800 2024-09-13T23:57:25.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.877+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983803c00 con 0x55d983752400 2024-09-13T23:57:25.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.881+0000 7f9d523dd700 1 -- 172.21.15.173:0/2096136808 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v35'194 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983752400 2024-09-13T23:57:25.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.881+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983802400 con 0x55d983749800 2024-09-13T23:57:25.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.881+0000 7f9d523dd700 1 -- 172.21.15.173:0/2096136808 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v35'60 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983749800 2024-09-13T23:57:25.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.881+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983802c00 con 0x55d983749800 2024-09-13T23:57:25.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.885+0000 7f9d523dd700 1 -- 172.21.15.173:0/2096136808 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v35'35 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983749800 2024-09-13T23:57:25.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.885+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983752000 con 0x55d983753800 2024-09-13T23:57:25.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.889+0000 7f9d52bde700 1 -- 172.21.15.173:0/2096136808 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v35'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d98373ab40 con 0x55d983753800 2024-09-13T23:57:25.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.889+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983753000 con 0x55d983749800 2024-09-13T23:57:25.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.889+0000 7f9d523dd700 1 -- 172.21.15.173:0/2096136808 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v35'32 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983749800 2024-09-13T23:57:25.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.889+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983753400 con 0x55d983753800 2024-09-13T23:57:25.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.893+0000 7f9d52bde700 1 -- 172.21.15.173:0/2096136808 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v35'21 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d98373ab40 con 0x55d983753800 2024-09-13T23:57:25.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.893+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983753c00 con 0x55d983753800 2024-09-13T23:57:25.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.897+0000 7f9d52bde700 1 -- 172.21.15.173:0/2096136808 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v35'44 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d98373ab40 con 0x55d983753800 2024-09-13T23:57:25.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.897+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983749c00 con 0x55d983753800 2024-09-13T23:57:25.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.897+0000 7f9d52bde700 1 -- 172.21.15.173:0/2096136808 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v35'33 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d98373ab40 con 0x55d983753800 2024-09-13T23:57:25.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.897+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983826000 con 0x55d983749800 2024-09-13T23:57:25.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.901+0000 7f9d523dd700 1 -- 172.21.15.173:0/2096136808 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v35'30 uv26 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983749800 2024-09-13T23:57:25.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.901+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983826400 con 0x55d983752400 2024-09-13T23:57:25.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.905+0000 7f9d523dd700 1 -- 172.21.15.173:0/2096136808 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v35'44 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983752400 2024-09-13T23:57:25.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.905+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983826800 con 0x55d983749800 2024-09-13T23:57:25.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.905+0000 7f9d523dd700 1 -- 172.21.15.173:0/2096136808 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v35'61 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983749800 2024-09-13T23:57:25.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.905+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983826c00 con 0x55d983752400 2024-09-13T23:57:25.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.909+0000 7f9d523dd700 1 -- 172.21.15.173:0/2096136808 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v35'50 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983752400 2024-09-13T23:57:25.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.909+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983827000 con 0x55d983748800 2024-09-13T23:57:25.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.909+0000 7f9d51bdc700 1 -- 172.21.15.173:0/2096136808 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v35'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55d98373b440 con 0x55d983748800 2024-09-13T23:57:25.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.913+0000 7f9d34ba2700 20 reqs_thread_entry: start 2024-09-13T23:57:25.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.913+0000 7f9d53c24f40 20 init_complete bucket index max shards: 11 2024-09-13T23:57:25.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.913+0000 7f9d53c24f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:57:25.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.913+0000 7f9d32b9e700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:57:56 2024 2024-09-13T23:57:25.921 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:57:25.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.913+0000 7f9d3237c700 20 reqs_thread_entry: start 2024-09-13T23:57:25.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.913+0000 7f9d53c24f40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:57:25.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.913+0000 7f9d53c24f40 20 rados->read ofs=0 len=0 2024-09-13T23:57:25.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.913+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d983827c00 con 0x55d983683000 2024-09-13T23:57:25.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.917+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv18 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55d98373ab40 con 0x55d983683000 2024-09-13T23:57:25.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.917+0000 7f9d53c24f40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:57:25.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.917+0000 7f9d53c24f40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:57:25.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.917+0000 7f9d53c24f40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:57:25.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.917+0000 7f9d53c24f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:57:25.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.917+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d98388e000 con 0x55d983748000 2024-09-13T23:57:25.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.917+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv40 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x55d98373ab40 con 0x55d983748000 2024-09-13T23:57:25.923 INFO:teuthology.orchestra.run.smithi173.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-13T23:57:25.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.917+0000 7f9d393ab700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:57:25.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.917+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94392701779968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d98388e400 con 0x55d983683000 2024-09-13T23:57:25.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.921+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94392701779968] v35'195 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55d98373ab40 con 0x55d983683000 2024-09-13T23:57:25.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.921+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94392700091136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d98388e800 con 0x55d983683400 2024-09-13T23:57:25.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.921+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94392700091136] v35'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983683400 2024-09-13T23:57:25.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.925+0000 7f9d53c24f40 20 remove_watcher() i=0 2024-09-13T23:57:25.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.925+0000 7f9d53c24f40 2 removed watcher, disabling cache 2024-09-13T23:57:25.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.925+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94392700092288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d98388ec00 con 0x55d983683000 2024-09-13T23:57:25.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.925+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94392700092288] v35'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d98373ab40 con 0x55d983683000 2024-09-13T23:57:25.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.925+0000 7f9d53c24f40 20 remove_watcher() i=1 2024-09-13T23:57:25.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.925+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94392700093440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d98388f000 con 0x55d983683400 2024-09-13T23:57:25.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.929+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94392700093440] v35'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983683400 2024-09-13T23:57:25.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.929+0000 7f9d53c24f40 20 remove_watcher() i=2 2024-09-13T23:57:25.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.929+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94392700094592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d98388f400 con 0x55d983748000 2024-09-13T23:57:25.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.933+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94392700094592] v35'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d98373ab40 con 0x55d983748000 2024-09-13T23:57:25.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.933+0000 7f9d53c24f40 20 remove_watcher() i=3 2024-09-13T23:57:25.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.933+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94392700095744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d98388f800 con 0x55d983683400 2024-09-13T23:57:25.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.933+0000 7f9d523dd700 1 -- 172.21.15.173:0/3124270632 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94392700095744] v35'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d98373b200 con 0x55d983683400 2024-09-13T23:57:25.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.933+0000 7f9d53c24f40 20 remove_watcher() i=4 2024-09-13T23:57:25.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.933+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94392700096896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d98388fc00 con 0x55d983683c00 2024-09-13T23:57:25.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.937+0000 7f9d51bdc700 1 -- 172.21.15.173:0/3124270632 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94392700096896] v35'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d98373b440 con 0x55d983683c00 2024-09-13T23:57:25.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.937+0000 7f9d53c24f40 20 remove_watcher() i=5 2024-09-13T23:57:25.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.937+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94392700098048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d98388fc00 con 0x55d983683c00 2024-09-13T23:57:25.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.941+0000 7f9d51bdc700 1 -- 172.21.15.173:0/3124270632 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94392700098048] v35'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d98373b440 con 0x55d983683c00 2024-09-13T23:57:25.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.941+0000 7f9d53c24f40 20 remove_watcher() i=6 2024-09-13T23:57:25.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.941+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94392700099200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55d98388e800 con 0x55d983748000 2024-09-13T23:57:25.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.941+0000 7f9d52bde700 1 -- 172.21.15.173:0/3124270632 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94392700099200] v35'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55d98373ab40 con 0x55d983748000 2024-09-13T23:57:25.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.941+0000 7f9d53c24f40 20 remove_watcher() i=7 2024-09-13T23:57:25.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.941+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55d983683400 msgr2=0x55d9835c6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.941+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/3124270632 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55d983683400 0x55d9835c6100 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.941+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55d983683000 msgr2=0x55d9835c5b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.941+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/3124270632 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55d983683000 0x55d9835c5b80 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.941+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55d983748000 msgr2=0x55d9835c6c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.941+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/3124270632 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55d983748000 0x55d9835c6c00 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.941+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55d983683c00 msgr2=0x55d9835c6680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.941+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/3124270632 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55d983683c00 0x55d9835c6680 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.941+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d983682c00 msgr2=0x55d9835c5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.941+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/3124270632 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d983682c00 0x55d9835c5600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55d9835bf920 tx=0x55d9833e3800 comp rx=0 tx=0).stop 2024-09-13T23:57:25.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.941+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df800 msgr2=0x55d9835c4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.941+0000 7f9d51bdc700 1 -- 172.21.15.173:0/3124270632 reap_dead start 2024-09-13T23:57:25.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.941+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/3124270632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df800 0x55d9835c4b00 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x55d9836100f0 tx=0x55d9833e3bc0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 shutdown_connections 2024-09-13T23:57:25.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/3124270632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df800 0x55d9835c4b00 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 >> 172.21.15.173:0/3124270632 conn(0x55d9832df400 msgr2=0x55d9833df800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 shutdown_connections 2024-09-13T23:57:25.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 -- 172.21.15.173:0/3124270632 wait complete. 2024-09-13T23:57:25.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55d983749800 msgr2=0x55d9835c7700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/2096136808 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55d983749800 0x55d9835c7700 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55d983752400 msgr2=0x55d9837e5080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/2096136808 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55d983752400 0x55d9837e5080 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55d983748800 msgr2=0x55d9837e4580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/2096136808 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55d983748800 0x55d9837e4580 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55d983753800 msgr2=0x55d9837e4b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/2096136808 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55d983753800 0x55d9837e4b00 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d983683800 msgr2=0x55d9837e4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/2096136808 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d983683800 0x55d9837e4000 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55d983761320 tx=0x55d9837335c0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d983748400 msgr2=0x55d9835c7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d523dd700 1 -- 172.21.15.173:0/2096136808 reap_dead start 2024-09-13T23:57:25.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/2096136808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d983748400 0x55d9835c7180 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x55d983667a10 tx=0x55d9837325a0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 shutdown_connections 2024-09-13T23:57:25.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/2096136808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d983748400 0x55d9835c7180 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 >> 172.21.15.173:0/2096136808 conn(0x55d983752800 msgr2=0x55d9833e0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 shutdown_connections 2024-09-13T23:57:25.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 -- 172.21.15.173:0/2096136808 wait complete. 2024-09-13T23:57:25.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 -- 172.21.15.173:0/1906138947 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d983682000 msgr2=0x55d9835c5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/1906138947 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d983682000 0x55d9835c5080 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x55d9836114d0 tx=0x55d98363e240 comp rx=0 tx=0).stop 2024-09-13T23:57:25.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 -- 172.21.15.173:0/1906138947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df000 msgr2=0x55d9835c4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:57:25.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/1906138947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df000 0x55d9835c4580 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x55d9840a9e00 tx=0x55d9833e3a40 comp rx=0 tx=0).stop 2024-09-13T23:57:25.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 -- 172.21.15.173:0/1906138947 shutdown_connections 2024-09-13T23:57:25.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/1906138947 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55d983682000 0x55d9835c5080 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 --2- 172.21.15.173:0/1906138947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d9832df000 0x55d9835c4580 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:57:25.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 -- 172.21.15.173:0/1906138947 >> 172.21.15.173:0/1906138947 conn(0x55d9832dec00 msgr2=0x55d9833df000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:57:25.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 -- 172.21.15.173:0/1906138947 shutdown_connections 2024-09-13T23:57:25.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:57:25.945+0000 7f9d53c24f40 1 -- 172.21.15.173:0/1906138947 wait complete. 2024-09-13T23:57:25.961 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T23:57:25.968 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:57:26.018 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-13T23:58:01.019 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-13T23:58:01.020 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-13T23:58:01.020 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-13T23:58:01.062 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:58:01.062 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:58:01.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.060+0000 7efd804f9f40 1 Processor -- start 2024-09-13T23:58:01.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.060+0000 7efd804f9f40 1 -- start start 2024-09-13T23:58:01.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.060+0000 7efd804f9f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x563043779000 0x563043a5e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.060+0000 7efd804f9f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56304383d500 con 0x563043779400 2024-09-13T23:58:01.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.060+0000 7efd804f9f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x563043806a00 con 0x563043779000 2024-09-13T23:58:01.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.060+0000 7efd7ecb2700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x563043779000 0x563043a5e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.060+0000 7efd7ecb2700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x563043779000 0x563043a5e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58318/0 (socket says 172.21.15.173:58318) 2024-09-13T23:58:01.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.060+0000 7efd7e4b1700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x563043779400 0x563043878800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:35204/0 (socket says 172.21.15.173:35204) 2024-09-13T23:58:01.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.060+0000 7efd7ecb2700 1 -- 172.21.15.173:0/313193718 learned_addr learned my addr 172.21.15.173:0/313193718 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.060+0000 7efd7ecb2700 1 -- 172.21.15.173:0/313193718 >> v1:172.21.15.87:6789/0 conn(0x563043779400 legacy=0x563043878800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.060+0000 7efd7ecb2700 1 -- 172.21.15.173:0/313193718 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56304378bd40 con 0x563043779000 2024-09-13T23:58:01.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.060+0000 7efd7ecb2700 1 --2- 172.21.15.173:0/313193718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779000 0x563043a5e580 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x563043a59a70 tx=0x56304387d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffdcd7fb785ff9c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.060+0000 7efd7dcb0700 1 -- 172.21.15.173:0/313193718 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56304381d4a0 con 0x563043779000 2024-09-13T23:58:01.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd7dcb0700 1 -- 172.21.15.173:0/313193718 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56304383d800 con 0x563043779000 2024-09-13T23:58:01.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd7dcb0700 1 -- 172.21.15.173:0/313193718 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56304381d600 con 0x563043779000 2024-09-13T23:58:01.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd804f9f40 1 -- 172.21.15.173:0/313193718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779000 msgr2=0x563043a5e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd804f9f40 1 --2- 172.21.15.173:0/313193718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779000 0x563043a5e580 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x563043a59a70 tx=0x56304387d920 comp rx=0 tx=0).stop 2024-09-13T23:58:01.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd804f9f40 1 -- 172.21.15.173:0/313193718 shutdown_connections 2024-09-13T23:58:01.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd804f9f40 1 --2- 172.21.15.173:0/313193718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779000 0x563043a5e580 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd804f9f40 1 -- 172.21.15.173:0/313193718 >> 172.21.15.173:0/313193718 conn(0x563043778c00 msgr2=0x563043878000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd804f9f40 1 -- 172.21.15.173:0/313193718 shutdown_connections 2024-09-13T23:58:01.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd804f9f40 1 -- 172.21.15.173:0/313193718 wait complete. 2024-09-13T23:58:01.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd804f9f40 1 Processor -- start 2024-09-13T23:58:01.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd804f9f40 1 -- start start 2024-09-13T23:58:01.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd804f9f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779000 0x563043a5e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd804f9f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563043806500 con 0x563043779000 2024-09-13T23:58:01.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd7ecb2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779000 0x563043a5e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd7ecb2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779000 0x563043a5e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58330/0 (socket says 172.21.15.173:58330) 2024-09-13T23:58:01.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd7ecb2700 1 -- 172.21.15.173:0/3124512805 learned_addr learned my addr 172.21.15.173:0/3124512805 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd7ecb2700 1 -- 172.21.15.173:0/3124512805 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56304378bba0 con 0x563043779000 2024-09-13T23:58:01.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd7ecb2700 1 --2- 172.21.15.173:0/3124512805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779000 0x563043a5e580 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x563043a58c30 tx=0x56304387d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8859daff6541376 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd7d4af700 1 -- 172.21.15.173:0/3124512805 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56304381d760 con 0x563043779000 2024-09-13T23:58:01.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd7d4af700 1 -- 172.21.15.173:0/3124512805 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56304383db00 con 0x563043779000 2024-09-13T23:58:01.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd7d4af700 1 -- 172.21.15.173:0/3124512805 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56304381d4a0 con 0x563043779000 2024-09-13T23:58:01.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd804f9f40 1 -- 172.21.15.173:0/3124512805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779000 msgr2=0x563043a5e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd804f9f40 1 --2- 172.21.15.173:0/3124512805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779000 0x563043a5e580 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x563043a58c30 tx=0x56304387d800 comp rx=0 tx=0).stop 2024-09-13T23:58:01.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd804f9f40 1 -- 172.21.15.173:0/3124512805 shutdown_connections 2024-09-13T23:58:01.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd804f9f40 1 --2- 172.21.15.173:0/3124512805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779000 0x563043a5e580 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.064+0000 7efd804f9f40 1 -- 172.21.15.173:0/3124512805 >> 172.21.15.173:0/3124512805 conn(0x563043778c00 msgr2=0x563043879000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.068+0000 7efd804f9f40 1 -- 172.21.15.173:0/3124512805 shutdown_connections 2024-09-13T23:58:01.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.068+0000 7efd804f9f40 1 -- 172.21.15.173:0/3124512805 wait complete. 2024-09-13T23:58:01.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.068+0000 7efd804f9f40 1 Processor -- start 2024-09-13T23:58:01.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.068+0000 7efd804f9f40 1 -- start start 2024-09-13T23:58:01.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.068+0000 7efd804f9f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779000 0x563043a5e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.068+0000 7efd804f9f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630438063c0 con 0x563043779000 2024-09-13T23:58:01.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.068+0000 7efd7ecb2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779000 0x563043a5e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.068+0000 7efd7ecb2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779000 0x563043a5e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58342/0 (socket says 172.21.15.173:58342) 2024-09-13T23:58:01.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.068+0000 7efd7ecb2700 1 -- 172.21.15.173:0/409954840 learned_addr learned my addr 172.21.15.173:0/409954840 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.068+0000 7efd7ecb2700 1 -- 172.21.15.173:0/409954840 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56304378ba00 con 0x563043779000 2024-09-13T23:58:01.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.068+0000 7efd7ecb2700 1 --2- 172.21.15.173:0/409954840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779000 0x563043a5e580 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x5630438d5fb0 tx=0x56304387d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.068+0000 7efd7bcac700 1 -- 172.21.15.173:0/409954840 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56304381d600 con 0x563043779000 2024-09-13T23:58:01.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.068+0000 7efd804f9f40 1 -- 172.21.15.173:0/409954840 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56304378b860 con 0x563043779000 2024-09-13T23:58:01.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.068+0000 7efd7bcac700 1 -- 172.21.15.173:0/409954840 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56304383dc80 con 0x563043779000 2024-09-13T23:58:01.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.068+0000 7efd7bcac700 1 -- 172.21.15.173:0/409954840 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56304381d8c0 con 0x563043779000 2024-09-13T23:58:01.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.068+0000 7efd804f9f40 1 -- 172.21.15.173:0/409954840 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56304378b6c0 con 0x563043779000 2024-09-13T23:58:01.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.072+0000 7efd804f9f40 1 Processor -- start 2024-09-13T23:58:01.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.072+0000 7efd804f9f40 1 -- start start 2024-09-13T23:58:01.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.072+0000 7efd7bcac700 1 -- 172.21.15.173:0/409954840 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x563043872b00 con 0x563043779000 2024-09-13T23:58:01.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.072+0000 7efd804f9f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779800 0x563043a5eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.072+0000 7efd7bcac700 1 --2- 172.21.15.173:0/409954840 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563043b16000 0x563043a5f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.072+0000 7efd804f9f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563043806000 con 0x563043779800 2024-09-13T23:58:01.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.072+0000 7efd7bcac700 1 -- 172.21.15.173:0/409954840 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x5630437df180 con 0x563043779000 2024-09-13T23:58:01.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.072+0000 7efd7ecb2700 1 --2- 172.21.15.173:0/409954840 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563043b16000 0x563043a5f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.072+0000 7efd7f4b3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779800 0x563043a5eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.072+0000 7efd7f4b3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779800 0x563043a5eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58352/0 (socket says 172.21.15.173:58352) 2024-09-13T23:58:01.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.072+0000 7efd7f4b3700 1 -- 172.21.15.173:0/302245670 learned_addr learned my addr 172.21.15.173:0/302245670 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.072+0000 7efd7f4b3700 1 -- 172.21.15.173:0/302245670 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56304378a000 con 0x563043779800 2024-09-13T23:58:01.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.072+0000 7efd7ecb2700 1 --2- 172.21.15.173:0/409954840 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563043b16000 0x563043a5f080 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x563043aa0ed0 tx=0x563043adcb40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.072+0000 7efd7f4b3700 1 --2- 172.21.15.173:0/302245670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779800 0x563043a5eb00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x563043aa02d0 tx=0x563043adce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b5f430d090bdae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.072+0000 7efd794a7700 1 -- 172.21.15.173:0/302245670 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56304381d600 con 0x563043779800 2024-09-13T23:58:01.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.072+0000 7efd794a7700 1 -- 172.21.15.173:0/302245670 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563043b28000 con 0x563043779800 2024-09-13T23:58:01.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.072+0000 7efd794a7700 1 -- 172.21.15.173:0/302245670 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56304381d8c0 con 0x563043779800 2024-09-13T23:58:01.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.072+0000 7efd804f9f40 1 -- 172.21.15.173:0/302245670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779800 msgr2=0x563043a5eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.072+0000 7efd804f9f40 1 --2- 172.21.15.173:0/302245670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779800 0x563043a5eb00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x563043aa02d0 tx=0x563043adce40 comp rx=0 tx=0).stop 2024-09-13T23:58:01.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.072+0000 7efd804f9f40 1 -- 172.21.15.173:0/302245670 shutdown_connections 2024-09-13T23:58:01.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.072+0000 7efd804f9f40 1 --2- 172.21.15.173:0/302245670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779800 0x563043a5eb00 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.072+0000 7efd804f9f40 1 -- 172.21.15.173:0/302245670 >> 172.21.15.173:0/302245670 conn(0x563043779400 msgr2=0x563043879800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.076+0000 7efd804f9f40 1 -- 172.21.15.173:0/302245670 shutdown_connections 2024-09-13T23:58:01.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.076+0000 7efd804f9f40 1 -- 172.21.15.173:0/302245670 wait complete. 2024-09-13T23:58:01.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.076+0000 7efd804f9f40 1 Processor -- start 2024-09-13T23:58:01.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.076+0000 7efd804f9f40 1 -- start start 2024-09-13T23:58:01.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.076+0000 7efd804f9f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779800 0x563043a5eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.076+0000 7efd804f9f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56304379e640 con 0x563043779800 2024-09-13T23:58:01.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.076+0000 7efd7f4b3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779800 0x563043a5eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.076+0000 7efd7f4b3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779800 0x563043a5eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58358/0 (socket says 172.21.15.173:58358) 2024-09-13T23:58:01.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.076+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 learned_addr learned my addr 172.21.15.173:0/1202925167 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.076+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56304378aea0 con 0x563043779800 2024-09-13T23:58:01.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.076+0000 7efd7f4b3700 1 --2- 172.21.15.173:0/1202925167 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779800 0x563043a5eb00 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x563043aa0840 tx=0x563043adca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.076+0000 7efd77ca4700 1 -- 172.21.15.173:0/1202925167 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56304381d760 con 0x563043779800 2024-09-13T23:58:01.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.076+0000 7efd77ca4700 1 -- 172.21.15.173:0/1202925167 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563043b28180 con 0x563043779800 2024-09-13T23:58:01.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.076+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56304378a820 con 0x563043779800 2024-09-13T23:58:01.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.076+0000 7efd77ca4700 1 -- 172.21.15.173:0/1202925167 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56304381d600 con 0x563043779800 2024-09-13T23:58:01.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.076+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56304378a9c0 con 0x563043779800 2024-09-13T23:58:01.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.080+0000 7efd77ca4700 1 -- 172.21.15.173:0/1202925167 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x563043872dc0 con 0x563043779800 2024-09-13T23:58:01.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.080+0000 7efd77ca4700 1 --2- 172.21.15.173:0/1202925167 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563043b16c00 0x563043a5f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.080+0000 7efd77ca4700 1 -- 172.21.15.173:0/1202925167 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x5630437df340 con 0x563043779800 2024-09-13T23:58:01.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.080+0000 7efd7e4b1700 1 --2- 172.21.15.173:0/1202925167 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563043b16c00 0x563043a5f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.080+0000 7efd804f9f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.080+0000 7efd804f9f40 1 --2- 172.21.15.173:0/1202925167 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563043b17000 0x563043a5fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.080+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17400 con 0x563043b17000 2024-09-13T23:58:01.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.080+0000 7efd7f4b3700 1 --2- 172.21.15.173:0/1202925167 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563043b17000 0x563043a5fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.080+0000 7efd7e4b1700 1 --2- 172.21.15.173:0/1202925167 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563043b16c00 0x563043a5f600 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x563043a59f80 tx=0x563043bc40c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.080+0000 7efd7f4b3700 1 --2- 172.21.15.173:0/1202925167 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563043b17000 0x563043a5fb80 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.080+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.080+0000 7efd804f9f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.080+0000 7efd804f9f40 20 realm 2024-09-13T23:58:01.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.080+0000 7efd804f9f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.080+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17000 2024-09-13T23:58:01.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.080+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.080+0000 7efd804f9f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.080+0000 7efd804f9f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:58:01.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.080+0000 7efd804f9f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.080+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17c00 con 0x563043b17000 2024-09-13T23:58:01.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.080+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.080+0000 7efd804f9f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.080+0000 7efd804f9f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.084+0000 7efd804f9f40 1 --2- 172.21.15.173:0/1202925167 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563043b17400 0x563043a60100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.084+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17400 2024-09-13T23:58:01.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.084+0000 7efd7ecb2700 1 --2- 172.21.15.173:0/1202925167 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563043b17400 0x563043a60100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.084+0000 7efd7ecb2700 1 --2- 172.21.15.173:0/1202925167 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563043b17400 0x563043a60100 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.084+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.084+0000 7efd804f9f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:01.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.084+0000 7efd804f9f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.084+0000 7efd804f9f40 1 --2- 172.21.15.173:0/1202925167 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563043b17c00 0x563043a60680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.084+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be0000 con 0x563043b17c00 2024-09-13T23:58:01.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.084+0000 7efd7e4b1700 1 --2- 172.21.15.173:0/1202925167 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563043b17c00 0x563043a60680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.084+0000 7efd7e4b1700 1 --2- 172.21.15.173:0/1202925167 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563043b17c00 0x563043a60680 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.084+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.084+0000 7efd804f9f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:58:01.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.084+0000 7efd804f9f40 20 searching for the correct realm 2024-09-13T23:58:01.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.084+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be0400 con 0x563043b17c00 2024-09-13T23:58:01.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.084+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.088+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be0000 con 0x563043b17400 2024-09-13T23:58:01.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.088+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.088+0000 7efd7ecb2700 1 --2- 172.21.15.173:0/1202925167 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563043be0000 0x563043a60c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.088+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043be0000 2024-09-13T23:58:01.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.088+0000 7efd7f4b3700 1 --2- 172.21.15.173:0/1202925167 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563043be0000 0x563043a60c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.088+0000 7efd7f4b3700 1 --2- 172.21.15.173:0/1202925167 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563043be0000 0x563043a60c00 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.088+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdcb40 con 0x563043be0000 2024-09-13T23:58:01.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.088+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043be0000 2024-09-13T23:58:01.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.088+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x563043bdcb40 con 0x563043be0000 2024-09-13T23:58:01.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.088+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17000 2024-09-13T23:58:01.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.088+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.088+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17c00 2024-09-13T23:58:01.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.088+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.088+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17000 2024-09-13T23:58:01.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.088+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.088+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17400 2024-09-13T23:58:01.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.092+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.092+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17400 2024-09-13T23:58:01.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.092+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.092+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17000 2024-09-13T23:58:01.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.092+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.092+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043be0000 2024-09-13T23:58:01.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.092+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdcb40 con 0x563043be0000 2024-09-13T23:58:01.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.092+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17000 2024-09-13T23:58:01.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.092+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.092+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043be0000 2024-09-13T23:58:01.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.092+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdcb40 con 0x563043be0000 2024-09-13T23:58:01.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.092+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17400 2024-09-13T23:58:01.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.096+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.096+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17c00 2024-09-13T23:58:01.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.096+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.096+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17000 2024-09-13T23:58:01.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.096+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.096+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17400 2024-09-13T23:58:01.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.096+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.096+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17c00 2024-09-13T23:58:01.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.096+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.096+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17000 2024-09-13T23:58:01.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.096+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.096+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17000 2024-09-13T23:58:01.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.096+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.096+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17000 2024-09-13T23:58:01.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.100+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.100+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17c00 2024-09-13T23:58:01.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.100+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.100+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043be0000 2024-09-13T23:58:01.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.100+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdcb40 con 0x563043be0000 2024-09-13T23:58:01.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.100+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17000 2024-09-13T23:58:01.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.100+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.100+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043be0000 2024-09-13T23:58:01.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.100+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdcb40 con 0x563043be0000 2024-09-13T23:58:01.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.100+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17c00 2024-09-13T23:58:01.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.100+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.100+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043be0000 2024-09-13T23:58:01.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.100+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdcb40 con 0x563043be0000 2024-09-13T23:58:01.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.100+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17400 2024-09-13T23:58:01.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.100+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.100+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17400 2024-09-13T23:58:01.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.104+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.104+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17c00 2024-09-13T23:58:01.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.104+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.104+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17400 2024-09-13T23:58:01.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.104+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.104+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043b17400 2024-09-13T23:58:01.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.104+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.104+0000 7efd804f9f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:58:01.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.104+0000 7efd804f9f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:58:01.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.104+0000 7efd804f9f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:58:01.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.104+0000 7efd804f9f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:58:01.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.104+0000 7efd804f9f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.104+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be0800 con 0x563043b17000 2024-09-13T23:58:01.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.104+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.104+0000 7efd804f9f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.104+0000 7efd804f9f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.104+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be0c00 con 0x563043b17400 2024-09-13T23:58:01.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd804f9f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:01.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd804f9f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be1000 con 0x563043be0000 2024-09-13T23:58:01.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x563043bdcb40 con 0x563043be0000 2024-09-13T23:58:01.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd804f9f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:58:01.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd804f9f40 20 zone default found 2024-09-13T23:58:01.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd804f9f40 4 Realm: () 2024-09-13T23:58:01.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd804f9f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:58:01.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd804f9f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:58:01.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd804f9f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:58:01.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd804f9f40 20 zonegroup default 2024-09-13T23:58:01.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd804f9f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be1400 con 0x563043be0000 2024-09-13T23:58:01.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043be0000 2024-09-13T23:58:01.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd804f9f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd804f9f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be1800 con 0x563043b17c00 2024-09-13T23:58:01.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd804f9f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd804f9f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be1c00 con 0x563043b17c00 2024-09-13T23:58:01.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd804f9f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd804f9f40 20 started sync module instance, tier type = 2024-09-13T23:58:01.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd804f9f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:58:01.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.108+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be6000 con 0x563043b17400 2024-09-13T23:58:01.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.112+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v35'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.112+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94765293329152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be6400 con 0x563043b17400 2024-09-13T23:58:01.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.112+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be6800 con 0x563043b17000 2024-09-13T23:58:01.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.116+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v35'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.116+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94765293330304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be6c00 con 0x563043b17000 2024-09-13T23:58:01.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.116+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94765293329152] v35'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.116+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be7000 con 0x563043b17400 2024-09-13T23:58:01.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.120+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94765293330304] v35'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.120+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v35'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.120+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94765293331456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be7400 con 0x563043b17400 2024-09-13T23:58:01.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.120+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be7800 con 0x563043be0000 2024-09-13T23:58:01.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.120+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v35'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043be0000 2024-09-13T23:58:01.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.120+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94765293332608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be7c00 con 0x563043be0000 2024-09-13T23:58:01.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.124+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be6800 con 0x563043b17400 2024-09-13T23:58:01.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.124+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94765293331456] v35'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.124+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94765293332608] v35'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043be0000 2024-09-13T23:58:01.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.124+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v35'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.124+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94765293333760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be6000 con 0x563043b17400 2024-09-13T23:58:01.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.124+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be0800 con 0x563043b17c00 2024-09-13T23:58:01.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.128+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v35'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.128+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94765293334912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be1000 con 0x563043b17c00 2024-09-13T23:58:01.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.128+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be1400 con 0x563043b17c00 2024-09-13T23:58:01.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.128+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94765293333760] v35'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.128+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94765293334912] v35'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.132+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v35'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.132+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94765293336064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be0c00 con 0x563043b17c00 2024-09-13T23:58:01.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.132+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043b17800 con 0x563043be0000 2024-09-13T23:58:01.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.132+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94765293336064] v35'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.132+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v35'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043be0000 2024-09-13T23:58:01.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.132+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94765293337216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be6400 con 0x563043be0000 2024-09-13T23:58:01.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.132+0000 7efd804f9f40 20 add_watcher() i=0 2024-09-13T23:58:01.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.132+0000 7efd804f9f40 20 add_watcher() i=1 2024-09-13T23:58:01.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.132+0000 7efd804f9f40 20 add_watcher() i=2 2024-09-13T23:58:01.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.132+0000 7efd804f9f40 20 add_watcher() i=3 2024-09-13T23:58:01.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.132+0000 7efd804f9f40 20 add_watcher() i=4 2024-09-13T23:58:01.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.132+0000 7efd804f9f40 20 add_watcher() i=5 2024-09-13T23:58:01.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.132+0000 7efd804f9f40 20 add_watcher() i=6 2024-09-13T23:58:01.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.136+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94765293337216] v35'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043be0000 2024-09-13T23:58:01.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.136+0000 7efd804f9f40 20 add_watcher() i=7 2024-09-13T23:58:01.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.136+0000 7efd804f9f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:58:01.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.136+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be7000 con 0x563043b17000 2024-09-13T23:58:01.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.136+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.136+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94765294993408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be7400 con 0x563043b17000 2024-09-13T23:58:01.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.136+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94765294993408] v35'196 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.140+0000 7efd65c80700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:01.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.140+0000 7efd804f9f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:58:01.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.140+0000 7efd804f9f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:58:01.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.140+0000 7efd804f9f40 1 Processor -- start 2024-09-13T23:58:01.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.140+0000 7efd804f9f40 1 -- start start 2024-09-13T23:58:01.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.140+0000 7efd804f9f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043be0400 0x563043a61180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.140+0000 7efd804f9f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56304379e780 con 0x563043be0400 2024-09-13T23:58:01.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.140+0000 7efd7e4b1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043be0400 0x563043a61180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.140+0000 7efd7e4b1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043be0400 0x563043a61180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58362/0 (socket says 172.21.15.173:58362) 2024-09-13T23:58:01.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.140+0000 7efd7e4b1700 1 -- 172.21.15.173:0/3933107561 learned_addr learned my addr 172.21.15.173:0/3933107561 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.140+0000 7efd7e4b1700 1 -- 172.21.15.173:0/3933107561 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56304378ab60 con 0x563043be0400 2024-09-13T23:58:01.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.140+0000 7efd7e4b1700 1 --2- 172.21.15.173:0/3933107561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043be0400 0x563043a61180 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x563043bf4060 tx=0x563043addf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c9ab94e9198328 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.140+0000 7efd6547f700 1 -- 172.21.15.173:0/3933107561 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563043bfc000 con 0x563043be0400 2024-09-13T23:58:01.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.140+0000 7efd6547f700 1 -- 172.21.15.173:0/3933107561 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563043b28600 con 0x563043be0400 2024-09-13T23:58:01.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.140+0000 7efd6547f700 1 -- 172.21.15.173:0/3933107561 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563043bfc160 con 0x563043be0400 2024-09-13T23:58:01.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.140+0000 7efd804f9f40 1 -- 172.21.15.173:0/3933107561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043be0400 msgr2=0x563043a61180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.140+0000 7efd804f9f40 1 --2- 172.21.15.173:0/3933107561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043be0400 0x563043a61180 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x563043bf4060 tx=0x563043addf80 comp rx=0 tx=0).stop 2024-09-13T23:58:01.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.140+0000 7efd804f9f40 1 -- 172.21.15.173:0/3933107561 shutdown_connections 2024-09-13T23:58:01.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.140+0000 7efd804f9f40 1 --2- 172.21.15.173:0/3933107561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043be0400 0x563043a61180 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.140+0000 7efd804f9f40 1 -- 172.21.15.173:0/3933107561 >> 172.21.15.173:0/3933107561 conn(0x563043be6800 msgr2=0x56304387a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.140+0000 7efd804f9f40 1 -- 172.21.15.173:0/3933107561 shutdown_connections 2024-09-13T23:58:01.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.144+0000 7efd804f9f40 1 -- 172.21.15.173:0/3933107561 wait complete. 2024-09-13T23:58:01.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.144+0000 7efd804f9f40 1 Processor -- start 2024-09-13T23:58:01.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.144+0000 7efd804f9f40 1 -- start start 2024-09-13T23:58:01.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.144+0000 7efd804f9f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043be0400 0x563043a61180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.144+0000 7efd804f9f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563043806000 con 0x563043be0400 2024-09-13T23:58:01.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.144+0000 7efd7e4b1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043be0400 0x563043a61180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.144+0000 7efd7e4b1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043be0400 0x563043a61180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58370/0 (socket says 172.21.15.173:58370) 2024-09-13T23:58:01.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.144+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1267681804 learned_addr learned my addr 172.21.15.173:0/1267681804 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.144+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1267681804 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56304378ad00 con 0x563043be0400 2024-09-13T23:58:01.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.144+0000 7efd7e4b1700 1 --2- 172.21.15.173:0/1267681804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043be0400 0x563043a61180 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x563043bf4270 tx=0x563043bc41e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.144+0000 7efd63c7c700 1 -- 172.21.15.173:0/1267681804 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563043bfc2c0 con 0x563043be0400 2024-09-13T23:58:01.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.144+0000 7efd63c7c700 1 -- 172.21.15.173:0/1267681804 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563043b28300 con 0x563043be0400 2024-09-13T23:58:01.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.144+0000 7efd63c7c700 1 -- 172.21.15.173:0/1267681804 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563043bfc000 con 0x563043be0400 2024-09-13T23:58:01.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.144+0000 7efd804f9f40 1 -- 172.21.15.173:0/1267681804 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56304378a340 con 0x563043be0400 2024-09-13T23:58:01.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.144+0000 7efd804f9f40 1 -- 172.21.15.173:0/1267681804 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56304378ab60 con 0x563043be0400 2024-09-13T23:58:01.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.148+0000 7efd63c7c700 1 -- 172.21.15.173:0/1267681804 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x563043873b80 con 0x563043be0400 2024-09-13T23:58:01.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.148+0000 7efd63c7c700 1 --2- 172.21.15.173:0/1267681804 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563043b17800 0x563043c7c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.148+0000 7efd63c7c700 1 -- 172.21.15.173:0/1267681804 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x5630437df500 con 0x563043be0400 2024-09-13T23:58:01.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.148+0000 7efd7f4b3700 1 --2- 172.21.15.173:0/1267681804 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563043b17800 0x563043c7c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.148+0000 7efd804f9f40 5 note: GC not initialized 2024-09-13T23:58:01.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.148+0000 7efd7f4b3700 1 --2- 172.21.15.173:0/1267681804 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563043b17800 0x563043c7c000 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x563043b87830 tx=0x563043bc5380 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.148+0000 7efd61477700 20 reqs_thread_entry: start 2024-09-13T23:58:01.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.148+0000 7efd804f9f40 20 init_complete bucket index max shards: 11 2024-09-13T23:58:01.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.148+0000 7efd804f9f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:58:01.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.148+0000 7efd5f473700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:58:31 2024 2024-09-13T23:58:01.153 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:58:01.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.148+0000 7efd5ec51700 20 reqs_thread_entry: start 2024-09-13T23:58:01.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.152+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be0800 con 0x563043b17400 2024-09-13T23:58:01.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.152+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.152+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be6c00 con 0x563043b17400 2024-09-13T23:58:01.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.152+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.152+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be7800 con 0x563043b17400 2024-09-13T23:58:01.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.152+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.152+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be7c00 con 0x563043b17c00 2024-09-13T23:58:01.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.152+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.152+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be6400 con 0x563043b17400 2024-09-13T23:58:01.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.152+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.152+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be6000 con 0x563043b17c00 2024-09-13T23:58:01.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.156+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.156+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be6c00 con 0x563043b17000 2024-09-13T23:58:01.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.156+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.156+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be7800 con 0x563043b17000 2024-09-13T23:58:01.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.156+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.156+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be6400 con 0x563043b17c00 2024-09-13T23:58:01.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.156+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.156+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be0800 con 0x563043b17c00 2024-09-13T23:58:01.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.156+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.156+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be7c00 con 0x563043b17c00 2024-09-13T23:58:01.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.156+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.156+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be6000 con 0x563043b17000 2024-09-13T23:58:01.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.160+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.160+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be6400 con 0x563043be0000 2024-09-13T23:58:01.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.160+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043be0000 2024-09-13T23:58:01.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.160+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be1000 con 0x563043b17c00 2024-09-13T23:58:01.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.160+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.160+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be1400 con 0x563043be0000 2024-09-13T23:58:01.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.160+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043be0000 2024-09-13T23:58:01.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.160+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be7000 con 0x563043b17000 2024-09-13T23:58:01.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.160+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.160+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be7400 con 0x563043b17c00 2024-09-13T23:58:01.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.160+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.160+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be6c00 con 0x563043b17000 2024-09-13T23:58:01.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.160+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) v8 ==== 152+0+163 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.164+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be7800 con 0x563043b17400 2024-09-13T23:58:01.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.164+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.164+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be6000 con 0x563043b17400 2024-09-13T23:58:01.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.164+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.164+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be6400 con 0x563043b17c00 2024-09-13T23:58:01.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.164+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.164+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043bf8000 con 0x563043b17400 2024-09-13T23:58:01.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.164+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.164+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043bf8400 con 0x563043b17c00 2024-09-13T23:58:01.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.164+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.164+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043bf8800 con 0x563043b17000 2024-09-13T23:58:01.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.168+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.168+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043bf8c00 con 0x563043b17400 2024-09-13T23:58:01.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.168+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.168+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043bf9000 con 0x563043b17400 2024-09-13T23:58:01.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.168+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.168+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043bf9400 con 0x563043b17400 2024-09-13T23:58:01.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.168+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 27 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.168+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043bf9800 con 0x563043b17000 2024-09-13T23:58:01.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.168+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 24 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.168+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043bf9c00 con 0x563043b17c00 2024-09-13T23:58:01.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.168+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.168+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043bf8000 con 0x563043b17c00 2024-09-13T23:58:01.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.172+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.172+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043bf8c00 con 0x563043b17400 2024-09-13T23:58:01.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.172+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 28 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.172+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043bf9000 con 0x563043b17000 2024-09-13T23:58:01.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.172+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 25 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.172+0000 7efd65c80700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:01.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.172+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94765294993408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043bf9400 con 0x563043b17000 2024-09-13T23:58:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.176+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 26 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94765294993408] v35'197 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.176+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94765293329152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043bf8400 con 0x563043b17400 2024-09-13T23:58:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.180+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 29 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94765293329152] v35'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.180+0000 7efd804f9f40 20 remove_watcher() i=0 2024-09-13T23:58:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.180+0000 7efd804f9f40 2 removed watcher, disabling cache 2024-09-13T23:58:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.180+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94765293330304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be7800 con 0x563043b17000 2024-09-13T23:58:01.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.180+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.1 v2:172.21.15.173:6808/3256211813 27 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94765293330304] v35'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043b17000 2024-09-13T23:58:01.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.180+0000 7efd804f9f40 20 remove_watcher() i=1 2024-09-13T23:58:01.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.180+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94765293331456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be6000 con 0x563043b17400 2024-09-13T23:58:01.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.184+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 30 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94765293331456] v35'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.184+0000 7efd804f9f40 20 remove_watcher() i=2 2024-09-13T23:58:01.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.184+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94765293332608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be7c00 con 0x563043be0000 2024-09-13T23:58:01.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.188+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94765293332608] v35'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043be0000 2024-09-13T23:58:01.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.188+0000 7efd804f9f40 20 remove_watcher() i=3 2024-09-13T23:58:01.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.188+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94765293333760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be7400 con 0x563043b17400 2024-09-13T23:58:01.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.192+0000 7efd7ecb2700 1 -- 172.21.15.173:0/1202925167 <== osd.0 v2:172.21.15.87:6800/3507919120 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94765293333760] v35'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd200 con 0x563043b17400 2024-09-13T23:58:01.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.192+0000 7efd804f9f40 20 remove_watcher() i=4 2024-09-13T23:58:01.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.192+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94765293334912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be6400 con 0x563043b17c00 2024-09-13T23:58:01.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.192+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94765293334912] v35'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.192+0000 7efd804f9f40 20 remove_watcher() i=5 2024-09-13T23:58:01.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.192+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94765293336064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be0800 con 0x563043b17c00 2024-09-13T23:58:01.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.196+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 <== osd.3 v2:172.21.15.173:6800/4020038786 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94765293336064] v35'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdd440 con 0x563043b17c00 2024-09-13T23:58:01.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.196+0000 7efd804f9f40 20 remove_watcher() i=6 2024-09-13T23:58:01.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.196+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94765293337216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563043be1000 con 0x563043be0000 2024-09-13T23:58:01.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.196+0000 7efd7f4b3700 1 -- 172.21.15.173:0/1202925167 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94765293337216] v35'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x563043bdcb40 con 0x563043be0000 2024-09-13T23:58:01.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.196+0000 7efd804f9f40 20 remove_watcher() i=7 2024-09-13T23:58:01.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.196+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563043b17400 msgr2=0x563043a60100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.196+0000 7efd804f9f40 1 --2- 172.21.15.173:0/1202925167 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563043b17400 0x563043a60100 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.196+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563043b17000 msgr2=0x563043a5fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.196+0000 7efd804f9f40 1 --2- 172.21.15.173:0/1202925167 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563043b17000 0x563043a5fb80 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.196+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563043be0000 msgr2=0x563043a60c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.196+0000 7efd804f9f40 1 --2- 172.21.15.173:0/1202925167 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563043be0000 0x563043a60c00 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.196+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563043b17c00 msgr2=0x563043a60680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.196+0000 7efd804f9f40 1 --2- 172.21.15.173:0/1202925167 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563043b17c00 0x563043a60680 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563043b16c00 msgr2=0x563043a5f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 --2- 172.21.15.173:0/1202925167 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563043b16c00 0x563043a5f600 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x563043a59f80 tx=0x563043bc40c0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779800 msgr2=0x563043a5eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 --2- 172.21.15.173:0/1202925167 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779800 0x563043a5eb00 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x563043aa0840 tx=0x563043adca20 comp rx=0 tx=0).stop 2024-09-13T23:58:01.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd7e4b1700 1 -- 172.21.15.173:0/1202925167 reap_dead start 2024-09-13T23:58:01.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 shutdown_connections 2024-09-13T23:58:01.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 --2- 172.21.15.173:0/1202925167 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779800 0x563043a5eb00 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 >> 172.21.15.173:0/1202925167 conn(0x563043779400 msgr2=0x563043879800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 shutdown_connections 2024-09-13T23:58:01.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 -- 172.21.15.173:0/1202925167 wait complete. 2024-09-13T23:58:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 -- 172.21.15.173:0/1267681804 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563043b17800 msgr2=0x563043c7c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 --2- 172.21.15.173:0/1267681804 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563043b17800 0x563043c7c000 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x563043b87830 tx=0x563043bc5380 comp rx=0 tx=0).stop 2024-09-13T23:58:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 -- 172.21.15.173:0/1267681804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043be0400 msgr2=0x563043a61180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 --2- 172.21.15.173:0/1267681804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043be0400 0x563043a61180 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x563043bf4270 tx=0x563043bc41e0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 -- 172.21.15.173:0/1267681804 shutdown_connections 2024-09-13T23:58:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 --2- 172.21.15.173:0/1267681804 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563043b17800 0x563043c7c000 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 --2- 172.21.15.173:0/1267681804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043be0400 0x563043a61180 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 -- 172.21.15.173:0/1267681804 >> 172.21.15.173:0/1267681804 conn(0x563043be6800 msgr2=0x56304387a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 -- 172.21.15.173:0/1267681804 shutdown_connections 2024-09-13T23:58:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 -- 172.21.15.173:0/1267681804 wait complete. 2024-09-13T23:58:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 -- 172.21.15.173:0/409954840 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563043b16000 msgr2=0x563043a5f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 --2- 172.21.15.173:0/409954840 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563043b16000 0x563043a5f080 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x563043aa0ed0 tx=0x563043adcb40 comp rx=0 tx=0).stop 2024-09-13T23:58:01.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 -- 172.21.15.173:0/409954840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779000 msgr2=0x563043a5e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 --2- 172.21.15.173:0/409954840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779000 0x563043a5e580 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x5630438d5fb0 tx=0x56304387d920 comp rx=0 tx=0).stop 2024-09-13T23:58:01.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 -- 172.21.15.173:0/409954840 shutdown_connections 2024-09-13T23:58:01.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 --2- 172.21.15.173:0/409954840 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563043b16000 0x563043a5f080 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 --2- 172.21.15.173:0/409954840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563043779000 0x563043a5e580 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 -- 172.21.15.173:0/409954840 >> 172.21.15.173:0/409954840 conn(0x563043778c00 msgr2=0x563043879000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 -- 172.21.15.173:0/409954840 shutdown_connections 2024-09-13T23:58:01.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.200+0000 7efd804f9f40 1 -- 172.21.15.173:0/409954840 wait complete. 2024-09-13T23:58:01.206 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:58:01.207 INFO:teuthology.orchestra.run.smithi173.stdout: "entries": [ 2024-09-13T23:58:01.207 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.207 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "anonymous", 2024-09-13T23:58:01.207 INFO:teuthology.orchestra.run.smithi173.stdout: "buckets": [ 2024-09-13T23:58:01.207 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.207 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "", 2024-09-13T23:58:01.207 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.207 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.207 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "anonymous", 2024-09-13T23:58:01.207 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [] 2024-09-13T23:58:01.207 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.207 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.207 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.208 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.208 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:58:01.208 INFO:teuthology.orchestra.run.smithi173.stdout: "buckets": [ 2024-09-13T23:58:01.208 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.208 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "", 2024-09-13T23:58:01.208 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.208 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.208 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.208 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [] 2024-09-13T23:58:01.208 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.208 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.208 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo", 2024-09-13T23:58:01.208 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.208 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.209 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.209 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:01.209 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.209 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "delete_obj", 2024-09-13T23:58:01.209 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.209 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.209 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 4, 2024-09-13T23:58:01.209 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 4 2024-09-13T23:58:01.209 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.209 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.209 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.209 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.209 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo2", 2024-09-13T23:58:01.210 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.210 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.210 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.210 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [] 2024-09-13T23:58:01.210 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.210 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.210 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo3", 2024-09-13T23:58:01.210 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.210 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.210 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.210 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [] 2024-09-13T23:58:01.210 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.210 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.210 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo4", 2024-09-13T23:58:01.210 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.211 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.211 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.211 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [] 2024-09-13T23:58:01.211 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.211 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.211 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.211 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:01.211 INFO:teuthology.orchestra.run.smithi173.stdout: "summary": [ 2024-09-13T23:58:01.211 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.211 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "anonymous", 2024-09-13T23:58:01.211 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [], 2024-09-13T23:58:01.211 INFO:teuthology.orchestra.run.smithi173.stdout: "total": { 2024-09-13T23:58:01.211 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.211 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.211 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 0, 2024-09-13T23:58:01.212 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 0 2024-09-13T23:58:01.212 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.212 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.212 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.212 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:58:01.212 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:01.212 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.212 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "delete_obj", 2024-09-13T23:58:01.212 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.212 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.212 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 4, 2024-09-13T23:58:01.212 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 4 2024-09-13T23:58:01.212 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.213 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:01.213 INFO:teuthology.orchestra.run.smithi173.stdout: "total": { 2024-09-13T23:58:01.213 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.213 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.213 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 4, 2024-09-13T23:58:01.213 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 4 2024-09-13T23:58:01.213 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.213 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.213 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.213 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:58:01.214 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-13T23:58:01.214 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-13T23:58:01.215 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-13T23:58:01.215 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-13T23:58:01.254 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:58:01.255 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:58:01.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.252+0000 7fea06c83f40 1 Processor -- start 2024-09-13T23:58:01.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.252+0000 7fea06c83f40 1 -- start start 2024-09-13T23:58:01.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.252+0000 7fea06c83f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x564caf265400 0x564caf54a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.252+0000 7fea06c83f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564caf329500 con 0x564caf265000 2024-09-13T23:58:01.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.252+0000 7fea06c83f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x564caf2f2a00 con 0x564caf265400 2024-09-13T23:58:01.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.252+0000 7fea04c3b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x564caf265400 0x564caf54a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.252+0000 7fea0543c700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x564caf265000 0x564caf364800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:35208/0 (socket says 172.21.15.173:35208) 2024-09-13T23:58:01.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.252+0000 7fea04c3b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x564caf265400 0x564caf54a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58386/0 (socket says 172.21.15.173:58386) 2024-09-13T23:58:01.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.252+0000 7fea0543c700 1 -- 172.21.15.173:0/4232336076 learned_addr learned my addr 172.21.15.173:0/4232336076 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:58:01.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.252+0000 7fea04c3b700 1 -- 172.21.15.173:0/4232336076 >> v1:172.21.15.87:6789/0 conn(0x564caf265000 legacy=0x564caf364800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.252+0000 7fea04c3b700 1 -- 172.21.15.173:0/4232336076 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564caf277d40 con 0x564caf265400 2024-09-13T23:58:01.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.256+0000 7fea04c3b700 1 --2- 172.21.15.173:0/4232336076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265400 0x564caf54a580 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x564caf545920 tx=0x564caf369920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93bb548390689ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.256+0000 7fea0443a700 1 -- 172.21.15.173:0/4232336076 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564caf3094a0 con 0x564caf265400 2024-09-13T23:58:01.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.256+0000 7fea0443a700 1 -- 172.21.15.173:0/4232336076 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564caf329800 con 0x564caf265400 2024-09-13T23:58:01.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.256+0000 7fea0443a700 1 -- 172.21.15.173:0/4232336076 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564caf309600 con 0x564caf265400 2024-09-13T23:58:01.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.256+0000 7fea06c83f40 1 -- 172.21.15.173:0/4232336076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265400 msgr2=0x564caf54a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.256+0000 7fea06c83f40 1 --2- 172.21.15.173:0/4232336076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265400 0x564caf54a580 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x564caf545920 tx=0x564caf369920 comp rx=0 tx=0).stop 2024-09-13T23:58:01.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.256+0000 7fea06c83f40 1 -- 172.21.15.173:0/4232336076 shutdown_connections 2024-09-13T23:58:01.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.256+0000 7fea06c83f40 1 --2- 172.21.15.173:0/4232336076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265400 0x564caf54a580 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.256+0000 7fea06c83f40 1 -- 172.21.15.173:0/4232336076 >> 172.21.15.173:0/4232336076 conn(0x564caf264c00 msgr2=0x564caf364000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.256+0000 7fea06c83f40 1 -- 172.21.15.173:0/4232336076 shutdown_connections 2024-09-13T23:58:01.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.256+0000 7fea06c83f40 1 -- 172.21.15.173:0/4232336076 wait complete. 2024-09-13T23:58:01.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.256+0000 7fea06c83f40 1 Processor -- start 2024-09-13T23:58:01.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.256+0000 7fea06c83f40 1 -- start start 2024-09-13T23:58:01.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.256+0000 7fea06c83f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265000 0x564caf54a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.256+0000 7fea06c83f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564caf2f2500 con 0x564caf265000 2024-09-13T23:58:01.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.256+0000 7fea0543c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265000 0x564caf54a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.256+0000 7fea0543c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265000 0x564caf54a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58400/0 (socket says 172.21.15.173:58400) 2024-09-13T23:58:01.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.256+0000 7fea0543c700 1 -- 172.21.15.173:0/3191385932 learned_addr learned my addr 172.21.15.173:0/3191385932 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.256+0000 7fea0543c700 1 -- 172.21.15.173:0/3191385932 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564caf277ba0 con 0x564caf265000 2024-09-13T23:58:01.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.256+0000 7fea0543c700 1 --2- 172.21.15.173:0/3191385932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265000 0x564caf54a580 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x564cb00c98c0 tx=0x564caf369b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec7c798e0e5ce1c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.256+0000 7fea03c39700 1 -- 172.21.15.173:0/3191385932 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564caf3094a0 con 0x564caf265000 2024-09-13T23:58:01.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.260+0000 7fea03c39700 1 -- 172.21.15.173:0/3191385932 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564caf329b00 con 0x564caf265000 2024-09-13T23:58:01.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.260+0000 7fea03c39700 1 -- 172.21.15.173:0/3191385932 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564caf309600 con 0x564caf265000 2024-09-13T23:58:01.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.260+0000 7fea06c83f40 1 -- 172.21.15.173:0/3191385932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265000 msgr2=0x564caf54a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.260+0000 7fea06c83f40 1 --2- 172.21.15.173:0/3191385932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265000 0x564caf54a580 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x564cb00c98c0 tx=0x564caf369b60 comp rx=0 tx=0).stop 2024-09-13T23:58:01.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.260+0000 7fea06c83f40 1 -- 172.21.15.173:0/3191385932 shutdown_connections 2024-09-13T23:58:01.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.260+0000 7fea06c83f40 1 --2- 172.21.15.173:0/3191385932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265000 0x564caf54a580 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.260+0000 7fea06c83f40 1 -- 172.21.15.173:0/3191385932 >> 172.21.15.173:0/3191385932 conn(0x564caf264c00 msgr2=0x564caf365000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.260+0000 7fea06c83f40 1 -- 172.21.15.173:0/3191385932 shutdown_connections 2024-09-13T23:58:01.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.260+0000 7fea06c83f40 1 -- 172.21.15.173:0/3191385932 wait complete. 2024-09-13T23:58:01.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.260+0000 7fea06c83f40 1 Processor -- start 2024-09-13T23:58:01.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.260+0000 7fea06c83f40 1 -- start start 2024-09-13T23:58:01.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.260+0000 7fea06c83f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265400 0x564caf54ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.260+0000 7fea06c83f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564caf2f23c0 con 0x564caf265400 2024-09-13T23:58:01.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.260+0000 7fea0543c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265400 0x564caf54ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.260+0000 7fea0543c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265400 0x564caf54ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58412/0 (socket says 172.21.15.173:58412) 2024-09-13T23:58:01.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.260+0000 7fea0543c700 1 -- 172.21.15.173:0/1108514687 learned_addr learned my addr 172.21.15.173:0/1108514687 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.260+0000 7fea0543c700 1 -- 172.21.15.173:0/1108514687 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564caf277a00 con 0x564caf265400 2024-09-13T23:58:01.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.260+0000 7fea0543c700 1 --2- 172.21.15.173:0/1108514687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265400 0x564caf54ab00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x564cb00c9ad0 tx=0x564caf369a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.260+0000 7fea02436700 1 -- 172.21.15.173:0/1108514687 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564caf3098c0 con 0x564caf265400 2024-09-13T23:58:01.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.260+0000 7fea06c83f40 1 -- 172.21.15.173:0/1108514687 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564caf277860 con 0x564caf265400 2024-09-13T23:58:01.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.260+0000 7fea02436700 1 -- 172.21.15.173:0/1108514687 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564caf329c80 con 0x564caf265400 2024-09-13T23:58:01.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.260+0000 7fea02436700 1 -- 172.21.15.173:0/1108514687 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564caf3094a0 con 0x564caf265400 2024-09-13T23:58:01.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.260+0000 7fea06c83f40 1 -- 172.21.15.173:0/1108514687 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564caf2776c0 con 0x564caf265400 2024-09-13T23:58:01.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fea06c83f40 1 Processor -- start 2024-09-13T23:58:01.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fea06c83f40 1 -- start start 2024-09-13T23:58:01.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fea06c83f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265c00 0x564caf54b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fea06c83f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564caf2f2000 con 0x564caf265c00 2024-09-13T23:58:01.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fea02436700 1 -- 172.21.15.173:0/1108514687 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x564caf35eb00 con 0x564caf265400 2024-09-13T23:58:01.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fea05c3d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265c00 0x564caf54b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fea05c3d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265c00 0x564caf54b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58418/0 (socket says 172.21.15.173:58418) 2024-09-13T23:58:01.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fea05c3d700 1 -- 172.21.15.173:0/2065332616 learned_addr learned my addr 172.21.15.173:0/2065332616 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fea02436700 1 --2- 172.21.15.173:0/1108514687 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564caf618000 0x564caf54c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fea02436700 1 -- 172.21.15.173:0/1108514687 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x564caf2cb180 con 0x564caf265400 2024-09-13T23:58:01.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fea0543c700 1 --2- 172.21.15.173:0/1108514687 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564caf618000 0x564caf54c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fea05c3d700 1 -- 172.21.15.173:0/2065332616 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564caf276000 con 0x564caf265c00 2024-09-13T23:58:01.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fea0543c700 1 --2- 172.21.15.173:0/1108514687 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564caf618000 0x564caf54c100 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x564caf5955c0 tx=0x564caf5d0240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fea05c3d700 1 --2- 172.21.15.173:0/2065332616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265c00 0x564caf54b080 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x564caf5f0720 tx=0x564caf5d0de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d435d84ce556d4c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fe9ffc31700 1 -- 172.21.15.173:0/2065332616 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564caf3098c0 con 0x564caf265c00 2024-09-13T23:58:01.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fe9ffc31700 1 -- 172.21.15.173:0/2065332616 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564caf620000 con 0x564caf265c00 2024-09-13T23:58:01.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fe9ffc31700 1 -- 172.21.15.173:0/2065332616 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564caf3094a0 con 0x564caf265c00 2024-09-13T23:58:01.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fea06c83f40 1 -- 172.21.15.173:0/2065332616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265c00 msgr2=0x564caf54b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fea06c83f40 1 --2- 172.21.15.173:0/2065332616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265c00 0x564caf54b080 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x564caf5f0720 tx=0x564caf5d0de0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fea06c83f40 1 -- 172.21.15.173:0/2065332616 shutdown_connections 2024-09-13T23:58:01.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fea06c83f40 1 --2- 172.21.15.173:0/2065332616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265c00 0x564caf54b080 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fea06c83f40 1 -- 172.21.15.173:0/2065332616 >> 172.21.15.173:0/2065332616 conn(0x564caf265800 msgr2=0x564caf365800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fea06c83f40 1 -- 172.21.15.173:0/2065332616 shutdown_connections 2024-09-13T23:58:01.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fea06c83f40 1 -- 172.21.15.173:0/2065332616 wait complete. 2024-09-13T23:58:01.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.264+0000 7fea06c83f40 1 Processor -- start 2024-09-13T23:58:01.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.268+0000 7fea06c83f40 1 -- start start 2024-09-13T23:58:01.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.268+0000 7fea06c83f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265c00 0x564caf54b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.268+0000 7fea06c83f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564caf28a640 con 0x564caf265c00 2024-09-13T23:58:01.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.268+0000 7fea05c3d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265c00 0x564caf54b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.268+0000 7fea05c3d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265c00 0x564caf54b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58422/0 (socket says 172.21.15.173:58422) 2024-09-13T23:58:01.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.268+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 learned_addr learned my addr 172.21.15.173:0/518360020 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.268+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564caf276ea0 con 0x564caf265c00 2024-09-13T23:58:01.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.268+0000 7fea05c3d700 1 --2- 172.21.15.173:0/518360020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265c00 0x564caf54b080 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x564caf594690 tx=0x564caf5d0840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.268+0000 7fe9fe42e700 1 -- 172.21.15.173:0/518360020 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564caf309b80 con 0x564caf265c00 2024-09-13T23:58:01.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.268+0000 7fe9fe42e700 1 -- 172.21.15.173:0/518360020 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564caf620180 con 0x564caf265c00 2024-09-13T23:58:01.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.268+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564caf276820 con 0x564caf265c00 2024-09-13T23:58:01.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.268+0000 7fe9fe42e700 1 -- 172.21.15.173:0/518360020 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564caf3098c0 con 0x564caf265c00 2024-09-13T23:58:01.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.268+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564caf2769c0 con 0x564caf265c00 2024-09-13T23:58:01.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fe9fe42e700 1 -- 172.21.15.173:0/518360020 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x564caf35f080 con 0x564caf265c00 2024-09-13T23:58:01.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fea06c83f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fe9fe42e700 1 --2- 172.21.15.173:0/518360020 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564caf618c00 0x564caf54c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fe9fe42e700 1 -- 172.21.15.173:0/518360020 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x564caf2cb340 con 0x564caf265c00 2024-09-13T23:58:01.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fea06c83f40 1 --2- 172.21.15.173:0/518360020 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564caf619000 0x564caf54b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619400 con 0x564caf619000 2024-09-13T23:58:01.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fea04c3b700 1 --2- 172.21.15.173:0/518360020 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564caf618c00 0x564caf54c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fea05c3d700 1 --2- 172.21.15.173:0/518360020 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564caf619000 0x564caf54b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fea04c3b700 1 --2- 172.21.15.173:0/518360020 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564caf618c00 0x564caf54c680 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x564caf545920 tx=0x564caf369800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fea05c3d700 1 --2- 172.21.15.173:0/518360020 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564caf619000 0x564caf54b600 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fea06c83f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fea06c83f40 20 realm 2024-09-13T23:58:01.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fea06c83f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619000 2024-09-13T23:58:01.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fea06c83f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fea06c83f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:58:01.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fea06c83f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619c00 con 0x564caf619000 2024-09-13T23:58:01.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fea06c83f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fea06c83f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fea06c83f40 1 --2- 172.21.15.173:0/518360020 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564caf619400 0x564caf54bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619400 2024-09-13T23:58:01.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.272+0000 7fea0543c700 1 --2- 172.21.15.173:0/518360020 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564caf619400 0x564caf54bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.276+0000 7fea0543c700 1 --2- 172.21.15.173:0/518360020 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564caf619400 0x564caf54bb80 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.276+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.276+0000 7fea06c83f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:01.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.276+0000 7fea06c83f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.276+0000 7fea06c83f40 1 --2- 172.21.15.173:0/518360020 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564caf619c00 0x564caf54cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.276+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf6ce000 con 0x564caf619c00 2024-09-13T23:58:01.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.276+0000 7fea04c3b700 1 --2- 172.21.15.173:0/518360020 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564caf619c00 0x564caf54cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.276+0000 7fea04c3b700 1 --2- 172.21.15.173:0/518360020 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564caf619c00 0x564caf54cc00 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.276+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.276+0000 7fea06c83f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:58:01.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.276+0000 7fea06c83f40 20 searching for the correct realm 2024-09-13T23:58:01.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.276+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf6ce400 con 0x564caf619c00 2024-09-13T23:58:01.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.276+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.276+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf6ce000 con 0x564caf619400 2024-09-13T23:58:01.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.276+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.276+0000 7fea0543c700 1 --2- 172.21.15.173:0/518360020 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564caf6ce000 0x564caf54a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.276+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf6ce000 2024-09-13T23:58:01.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.280+0000 7fea05c3d700 1 --2- 172.21.15.173:0/518360020 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564caf6ce000 0x564caf54a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.280+0000 7fea05c3d700 1 --2- 172.21.15.173:0/518360020 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564caf6ce000 0x564caf54a580 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.280+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf6ce000 2024-09-13T23:58:01.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.280+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf6ce000 2024-09-13T23:58:01.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.280+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf6ce000 2024-09-13T23:58:01.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.280+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619000 2024-09-13T23:58:01.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.280+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.280+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619c00 2024-09-13T23:58:01.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.280+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.280+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619000 2024-09-13T23:58:01.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.280+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.280+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619400 2024-09-13T23:58:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.280+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.280+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619400 2024-09-13T23:58:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.284+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.284+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619000 2024-09-13T23:58:01.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.284+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.284+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf6ce000 2024-09-13T23:58:01.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.284+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf6ce000 2024-09-13T23:58:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.284+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619000 2024-09-13T23:58:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.284+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.284+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf6ce000 2024-09-13T23:58:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.284+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf6ce000 2024-09-13T23:58:01.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.284+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619400 2024-09-13T23:58:01.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.284+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.284+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619c00 2024-09-13T23:58:01.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.284+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.284+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619000 2024-09-13T23:58:01.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.288+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.288+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619400 2024-09-13T23:58:01.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.288+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.288+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619c00 2024-09-13T23:58:01.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.288+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.288+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619000 2024-09-13T23:58:01.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.288+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.288+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619000 2024-09-13T23:58:01.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.288+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.288+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619000 2024-09-13T23:58:01.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.288+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.288+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619c00 2024-09-13T23:58:01.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.288+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.288+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf6ce000 2024-09-13T23:58:01.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.292+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf6ce000 2024-09-13T23:58:01.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.292+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619000 2024-09-13T23:58:01.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.292+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.292+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf6ce000 2024-09-13T23:58:01.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.292+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf6ce000 2024-09-13T23:58:01.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.292+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619c00 2024-09-13T23:58:01.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.292+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.292+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf6ce000 2024-09-13T23:58:01.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.292+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf6ce000 2024-09-13T23:58:01.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.292+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619400 2024-09-13T23:58:01.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.292+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.292+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619400 2024-09-13T23:58:01.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.292+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.292+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619c00 2024-09-13T23:58:01.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.296+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.296+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619400 2024-09-13T23:58:01.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.296+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.296+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619400 2024-09-13T23:58:01.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.296+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.296+0000 7fea06c83f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:58:01.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.296+0000 7fea06c83f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:58:01.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.296+0000 7fea06c83f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:58:01.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.296+0000 7fea06c83f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:58:01.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.296+0000 7fea06c83f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.296+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf6ce800 con 0x564caf619000 2024-09-13T23:58:01.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.296+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.296+0000 7fea06c83f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.296+0000 7fea06c83f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.296+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf6cec00 con 0x564caf619400 2024-09-13T23:58:01.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.296+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.296+0000 7fea06c83f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:01.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.296+0000 7fea06c83f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.296+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf6cf000 con 0x564caf6ce000 2024-09-13T23:58:01.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.300+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf6ce000 2024-09-13T23:58:01.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.300+0000 7fea06c83f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:58:01.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.300+0000 7fea06c83f40 20 zone default found 2024-09-13T23:58:01.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.300+0000 7fea06c83f40 4 Realm: () 2024-09-13T23:58:01.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.300+0000 7fea06c83f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:58:01.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.300+0000 7fea06c83f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:58:01.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.300+0000 7fea06c83f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:58:01.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.300+0000 7fea06c83f40 20 zonegroup default 2024-09-13T23:58:01.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.300+0000 7fea06c83f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.300+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf6cf400 con 0x564caf6ce000 2024-09-13T23:58:01.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.300+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf6ce000 2024-09-13T23:58:01.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.300+0000 7fea06c83f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.300+0000 7fea06c83f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.300+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf6cf800 con 0x564caf619c00 2024-09-13T23:58:01.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.300+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.300+0000 7fea06c83f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.300+0000 7fea06c83f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.300+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf6cfc00 con 0x564caf619c00 2024-09-13T23:58:01.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.300+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.300+0000 7fea06c83f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.300+0000 7fea06c83f40 20 started sync module instance, tier type = 2024-09-13T23:58:01.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.300+0000 7fea06c83f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:58:01.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.300+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf5a4000 con 0x564caf619400 2024-09-13T23:58:01.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.304+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v35'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.304+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94887359027968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf5a4400 con 0x564caf619400 2024-09-13T23:58:01.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.304+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf5a4800 con 0x564caf619000 2024-09-13T23:58:01.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.308+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v35'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.308+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94887359027968] v35'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.308+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94887359029120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf5a4c00 con 0x564caf619000 2024-09-13T23:58:01.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.308+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf5a5000 con 0x564caf619400 2024-09-13T23:58:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.308+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94887359029120] v35'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.308+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v35'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.308+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94887359030272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf5a5400 con 0x564caf619400 2024-09-13T23:58:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.312+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf5a5800 con 0x564caf6ce000 2024-09-13T23:58:01.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.312+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v35'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf6ce000 2024-09-13T23:58:01.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.312+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94887359031424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf5a5c00 con 0x564caf6ce000 2024-09-13T23:58:01.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.312+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf5a4800 con 0x564caf619400 2024-09-13T23:58:01.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.312+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94887359030272] v35'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.316+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94887359031424] v35'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf6ce000 2024-09-13T23:58:01.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.316+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v35'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.316+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94887359032576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf5a4000 con 0x564caf619400 2024-09-13T23:58:01.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.316+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf5a4400 con 0x564caf619c00 2024-09-13T23:58:01.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.316+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v35'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.316+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94887359033728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf6ce800 con 0x564caf619c00 2024-09-13T23:58:01.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.316+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf6cf000 con 0x564caf619c00 2024-09-13T23:58:01.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.316+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94887359032576] v35'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.320+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94887359033728] v35'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.320+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v35'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.320+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94887359034880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf6cf400 con 0x564caf619c00 2024-09-13T23:58:01.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.320+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf6cec00 con 0x564caf6ce000 2024-09-13T23:58:01.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.324+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94887359034880] v35'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.324+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v35'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf6ce000 2024-09-13T23:58:01.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.324+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94887359036032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf6ce000 2024-09-13T23:58:01.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.324+0000 7fea06c83f40 20 add_watcher() i=0 2024-09-13T23:58:01.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.324+0000 7fea06c83f40 20 add_watcher() i=1 2024-09-13T23:58:01.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.324+0000 7fea06c83f40 20 add_watcher() i=2 2024-09-13T23:58:01.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.324+0000 7fea06c83f40 20 add_watcher() i=3 2024-09-13T23:58:01.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.324+0000 7fea06c83f40 20 add_watcher() i=4 2024-09-13T23:58:01.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.324+0000 7fea06c83f40 20 add_watcher() i=5 2024-09-13T23:58:01.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.324+0000 7fea06c83f40 20 add_watcher() i=6 2024-09-13T23:58:01.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.324+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94887359036032] v35'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf6ce000 2024-09-13T23:58:01.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.324+0000 7fea06c83f40 20 add_watcher() i=7 2024-09-13T23:58:01.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.324+0000 7fea06c83f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:58:01.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.324+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf5a4c00 con 0x564caf619000 2024-09-13T23:58:01.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.324+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.324+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94887360724992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf5a5800 con 0x564caf619000 2024-09-13T23:58:01.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.328+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94887360724992] v35'198 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.328+0000 7fe9ec40a700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:01.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.328+0000 7fea06c83f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:58:01.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.328+0000 7fea06c83f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:58:01.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.328+0000 7fea06c83f40 1 Processor -- start 2024-09-13T23:58:01.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.328+0000 7fea06c83f40 1 -- start start 2024-09-13T23:58:01.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.328+0000 7fea06c83f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf5a4400 0x564caf54d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.328+0000 7fea06c83f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564caf28a780 con 0x564caf5a4400 2024-09-13T23:58:01.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.328+0000 7fea04c3b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf5a4400 0x564caf54d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.328+0000 7fea04c3b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf5a4400 0x564caf54d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58426/0 (socket says 172.21.15.173:58426) 2024-09-13T23:58:01.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.328+0000 7fea04c3b700 1 -- 172.21.15.173:0/3561189102 learned_addr learned my addr 172.21.15.173:0/3561189102 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.328+0000 7fea04c3b700 1 -- 172.21.15.173:0/3561189102 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564caf276b60 con 0x564caf5a4400 2024-09-13T23:58:01.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.328+0000 7fea04c3b700 1 --2- 172.21.15.173:0/3561189102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf5a4400 0x564caf54d180 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x564caf677f20 tx=0x564caf369980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ebdebdcd29a0f22 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.328+0000 7fe9ebc09700 1 -- 172.21.15.173:0/3561189102 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564caf309760 con 0x564caf5a4400 2024-09-13T23:58:01.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.328+0000 7fe9ebc09700 1 -- 172.21.15.173:0/3561189102 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564caf620600 con 0x564caf5a4400 2024-09-13T23:58:01.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.328+0000 7fe9ebc09700 1 -- 172.21.15.173:0/3561189102 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564caf6f0000 con 0x564caf5a4400 2024-09-13T23:58:01.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.332+0000 7fea06c83f40 1 -- 172.21.15.173:0/3561189102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf5a4400 msgr2=0x564caf54d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.332+0000 7fea06c83f40 1 --2- 172.21.15.173:0/3561189102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf5a4400 0x564caf54d180 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x564caf677f20 tx=0x564caf369980 comp rx=0 tx=0).stop 2024-09-13T23:58:01.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.332+0000 7fea06c83f40 1 -- 172.21.15.173:0/3561189102 shutdown_connections 2024-09-13T23:58:01.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.332+0000 7fea06c83f40 1 --2- 172.21.15.173:0/3561189102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf5a4400 0x564caf54d180 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.332+0000 7fea06c83f40 1 -- 172.21.15.173:0/3561189102 >> 172.21.15.173:0/3561189102 conn(0x564caf5a5c00 msgr2=0x564caf366000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.332+0000 7fea06c83f40 1 -- 172.21.15.173:0/3561189102 shutdown_connections 2024-09-13T23:58:01.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.332+0000 7fea06c83f40 1 -- 172.21.15.173:0/3561189102 wait complete. 2024-09-13T23:58:01.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.332+0000 7fea06c83f40 1 Processor -- start 2024-09-13T23:58:01.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.332+0000 7fea06c83f40 1 -- start start 2024-09-13T23:58:01.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.332+0000 7fea06c83f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf5a4400 0x564caf54d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.332+0000 7fea06c83f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564caf2f2000 con 0x564caf5a4400 2024-09-13T23:58:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.332+0000 7fea04c3b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf5a4400 0x564caf54d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.332+0000 7fea04c3b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf5a4400 0x564caf54d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:58438/0 (socket says 172.21.15.173:58438) 2024-09-13T23:58:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.332+0000 7fea04c3b700 1 -- 172.21.15.173:0/1175393144 learned_addr learned my addr 172.21.15.173:0/1175393144 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.332+0000 7fea04c3b700 1 -- 172.21.15.173:0/1175393144 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564caf276d00 con 0x564caf5a4400 2024-09-13T23:58:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.332+0000 7fea04c3b700 1 --2- 172.21.15.173:0/1175393144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf5a4400 0x564caf54d180 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x564caf6e81e0 tx=0x564caf6b65a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.332+0000 7fe9ea406700 1 -- 172.21.15.173:0/1175393144 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564caf6f0160 con 0x564caf5a4400 2024-09-13T23:58:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.332+0000 7fe9ea406700 1 -- 172.21.15.173:0/1175393144 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564caf620300 con 0x564caf5a4400 2024-09-13T23:58:01.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.332+0000 7fe9ea406700 1 -- 172.21.15.173:0/1175393144 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x564caf6f02c0 con 0x564caf5a4400 2024-09-13T23:58:01.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.332+0000 7fea06c83f40 1 -- 172.21.15.173:0/1175393144 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564caf276340 con 0x564caf5a4400 2024-09-13T23:58:01.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.332+0000 7fea06c83f40 1 -- 172.21.15.173:0/1175393144 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564caf277d40 con 0x564caf5a4400 2024-09-13T23:58:01.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.336+0000 7fe9ea406700 1 -- 172.21.15.173:0/1175393144 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x564caf35fb80 con 0x564caf5a4400 2024-09-13T23:58:01.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.336+0000 7fe9ea406700 1 --2- 172.21.15.173:0/1175393144 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564caf768000 0x564caf76e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.336+0000 7fe9ea406700 1 -- 172.21.15.173:0/1175393144 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x564caf2cb500 con 0x564caf5a4400 2024-09-13T23:58:01.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.336+0000 7fea06c83f40 5 note: GC not initialized 2024-09-13T23:58:01.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.336+0000 7fea05c3d700 1 --2- 172.21.15.173:0/1175393144 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564caf768000 0x564caf76e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.336+0000 7fea05c3d700 1 --2- 172.21.15.173:0/1175393144 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564caf768000 0x564caf76e000 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x564caf677500 tx=0x564caf6b75c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.336+0000 7fe9e7c01700 20 reqs_thread_entry: start 2024-09-13T23:58:01.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.336+0000 7fea06c83f40 20 init_complete bucket index max shards: 11 2024-09-13T23:58:01.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.336+0000 7fea06c83f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:58:01.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.336+0000 7fe9e53fc700 20 reqs_thread_entry: start 2024-09-13T23:58:01.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.336+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf6cf800 con 0x564caf619400 2024-09-13T23:58:01.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.336+0000 7fe9e5bfd700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:58:31 2024 2024-09-13T23:58:01.341 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:58:01.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.340+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.340+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf6cfc00 con 0x564caf619400 2024-09-13T23:58:01.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.340+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.340+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619400 2024-09-13T23:58:01.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.340+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.340+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf768400 con 0x564caf619c00 2024-09-13T23:58:01.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.340+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.340+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf768800 con 0x564caf619400 2024-09-13T23:58:01.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.340+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.340+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf768c00 con 0x564caf619c00 2024-09-13T23:58:01.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.340+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.340+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf769000 con 0x564caf619000 2024-09-13T23:58:01.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.340+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.340+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf769400 con 0x564caf619000 2024-09-13T23:58:01.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.344+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.344+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf769800 con 0x564caf619c00 2024-09-13T23:58:01.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.344+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.344+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf769c00 con 0x564caf619c00 2024-09-13T23:58:01.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.344+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.344+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf6cf800 con 0x564caf619c00 2024-09-13T23:58:01.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.344+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.344+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf5a5000 con 0x564caf619000 2024-09-13T23:58:01.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.344+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.344+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf5a5400 con 0x564caf6ce000 2024-09-13T23:58:01.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.344+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf6ce000 2024-09-13T23:58:01.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.344+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf5a4800 con 0x564caf619c00 2024-09-13T23:58:01.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.344+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.344+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf5a4000 con 0x564caf6ce000 2024-09-13T23:58:01.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.344+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf6ce000 2024-09-13T23:58:01.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.344+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf769000 con 0x564caf619000 2024-09-13T23:58:01.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.348+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.348+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf769400 con 0x564caf619c00 2024-09-13T23:58:01.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.348+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.348+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf768400 con 0x564caf619000 2024-09-13T23:58:01.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.348+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) v8 ==== 152+0+163 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.348+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf768c00 con 0x564caf619400 2024-09-13T23:58:01.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.348+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.348+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf769800 con 0x564caf619400 2024-09-13T23:58:01.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.348+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.348+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf6ce800 con 0x564caf619c00 2024-09-13T23:58:01.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.348+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.348+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf6cf000 con 0x564caf619400 2024-09-13T23:58:01.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.352+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.352+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf5a4c00 con 0x564caf619c00 2024-09-13T23:58:01.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.352+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.352+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf5a5800 con 0x564caf619000 2024-09-13T23:58:01.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.352+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.352+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf5a5000 con 0x564caf619400 2024-09-13T23:58:01.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.352+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.352+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf5a5400 con 0x564caf619400 2024-09-13T23:58:01.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.352+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.352+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf6cf800 con 0x564caf619400 2024-09-13T23:58:01.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.356+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 27 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.356+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf6ce800 con 0x564caf619000 2024-09-13T23:58:01.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.356+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 24 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.356+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf6cfc00 con 0x564caf619c00 2024-09-13T23:58:01.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.356+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.356+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf6cf000 con 0x564caf619c00 2024-09-13T23:58:01.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.356+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.356+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf769c00 con 0x564caf619400 2024-09-13T23:58:01.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.356+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 28 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.356+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf769400 con 0x564caf619000 2024-09-13T23:58:01.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.356+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 25 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.361 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:58:01.361 INFO:teuthology.orchestra.run.smithi173.stdout: "entries": [ 2024-09-13T23:58:01.361 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.361 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "anonymous", 2024-09-13T23:58:01.361 INFO:teuthology.orchestra.run.smithi173.stdout: "buckets": [ 2024-09-13T23:58:01.361 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.361 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "", 2024-09-13T23:58:01.361 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.362 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.362 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "anonymous", 2024-09-13T23:58:01.362 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:01.362 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.362 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "list_buckets", 2024-09-13T23:58:01.362 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 231, 2024-09-13T23:58:01.362 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.362 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.362 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.362 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.362 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.362 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.362 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.363 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.363 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.363 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:58:01.363 INFO:teuthology.orchestra.run.smithi173.stdout: "buckets": [ 2024-09-13T23:58:01.363 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.363 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "", 2024-09-13T23:58:01.363 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.363 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.363 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.363 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:01.363 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.363 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "list_buckets", 2024-09-13T23:58:01.363 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 322, 2024-09-13T23:58:01.363 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.364 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.364 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.364 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.364 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.364 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.364 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.364 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo", 2024-09-13T23:58:01.364 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.364 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.364 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.364 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:01.364 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.364 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "create_bucket", 2024-09-13T23:58:01.364 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.365 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.365 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 5, 2024-09-13T23:58:01.365 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 5 2024-09-13T23:58:01.365 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.365 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.365 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "delete_bucket", 2024-09-13T23:58:01.365 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 236, 2024-09-13T23:58:01.365 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.365 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 2, 2024-09-13T23:58:01.365 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.365 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.365 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.365 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "delete_obj", 2024-09-13T23:58:01.365 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.366 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.366 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 4, 2024-09-13T23:58:01.366 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 4 2024-09-13T23:58:01.366 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.366 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.366 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "get_acls", 2024-09-13T23:58:01.366 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 1026, 2024-09-13T23:58:01.366 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.366 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 2, 2024-09-13T23:58:01.366 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 2 2024-09-13T23:58:01.366 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.366 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.366 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "get_obj", 2024-09-13T23:58:01.366 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 4, 2024-09-13T23:58:01.367 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.367 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.367 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.367 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.367 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.367 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "list_bucket", 2024-09-13T23:58:01.367 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 515, 2024-09-13T23:58:01.367 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.367 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.367 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.367 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.367 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.367 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "put_acls", 2024-09-13T23:58:01.367 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.368 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.368 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 2, 2024-09-13T23:58:01.368 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 2 2024-09-13T23:58:01.368 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.368 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.368 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "put_obj", 2024-09-13T23:58:01.368 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.368 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 30000042, 2024-09-13T23:58:01.368 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 11, 2024-09-13T23:58:01.368 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 11 2024-09-13T23:58:01.368 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.368 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.368 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.369 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.369 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo2", 2024-09-13T23:58:01.369 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.369 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.369 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.369 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:01.369 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.369 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "create_bucket", 2024-09-13T23:58:01.369 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.369 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.369 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.369 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.369 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.370 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.370 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "delete_bucket", 2024-09-13T23:58:01.370 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.370 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.370 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.370 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.370 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.370 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.370 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.370 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.370 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo3", 2024-09-13T23:58:01.370 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.370 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.370 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.371 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:01.371 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.371 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "create_bucket", 2024-09-13T23:58:01.371 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.371 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.371 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.371 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.371 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.371 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.371 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "delete_bucket", 2024-09-13T23:58:01.371 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.371 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.371 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.371 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.371 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.371 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.372 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.372 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.372 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo4", 2024-09-13T23:58:01.372 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.372 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.372 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.372 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:01.372 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.372 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "create_bucket", 2024-09-13T23:58:01.372 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.372 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.372 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.372 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.372 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.372 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.373 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "delete_bucket", 2024-09-13T23:58:01.373 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.373 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.373 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.373 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.373 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.373 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.373 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.373 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.373 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.373 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:01.373 INFO:teuthology.orchestra.run.smithi173.stdout: "summary": [ 2024-09-13T23:58:01.373 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.373 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "anonymous", 2024-09-13T23:58:01.373 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:01.374 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.374 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "list_buckets", 2024-09-13T23:58:01.374 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 231, 2024-09-13T23:58:01.374 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.374 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.374 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.374 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.374 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:01.374 INFO:teuthology.orchestra.run.smithi173.stdout: "total": { 2024-09-13T23:58:01.374 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 231, 2024-09-13T23:58:01.374 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.374 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.374 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.374 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.374 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.374 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.375 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:58:01.375 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:01.375 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.375 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "create_bucket", 2024-09-13T23:58:01.375 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.375 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.375 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 8, 2024-09-13T23:58:01.375 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 8 2024-09-13T23:58:01.375 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.375 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.375 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "delete_bucket", 2024-09-13T23:58:01.375 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 236, 2024-09-13T23:58:01.375 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.375 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 5, 2024-09-13T23:58:01.375 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 4 2024-09-13T23:58:01.375 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.376 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.376 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "delete_obj", 2024-09-13T23:58:01.376 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.376 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.376 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 4, 2024-09-13T23:58:01.376 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 4 2024-09-13T23:58:01.376 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.376 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.376 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "get_acls", 2024-09-13T23:58:01.376 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 1026, 2024-09-13T23:58:01.376 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.376 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 2, 2024-09-13T23:58:01.376 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 2 2024-09-13T23:58:01.376 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.376 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.377 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "get_obj", 2024-09-13T23:58:01.377 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 4, 2024-09-13T23:58:01.377 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.377 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.377 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.377 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.360+0000 7fe9ec40a700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:01.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.360+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94887360724992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf619800 con 0x564caf619000 2024-09-13T23:58:01.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.364+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 26 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94887360724992] v35'199 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.364+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94887359027968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf5a4800 con 0x564caf619400 2024-09-13T23:58:01.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.364+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 29 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94887359027968] v35'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.364+0000 7fea06c83f40 20 remove_watcher() i=0 2024-09-13T23:58:01.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.364+0000 7fea06c83f40 2 removed watcher, disabling cache 2024-09-13T23:58:01.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.364+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94887359029120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf5a4c00 con 0x564caf619000 2024-09-13T23:58:01.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.368+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.1 v2:172.21.15.173:6808/3256211813 27 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94887359029120] v35'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf619000 2024-09-13T23:58:01.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.368+0000 7fea06c83f40 20 remove_watcher() i=1 2024-09-13T23:58:01.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.368+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94887359030272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf769000 con 0x564caf619400 2024-09-13T23:58:01.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.372+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 30 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94887359030272] v35'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.372+0000 7fea06c83f40 20 remove_watcher() i=2 2024-09-13T23:58:01.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.372+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94887359031424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf768400 con 0x564caf6ce000 2024-09-13T23:58:01.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.372+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94887359031424] v35'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf6ce000 2024-09-13T23:58:01.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.372+0000 7fea06c83f40 20 remove_watcher() i=3 2024-09-13T23:58:01.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.372+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94887359032576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf769400 con 0x564caf619400 2024-09-13T23:58:01.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.376+0000 7fea0543c700 1 -- 172.21.15.173:0/518360020 <== osd.0 v2:172.21.15.87:6800/3507919120 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94887359032576] v35'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9200 con 0x564caf619400 2024-09-13T23:58:01.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.376+0000 7fea06c83f40 20 remove_watcher() i=4 2024-09-13T23:58:01.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.376+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94887359033728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf769800 con 0x564caf619c00 2024-09-13T23:58:01.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.380+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94887359033728] v35'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.380+0000 7fea06c83f40 20 remove_watcher() i=5 2024-09-13T23:58:01.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.380+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94887359034880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf768c00 con 0x564caf619c00 2024-09-13T23:58:01.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.380+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 <== osd.3 v2:172.21.15.173:6800/4020038786 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94887359034880] v35'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b9440 con 0x564caf619c00 2024-09-13T23:58:01.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.380+0000 7fea06c83f40 20 remove_watcher() i=6 2024-09-13T23:58:01.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.380+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94887359036032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x564caf768800 con 0x564caf6ce000 2024-09-13T23:58:01.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea05c3d700 1 -- 172.21.15.173:0/518360020 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94887359036032] v35'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x564caf6b8b40 con 0x564caf6ce000 2024-09-13T23:58:01.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 20 remove_watcher() i=7 2024-09-13T23:58:01.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564caf619400 msgr2=0x564caf54bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 --2- 172.21.15.173:0/518360020 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x564caf619400 0x564caf54bb80 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564caf619000 msgr2=0x564caf54b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 --2- 172.21.15.173:0/518360020 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x564caf619000 0x564caf54b600 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564caf6ce000 msgr2=0x564caf54a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 --2- 172.21.15.173:0/518360020 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x564caf6ce000 0x564caf54a580 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564caf619c00 msgr2=0x564caf54cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 --2- 172.21.15.173:0/518360020 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x564caf619c00 0x564caf54cc00 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564caf618c00 msgr2=0x564caf54c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 --2- 172.21.15.173:0/518360020 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564caf618c00 0x564caf54c680 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x564caf545920 tx=0x564caf369800 comp rx=0 tx=0).stop 2024-09-13T23:58:01.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265c00 msgr2=0x564caf54b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 --2- 172.21.15.173:0/518360020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265c00 0x564caf54b080 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x564caf594690 tx=0x564caf5d0840 comp rx=0 tx=0).stop 2024-09-13T23:58:01.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 reap_dead start 2024-09-13T23:58:01.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea04c3b700 1 -- 172.21.15.173:0/518360020 reap_dead start 2024-09-13T23:58:01.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 shutdown_connections 2024-09-13T23:58:01.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 >> 172.21.15.173:0/518360020 conn(0x564caf265800 msgr2=0x564caf365800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 shutdown_connections 2024-09-13T23:58:01.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 -- 172.21.15.173:0/518360020 wait complete. 2024-09-13T23:58:01.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 -- 172.21.15.173:0/1175393144 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564caf768000 msgr2=0x564caf76e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 --2- 172.21.15.173:0/1175393144 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564caf768000 0x564caf76e000 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x564caf677500 tx=0x564caf6b75c0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 -- 172.21.15.173:0/1175393144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf5a4400 msgr2=0x564caf54d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 --2- 172.21.15.173:0/1175393144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf5a4400 0x564caf54d180 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x564caf6e81e0 tx=0x564caf6b65a0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 -- 172.21.15.173:0/1175393144 shutdown_connections 2024-09-13T23:58:01.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 --2- 172.21.15.173:0/1175393144 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564caf768000 0x564caf76e000 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 --2- 172.21.15.173:0/1175393144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf5a4400 0x564caf54d180 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 -- 172.21.15.173:0/1175393144 >> 172.21.15.173:0/1175393144 conn(0x564caf5a5c00 msgr2=0x564caf366000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 -- 172.21.15.173:0/1175393144 shutdown_connections 2024-09-13T23:58:01.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.384+0000 7fea06c83f40 1 -- 172.21.15.173:0/1175393144 wait complete. 2024-09-13T23:58:01.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.388+0000 7fea06c83f40 1 -- 172.21.15.173:0/1108514687 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564caf618000 msgr2=0x564caf54c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.388+0000 7fea06c83f40 1 --2- 172.21.15.173:0/1108514687 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564caf618000 0x564caf54c100 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x564caf5955c0 tx=0x564caf5d0240 comp rx=0 tx=0).stop 2024-09-13T23:58:01.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.388+0000 7fea06c83f40 1 -- 172.21.15.173:0/1108514687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265400 msgr2=0x564caf54ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.388+0000 7fea06c83f40 1 --2- 172.21.15.173:0/1108514687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265400 0x564caf54ab00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x564cb00c9ad0 tx=0x564caf369a40 comp rx=0 tx=0).stop 2024-09-13T23:58:01.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.388+0000 7fea06c83f40 1 -- 172.21.15.173:0/1108514687 shutdown_connections 2024-09-13T23:58:01.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.388+0000 7fea06c83f40 1 --2- 172.21.15.173:0/1108514687 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x564caf618000 0x564caf54c100 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.388+0000 7fea06c83f40 1 --2- 172.21.15.173:0/1108514687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564caf265400 0x564caf54ab00 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.388+0000 7fea06c83f40 1 -- 172.21.15.173:0/1108514687 >> 172.21.15.173:0/1108514687 conn(0x564caf264c00 msgr2=0x564caf365000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.388+0000 7fea06c83f40 1 -- 172.21.15.173:0/1108514687 shutdown_connections 2024-09-13T23:58:01.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.388+0000 7fea06c83f40 1 -- 172.21.15.173:0/1108514687 wait complete. 2024-09-13T23:58:01.393 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.393 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "list_bucket", 2024-09-13T23:58:01.393 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 515, 2024-09-13T23:58:01.393 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.393 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.393 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.393 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.393 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.393 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "list_buckets", 2024-09-13T23:58:01.393 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 322, 2024-09-13T23:58:01.393 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.393 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.394 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.394 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.394 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.394 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "put_acls", 2024-09-13T23:58:01.394 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.394 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.394 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 2, 2024-09-13T23:58:01.394 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 2 2024-09-13T23:58:01.394 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.394 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.394 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "put_obj", 2024-09-13T23:58:01.394 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.394 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 30000042, 2024-09-13T23:58:01.394 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 11, 2024-09-13T23:58:01.394 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 11 2024-09-13T23:58:01.394 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.395 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:01.395 INFO:teuthology.orchestra.run.smithi173.stdout: "total": { 2024-09-13T23:58:01.395 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 2103, 2024-09-13T23:58:01.395 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 30000042, 2024-09-13T23:58:01.395 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 35, 2024-09-13T23:58:01.395 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 34 2024-09-13T23:58:01.395 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.395 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.395 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.395 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:58:01.397 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 231, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 231, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 231, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-13T23:58:01.397 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-13T23:58:01.397 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-13T23:58:01.397 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-13T23:58:01.481 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:58:01.482 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:58:01.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.480+0000 7f748bba6f40 1 Processor -- start 2024-09-13T23:58:01.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.480+0000 7f748bba6f40 1 -- start start 2024-09-13T23:58:01.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.480+0000 7f748bba6f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x56333419d400 0x563334482580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.480+0000 7f748bba6f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563334261500 con 0x56333419d000 2024-09-13T23:58:01.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.480+0000 7f748bba6f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x56333422aa00 con 0x56333419d400 2024-09-13T23:58:01.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.480+0000 7f748a35f700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x56333419d000 0x56333429c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:38596/0 (socket says 172.21.15.173:38596) 2024-09-13T23:58:01.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.480+0000 7f7489b5e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x56333419d400 0x563334482580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.480+0000 7f748a35f700 1 -- 172.21.15.173:0/2491337357 learned_addr learned my addr 172.21.15.173:0/2491337357 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:58:01.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.480+0000 7f7489b5e700 1 -- 172.21.15.173:0/2491337357 >> v1:172.21.15.87:6789/0 conn(0x56333419d000 legacy=0x56333429c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.480+0000 7f7489b5e700 1 -- 172.21.15.173:0/2491337357 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633341afd40 con 0x56333419d400 2024-09-13T23:58:01.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.480+0000 7f7489b5e700 1 --2- 172.21.15.173:0/2491337357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d400 0x563334482580 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x56333447d920 tx=0x5633342a1920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecafdb63e81d5bd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.480+0000 7f748935d700 1 -- 172.21.15.173:0/2491337357 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5633342414a0 con 0x56333419d400 2024-09-13T23:58:01.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.480+0000 7f748935d700 1 -- 172.21.15.173:0/2491337357 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563334261800 con 0x56333419d400 2024-09-13T23:58:01.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.480+0000 7f748935d700 1 -- 172.21.15.173:0/2491337357 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563334241600 con 0x56333419d400 2024-09-13T23:58:01.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.480+0000 7f748bba6f40 1 -- 172.21.15.173:0/2491337357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d400 msgr2=0x563334482580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.480+0000 7f748bba6f40 1 --2- 172.21.15.173:0/2491337357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d400 0x563334482580 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x56333447d920 tx=0x5633342a1920 comp rx=0 tx=0).stop 2024-09-13T23:58:01.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.480+0000 7f748bba6f40 1 -- 172.21.15.173:0/2491337357 shutdown_connections 2024-09-13T23:58:01.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.480+0000 7f748bba6f40 1 --2- 172.21.15.173:0/2491337357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d400 0x563334482580 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.480+0000 7f748bba6f40 1 -- 172.21.15.173:0/2491337357 >> 172.21.15.173:0/2491337357 conn(0x56333419cc00 msgr2=0x56333429c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.480+0000 7f748bba6f40 1 -- 172.21.15.173:0/2491337357 shutdown_connections 2024-09-13T23:58:01.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.480+0000 7f748bba6f40 1 -- 172.21.15.173:0/2491337357 wait complete. 2024-09-13T23:58:01.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.484+0000 7f748bba6f40 1 Processor -- start 2024-09-13T23:58:01.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.484+0000 7f748bba6f40 1 -- start start 2024-09-13T23:58:01.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.484+0000 7f748bba6f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d000 0x563334482580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.484+0000 7f748bba6f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56333422a500 con 0x56333419d000 2024-09-13T23:58:01.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.484+0000 7f748a35f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d000 0x563334482580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.484+0000 7f748a35f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d000 0x563334482580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49476/0 (socket says 172.21.15.173:49476) 2024-09-13T23:58:01.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.484+0000 7f748a35f700 1 -- 172.21.15.173:0/2144107138 learned_addr learned my addr 172.21.15.173:0/2144107138 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.484+0000 7f748a35f700 1 -- 172.21.15.173:0/2144107138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633341afba0 con 0x56333419d000 2024-09-13T23:58:01.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.484+0000 7f748a35f700 1 --2- 172.21.15.173:0/2144107138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d000 0x563334482580 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x5633350018c0 tx=0x5633342a1b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c6a6d83ccf6a49 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.484+0000 7f7488b5c700 1 -- 172.21.15.173:0/2144107138 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5633342414a0 con 0x56333419d000 2024-09-13T23:58:01.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.484+0000 7f7488b5c700 1 -- 172.21.15.173:0/2144107138 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563334261b00 con 0x56333419d000 2024-09-13T23:58:01.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.484+0000 7f7488b5c700 1 -- 172.21.15.173:0/2144107138 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563334241600 con 0x56333419d000 2024-09-13T23:58:01.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.484+0000 7f748bba6f40 1 -- 172.21.15.173:0/2144107138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d000 msgr2=0x563334482580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.484+0000 7f748bba6f40 1 --2- 172.21.15.173:0/2144107138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d000 0x563334482580 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x5633350018c0 tx=0x5633342a1b60 comp rx=0 tx=0).stop 2024-09-13T23:58:01.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.484+0000 7f748bba6f40 1 -- 172.21.15.173:0/2144107138 shutdown_connections 2024-09-13T23:58:01.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.484+0000 7f748bba6f40 1 --2- 172.21.15.173:0/2144107138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d000 0x563334482580 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.484+0000 7f748bba6f40 1 -- 172.21.15.173:0/2144107138 >> 172.21.15.173:0/2144107138 conn(0x56333419cc00 msgr2=0x56333429d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.488+0000 7f748bba6f40 1 -- 172.21.15.173:0/2144107138 shutdown_connections 2024-09-13T23:58:01.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.488+0000 7f748bba6f40 1 -- 172.21.15.173:0/2144107138 wait complete. 2024-09-13T23:58:01.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.488+0000 7f748bba6f40 1 Processor -- start 2024-09-13T23:58:01.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.488+0000 7f748bba6f40 1 -- start start 2024-09-13T23:58:01.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.488+0000 7f748bba6f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d000 0x563334482580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.488+0000 7f748bba6f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56333422a3c0 con 0x56333419d000 2024-09-13T23:58:01.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.488+0000 7f748a35f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d000 0x563334482580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.488+0000 7f748a35f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d000 0x563334482580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49488/0 (socket says 172.21.15.173:49488) 2024-09-13T23:58:01.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.488+0000 7f748a35f700 1 -- 172.21.15.173:0/2733977215 learned_addr learned my addr 172.21.15.173:0/2733977215 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.488+0000 7f748a35f700 1 -- 172.21.15.173:0/2733977215 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633341afa00 con 0x56333419d000 2024-09-13T23:58:01.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.488+0000 7f748a35f700 1 --2- 172.21.15.173:0/2733977215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d000 0x563334482580 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x563335001b00 tx=0x5633342a1a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.488+0000 7f7487359700 1 -- 172.21.15.173:0/2733977215 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5633342418c0 con 0x56333419d000 2024-09-13T23:58:01.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.488+0000 7f7487359700 1 -- 172.21.15.173:0/2733977215 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563334261c80 con 0x56333419d000 2024-09-13T23:58:01.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.488+0000 7f748bba6f40 1 -- 172.21.15.173:0/2733977215 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5633341af860 con 0x56333419d000 2024-09-13T23:58:01.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.488+0000 7f7487359700 1 -- 172.21.15.173:0/2733977215 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5633342414a0 con 0x56333419d000 2024-09-13T23:58:01.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.488+0000 7f748bba6f40 1 -- 172.21.15.173:0/2733977215 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5633341af6c0 con 0x56333419d000 2024-09-13T23:58:01.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f748bba6f40 1 Processor -- start 2024-09-13T23:58:01.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f748bba6f40 1 -- start start 2024-09-13T23:58:01.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f748bba6f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d800 0x563334482b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f748bba6f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56333422a000 con 0x56333419d800 2024-09-13T23:58:01.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f7487359700 1 -- 172.21.15.173:0/2733977215 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x563334296b00 con 0x56333419d000 2024-09-13T23:58:01.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f7487359700 1 --2- 172.21.15.173:0/2733977215 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563334544000 0x563334483080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f748ab60700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d800 0x563334482b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f7487359700 1 -- 172.21.15.173:0/2733977215 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x563334203180 con 0x56333419d000 2024-09-13T23:58:01.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f748ab60700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d800 0x563334482b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49498/0 (socket says 172.21.15.173:49498) 2024-09-13T23:58:01.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f748ab60700 1 -- 172.21.15.173:0/315977886 learned_addr learned my addr 172.21.15.173:0/315977886 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f748a35f700 1 --2- 172.21.15.173:0/2733977215 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563334544000 0x563334483080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f748ab60700 1 -- 172.21.15.173:0/315977886 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633341ae000 con 0x56333419d800 2024-09-13T23:58:01.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f748a35f700 1 --2- 172.21.15.173:0/2733977215 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563334544000 0x563334483080 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x5633350155c0 tx=0x5633344fc240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f748ab60700 1 --2- 172.21.15.173:0/315977886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d800 0x563334482b00 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x5633350147b0 tx=0x5633344fd0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39034783a88bf5f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f7484b54700 1 -- 172.21.15.173:0/315977886 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5633342418c0 con 0x56333419d800 2024-09-13T23:58:01.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f7484b54700 1 -- 172.21.15.173:0/315977886 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563334556000 con 0x56333419d800 2024-09-13T23:58:01.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f7484b54700 1 -- 172.21.15.173:0/315977886 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5633342414a0 con 0x56333419d800 2024-09-13T23:58:01.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f748bba6f40 1 -- 172.21.15.173:0/315977886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d800 msgr2=0x563334482b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f748bba6f40 1 --2- 172.21.15.173:0/315977886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d800 0x563334482b00 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x5633350147b0 tx=0x5633344fd0e0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f748bba6f40 1 -- 172.21.15.173:0/315977886 shutdown_connections 2024-09-13T23:58:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f748bba6f40 1 --2- 172.21.15.173:0/315977886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d800 0x563334482b00 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f748bba6f40 1 -- 172.21.15.173:0/315977886 >> 172.21.15.173:0/315977886 conn(0x56333419d400 msgr2=0x56333429d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f748bba6f40 1 -- 172.21.15.173:0/315977886 shutdown_connections 2024-09-13T23:58:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f748bba6f40 1 -- 172.21.15.173:0/315977886 wait complete. 2024-09-13T23:58:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f748bba6f40 1 Processor -- start 2024-09-13T23:58:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f748bba6f40 1 -- start start 2024-09-13T23:58:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f748bba6f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d800 0x563334482b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.492+0000 7f748bba6f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633341c2640 con 0x56333419d800 2024-09-13T23:58:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.496+0000 7f748ab60700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d800 0x563334482b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.496+0000 7f748ab60700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d800 0x563334482b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49502/0 (socket says 172.21.15.173:49502) 2024-09-13T23:58:01.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.496+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 learned_addr learned my addr 172.21.15.173:0/1673020704 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.496+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633341aeea0 con 0x56333419d800 2024-09-13T23:58:01.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.496+0000 7f748ab60700 1 --2- 172.21.15.173:0/1673020704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d800 0x563334482b00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x563335014420 tx=0x5633342a1f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.496+0000 7f7483351700 1 -- 172.21.15.173:0/1673020704 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563334241b80 con 0x56333419d800 2024-09-13T23:58:01.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.496+0000 7f7483351700 1 -- 172.21.15.173:0/1673020704 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563334556180 con 0x56333419d800 2024-09-13T23:58:01.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.496+0000 7f7483351700 1 -- 172.21.15.173:0/1673020704 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5633342418c0 con 0x56333419d800 2024-09-13T23:58:01.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.496+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5633341ae820 con 0x56333419d800 2024-09-13T23:58:01.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.496+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5633341ae9c0 con 0x56333419d800 2024-09-13T23:58:01.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.496+0000 7f748bba6f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.496+0000 7f7483351700 1 -- 172.21.15.173:0/1673020704 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x563334296dc0 con 0x56333419d800 2024-09-13T23:58:01.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.496+0000 7f7483351700 1 --2- 172.21.15.173:0/1673020704 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563334544c00 0x563334483600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.496+0000 7f7483351700 1 -- 172.21.15.173:0/1673020704 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x563334203340 con 0x56333419d800 2024-09-13T23:58:01.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.500+0000 7f7489b5e700 1 --2- 172.21.15.173:0/1673020704 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563334544c00 0x563334483600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.500+0000 7f748bba6f40 1 --2- 172.21.15.173:0/1673020704 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563334545000 0x563334483b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.500+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545400 con 0x563334545000 2024-09-13T23:58:01.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.500+0000 7f748ab60700 1 --2- 172.21.15.173:0/1673020704 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563334545000 0x563334483b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.500+0000 7f7489b5e700 1 --2- 172.21.15.173:0/1673020704 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563334544c00 0x563334483600 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x56333447d920 tx=0x5633342a1800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.500+0000 7f748ab60700 1 --2- 172.21.15.173:0/1673020704 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563334545000 0x563334483b80 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.500+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5633345f8b40 con 0x563334545000 2024-09-13T23:58:01.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.500+0000 7f748bba6f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.500+0000 7f748bba6f40 20 realm 2024-09-13T23:58:01.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.500+0000 7f748bba6f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.500+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545000 2024-09-13T23:58:01.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.500+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5633345f8b40 con 0x563334545000 2024-09-13T23:58:01.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.500+0000 7f748bba6f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.500+0000 7f748bba6f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:58:01.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.500+0000 7f748bba6f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.500+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545c00 con 0x563334545000 2024-09-13T23:58:01.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.500+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5633345f8b40 con 0x563334545000 2024-09-13T23:58:01.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.500+0000 7f748bba6f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.500+0000 7f748bba6f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.500+0000 7f748bba6f40 1 --2- 172.21.15.173:0/1673020704 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563334545400 0x563334484100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.500+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545400 2024-09-13T23:58:01.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.500+0000 7f748a35f700 1 --2- 172.21.15.173:0/1673020704 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563334545400 0x563334484100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.500+0000 7f748a35f700 1 --2- 172.21.15.173:0/1673020704 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563334545400 0x563334484100 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.504+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5633345f9200 con 0x563334545400 2024-09-13T23:58:01.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.504+0000 7f748bba6f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:01.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.504+0000 7f748bba6f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.504+0000 7f748bba6f40 1 --2- 172.21.15.173:0/1673020704 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563334545c00 0x563334484680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.504+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334606000 con 0x563334545c00 2024-09-13T23:58:01.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.504+0000 7f7489b5e700 1 --2- 172.21.15.173:0/1673020704 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563334545c00 0x563334484680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.504+0000 7f7489b5e700 1 --2- 172.21.15.173:0/1673020704 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563334545c00 0x563334484680 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.504+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5633345f9440 con 0x563334545c00 2024-09-13T23:58:01.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.504+0000 7f748bba6f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:58:01.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.504+0000 7f748bba6f40 20 searching for the correct realm 2024-09-13T23:58:01.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.504+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334606400 con 0x563334545c00 2024-09-13T23:58:01.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.504+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5633345f9440 con 0x563334545c00 2024-09-13T23:58:01.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.504+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334606000 con 0x563334545400 2024-09-13T23:58:01.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.504+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f9200 con 0x563334545400 2024-09-13T23:58:01.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.504+0000 7f748a35f700 1 --2- 172.21.15.173:0/1673020704 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563334606000 0x563334484c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.504+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334606000 2024-09-13T23:58:01.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.504+0000 7f748ab60700 1 --2- 172.21.15.173:0/1673020704 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563334606000 0x563334484c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.508+0000 7f748ab60700 1 --2- 172.21.15.173:0/1673020704 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563334606000 0x563334484c00 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.508+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f8b40 con 0x563334606000 2024-09-13T23:58:01.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.508+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334606000 2024-09-13T23:58:01.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.508+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5633345f8b40 con 0x563334606000 2024-09-13T23:58:01.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.508+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545000 2024-09-13T23:58:01.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.508+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f8b40 con 0x563334545000 2024-09-13T23:58:01.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.508+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545c00 2024-09-13T23:58:01.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.508+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f9440 con 0x563334545c00 2024-09-13T23:58:01.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.508+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545000 2024-09-13T23:58:01.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.508+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f8b40 con 0x563334545000 2024-09-13T23:58:01.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.508+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545400 2024-09-13T23:58:01.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.508+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f9200 con 0x563334545400 2024-09-13T23:58:01.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.508+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545400 2024-09-13T23:58:01.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.512+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f9200 con 0x563334545400 2024-09-13T23:58:01.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.512+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545000 2024-09-13T23:58:01.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.512+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f8b40 con 0x563334545000 2024-09-13T23:58:01.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.512+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334606000 2024-09-13T23:58:01.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.512+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f8b40 con 0x563334606000 2024-09-13T23:58:01.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.512+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545000 2024-09-13T23:58:01.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.512+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f8b40 con 0x563334545000 2024-09-13T23:58:01.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.512+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334606000 2024-09-13T23:58:01.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.512+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f8b40 con 0x563334606000 2024-09-13T23:58:01.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.512+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545400 2024-09-13T23:58:01.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.512+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f9200 con 0x563334545400 2024-09-13T23:58:01.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.512+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545c00 2024-09-13T23:58:01.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.512+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f9440 con 0x563334545c00 2024-09-13T23:58:01.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.512+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545000 2024-09-13T23:58:01.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.516+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f8b40 con 0x563334545000 2024-09-13T23:58:01.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.516+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545400 2024-09-13T23:58:01.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.516+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f9200 con 0x563334545400 2024-09-13T23:58:01.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.516+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545c00 2024-09-13T23:58:01.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.516+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f9440 con 0x563334545c00 2024-09-13T23:58:01.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.516+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545000 2024-09-13T23:58:01.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.516+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f8b40 con 0x563334545000 2024-09-13T23:58:01.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.516+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545000 2024-09-13T23:58:01.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.516+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f8b40 con 0x563334545000 2024-09-13T23:58:01.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.516+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545000 2024-09-13T23:58:01.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.516+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f8b40 con 0x563334545000 2024-09-13T23:58:01.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.516+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545c00 2024-09-13T23:58:01.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.520+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f9440 con 0x563334545c00 2024-09-13T23:58:01.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.520+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334606000 2024-09-13T23:58:01.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.520+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f8b40 con 0x563334606000 2024-09-13T23:58:01.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.520+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545000 2024-09-13T23:58:01.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.520+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f8b40 con 0x563334545000 2024-09-13T23:58:01.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.520+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334606000 2024-09-13T23:58:01.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.520+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f8b40 con 0x563334606000 2024-09-13T23:58:01.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.520+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545c00 2024-09-13T23:58:01.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.520+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f9440 con 0x563334545c00 2024-09-13T23:58:01.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.520+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334606000 2024-09-13T23:58:01.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.520+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f8b40 con 0x563334606000 2024-09-13T23:58:01.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.520+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545400 2024-09-13T23:58:01.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.520+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f9200 con 0x563334545400 2024-09-13T23:58:01.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.524+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545400 2024-09-13T23:58:01.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.524+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f9200 con 0x563334545400 2024-09-13T23:58:01.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.524+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545c00 2024-09-13T23:58:01.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.524+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f9440 con 0x563334545c00 2024-09-13T23:58:01.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.524+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545400 2024-09-13T23:58:01.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.524+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5633345f9200 con 0x563334545400 2024-09-13T23:58:01.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.524+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334545400 2024-09-13T23:58:01.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.524+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5633345f9200 con 0x563334545400 2024-09-13T23:58:01.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.524+0000 7f748bba6f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:58:01.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.524+0000 7f748bba6f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:58:01.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.524+0000 7f748bba6f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:58:01.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.524+0000 7f748bba6f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:58:01.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.524+0000 7f748bba6f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.524+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334606800 con 0x563334545000 2024-09-13T23:58:01.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.524+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5633345f8b40 con 0x563334545000 2024-09-13T23:58:01.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.524+0000 7f748bba6f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.524+0000 7f748bba6f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.524+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334606c00 con 0x563334545400 2024-09-13T23:58:01.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5633345f9200 con 0x563334545400 2024-09-13T23:58:01.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748bba6f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:01.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748bba6f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334607000 con 0x563334606000 2024-09-13T23:58:01.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5633345f8b40 con 0x563334606000 2024-09-13T23:58:01.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748bba6f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:58:01.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748bba6f40 20 zone default found 2024-09-13T23:58:01.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748bba6f40 4 Realm: () 2024-09-13T23:58:01.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748bba6f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:58:01.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748bba6f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:58:01.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748bba6f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:58:01.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748bba6f40 20 zonegroup default 2024-09-13T23:58:01.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748bba6f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334607400 con 0x563334606000 2024-09-13T23:58:01.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5633345f8b40 con 0x563334606000 2024-09-13T23:58:01.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748bba6f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748bba6f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334607800 con 0x563334545c00 2024-09-13T23:58:01.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5633345f9440 con 0x563334545c00 2024-09-13T23:58:01.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748bba6f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748bba6f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334607c00 con 0x563334545c00 2024-09-13T23:58:01.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5633345f9440 con 0x563334545c00 2024-09-13T23:58:01.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748bba6f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748bba6f40 20 started sync module instance, tier type = 2024-09-13T23:58:01.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748bba6f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:58:01.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.528+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5633344e0000 con 0x563334545400 2024-09-13T23:58:01.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.532+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v35'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5633345f9200 con 0x563334545400 2024-09-13T23:58:01.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.532+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94777920428800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5633344e0400 con 0x563334545400 2024-09-13T23:58:01.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.532+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5633344e0800 con 0x563334545000 2024-09-13T23:58:01.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.536+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v35'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5633345f8b40 con 0x563334545000 2024-09-13T23:58:01.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.536+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94777920429952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5633344e0c00 con 0x563334545000 2024-09-13T23:58:01.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.536+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94777920428800] v35'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5633345f9200 con 0x563334545400 2024-09-13T23:58:01.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.536+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5633344e1000 con 0x563334545400 2024-09-13T23:58:01.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.536+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94777920429952] v35'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5633345f8b40 con 0x563334545000 2024-09-13T23:58:01.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.536+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v35'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5633345f9200 con 0x563334545400 2024-09-13T23:58:01.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.536+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94777920431104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5633344e1400 con 0x563334545400 2024-09-13T23:58:01.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.536+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5633344e1800 con 0x563334606000 2024-09-13T23:58:01.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.540+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v35'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5633345f8b40 con 0x563334606000 2024-09-13T23:58:01.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.540+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94777920432256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5633344e1c00 con 0x563334606000 2024-09-13T23:58:01.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.540+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5633344e0800 con 0x563334545400 2024-09-13T23:58:01.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.540+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94777920431104] v35'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5633345f9200 con 0x563334545400 2024-09-13T23:58:01.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.540+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94777920432256] v35'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5633345f8b40 con 0x563334606000 2024-09-13T23:58:01.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.544+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v35'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5633345f9200 con 0x563334545400 2024-09-13T23:58:01.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.544+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94777920433408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5633344e0000 con 0x563334545400 2024-09-13T23:58:01.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.544+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334606800 con 0x563334545c00 2024-09-13T23:58:01.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.544+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v35'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5633345f9440 con 0x563334545c00 2024-09-13T23:58:01.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.544+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94777920434560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334607000 con 0x563334545c00 2024-09-13T23:58:01.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.544+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334607400 con 0x563334545c00 2024-09-13T23:58:01.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.544+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94777920433408] v35'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5633345f9200 con 0x563334545400 2024-09-13T23:58:01.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.548+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v35'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5633345f9440 con 0x563334545c00 2024-09-13T23:58:01.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.548+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94777920434560] v35'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5633345f9440 con 0x563334545c00 2024-09-13T23:58:01.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.548+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94777920435712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334606c00 con 0x563334545c00 2024-09-13T23:58:01.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.548+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334545800 con 0x563334606000 2024-09-13T23:58:01.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.548+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v35'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5633345f8b40 con 0x563334606000 2024-09-13T23:58:01.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.548+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94777920436864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5633344e0400 con 0x563334606000 2024-09-13T23:58:01.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.548+0000 7f748bba6f40 20 add_watcher() i=0 2024-09-13T23:58:01.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.548+0000 7f748bba6f40 20 add_watcher() i=1 2024-09-13T23:58:01.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.548+0000 7f748bba6f40 20 add_watcher() i=2 2024-09-13T23:58:01.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.548+0000 7f748bba6f40 20 add_watcher() i=3 2024-09-13T23:58:01.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.548+0000 7f748bba6f40 20 add_watcher() i=4 2024-09-13T23:58:01.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.548+0000 7f748bba6f40 20 add_watcher() i=5 2024-09-13T23:58:01.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.548+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94777920435712] v35'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5633345f9440 con 0x563334545c00 2024-09-13T23:58:01.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.548+0000 7f748bba6f40 20 add_watcher() i=6 2024-09-13T23:58:01.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.552+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94777920436864] v35'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5633345f8b40 con 0x563334606000 2024-09-13T23:58:01.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.552+0000 7f748bba6f40 20 add_watcher() i=7 2024-09-13T23:58:01.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.552+0000 7f748bba6f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:58:01.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.552+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x5633344e1000 con 0x563334545000 2024-09-13T23:58:01.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.552+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5633345f8b40 con 0x563334545000 2024-09-13T23:58:01.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.552+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94777922125824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5633344e1400 con 0x563334545000 2024-09-13T23:58:01.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.552+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94777922125824] v35'200 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5633345f8b40 con 0x563334545000 2024-09-13T23:58:01.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.552+0000 7f747132d700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:01.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.552+0000 7f748bba6f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:58:01.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.552+0000 7f748bba6f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:58:01.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.552+0000 7f748bba6f40 1 Processor -- start 2024-09-13T23:58:01.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.556+0000 7f748bba6f40 1 -- start start 2024-09-13T23:58:01.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.556+0000 7f748bba6f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563334606400 0x563334485180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.556+0000 7f748bba6f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633341c2780 con 0x563334606400 2024-09-13T23:58:01.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.556+0000 7f7489b5e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563334606400 0x563334485180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.556+0000 7f7489b5e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563334606400 0x563334485180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49508/0 (socket says 172.21.15.173:49508) 2024-09-13T23:58:01.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.556+0000 7f7489b5e700 1 -- 172.21.15.173:0/3759817564 learned_addr learned my addr 172.21.15.173:0/3759817564 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.556+0000 7f7489b5e700 1 -- 172.21.15.173:0/3759817564 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633341aeb60 con 0x563334606400 2024-09-13T23:58:01.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.556+0000 7f7489b5e700 1 --2- 172.21.15.173:0/3759817564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563334606400 0x563334485180 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x5633346200f0 tx=0x5633342a1980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8766306871bdce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.556+0000 7f7470b2c700 1 -- 172.21.15.173:0/3759817564 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x563334241760 con 0x563334606400 2024-09-13T23:58:01.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.556+0000 7f7470b2c700 1 -- 172.21.15.173:0/3759817564 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563334556600 con 0x563334606400 2024-09-13T23:58:01.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.556+0000 7f7470b2c700 1 -- 172.21.15.173:0/3759817564 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56333462a000 con 0x563334606400 2024-09-13T23:58:01.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.556+0000 7f748bba6f40 1 -- 172.21.15.173:0/3759817564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563334606400 msgr2=0x563334485180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.556+0000 7f748bba6f40 1 --2- 172.21.15.173:0/3759817564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563334606400 0x563334485180 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x5633346200f0 tx=0x5633342a1980 comp rx=0 tx=0).stop 2024-09-13T23:58:01.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.556+0000 7f748bba6f40 1 -- 172.21.15.173:0/3759817564 shutdown_connections 2024-09-13T23:58:01.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.556+0000 7f748bba6f40 1 --2- 172.21.15.173:0/3759817564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563334606400 0x563334485180 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.556+0000 7f748bba6f40 1 -- 172.21.15.173:0/3759817564 >> 172.21.15.173:0/3759817564 conn(0x5633344e0800 msgr2=0x56333429e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.556+0000 7f748bba6f40 1 -- 172.21.15.173:0/3759817564 shutdown_connections 2024-09-13T23:58:01.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.556+0000 7f748bba6f40 1 -- 172.21.15.173:0/3759817564 wait complete. 2024-09-13T23:58:01.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.556+0000 7f748bba6f40 1 Processor -- start 2024-09-13T23:58:01.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.556+0000 7f748bba6f40 1 -- start start 2024-09-13T23:58:01.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.560+0000 7f748bba6f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563334606400 0x563334485180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.560+0000 7f748bba6f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56333422a000 con 0x563334606400 2024-09-13T23:58:01.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.560+0000 7f7489b5e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563334606400 0x563334485180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.560+0000 7f7489b5e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563334606400 0x563334485180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49514/0 (socket says 172.21.15.173:49514) 2024-09-13T23:58:01.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.560+0000 7f7489b5e700 1 -- 172.21.15.173:0/3808564606 learned_addr learned my addr 172.21.15.173:0/3808564606 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.560+0000 7f7489b5e700 1 -- 172.21.15.173:0/3808564606 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633341aed00 con 0x563334606400 2024-09-13T23:58:01.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.560+0000 7f7489b5e700 1 --2- 172.21.15.173:0/3808564606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563334606400 0x563334485180 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x563334620330 tx=0x5633345f05a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.560+0000 7f746f329700 1 -- 172.21.15.173:0/3808564606 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56333462a160 con 0x563334606400 2024-09-13T23:58:01.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.560+0000 7f746f329700 1 -- 172.21.15.173:0/3808564606 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563334556300 con 0x563334606400 2024-09-13T23:58:01.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.560+0000 7f748bba6f40 1 -- 172.21.15.173:0/3808564606 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5633341ae340 con 0x563334606400 2024-09-13T23:58:01.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.560+0000 7f746f329700 1 -- 172.21.15.173:0/3808564606 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56333462a2c0 con 0x563334606400 2024-09-13T23:58:01.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.560+0000 7f748bba6f40 1 -- 172.21.15.173:0/3808564606 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5633341afd40 con 0x563334606400 2024-09-13T23:58:01.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.560+0000 7f746f329700 1 -- 172.21.15.173:0/3808564606 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x563334297b80 con 0x563334606400 2024-09-13T23:58:01.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.560+0000 7f746f329700 1 --2- 172.21.15.173:0/3808564606 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563334545800 0x56333469e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.560+0000 7f746f329700 1 -- 172.21.15.173:0/3808564606 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x563334203500 con 0x563334606400 2024-09-13T23:58:01.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.560+0000 7f748bba6f40 5 note: GC not initialized 2024-09-13T23:58:01.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.560+0000 7f748ab60700 1 --2- 172.21.15.173:0/3808564606 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563334545800 0x56333469e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.564+0000 7f748ab60700 1 --2- 172.21.15.173:0/3808564606 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563334545800 0x56333469e000 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x563335014930 tx=0x5633345f15c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.564+0000 7f746cb24700 20 reqs_thread_entry: start 2024-09-13T23:58:01.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.564+0000 7f748bba6f40 20 init_complete bucket index max shards: 11 2024-09-13T23:58:01.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.564+0000 7f748bba6f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:58:01.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.564+0000 7f746ab20700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:58:31 2024 2024-09-13T23:58:01.568 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:58:01.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.564+0000 7f746a2fe700 20 reqs_thread_entry: start 2024-09-13T23:58:01.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.564+0000 7f748bba6f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.564+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x563334606800 con 0x563334545000 2024-09-13T23:58:01.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.564+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv18 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x5633345f8b40 con 0x563334545000 2024-09-13T23:58:01.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.564+0000 7f748bba6f40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:58:01.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.564+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x5633344e0c00 con 0x563334545c00 2024-09-13T23:58:01.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.568+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x5633345f9440 con 0x563334545c00 2024-09-13T23:58:01.570 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:58:01.570 INFO:teuthology.orchestra.run.smithi173.stdout: "entries": [ 2024-09-13T23:58:01.570 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.570 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:58:01.570 INFO:teuthology.orchestra.run.smithi173.stdout: "buckets": [ 2024-09-13T23:58:01.570 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.570 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "", 2024-09-13T23:58:01.570 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.570 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.571 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.571 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:01.571 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.571 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "list_buckets", 2024-09-13T23:58:01.571 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 322, 2024-09-13T23:58:01.571 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.571 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.571 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.571 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.571 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.571 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.571 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.571 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo", 2024-09-13T23:58:01.572 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.572 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.572 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.572 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:01.572 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.572 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "create_bucket", 2024-09-13T23:58:01.572 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.572 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.572 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 5, 2024-09-13T23:58:01.572 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 5 2024-09-13T23:58:01.572 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.572 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.572 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "delete_bucket", 2024-09-13T23:58:01.572 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 236, 2024-09-13T23:58:01.572 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.573 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 2, 2024-09-13T23:58:01.573 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.573 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.573 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.573 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "delete_obj", 2024-09-13T23:58:01.573 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.573 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.573 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 4, 2024-09-13T23:58:01.573 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 4 2024-09-13T23:58:01.573 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.573 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.573 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "get_acls", 2024-09-13T23:58:01.573 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 1026, 2024-09-13T23:58:01.573 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.574 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 2, 2024-09-13T23:58:01.574 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 2 2024-09-13T23:58:01.574 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.574 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.574 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "get_obj", 2024-09-13T23:58:01.574 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 4, 2024-09-13T23:58:01.574 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.574 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.574 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.574 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.574 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.574 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "list_bucket", 2024-09-13T23:58:01.574 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 515, 2024-09-13T23:58:01.574 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.575 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.575 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.575 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.575 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.575 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "put_acls", 2024-09-13T23:58:01.575 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.575 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.575 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 2, 2024-09-13T23:58:01.575 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 2 2024-09-13T23:58:01.575 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.575 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.575 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "put_obj", 2024-09-13T23:58:01.575 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.575 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 30000042, 2024-09-13T23:58:01.575 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 11, 2024-09-13T23:58:01.575 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 11 2024-09-13T23:58:01.576 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.576 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.576 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.576 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.576 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo2", 2024-09-13T23:58:01.576 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.576 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.576 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.576 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:01.576 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.576 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "create_bucket", 2024-09-13T23:58:01.576 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.576 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.577 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.577 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.577 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.577 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.577 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "delete_bucket", 2024-09-13T23:58:01.577 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.577 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.577 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.577 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.577 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.577 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.577 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.577 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.568+0000 7f747132d700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:01.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.568+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94777922125824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5633344e1800 con 0x563334545000 2024-09-13T23:58:01.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.572+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94777922125824] v35'201 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5633345f8b40 con 0x563334545000 2024-09-13T23:58:01.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.572+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94777920428800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5633344e1c00 con 0x563334545400 2024-09-13T23:58:01.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.572+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94777920428800] v35'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5633345f9200 con 0x563334545400 2024-09-13T23:58:01.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.572+0000 7f748bba6f40 20 remove_watcher() i=0 2024-09-13T23:58:01.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.572+0000 7f748bba6f40 2 removed watcher, disabling cache 2024-09-13T23:58:01.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.572+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94777920429952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5633344e0400 con 0x563334545000 2024-09-13T23:58:01.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.576+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94777920429952] v35'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5633345f8b40 con 0x563334545000 2024-09-13T23:58:01.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.576+0000 7f748bba6f40 20 remove_watcher() i=1 2024-09-13T23:58:01.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.576+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94777920431104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56333456e000 con 0x563334545400 2024-09-13T23:58:01.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.580+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94777920431104] v35'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5633345f9200 con 0x563334545400 2024-09-13T23:58:01.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.580+0000 7f748bba6f40 20 remove_watcher() i=2 2024-09-13T23:58:01.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.580+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94777920432256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56333456e400 con 0x563334606000 2024-09-13T23:58:01.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.580+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94777920432256] v35'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5633345f8b40 con 0x563334606000 2024-09-13T23:58:01.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.580+0000 7f748bba6f40 20 remove_watcher() i=3 2024-09-13T23:58:01.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.580+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94777920433408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56333456e800 con 0x563334545400 2024-09-13T23:58:01.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.584+0000 7f748a35f700 1 -- 172.21.15.173:0/1673020704 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94777920433408] v35'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5633345f9200 con 0x563334545400 2024-09-13T23:58:01.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.584+0000 7f748bba6f40 20 remove_watcher() i=4 2024-09-13T23:58:01.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.584+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94777920434560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56333456ec00 con 0x563334545c00 2024-09-13T23:58:01.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.584+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94777920434560] v35'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5633345f9440 con 0x563334545c00 2024-09-13T23:58:01.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.584+0000 7f748bba6f40 20 remove_watcher() i=5 2024-09-13T23:58:01.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.584+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94777920435712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56333456f000 con 0x563334545c00 2024-09-13T23:58:01.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.588+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94777920435712] v35'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5633345f9440 con 0x563334545c00 2024-09-13T23:58:01.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.588+0000 7f748bba6f40 20 remove_watcher() i=6 2024-09-13T23:58:01.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.588+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94777920436864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56333456f400 con 0x563334606000 2024-09-13T23:58:01.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748ab60700 1 -- 172.21.15.173:0/1673020704 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94777920436864] v35'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5633345f8b40 con 0x563334606000 2024-09-13T23:58:01.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 20 remove_watcher() i=7 2024-09-13T23:58:01.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563334545400 msgr2=0x563334484100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 --2- 172.21.15.173:0/1673020704 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x563334545400 0x563334484100 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563334545000 msgr2=0x563334483b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 --2- 172.21.15.173:0/1673020704 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x563334545000 0x563334483b80 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563334606000 msgr2=0x563334484c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 --2- 172.21.15.173:0/1673020704 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563334606000 0x563334484c00 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563334545c00 msgr2=0x563334484680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 --2- 172.21.15.173:0/1673020704 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x563334545c00 0x563334484680 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563334544c00 msgr2=0x563334483600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 --2- 172.21.15.173:0/1673020704 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563334544c00 0x563334483600 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x56333447d920 tx=0x5633342a1800 comp rx=0 tx=0).stop 2024-09-13T23:58:01.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d800 msgr2=0x563334482b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 --2- 172.21.15.173:0/1673020704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d800 0x563334482b00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x563335014420 tx=0x5633342a1f20 comp rx=0 tx=0).stop 2024-09-13T23:58:01.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 reap_dead start 2024-09-13T23:58:01.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f7489b5e700 1 -- 172.21.15.173:0/1673020704 reap_dead start 2024-09-13T23:58:01.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 shutdown_connections 2024-09-13T23:58:01.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 >> 172.21.15.173:0/1673020704 conn(0x56333419d400 msgr2=0x56333429d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 shutdown_connections 2024-09-13T23:58:01.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 -- 172.21.15.173:0/1673020704 wait complete. 2024-09-13T23:58:01.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 -- 172.21.15.173:0/3808564606 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563334545800 msgr2=0x56333469e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 --2- 172.21.15.173:0/3808564606 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563334545800 0x56333469e000 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x563335014930 tx=0x5633345f15c0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 -- 172.21.15.173:0/3808564606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563334606400 msgr2=0x563334485180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 --2- 172.21.15.173:0/3808564606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563334606400 0x563334485180 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x563334620330 tx=0x5633345f05a0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 -- 172.21.15.173:0/3808564606 shutdown_connections 2024-09-13T23:58:01.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 --2- 172.21.15.173:0/3808564606 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563334545800 0x56333469e000 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 --2- 172.21.15.173:0/3808564606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563334606400 0x563334485180 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 -- 172.21.15.173:0/3808564606 >> 172.21.15.173:0/3808564606 conn(0x5633344e0800 msgr2=0x56333429e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 -- 172.21.15.173:0/3808564606 shutdown_connections 2024-09-13T23:58:01.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 -- 172.21.15.173:0/3808564606 wait complete. 2024-09-13T23:58:01.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 -- 172.21.15.173:0/2733977215 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563334544000 msgr2=0x563334483080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 --2- 172.21.15.173:0/2733977215 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563334544000 0x563334483080 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x5633350155c0 tx=0x5633344fc240 comp rx=0 tx=0).stop 2024-09-13T23:58:01.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 -- 172.21.15.173:0/2733977215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d000 msgr2=0x563334482580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 --2- 172.21.15.173:0/2733977215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d000 0x563334482580 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x563335001b00 tx=0x5633342a1a40 comp rx=0 tx=0).stop 2024-09-13T23:58:01.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 -- 172.21.15.173:0/2733977215 shutdown_connections 2024-09-13T23:58:01.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 --2- 172.21.15.173:0/2733977215 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x563334544000 0x563334483080 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 --2- 172.21.15.173:0/2733977215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56333419d000 0x563334482580 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 -- 172.21.15.173:0/2733977215 >> 172.21.15.173:0/2733977215 conn(0x56333419cc00 msgr2=0x56333429d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 -- 172.21.15.173:0/2733977215 shutdown_connections 2024-09-13T23:58:01.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.592+0000 7f748bba6f40 1 -- 172.21.15.173:0/2733977215 wait complete. 2024-09-13T23:58:01.600 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo3", 2024-09-13T23:58:01.600 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.600 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.600 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.600 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:01.600 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.600 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "create_bucket", 2024-09-13T23:58:01.600 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.601 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.601 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.601 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.601 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.601 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.601 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "delete_bucket", 2024-09-13T23:58:01.601 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.601 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.601 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.601 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.601 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.601 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.601 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.602 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.602 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo4", 2024-09-13T23:58:01.602 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.602 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.602 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.602 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:01.602 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.602 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "create_bucket", 2024-09-13T23:58:01.602 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.602 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.602 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.602 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.602 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.602 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.603 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "delete_bucket", 2024-09-13T23:58:01.603 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.603 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.603 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.603 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.603 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.603 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.603 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.603 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.603 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.603 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:01.603 INFO:teuthology.orchestra.run.smithi173.stdout: "summary": [ 2024-09-13T23:58:01.603 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.603 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:58:01.604 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:01.604 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.604 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "create_bucket", 2024-09-13T23:58:01.604 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.604 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.604 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 8, 2024-09-13T23:58:01.604 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 8 2024-09-13T23:58:01.604 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.604 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.604 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "delete_bucket", 2024-09-13T23:58:01.604 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 236, 2024-09-13T23:58:01.604 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.604 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 5, 2024-09-13T23:58:01.604 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 4 2024-09-13T23:58:01.604 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.604 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.605 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "delete_obj", 2024-09-13T23:58:01.605 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.605 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.605 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 4, 2024-09-13T23:58:01.605 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 4 2024-09-13T23:58:01.605 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.605 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.605 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "get_acls", 2024-09-13T23:58:01.605 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 1026, 2024-09-13T23:58:01.605 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.605 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 2, 2024-09-13T23:58:01.605 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 2 2024-09-13T23:58:01.605 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.605 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.605 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "get_obj", 2024-09-13T23:58:01.606 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 4, 2024-09-13T23:58:01.606 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.606 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.606 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.606 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.606 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.606 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "list_bucket", 2024-09-13T23:58:01.606 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 515, 2024-09-13T23:58:01.606 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.606 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.606 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.606 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.606 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.606 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "list_buckets", 2024-09-13T23:58:01.606 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 322, 2024-09-13T23:58:01.606 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.607 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.607 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.607 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.607 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.607 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "put_acls", 2024-09-13T23:58:01.607 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.607 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.607 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 2, 2024-09-13T23:58:01.607 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 2 2024-09-13T23:58:01.607 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.607 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.607 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "put_obj", 2024-09-13T23:58:01.607 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.607 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 30000042, 2024-09-13T23:58:01.608 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 11, 2024-09-13T23:58:01.608 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 11 2024-09-13T23:58:01.608 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.608 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:01.608 INFO:teuthology.orchestra.run.smithi173.stdout: "total": { 2024-09-13T23:58:01.608 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 2103, 2024-09-13T23:58:01.608 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 30000042, 2024-09-13T23:58:01.608 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 35, 2024-09-13T23:58:01.608 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 34 2024-09-13T23:58:01.608 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.608 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.608 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.608 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:58:01.609 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-13T23:58:01.609 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-13T23:58:01.609 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-13T23:58:01.610 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-13T23:58:01.657 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:58:01.657 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:58:01.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.656+0000 7fa35e545f40 1 Processor -- start 2024-09-13T23:58:01.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.656+0000 7fa35e545f40 1 -- start start 2024-09-13T23:58:01.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.656+0000 7fa35e545f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55b409909000 0x55b409bee580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.656+0000 7fa35e545f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b4099cd500 con 0x55b409909400 2024-09-13T23:58:01.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.656+0000 7fa35e545f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b409996a00 con 0x55b409909000 2024-09-13T23:58:01.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.656+0000 7fa35ccfe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55b409909000 0x55b409bee580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.656+0000 7fa35c4fd700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55b409909400 0x55b409a08800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:38600/0 (socket says 172.21.15.173:38600) 2024-09-13T23:58:01.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.656+0000 7fa35c4fd700 1 -- 172.21.15.173:0/1827131225 learned_addr learned my addr 172.21.15.173:0/1827131225 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:58:01.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.656+0000 7fa35ccfe700 1 -- 172.21.15.173:0/1827131225 >> v1:172.21.15.87:6789/0 conn(0x55b409909400 legacy=0x55b409a08800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.656+0000 7fa35ccfe700 1 -- 172.21.15.173:0/1827131225 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b40991bd40 con 0x55b409909000 2024-09-13T23:58:01.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.656+0000 7fa35ccfe700 1 --2- 172.21.15.173:0/1827131225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909000 0x55b409bee580 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x55b409be9a70 tx=0x55b409a0d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c955f0db2d765b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.656+0000 7fa35bcfc700 1 -- 172.21.15.173:0/1827131225 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b4099ad4a0 con 0x55b409909000 2024-09-13T23:58:01.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.656+0000 7fa35bcfc700 1 -- 172.21.15.173:0/1827131225 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b4099cd800 con 0x55b409909000 2024-09-13T23:58:01.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.656+0000 7fa35bcfc700 1 -- 172.21.15.173:0/1827131225 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b4099ad600 con 0x55b409909000 2024-09-13T23:58:01.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.656+0000 7fa35e545f40 1 -- 172.21.15.173:0/1827131225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909000 msgr2=0x55b409bee580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.656+0000 7fa35e545f40 1 --2- 172.21.15.173:0/1827131225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909000 0x55b409bee580 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x55b409be9a70 tx=0x55b409a0d920 comp rx=0 tx=0).stop 2024-09-13T23:58:01.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.656+0000 7fa35e545f40 1 -- 172.21.15.173:0/1827131225 shutdown_connections 2024-09-13T23:58:01.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.656+0000 7fa35e545f40 1 --2- 172.21.15.173:0/1827131225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909000 0x55b409bee580 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.656+0000 7fa35e545f40 1 -- 172.21.15.173:0/1827131225 >> 172.21.15.173:0/1827131225 conn(0x55b409908c00 msgr2=0x55b409a08000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.656+0000 7fa35e545f40 1 -- 172.21.15.173:0/1827131225 shutdown_connections 2024-09-13T23:58:01.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.656+0000 7fa35e545f40 1 -- 172.21.15.173:0/1827131225 wait complete. 2024-09-13T23:58:01.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35e545f40 1 Processor -- start 2024-09-13T23:58:01.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35e545f40 1 -- start start 2024-09-13T23:58:01.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35e545f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909000 0x55b409bee580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35e545f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b409996500 con 0x55b409909000 2024-09-13T23:58:01.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35ccfe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909000 0x55b409bee580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35ccfe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909000 0x55b409bee580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49536/0 (socket says 172.21.15.173:49536) 2024-09-13T23:58:01.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35ccfe700 1 -- 172.21.15.173:0/816594061 learned_addr learned my addr 172.21.15.173:0/816594061 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35ccfe700 1 -- 172.21.15.173:0/816594061 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b40991bba0 con 0x55b409909000 2024-09-13T23:58:01.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35ccfe700 1 --2- 172.21.15.173:0/816594061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909000 0x55b409bee580 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x55b409a65d40 tx=0x55b409a0d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8485ca26c52389f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35b4fb700 1 -- 172.21.15.173:0/816594061 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b4099ad760 con 0x55b409909000 2024-09-13T23:58:01.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35b4fb700 1 -- 172.21.15.173:0/816594061 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b4099cdb00 con 0x55b409909000 2024-09-13T23:58:01.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35b4fb700 1 -- 172.21.15.173:0/816594061 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b4099ad4a0 con 0x55b409909000 2024-09-13T23:58:01.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35e545f40 1 -- 172.21.15.173:0/816594061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909000 msgr2=0x55b409bee580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35e545f40 1 --2- 172.21.15.173:0/816594061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909000 0x55b409bee580 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x55b409a65d40 tx=0x55b409a0d800 comp rx=0 tx=0).stop 2024-09-13T23:58:01.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35e545f40 1 -- 172.21.15.173:0/816594061 shutdown_connections 2024-09-13T23:58:01.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35e545f40 1 --2- 172.21.15.173:0/816594061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909000 0x55b409bee580 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35e545f40 1 -- 172.21.15.173:0/816594061 >> 172.21.15.173:0/816594061 conn(0x55b409908c00 msgr2=0x55b409a09000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35e545f40 1 -- 172.21.15.173:0/816594061 shutdown_connections 2024-09-13T23:58:01.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35e545f40 1 -- 172.21.15.173:0/816594061 wait complete. 2024-09-13T23:58:01.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35e545f40 1 Processor -- start 2024-09-13T23:58:01.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35e545f40 1 -- start start 2024-09-13T23:58:01.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35e545f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909000 0x55b409bee580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35e545f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4099963c0 con 0x55b409909000 2024-09-13T23:58:01.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35ccfe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909000 0x55b409bee580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35ccfe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909000 0x55b409bee580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49538/0 (socket says 172.21.15.173:49538) 2024-09-13T23:58:01.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35ccfe700 1 -- 172.21.15.173:0/591026941 learned_addr learned my addr 172.21.15.173:0/591026941 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.660+0000 7fa35ccfe700 1 -- 172.21.15.173:0/591026941 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b40991ba00 con 0x55b409909000 2024-09-13T23:58:01.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.664+0000 7fa35ccfe700 1 --2- 172.21.15.173:0/591026941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909000 0x55b409bee580 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x55b409a656b0 tx=0x55b409a0d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.664+0000 7fa359cf8700 1 -- 172.21.15.173:0/591026941 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b4099ad600 con 0x55b409909000 2024-09-13T23:58:01.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.664+0000 7fa35e545f40 1 -- 172.21.15.173:0/591026941 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b40991b860 con 0x55b409909000 2024-09-13T23:58:01.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.664+0000 7fa359cf8700 1 -- 172.21.15.173:0/591026941 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b4099cdc80 con 0x55b409909000 2024-09-13T23:58:01.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.664+0000 7fa35e545f40 1 -- 172.21.15.173:0/591026941 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b40991b6c0 con 0x55b409909000 2024-09-13T23:58:01.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.664+0000 7fa359cf8700 1 -- 172.21.15.173:0/591026941 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b4099ad8c0 con 0x55b409909000 2024-09-13T23:58:01.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.664+0000 7fa35e545f40 1 Processor -- start 2024-09-13T23:58:01.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.664+0000 7fa35e545f40 1 -- start start 2024-09-13T23:58:01.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.664+0000 7fa359cf8700 1 -- 172.21.15.173:0/591026941 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55b409a02b00 con 0x55b409909000 2024-09-13T23:58:01.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.664+0000 7fa35e545f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909800 0x55b409beeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.664+0000 7fa35e545f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b409996000 con 0x55b409909800 2024-09-13T23:58:01.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.664+0000 7fa359cf8700 1 --2- 172.21.15.173:0/591026941 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b409ca8000 0x55b409bef080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.664+0000 7fa359cf8700 1 -- 172.21.15.173:0/591026941 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55b40996f180 con 0x55b409909000 2024-09-13T23:58:01.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.664+0000 7fa35d4ff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909800 0x55b409beeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.664+0000 7fa35ccfe700 1 --2- 172.21.15.173:0/591026941 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b409ca8000 0x55b409bef080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.664+0000 7fa35d4ff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909800 0x55b409beeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49552/0 (socket says 172.21.15.173:49552) 2024-09-13T23:58:01.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.664+0000 7fa35d4ff700 1 -- 172.21.15.173:0/3487935807 learned_addr learned my addr 172.21.15.173:0/3487935807 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.664+0000 7fa35ccfe700 1 --2- 172.21.15.173:0/591026941 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b409ca8000 0x55b409bef080 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55b409c30ea0 tx=0x55b409c6cb40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.664+0000 7fa35d4ff700 1 -- 172.21.15.173:0/3487935807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b40991a000 con 0x55b409909800 2024-09-13T23:58:01.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.664+0000 7fa35d4ff700 1 --2- 172.21.15.173:0/3487935807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909800 0x55b409beeb00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x55b409c30b40 tx=0x55b409c6ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c332ead77e13a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.664+0000 7fa3574f3700 1 -- 172.21.15.173:0/3487935807 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b4099ad600 con 0x55b409909800 2024-09-13T23:58:01.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.668+0000 7fa3574f3700 1 -- 172.21.15.173:0/3487935807 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b409cb8000 con 0x55b409909800 2024-09-13T23:58:01.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.668+0000 7fa3574f3700 1 -- 172.21.15.173:0/3487935807 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b4099ad8c0 con 0x55b409909800 2024-09-13T23:58:01.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.668+0000 7fa35e545f40 1 -- 172.21.15.173:0/3487935807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909800 msgr2=0x55b409beeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.668+0000 7fa35e545f40 1 --2- 172.21.15.173:0/3487935807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909800 0x55b409beeb00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x55b409c30b40 tx=0x55b409c6ce40 comp rx=0 tx=0).stop 2024-09-13T23:58:01.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.668+0000 7fa35e545f40 1 -- 172.21.15.173:0/3487935807 shutdown_connections 2024-09-13T23:58:01.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.668+0000 7fa35e545f40 1 --2- 172.21.15.173:0/3487935807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909800 0x55b409beeb00 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.668+0000 7fa35e545f40 1 -- 172.21.15.173:0/3487935807 >> 172.21.15.173:0/3487935807 conn(0x55b409909400 msgr2=0x55b409a09800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.668+0000 7fa35e545f40 1 -- 172.21.15.173:0/3487935807 shutdown_connections 2024-09-13T23:58:01.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.668+0000 7fa35e545f40 1 -- 172.21.15.173:0/3487935807 wait complete. 2024-09-13T23:58:01.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.668+0000 7fa35e545f40 1 Processor -- start 2024-09-13T23:58:01.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.668+0000 7fa35e545f40 1 -- start start 2024-09-13T23:58:01.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.668+0000 7fa35e545f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909800 0x55b409beeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.668+0000 7fa35e545f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b40992e640 con 0x55b409909800 2024-09-13T23:58:01.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.668+0000 7fa35d4ff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909800 0x55b409beeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.668+0000 7fa35d4ff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909800 0x55b409beeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49564/0 (socket says 172.21.15.173:49564) 2024-09-13T23:58:01.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.668+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 learned_addr learned my addr 172.21.15.173:0/4101153457 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.668+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b40991aea0 con 0x55b409909800 2024-09-13T23:58:01.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.668+0000 7fa35d4ff700 1 --2- 172.21.15.173:0/4101153457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909800 0x55b409beeb00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x55b409c30840 tx=0x55b409c6ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.668+0000 7fa355cf0700 1 -- 172.21.15.173:0/4101153457 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b4099ad760 con 0x55b409909800 2024-09-13T23:58:01.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.668+0000 7fa355cf0700 1 -- 172.21.15.173:0/4101153457 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b409cb8180 con 0x55b409909800 2024-09-13T23:58:01.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.668+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b40991a820 con 0x55b409909800 2024-09-13T23:58:01.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.668+0000 7fa355cf0700 1 -- 172.21.15.173:0/4101153457 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b4099ad600 con 0x55b409909800 2024-09-13T23:58:01.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.668+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b40991a9c0 con 0x55b409909800 2024-09-13T23:58:01.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.672+0000 7fa355cf0700 1 -- 172.21.15.173:0/4101153457 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55b409a03080 con 0x55b409909800 2024-09-13T23:58:01.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.672+0000 7fa35e545f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.672+0000 7fa355cf0700 1 --2- 172.21.15.173:0/4101153457 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b409ca8c00 0x55b409bef600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.672+0000 7fa355cf0700 1 -- 172.21.15.173:0/4101153457 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55b40996f340 con 0x55b409909800 2024-09-13T23:58:01.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.672+0000 7fa35c4fd700 1 --2- 172.21.15.173:0/4101153457 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b409ca8c00 0x55b409bef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.672+0000 7fa35e545f40 1 --2- 172.21.15.173:0/4101153457 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55b409ca9000 0x55b409befb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.672+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9400 con 0x55b409ca9000 2024-09-13T23:58:01.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.672+0000 7fa35d4ff700 1 --2- 172.21.15.173:0/4101153457 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55b409ca9000 0x55b409befb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.672+0000 7fa35c4fd700 1 --2- 172.21.15.173:0/4101153457 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b409ca8c00 0x55b409bef600 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55b409c89b00 tx=0x55b409d5e0c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.672+0000 7fa35d4ff700 1 --2- 172.21.15.173:0/4101153457 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55b409ca9000 0x55b409befb80 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.676+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55b409d54b40 con 0x55b409ca9000 2024-09-13T23:58:01.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.676+0000 7fa35e545f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.676+0000 7fa35e545f40 20 realm 2024-09-13T23:58:01.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.676+0000 7fa35e545f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.676+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9000 2024-09-13T23:58:01.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.676+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55b409d54b40 con 0x55b409ca9000 2024-09-13T23:58:01.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.676+0000 7fa35e545f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.676+0000 7fa35e545f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:58:01.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.676+0000 7fa35e545f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.676+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9c00 con 0x55b409ca9000 2024-09-13T23:58:01.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.676+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55b409d54b40 con 0x55b409ca9000 2024-09-13T23:58:01.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.676+0000 7fa35e545f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.676+0000 7fa35e545f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.676+0000 7fa35e545f40 1 --2- 172.21.15.173:0/4101153457 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55b409ca9400 0x55b409bf0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.676+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9400 2024-09-13T23:58:01.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.676+0000 7fa35ccfe700 1 --2- 172.21.15.173:0/4101153457 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55b409ca9400 0x55b409bf0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.676+0000 7fa35ccfe700 1 --2- 172.21.15.173:0/4101153457 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55b409ca9400 0x55b409bf0100 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.676+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55b409d55200 con 0x55b409ca9400 2024-09-13T23:58:01.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.676+0000 7fa35e545f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:01.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.676+0000 7fa35e545f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.676+0000 7fa35e545f40 1 --2- 172.21.15.173:0/4101153457 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55b409ca9c00 0x55b409bf0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.676+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d72000 con 0x55b409ca9c00 2024-09-13T23:58:01.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.676+0000 7fa35c4fd700 1 --2- 172.21.15.173:0/4101153457 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55b409ca9c00 0x55b409bf0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.676+0000 7fa35c4fd700 1 --2- 172.21.15.173:0/4101153457 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55b409ca9c00 0x55b409bf0680 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.680+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55b409d55440 con 0x55b409ca9c00 2024-09-13T23:58:01.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.680+0000 7fa35e545f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:58:01.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.680+0000 7fa35e545f40 20 searching for the correct realm 2024-09-13T23:58:01.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.680+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d72400 con 0x55b409ca9c00 2024-09-13T23:58:01.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.680+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55b409d55440 con 0x55b409ca9c00 2024-09-13T23:58:01.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.680+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d72000 con 0x55b409ca9400 2024-09-13T23:58:01.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.680+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d55200 con 0x55b409ca9400 2024-09-13T23:58:01.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.680+0000 7fa35ccfe700 1 --2- 172.21.15.173:0/4101153457 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55b409d72000 0x55b409bf0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.680+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409d72000 2024-09-13T23:58:01.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.680+0000 7fa35d4ff700 1 --2- 172.21.15.173:0/4101153457 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55b409d72000 0x55b409bf0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.680+0000 7fa35d4ff700 1 --2- 172.21.15.173:0/4101153457 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55b409d72000 0x55b409bf0c00 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.680+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d54b40 con 0x55b409d72000 2024-09-13T23:58:01.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.680+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409d72000 2024-09-13T23:58:01.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.680+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55b409d54b40 con 0x55b409d72000 2024-09-13T23:58:01.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.680+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9000 2024-09-13T23:58:01.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.684+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d54b40 con 0x55b409ca9000 2024-09-13T23:58:01.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.684+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9c00 2024-09-13T23:58:01.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.684+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d55440 con 0x55b409ca9c00 2024-09-13T23:58:01.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.684+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9000 2024-09-13T23:58:01.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.684+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d54b40 con 0x55b409ca9000 2024-09-13T23:58:01.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.684+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9400 2024-09-13T23:58:01.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.684+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d55200 con 0x55b409ca9400 2024-09-13T23:58:01.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.684+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9400 2024-09-13T23:58:01.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.684+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d55200 con 0x55b409ca9400 2024-09-13T23:58:01.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.684+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9000 2024-09-13T23:58:01.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.684+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d54b40 con 0x55b409ca9000 2024-09-13T23:58:01.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.684+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409d72000 2024-09-13T23:58:01.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.684+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d54b40 con 0x55b409d72000 2024-09-13T23:58:01.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.684+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9000 2024-09-13T23:58:01.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.688+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d54b40 con 0x55b409ca9000 2024-09-13T23:58:01.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.688+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409d72000 2024-09-13T23:58:01.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.688+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d54b40 con 0x55b409d72000 2024-09-13T23:58:01.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.688+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9400 2024-09-13T23:58:01.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.688+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d55200 con 0x55b409ca9400 2024-09-13T23:58:01.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.688+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9c00 2024-09-13T23:58:01.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.688+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d55440 con 0x55b409ca9c00 2024-09-13T23:58:01.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.688+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9000 2024-09-13T23:58:01.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.688+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d54b40 con 0x55b409ca9000 2024-09-13T23:58:01.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.688+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9400 2024-09-13T23:58:01.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.688+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d55200 con 0x55b409ca9400 2024-09-13T23:58:01.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.688+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9c00 2024-09-13T23:58:01.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.688+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d55440 con 0x55b409ca9c00 2024-09-13T23:58:01.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.688+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9000 2024-09-13T23:58:01.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.692+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d54b40 con 0x55b409ca9000 2024-09-13T23:58:01.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.692+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9000 2024-09-13T23:58:01.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.692+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d54b40 con 0x55b409ca9000 2024-09-13T23:58:01.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.692+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9000 2024-09-13T23:58:01.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.692+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d54b40 con 0x55b409ca9000 2024-09-13T23:58:01.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.692+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9c00 2024-09-13T23:58:01.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.692+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d55440 con 0x55b409ca9c00 2024-09-13T23:58:01.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.692+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409d72000 2024-09-13T23:58:01.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.692+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d54b40 con 0x55b409d72000 2024-09-13T23:58:01.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.692+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9000 2024-09-13T23:58:01.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.692+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d54b40 con 0x55b409ca9000 2024-09-13T23:58:01.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.692+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409d72000 2024-09-13T23:58:01.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.696+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d54b40 con 0x55b409d72000 2024-09-13T23:58:01.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.696+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9c00 2024-09-13T23:58:01.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.696+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d55440 con 0x55b409ca9c00 2024-09-13T23:58:01.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.696+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409d72000 2024-09-13T23:58:01.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.696+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d54b40 con 0x55b409d72000 2024-09-13T23:58:01.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.696+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9400 2024-09-13T23:58:01.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.696+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d55200 con 0x55b409ca9400 2024-09-13T23:58:01.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.696+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9400 2024-09-13T23:58:01.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.696+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d55200 con 0x55b409ca9400 2024-09-13T23:58:01.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.696+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9c00 2024-09-13T23:58:01.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.696+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d55440 con 0x55b409ca9c00 2024-09-13T23:58:01.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.696+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9400 2024-09-13T23:58:01.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55b409d55200 con 0x55b409ca9400 2024-09-13T23:58:01.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409ca9400 2024-09-13T23:58:01.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b409d55200 con 0x55b409ca9400 2024-09-13T23:58:01.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35e545f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:58:01.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35e545f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:58:01.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35e545f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:58:01.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35e545f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:58:01.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35e545f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d72800 con 0x55b409ca9000 2024-09-13T23:58:01.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55b409d54b40 con 0x55b409ca9000 2024-09-13T23:58:01.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35e545f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35e545f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d72c00 con 0x55b409ca9400 2024-09-13T23:58:01.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55b409d55200 con 0x55b409ca9400 2024-09-13T23:58:01.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35e545f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:01.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35e545f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d73000 con 0x55b409d72000 2024-09-13T23:58:01.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55b409d54b40 con 0x55b409d72000 2024-09-13T23:58:01.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35e545f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:58:01.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35e545f40 20 zone default found 2024-09-13T23:58:01.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35e545f40 4 Realm: () 2024-09-13T23:58:01.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35e545f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:58:01.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35e545f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:58:01.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35e545f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:58:01.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35e545f40 20 zonegroup default 2024-09-13T23:58:01.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.700+0000 7fa35e545f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.704+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d73400 con 0x55b409d72000 2024-09-13T23:58:01.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.704+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55b409d54b40 con 0x55b409d72000 2024-09-13T23:58:01.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.704+0000 7fa35e545f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.704+0000 7fa35e545f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.704+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d73800 con 0x55b409ca9c00 2024-09-13T23:58:01.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.704+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55b409d55440 con 0x55b409ca9c00 2024-09-13T23:58:01.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.704+0000 7fa35e545f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.704+0000 7fa35e545f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.704+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d73c00 con 0x55b409ca9c00 2024-09-13T23:58:01.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.704+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55b409d55440 con 0x55b409ca9c00 2024-09-13T23:58:01.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.704+0000 7fa35e545f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.704+0000 7fa35e545f40 20 started sync module instance, tier type = 2024-09-13T23:58:01.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.704+0000 7fa35e545f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:58:01.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.704+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d78000 con 0x55b409ca9400 2024-09-13T23:58:01.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.708+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v35'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b409d55200 con 0x55b409ca9400 2024-09-13T23:58:01.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.708+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94231745944320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d78400 con 0x55b409ca9400 2024-09-13T23:58:01.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.708+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d78800 con 0x55b409ca9000 2024-09-13T23:58:01.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.708+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v35'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b409d54b40 con 0x55b409ca9000 2024-09-13T23:58:01.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.708+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94231745945472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d78c00 con 0x55b409ca9000 2024-09-13T23:58:01.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.708+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d79000 con 0x55b409ca9400 2024-09-13T23:58:01.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.712+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94231745944320] v35'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b409d55200 con 0x55b409ca9400 2024-09-13T23:58:01.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.712+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94231745945472] v35'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b409d54b40 con 0x55b409ca9000 2024-09-13T23:58:01.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.712+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v35'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b409d55200 con 0x55b409ca9400 2024-09-13T23:58:01.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.712+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94231745946624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d79400 con 0x55b409ca9400 2024-09-13T23:58:01.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.712+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d79800 con 0x55b409d72000 2024-09-13T23:58:01.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.712+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v35'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b409d54b40 con 0x55b409d72000 2024-09-13T23:58:01.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.712+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94231745947776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d79c00 con 0x55b409d72000 2024-09-13T23:58:01.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.712+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d78800 con 0x55b409ca9400 2024-09-13T23:58:01.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.716+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94231745946624] v35'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b409d55200 con 0x55b409ca9400 2024-09-13T23:58:01.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.716+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94231745947776] v35'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b409d54b40 con 0x55b409d72000 2024-09-13T23:58:01.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.716+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v35'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b409d55200 con 0x55b409ca9400 2024-09-13T23:58:01.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.716+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94231745948928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d78000 con 0x55b409ca9400 2024-09-13T23:58:01.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.716+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d72800 con 0x55b409ca9c00 2024-09-13T23:58:01.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.716+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v35'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b409d55440 con 0x55b409ca9c00 2024-09-13T23:58:01.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.716+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94231745950080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d73000 con 0x55b409ca9c00 2024-09-13T23:58:01.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.720+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d73400 con 0x55b409ca9c00 2024-09-13T23:58:01.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.720+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94231745948928] v35'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b409d55200 con 0x55b409ca9400 2024-09-13T23:58:01.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.720+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v35'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b409d55440 con 0x55b409ca9c00 2024-09-13T23:58:01.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.720+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94231745951232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d72c00 con 0x55b409ca9c00 2024-09-13T23:58:01.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.720+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ca9800 con 0x55b409d72000 2024-09-13T23:58:01.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.720+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94231745950080] v35'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b409d55440 con 0x55b409ca9c00 2024-09-13T23:58:01.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.720+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v35'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b409d54b40 con 0x55b409d72000 2024-09-13T23:58:01.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.720+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94231745951232] v35'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b409d55440 con 0x55b409ca9c00 2024-09-13T23:58:01.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.720+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94231745952384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d78400 con 0x55b409d72000 2024-09-13T23:58:01.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.720+0000 7fa35e545f40 20 add_watcher() i=0 2024-09-13T23:58:01.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.720+0000 7fa35e545f40 20 add_watcher() i=1 2024-09-13T23:58:01.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.720+0000 7fa35e545f40 20 add_watcher() i=2 2024-09-13T23:58:01.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.720+0000 7fa35e545f40 20 add_watcher() i=3 2024-09-13T23:58:01.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.720+0000 7fa35e545f40 20 add_watcher() i=4 2024-09-13T23:58:01.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.720+0000 7fa35e545f40 20 add_watcher() i=5 2024-09-13T23:58:01.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.720+0000 7fa35e545f40 20 add_watcher() i=6 2024-09-13T23:58:01.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.724+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94231745952384] v35'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b409d54b40 con 0x55b409d72000 2024-09-13T23:58:01.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.724+0000 7fa35e545f40 20 add_watcher() i=7 2024-09-13T23:58:01.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.724+0000 7fa35e545f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:58:01.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.724+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d79000 con 0x55b409ca9000 2024-09-13T23:58:01.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.724+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55b409d54b40 con 0x55b409ca9000 2024-09-13T23:58:01.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.724+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94231747616768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d79400 con 0x55b409ca9000 2024-09-13T23:58:01.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.728+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94231747616768] v35'202 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55b409d54b40 con 0x55b409ca9000 2024-09-13T23:58:01.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.728+0000 7fa343ccc700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:01.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.728+0000 7fa35e545f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:58:01.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.728+0000 7fa35e545f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:58:01.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.728+0000 7fa35e545f40 1 Processor -- start 2024-09-13T23:58:01.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.728+0000 7fa35e545f40 1 -- start start 2024-09-13T23:58:01.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.728+0000 7fa35e545f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409d72400 0x55b409bf1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.728+0000 7fa35e545f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b40992e780 con 0x55b409d72400 2024-09-13T23:58:01.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.728+0000 7fa35c4fd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409d72400 0x55b409bf1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.728+0000 7fa35c4fd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409d72400 0x55b409bf1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49578/0 (socket says 172.21.15.173:49578) 2024-09-13T23:58:01.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.728+0000 7fa35c4fd700 1 -- 172.21.15.173:0/2106559872 learned_addr learned my addr 172.21.15.173:0/2106559872 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.728+0000 7fa35c4fd700 1 -- 172.21.15.173:0/2106559872 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b40991ab60 con 0x55b409d72400 2024-09-13T23:58:01.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.728+0000 7fa35c4fd700 1 --2- 172.21.15.173:0/2106559872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409d72400 0x55b409bf1180 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x55b409d88090 tx=0x55b409c6df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1529e4a08e56910 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.728+0000 7fa3434cb700 1 -- 172.21.15.173:0/2106559872 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b409d90000 con 0x55b409d72400 2024-09-13T23:58:01.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.728+0000 7fa3434cb700 1 -- 172.21.15.173:0/2106559872 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b409cb8600 con 0x55b409d72400 2024-09-13T23:58:01.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.728+0000 7fa3434cb700 1 -- 172.21.15.173:0/2106559872 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b409d90160 con 0x55b409d72400 2024-09-13T23:58:01.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.728+0000 7fa35e545f40 1 -- 172.21.15.173:0/2106559872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409d72400 msgr2=0x55b409bf1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.728+0000 7fa35e545f40 1 --2- 172.21.15.173:0/2106559872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409d72400 0x55b409bf1180 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x55b409d88090 tx=0x55b409c6df80 comp rx=0 tx=0).stop 2024-09-13T23:58:01.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.728+0000 7fa35e545f40 1 -- 172.21.15.173:0/2106559872 shutdown_connections 2024-09-13T23:58:01.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.728+0000 7fa35e545f40 1 --2- 172.21.15.173:0/2106559872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409d72400 0x55b409bf1180 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.728+0000 7fa35e545f40 1 -- 172.21.15.173:0/2106559872 >> 172.21.15.173:0/2106559872 conn(0x55b409d78800 msgr2=0x55b409a0a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.728+0000 7fa35e545f40 1 -- 172.21.15.173:0/2106559872 shutdown_connections 2024-09-13T23:58:01.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.728+0000 7fa35e545f40 1 -- 172.21.15.173:0/2106559872 wait complete. 2024-09-13T23:58:01.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.732+0000 7fa35e545f40 1 Processor -- start 2024-09-13T23:58:01.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.732+0000 7fa35e545f40 1 -- start start 2024-09-13T23:58:01.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.732+0000 7fa35e545f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409d72400 0x55b409bf1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.732+0000 7fa35e545f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b409996000 con 0x55b409d72400 2024-09-13T23:58:01.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.732+0000 7fa35c4fd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409d72400 0x55b409bf1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.732+0000 7fa35c4fd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409d72400 0x55b409bf1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49586/0 (socket says 172.21.15.173:49586) 2024-09-13T23:58:01.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.732+0000 7fa35c4fd700 1 -- 172.21.15.173:0/632385213 learned_addr learned my addr 172.21.15.173:0/632385213 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.732+0000 7fa35c4fd700 1 -- 172.21.15.173:0/632385213 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b40991ad00 con 0x55b409d72400 2024-09-13T23:58:01.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.732+0000 7fa35c4fd700 1 --2- 172.21.15.173:0/632385213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409d72400 0x55b409bf1180 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x55b409d882a0 tx=0x55b409d5e1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.732+0000 7fa341cc8700 1 -- 172.21.15.173:0/632385213 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b409d902c0 con 0x55b409d72400 2024-09-13T23:58:01.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.732+0000 7fa341cc8700 1 -- 172.21.15.173:0/632385213 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b409cb8300 con 0x55b409d72400 2024-09-13T23:58:01.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.732+0000 7fa341cc8700 1 -- 172.21.15.173:0/632385213 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b409d90000 con 0x55b409d72400 2024-09-13T23:58:01.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.732+0000 7fa35e545f40 1 -- 172.21.15.173:0/632385213 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b40991a340 con 0x55b409d72400 2024-09-13T23:58:01.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.732+0000 7fa35e545f40 1 -- 172.21.15.173:0/632385213 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b40991ab60 con 0x55b409d72400 2024-09-13T23:58:01.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.732+0000 7fa341cc8700 1 -- 172.21.15.173:0/632385213 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55b409a03b80 con 0x55b409d72400 2024-09-13T23:58:01.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.732+0000 7fa341cc8700 1 --2- 172.21.15.173:0/632385213 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b409ca9800 0x55b409e0c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.736+0000 7fa341cc8700 1 -- 172.21.15.173:0/632385213 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55b40996f500 con 0x55b409d72400 2024-09-13T23:58:01.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.736+0000 7fa35e545f40 5 note: GC not initialized 2024-09-13T23:58:01.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.736+0000 7fa35d4ff700 1 --2- 172.21.15.173:0/632385213 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b409ca9800 0x55b409e0c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.736+0000 7fa35d4ff700 1 --2- 172.21.15.173:0/632385213 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b409ca9800 0x55b409e0c000 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55b409d1b4d0 tx=0x55b409d5f380 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.736+0000 7fa35e545f40 20 init_complete bucket index max shards: 11 2024-09-13T23:58:01.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.736+0000 7fa33f4c3700 20 reqs_thread_entry: start 2024-09-13T23:58:01.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.736+0000 7fa35e545f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:58:01.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.736+0000 7fa33d4bf700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:58:32 2024 2024-09-13T23:58:01.740 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:58:01.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.736+0000 7fa33cc9d700 20 reqs_thread_entry: start 2024-09-13T23:58:01.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.736+0000 7fa35e545f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.736+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d72800 con 0x55b409ca9000 2024-09-13T23:58:01.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.736+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv18 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55b409d54b40 con 0x55b409ca9000 2024-09-13T23:58:01.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.736+0000 7fa35e545f40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:58:01.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.736+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d78c00 con 0x55b409ca9c00 2024-09-13T23:58:01.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.740+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x55b409d55440 con 0x55b409ca9c00 2024-09-13T23:58:01.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.740+0000 7fa343ccc700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:01.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.740+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94231747616768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d79800 con 0x55b409ca9000 2024-09-13T23:58:01.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.744+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94231747616768] v35'203 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55b409d54b40 con 0x55b409ca9000 2024-09-13T23:58:01.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.744+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94231745944320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d79c00 con 0x55b409ca9400 2024-09-13T23:58:01.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.744+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94231745944320] v35'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b409d55200 con 0x55b409ca9400 2024-09-13T23:58:01.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.744+0000 7fa35e545f40 20 remove_watcher() i=0 2024-09-13T23:58:01.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.744+0000 7fa35e545f40 2 removed watcher, disabling cache 2024-09-13T23:58:01.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.744+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94231745945472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409d78400 con 0x55b409ca9000 2024-09-13T23:58:01.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.748+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94231745945472] v35'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b409d54b40 con 0x55b409ca9000 2024-09-13T23:58:01.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.748+0000 7fa35e545f40 20 remove_watcher() i=1 2024-09-13T23:58:01.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.748+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94231745946624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ce0000 con 0x55b409ca9400 2024-09-13T23:58:01.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.748+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94231745946624] v35'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b409d55200 con 0x55b409ca9400 2024-09-13T23:58:01.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.748+0000 7fa35e545f40 20 remove_watcher() i=2 2024-09-13T23:58:01.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.748+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94231745947776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ce0400 con 0x55b409d72000 2024-09-13T23:58:01.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.752+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94231745947776] v35'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b409d54b40 con 0x55b409d72000 2024-09-13T23:58:01.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.752+0000 7fa35e545f40 20 remove_watcher() i=3 2024-09-13T23:58:01.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.752+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94231745948928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ce0800 con 0x55b409ca9400 2024-09-13T23:58:01.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.752+0000 7fa35ccfe700 1 -- 172.21.15.173:0/4101153457 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94231745948928] v35'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b409d55200 con 0x55b409ca9400 2024-09-13T23:58:01.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.752+0000 7fa35e545f40 20 remove_watcher() i=4 2024-09-13T23:58:01.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.756+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94231745950080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ce0c00 con 0x55b409ca9c00 2024-09-13T23:58:01.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.756+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94231745950080] v35'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b409d55440 con 0x55b409ca9c00 2024-09-13T23:58:01.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.756+0000 7fa35e545f40 20 remove_watcher() i=5 2024-09-13T23:58:01.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.756+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94231745951232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ce1000 con 0x55b409ca9c00 2024-09-13T23:58:01.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.760+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94231745951232] v35'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b409d55440 con 0x55b409ca9c00 2024-09-13T23:58:01.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.760+0000 7fa35e545f40 20 remove_watcher() i=6 2024-09-13T23:58:01.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.760+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94231745952384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b409ce1400 con 0x55b409d72000 2024-09-13T23:58:01.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.760+0000 7fa35d4ff700 1 -- 172.21.15.173:0/4101153457 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94231745952384] v35'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b409d54b40 con 0x55b409d72000 2024-09-13T23:58:01.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.760+0000 7fa35e545f40 20 remove_watcher() i=7 2024-09-13T23:58:01.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.760+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55b409ca9400 msgr2=0x55b409bf0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.760+0000 7fa35e545f40 1 --2- 172.21.15.173:0/4101153457 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55b409ca9400 0x55b409bf0100 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.760+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55b409ca9000 msgr2=0x55b409befb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.760+0000 7fa35e545f40 1 --2- 172.21.15.173:0/4101153457 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55b409ca9000 0x55b409befb80 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.760+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55b409d72000 msgr2=0x55b409bf0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.760+0000 7fa35e545f40 1 --2- 172.21.15.173:0/4101153457 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55b409d72000 0x55b409bf0c00 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.760+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55b409ca9c00 msgr2=0x55b409bf0680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.760+0000 7fa35e545f40 1 --2- 172.21.15.173:0/4101153457 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55b409ca9c00 0x55b409bf0680 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.760+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b409ca8c00 msgr2=0x55b409bef600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.760+0000 7fa35e545f40 1 --2- 172.21.15.173:0/4101153457 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b409ca8c00 0x55b409bef600 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55b409c89b00 tx=0x55b409d5e0c0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909800 msgr2=0x55b409beeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 --2- 172.21.15.173:0/4101153457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909800 0x55b409beeb00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x55b409c30840 tx=0x55b409c6ca80 comp rx=0 tx=0).stop 2024-09-13T23:58:01.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35c4fd700 1 -- 172.21.15.173:0/4101153457 reap_dead start 2024-09-13T23:58:01.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 shutdown_connections 2024-09-13T23:58:01.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 --2- 172.21.15.173:0/4101153457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909800 0x55b409beeb00 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 >> 172.21.15.173:0/4101153457 conn(0x55b409909400 msgr2=0x55b409a09800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 shutdown_connections 2024-09-13T23:58:01.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 -- 172.21.15.173:0/4101153457 wait complete. 2024-09-13T23:58:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 -- 172.21.15.173:0/632385213 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b409ca9800 msgr2=0x55b409e0c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 --2- 172.21.15.173:0/632385213 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b409ca9800 0x55b409e0c000 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55b409d1b4d0 tx=0x55b409d5f380 comp rx=0 tx=0).stop 2024-09-13T23:58:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 -- 172.21.15.173:0/632385213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409d72400 msgr2=0x55b409bf1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 --2- 172.21.15.173:0/632385213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409d72400 0x55b409bf1180 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x55b409d882a0 tx=0x55b409d5e1e0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 -- 172.21.15.173:0/632385213 shutdown_connections 2024-09-13T23:58:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 --2- 172.21.15.173:0/632385213 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b409ca9800 0x55b409e0c000 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 --2- 172.21.15.173:0/632385213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409d72400 0x55b409bf1180 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 -- 172.21.15.173:0/632385213 >> 172.21.15.173:0/632385213 conn(0x55b409d78800 msgr2=0x55b409a0a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 -- 172.21.15.173:0/632385213 shutdown_connections 2024-09-13T23:58:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 -- 172.21.15.173:0/632385213 wait complete. 2024-09-13T23:58:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 -- 172.21.15.173:0/591026941 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b409ca8000 msgr2=0x55b409bef080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 --2- 172.21.15.173:0/591026941 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b409ca8000 0x55b409bef080 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55b409c30ea0 tx=0x55b409c6cb40 comp rx=0 tx=0).stop 2024-09-13T23:58:01.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 -- 172.21.15.173:0/591026941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909000 msgr2=0x55b409bee580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 --2- 172.21.15.173:0/591026941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909000 0x55b409bee580 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x55b409a656b0 tx=0x55b409a0d920 comp rx=0 tx=0).stop 2024-09-13T23:58:01.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 -- 172.21.15.173:0/591026941 shutdown_connections 2024-09-13T23:58:01.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 --2- 172.21.15.173:0/591026941 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b409ca8000 0x55b409bef080 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 --2- 172.21.15.173:0/591026941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b409909000 0x55b409bee580 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 -- 172.21.15.173:0/591026941 >> 172.21.15.173:0/591026941 conn(0x55b409908c00 msgr2=0x55b409a09000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 -- 172.21.15.173:0/591026941 shutdown_connections 2024-09-13T23:58:01.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.764+0000 7fa35e545f40 1 -- 172.21.15.173:0/591026941 wait complete. 2024-09-13T23:58:01.770 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:58:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: "entries": [ 2024-09-13T23:58:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:58:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: "buckets": [ 2024-09-13T23:58:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "", 2024-09-13T23:58:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [] 2024-09-13T23:58:01.771 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo", 2024-09-13T23:58:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "create_bucket", 2024-09-13T23:58:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 5, 2024-09-13T23:58:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 5 2024-09-13T23:58:01.772 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo2", 2024-09-13T23:58:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "create_bucket", 2024-09-13T23:58:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.773 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo3", 2024-09-13T23:58:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "create_bucket", 2024-09-13T23:58:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.774 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo4", 2024-09-13T23:58:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "create_bucket", 2024-09-13T23:58:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.775 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: "summary": [ 2024-09-13T23:58:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:58:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.776 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "create_bucket", 2024-09-13T23:58:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 8, 2024-09-13T23:58:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 8 2024-09-13T23:58:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: "total": { 2024-09-13T23:58:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 8, 2024-09-13T23:58:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 8 2024-09-13T23:58:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.777 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.778 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:58:01.778 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-09-13T23:58:01.779 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-13T23:58:01.779 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-13T23:58:01.779 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-13T23:58:01.821 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:58:01.821 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:58:01.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.820+0000 7fbd3308bf40 1 Processor -- start 2024-09-13T23:58:01.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.820+0000 7fbd3308bf40 1 -- start start 2024-09-13T23:58:01.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.820+0000 7fbd3308bf40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x56459cd51400 0x56459d036580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.820+0000 7fbd3308bf40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56459ce15500 con 0x56459cd51000 2024-09-13T23:58:01.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.820+0000 7fbd3308bf40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x56459cddea00 con 0x56459cd51400 2024-09-13T23:58:01.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.820+0000 7fbd31043700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x56459cd51400 0x56459d036580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.820+0000 7fbd31844700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x56459cd51000 0x56459ce50800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:38614/0 (socket says 172.21.15.173:38614) 2024-09-13T23:58:01.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.820+0000 7fbd31043700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x56459cd51400 0x56459d036580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49600/0 (socket says 172.21.15.173:49600) 2024-09-13T23:58:01.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.820+0000 7fbd31844700 1 -- 172.21.15.173:0/304252827 learned_addr learned my addr 172.21.15.173:0/304252827 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:58:01.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.820+0000 7fbd31043700 1 -- 172.21.15.173:0/304252827 >> v1:172.21.15.87:6789/0 conn(0x56459cd51000 legacy=0x56459ce50800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.820+0000 7fbd31043700 1 -- 172.21.15.173:0/304252827 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56459cd63d40 con 0x56459cd51400 2024-09-13T23:58:01.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.820+0000 7fbd31043700 1 --2- 172.21.15.173:0/304252827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51400 0x56459d036580 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x56459d031920 tx=0x56459ce55920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362e2480c6054b2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.820+0000 7fbd30842700 1 -- 172.21.15.173:0/304252827 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56459cdf54a0 con 0x56459cd51400 2024-09-13T23:58:01.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.820+0000 7fbd30842700 1 -- 172.21.15.173:0/304252827 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56459ce15800 con 0x56459cd51400 2024-09-13T23:58:01.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.820+0000 7fbd30842700 1 -- 172.21.15.173:0/304252827 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56459cdf5600 con 0x56459cd51400 2024-09-13T23:58:01.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.820+0000 7fbd3308bf40 1 -- 172.21.15.173:0/304252827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51400 msgr2=0x56459d036580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.820+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/304252827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51400 0x56459d036580 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x56459d031920 tx=0x56459ce55920 comp rx=0 tx=0).stop 2024-09-13T23:58:01.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.820+0000 7fbd3308bf40 1 -- 172.21.15.173:0/304252827 shutdown_connections 2024-09-13T23:58:01.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.820+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/304252827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51400 0x56459d036580 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.820+0000 7fbd3308bf40 1 -- 172.21.15.173:0/304252827 >> 172.21.15.173:0/304252827 conn(0x56459cd50c00 msgr2=0x56459ce50000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.824+0000 7fbd3308bf40 1 -- 172.21.15.173:0/304252827 shutdown_connections 2024-09-13T23:58:01.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.824+0000 7fbd3308bf40 1 -- 172.21.15.173:0/304252827 wait complete. 2024-09-13T23:58:01.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.824+0000 7fbd3308bf40 1 Processor -- start 2024-09-13T23:58:01.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.824+0000 7fbd3308bf40 1 -- start start 2024-09-13T23:58:01.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.824+0000 7fbd3308bf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51000 0x56459d036580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.824+0000 7fbd3308bf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56459cdde500 con 0x56459cd51000 2024-09-13T23:58:01.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.824+0000 7fbd31844700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51000 0x56459d036580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.824+0000 7fbd31844700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51000 0x56459d036580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49614/0 (socket says 172.21.15.173:49614) 2024-09-13T23:58:01.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.824+0000 7fbd31844700 1 -- 172.21.15.173:0/2164537430 learned_addr learned my addr 172.21.15.173:0/2164537430 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.824+0000 7fbd31844700 1 -- 172.21.15.173:0/2164537430 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56459cd63ba0 con 0x56459cd51000 2024-09-13T23:58:01.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.824+0000 7fbd31844700 1 --2- 172.21.15.173:0/2164537430 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51000 0x56459d036580 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x56459dbb58c0 tx=0x56459ce55b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f707691432edacf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.824+0000 7fbd30041700 1 -- 172.21.15.173:0/2164537430 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56459cdf54a0 con 0x56459cd51000 2024-09-13T23:58:01.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.824+0000 7fbd30041700 1 -- 172.21.15.173:0/2164537430 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56459ce15b00 con 0x56459cd51000 2024-09-13T23:58:01.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.824+0000 7fbd30041700 1 -- 172.21.15.173:0/2164537430 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56459cdf5600 con 0x56459cd51000 2024-09-13T23:58:01.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.824+0000 7fbd3308bf40 1 -- 172.21.15.173:0/2164537430 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51000 msgr2=0x56459d036580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.824+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/2164537430 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51000 0x56459d036580 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x56459dbb58c0 tx=0x56459ce55b60 comp rx=0 tx=0).stop 2024-09-13T23:58:01.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.824+0000 7fbd3308bf40 1 -- 172.21.15.173:0/2164537430 shutdown_connections 2024-09-13T23:58:01.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.824+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/2164537430 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51000 0x56459d036580 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.824+0000 7fbd3308bf40 1 -- 172.21.15.173:0/2164537430 >> 172.21.15.173:0/2164537430 conn(0x56459cd50c00 msgr2=0x56459ce51000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.824+0000 7fbd3308bf40 1 -- 172.21.15.173:0/2164537430 shutdown_connections 2024-09-13T23:58:01.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.824+0000 7fbd3308bf40 1 -- 172.21.15.173:0/2164537430 wait complete. 2024-09-13T23:58:01.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.824+0000 7fbd3308bf40 1 Processor -- start 2024-09-13T23:58:01.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.828+0000 7fbd3308bf40 1 -- start start 2024-09-13T23:58:01.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.828+0000 7fbd3308bf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51000 0x56459d036580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.828+0000 7fbd3308bf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56459cdde3c0 con 0x56459cd51000 2024-09-13T23:58:01.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.828+0000 7fbd31844700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51000 0x56459d036580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.828+0000 7fbd31844700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51000 0x56459d036580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49618/0 (socket says 172.21.15.173:49618) 2024-09-13T23:58:01.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.828+0000 7fbd31844700 1 -- 172.21.15.173:0/1331192197 learned_addr learned my addr 172.21.15.173:0/1331192197 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.828+0000 7fbd31844700 1 -- 172.21.15.173:0/1331192197 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56459cd63a00 con 0x56459cd51000 2024-09-13T23:58:01.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.828+0000 7fbd31844700 1 --2- 172.21.15.173:0/1331192197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51000 0x56459d036580 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x56459dbb5aa0 tx=0x56459ce55a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.828+0000 7fbd2e83e700 1 -- 172.21.15.173:0/1331192197 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56459cdf58c0 con 0x56459cd51000 2024-09-13T23:58:01.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.828+0000 7fbd2e83e700 1 -- 172.21.15.173:0/1331192197 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56459ce15c80 con 0x56459cd51000 2024-09-13T23:58:01.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.828+0000 7fbd3308bf40 1 -- 172.21.15.173:0/1331192197 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56459cd63860 con 0x56459cd51000 2024-09-13T23:58:01.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.828+0000 7fbd2e83e700 1 -- 172.21.15.173:0/1331192197 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56459cdf54a0 con 0x56459cd51000 2024-09-13T23:58:01.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.828+0000 7fbd3308bf40 1 -- 172.21.15.173:0/1331192197 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56459cd636c0 con 0x56459cd51000 2024-09-13T23:58:01.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.828+0000 7fbd2e83e700 1 -- 172.21.15.173:0/1331192197 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x56459ce4ab00 con 0x56459cd51000 2024-09-13T23:58:01.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.828+0000 7fbd3308bf40 1 Processor -- start 2024-09-13T23:58:01.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.828+0000 7fbd3308bf40 1 -- start start 2024-09-13T23:58:01.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.828+0000 7fbd2e83e700 1 --2- 172.21.15.173:0/1331192197 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56459d0f0000 0x56459d037080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.828+0000 7fbd2e83e700 1 -- 172.21.15.173:0/1331192197 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x56459cdb7180 con 0x56459cd51000 2024-09-13T23:58:01.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.828+0000 7fbd3308bf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51800 0x56459d036b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.828+0000 7fbd32045700 1 --2- 172.21.15.173:0/1331192197 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56459d0f0000 0x56459d037080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.828+0000 7fbd3308bf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56459cdde000 con 0x56459cd51800 2024-09-13T23:58:01.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.832+0000 7fbd31844700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51800 0x56459d036b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.832+0000 7fbd31844700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51800 0x56459d036b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49622/0 (socket says 172.21.15.173:49622) 2024-09-13T23:58:01.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.832+0000 7fbd31844700 1 -- 172.21.15.173:0/824778062 learned_addr learned my addr 172.21.15.173:0/824778062 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.832+0000 7fbd32045700 1 --2- 172.21.15.173:0/1331192197 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56459d0f0000 0x56459d037080 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x56459dbc8b10 tx=0x56459d0aade0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.832+0000 7fbd31844700 1 -- 172.21.15.173:0/824778062 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56459cd62000 con 0x56459cd51800 2024-09-13T23:58:01.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.832+0000 7fbd31844700 1 --2- 172.21.15.173:0/824778062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51800 0x56459d036b00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x56459dbc8300 tx=0x56459d0aa240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab895b34df68ddc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.832+0000 7fbd2c039700 1 -- 172.21.15.173:0/824778062 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56459cdf5600 con 0x56459cd51800 2024-09-13T23:58:01.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.832+0000 7fbd2c039700 1 -- 172.21.15.173:0/824778062 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56459ce15c80 con 0x56459cd51800 2024-09-13T23:58:01.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.832+0000 7fbd2c039700 1 -- 172.21.15.173:0/824778062 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56459cdf5a20 con 0x56459cd51800 2024-09-13T23:58:01.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.832+0000 7fbd3308bf40 1 -- 172.21.15.173:0/824778062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51800 msgr2=0x56459d036b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.832+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/824778062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51800 0x56459d036b00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x56459dbc8300 tx=0x56459d0aa240 comp rx=0 tx=0).stop 2024-09-13T23:58:01.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.832+0000 7fbd3308bf40 1 -- 172.21.15.173:0/824778062 shutdown_connections 2024-09-13T23:58:01.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.832+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/824778062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51800 0x56459d036b00 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.832+0000 7fbd3308bf40 1 -- 172.21.15.173:0/824778062 >> 172.21.15.173:0/824778062 conn(0x56459cd51400 msgr2=0x56459ce51800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.832+0000 7fbd3308bf40 1 -- 172.21.15.173:0/824778062 shutdown_connections 2024-09-13T23:58:01.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.832+0000 7fbd3308bf40 1 -- 172.21.15.173:0/824778062 wait complete. 2024-09-13T23:58:01.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.832+0000 7fbd3308bf40 1 Processor -- start 2024-09-13T23:58:01.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.832+0000 7fbd3308bf40 1 -- start start 2024-09-13T23:58:01.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.832+0000 7fbd3308bf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51800 0x56459d036b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.832+0000 7fbd3308bf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56459cd76640 con 0x56459cd51800 2024-09-13T23:58:01.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.832+0000 7fbd31844700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51800 0x56459d036b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.832+0000 7fbd31844700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51800 0x56459d036b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49630/0 (socket says 172.21.15.173:49630) 2024-09-13T23:58:01.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.832+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 learned_addr learned my addr 172.21.15.173:0/4268484181 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.836+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56459cd62ea0 con 0x56459cd51800 2024-09-13T23:58:01.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.836+0000 7fbd31844700 1 --2- 172.21.15.173:0/4268484181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51800 0x56459d036b00 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x56459d0f6bd0 tx=0x56459d0aafc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.836+0000 7fbd2a836700 1 -- 172.21.15.173:0/4268484181 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56459cdf5600 con 0x56459cd51800 2024-09-13T23:58:01.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.836+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56459cd62820 con 0x56459cd51800 2024-09-13T23:58:01.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.836+0000 7fbd2a836700 1 -- 172.21.15.173:0/4268484181 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56459d11a000 con 0x56459cd51800 2024-09-13T23:58:01.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.836+0000 7fbd2a836700 1 -- 172.21.15.173:0/4268484181 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56459cdf5a20 con 0x56459cd51800 2024-09-13T23:58:01.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.836+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56459cd629c0 con 0x56459cd51800 2024-09-13T23:58:01.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.836+0000 7fbd3308bf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.836+0000 7fbd2a836700 1 -- 172.21.15.173:0/4268484181 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x56459ce4adc0 con 0x56459cd51800 2024-09-13T23:58:01.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.836+0000 7fbd2a836700 1 --2- 172.21.15.173:0/4268484181 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56459d0f1000 0x56459d037600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.836+0000 7fbd2a836700 1 -- 172.21.15.173:0/4268484181 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x56459cdb7340 con 0x56459cd51800 2024-09-13T23:58:01.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.836+0000 7fbd31043700 1 --2- 172.21.15.173:0/4268484181 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56459d0f1000 0x56459d037600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.836+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/4268484181 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56459d0f1400 0x56459d037b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.836+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d0f1800 con 0x56459d0f1400 2024-09-13T23:58:01.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.836+0000 7fbd32045700 1 --2- 172.21.15.173:0/4268484181 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56459d0f1400 0x56459d037b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.840+0000 7fbd31043700 1 --2- 172.21.15.173:0/4268484181 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56459d0f1000 0x56459d037600 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x56459d031920 tx=0x56459ce55800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.840+0000 7fbd32045700 1 --2- 172.21.15.173:0/4268484181 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56459d0f1400 0x56459d037b80 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.840+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56459d144b40 con 0x56459d0f1400 2024-09-13T23:58:01.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.840+0000 7fbd3308bf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.840+0000 7fbd3308bf40 20 realm 2024-09-13T23:58:01.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.840+0000 7fbd3308bf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.840+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d0f1c00 con 0x56459d0f1400 2024-09-13T23:58:01.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.840+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56459d144b40 con 0x56459d0f1400 2024-09-13T23:58:01.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.840+0000 7fbd3308bf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.840+0000 7fbd3308bf40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:58:01.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.840+0000 7fbd3308bf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.840+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d0f1800 con 0x56459d0f1400 2024-09-13T23:58:01.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.840+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56459d144b40 con 0x56459d0f1400 2024-09-13T23:58:01.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.840+0000 7fbd3308bf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.840+0000 7fbd3308bf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.840+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/4268484181 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56459d0f1c00 0x56459d038100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.840+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d0f1c00 2024-09-13T23:58:01.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.840+0000 7fbd31844700 1 --2- 172.21.15.173:0/4268484181 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56459d0f1c00 0x56459d038100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.840+0000 7fbd31844700 1 --2- 172.21.15.173:0/4268484181 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56459d0f1c00 0x56459d038100 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.844+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x56459d145200 con 0x56459d0f1c00 2024-09-13T23:58:01.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.844+0000 7fbd3308bf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:01.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.844+0000 7fbd3308bf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.844+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/4268484181 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56459d188400 0x56459d038680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.844+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188800 con 0x56459d188400 2024-09-13T23:58:01.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.844+0000 7fbd31043700 1 --2- 172.21.15.173:0/4268484181 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56459d188400 0x56459d038680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.844+0000 7fbd31043700 1 --2- 172.21.15.173:0/4268484181 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56459d188400 0x56459d038680 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.844+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x56459d145440 con 0x56459d188400 2024-09-13T23:58:01.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.844+0000 7fbd3308bf40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:58:01.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.844+0000 7fbd3308bf40 20 searching for the correct realm 2024-09-13T23:58:01.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.844+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188c00 con 0x56459d188400 2024-09-13T23:58:01.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.844+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x56459d145440 con 0x56459d188400 2024-09-13T23:58:01.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.844+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188800 con 0x56459d0f1c00 2024-09-13T23:58:01.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.844+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d145200 con 0x56459d0f1c00 2024-09-13T23:58:01.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.844+0000 7fbd31844700 1 --2- 172.21.15.173:0/4268484181 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56459d188800 0x56459d038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.844+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d188800 2024-09-13T23:58:01.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.844+0000 7fbd32045700 1 --2- 172.21.15.173:0/4268484181 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56459d188800 0x56459d038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.844+0000 7fbd32045700 1 --2- 172.21.15.173:0/4268484181 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56459d188800 0x56459d038c00 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.848+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d144b40 con 0x56459d188800 2024-09-13T23:58:01.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.848+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d188800 2024-09-13T23:58:01.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.848+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x56459d144b40 con 0x56459d188800 2024-09-13T23:58:01.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.848+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d0f1400 2024-09-13T23:58:01.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.848+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d144b40 con 0x56459d0f1400 2024-09-13T23:58:01.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.848+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d188400 2024-09-13T23:58:01.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.848+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d145440 con 0x56459d188400 2024-09-13T23:58:01.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.848+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d0f1400 2024-09-13T23:58:01.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.848+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d144b40 con 0x56459d0f1400 2024-09-13T23:58:01.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.848+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d0f1c00 2024-09-13T23:58:01.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.848+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d145200 con 0x56459d0f1c00 2024-09-13T23:58:01.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.848+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d0f1c00 2024-09-13T23:58:01.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.848+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d145200 con 0x56459d0f1c00 2024-09-13T23:58:01.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.848+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d0f1400 2024-09-13T23:58:01.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.852+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d144b40 con 0x56459d0f1400 2024-09-13T23:58:01.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.852+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d188800 2024-09-13T23:58:01.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.852+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d144b40 con 0x56459d188800 2024-09-13T23:58:01.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.852+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d0f1400 2024-09-13T23:58:01.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.852+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d144b40 con 0x56459d0f1400 2024-09-13T23:58:01.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.852+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d188800 2024-09-13T23:58:01.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.852+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d144b40 con 0x56459d188800 2024-09-13T23:58:01.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.852+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d0f1c00 2024-09-13T23:58:01.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.852+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d145200 con 0x56459d0f1c00 2024-09-13T23:58:01.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.852+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d188400 2024-09-13T23:58:01.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.852+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d145440 con 0x56459d188400 2024-09-13T23:58:01.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.852+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d0f1400 2024-09-13T23:58:01.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.852+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d144b40 con 0x56459d0f1400 2024-09-13T23:58:01.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.852+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d0f1c00 2024-09-13T23:58:01.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.856+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d145200 con 0x56459d0f1c00 2024-09-13T23:58:01.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.856+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d188400 2024-09-13T23:58:01.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.856+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d145440 con 0x56459d188400 2024-09-13T23:58:01.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.856+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d0f1400 2024-09-13T23:58:01.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.856+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d144b40 con 0x56459d0f1400 2024-09-13T23:58:01.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.856+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d0f1400 2024-09-13T23:58:01.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.856+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d144b40 con 0x56459d0f1400 2024-09-13T23:58:01.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.856+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d0f1400 2024-09-13T23:58:01.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.856+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d144b40 con 0x56459d0f1400 2024-09-13T23:58:01.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.856+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d188400 2024-09-13T23:58:01.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.856+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d145440 con 0x56459d188400 2024-09-13T23:58:01.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.856+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d188800 2024-09-13T23:58:01.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.860+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d144b40 con 0x56459d188800 2024-09-13T23:58:01.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.860+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d0f1400 2024-09-13T23:58:01.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.860+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d144b40 con 0x56459d0f1400 2024-09-13T23:58:01.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.860+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d188800 2024-09-13T23:58:01.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.860+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d144b40 con 0x56459d188800 2024-09-13T23:58:01.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.860+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d188400 2024-09-13T23:58:01.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.860+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d145440 con 0x56459d188400 2024-09-13T23:58:01.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.860+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d188800 2024-09-13T23:58:01.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.860+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d144b40 con 0x56459d188800 2024-09-13T23:58:01.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.860+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d0f1c00 2024-09-13T23:58:01.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.860+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d145200 con 0x56459d0f1c00 2024-09-13T23:58:01.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.860+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d0f1c00 2024-09-13T23:58:01.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.864+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d145200 con 0x56459d0f1c00 2024-09-13T23:58:01.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.864+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d188400 2024-09-13T23:58:01.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.864+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d145440 con 0x56459d188400 2024-09-13T23:58:01.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.864+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d0f1c00 2024-09-13T23:58:01.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.864+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x56459d145200 con 0x56459d0f1c00 2024-09-13T23:58:01.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.864+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d0f1c00 2024-09-13T23:58:01.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.864+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56459d145200 con 0x56459d0f1c00 2024-09-13T23:58:01.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.864+0000 7fbd3308bf40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:58:01.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.864+0000 7fbd3308bf40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:58:01.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.864+0000 7fbd3308bf40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:58:01.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.864+0000 7fbd3308bf40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:58:01.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.864+0000 7fbd3308bf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.864+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d189000 con 0x56459d0f1400 2024-09-13T23:58:01.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.864+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x56459d144b40 con 0x56459d0f1400 2024-09-13T23:58:01.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.864+0000 7fbd3308bf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.864+0000 7fbd3308bf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.864+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d189400 con 0x56459d0f1c00 2024-09-13T23:58:01.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x56459d145200 con 0x56459d0f1c00 2024-09-13T23:58:01.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd3308bf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:01.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd3308bf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d189800 con 0x56459d188800 2024-09-13T23:58:01.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x56459d144b40 con 0x56459d188800 2024-09-13T23:58:01.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd3308bf40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:58:01.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd3308bf40 20 zone default found 2024-09-13T23:58:01.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd3308bf40 4 Realm: () 2024-09-13T23:58:01.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd3308bf40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:58:01.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd3308bf40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:58:01.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd3308bf40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:58:01.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd3308bf40 20 zonegroup default 2024-09-13T23:58:01.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd3308bf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d189c00 con 0x56459d188800 2024-09-13T23:58:01.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x56459d144b40 con 0x56459d188800 2024-09-13T23:58:01.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd3308bf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd3308bf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d189000 con 0x56459d188400 2024-09-13T23:58:01.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x56459d145440 con 0x56459d188400 2024-09-13T23:58:01.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd3308bf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd3308bf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d189800 con 0x56459d188400 2024-09-13T23:58:01.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x56459d145440 con 0x56459d188400 2024-09-13T23:58:01.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd3308bf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:01.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd3308bf40 20 started sync module instance, tier type = 2024-09-13T23:58:01.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd3308bf40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:58:01.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.868+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d0f1800 con 0x56459d0f1c00 2024-09-13T23:58:01.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.872+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v35'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56459d145200 con 0x56459d0f1c00 2024-09-13T23:58:01.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.872+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94856986942208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d0f0800 con 0x56459d0f1c00 2024-09-13T23:58:01.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.872+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d0f1800 con 0x56459d0f1400 2024-09-13T23:58:01.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.876+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v35'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56459d144b40 con 0x56459d0f1400 2024-09-13T23:58:01.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.876+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94856986943360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188000 con 0x56459d0f1400 2024-09-13T23:58:01.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.876+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d189400 con 0x56459d0f1c00 2024-09-13T23:58:01.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.876+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94856986942208] v35'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56459d145200 con 0x56459d0f1c00 2024-09-13T23:58:01.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.876+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94856986943360] v35'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56459d144b40 con 0x56459d0f1400 2024-09-13T23:58:01.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.876+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v35'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56459d145200 con 0x56459d0f1c00 2024-09-13T23:58:01.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.876+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94856986944512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d19a000 con 0x56459d0f1c00 2024-09-13T23:58:01.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.876+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d19a400 con 0x56459d188800 2024-09-13T23:58:01.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.880+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v35'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56459d144b40 con 0x56459d188800 2024-09-13T23:58:01.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.880+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94856986944512] v35'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56459d145200 con 0x56459d0f1c00 2024-09-13T23:58:01.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.880+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94856986945664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d19a800 con 0x56459d188800 2024-09-13T23:58:01.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.880+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d19ac00 con 0x56459d0f1c00 2024-09-13T23:58:01.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.884+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94856986945664] v35'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56459d144b40 con 0x56459d188800 2024-09-13T23:58:01.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.884+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v35'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56459d145200 con 0x56459d0f1c00 2024-09-13T23:58:01.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.884+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94856986946816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d19b000 con 0x56459d0f1c00 2024-09-13T23:58:01.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.884+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d19b400 con 0x56459d188400 2024-09-13T23:58:01.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.884+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94856986946816] v35'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56459d145200 con 0x56459d0f1c00 2024-09-13T23:58:01.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.884+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v35'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56459d145440 con 0x56459d188400 2024-09-13T23:58:01.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.884+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94856986947968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d19b800 con 0x56459d188400 2024-09-13T23:58:01.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.884+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d19bc00 con 0x56459d188400 2024-09-13T23:58:01.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.888+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94856986947968] v35'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56459d145440 con 0x56459d188400 2024-09-13T23:58:01.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.888+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v35'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56459d145440 con 0x56459d188400 2024-09-13T23:58:01.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.888+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94856986949120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d19b400 con 0x56459d188400 2024-09-13T23:58:01.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.888+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d19a000 con 0x56459d188800 2024-09-13T23:58:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.892+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94856986949120] v35'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56459d145440 con 0x56459d188400 2024-09-13T23:58:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.892+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v35'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56459d144b40 con 0x56459d188800 2024-09-13T23:58:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.892+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94856986950272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d19ac00 con 0x56459d188800 2024-09-13T23:58:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.892+0000 7fbd3308bf40 20 add_watcher() i=0 2024-09-13T23:58:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.892+0000 7fbd3308bf40 20 add_watcher() i=1 2024-09-13T23:58:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.892+0000 7fbd3308bf40 20 add_watcher() i=2 2024-09-13T23:58:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.892+0000 7fbd3308bf40 20 add_watcher() i=3 2024-09-13T23:58:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.892+0000 7fbd3308bf40 20 add_watcher() i=4 2024-09-13T23:58:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.892+0000 7fbd3308bf40 20 add_watcher() i=5 2024-09-13T23:58:01.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.892+0000 7fbd3308bf40 20 add_watcher() i=6 2024-09-13T23:58:01.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.892+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94856986950272] v35'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56459d144b40 con 0x56459d188800 2024-09-13T23:58:01.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.892+0000 7fbd3308bf40 20 add_watcher() i=7 2024-09-13T23:58:01.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.892+0000 7fbd3308bf40 2 all 8 watchers are set, enabling cache 2024-09-13T23:58:01.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.892+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d188c00 con 0x56459d0f1400 2024-09-13T23:58:01.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.892+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x56459d144b40 con 0x56459d0f1400 2024-09-13T23:58:01.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.892+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94856988459008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d189000 con 0x56459d0f1400 2024-09-13T23:58:01.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.896+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94856988459008] v35'204 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x56459d144b40 con 0x56459d0f1400 2024-09-13T23:58:01.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.896+0000 7fbd3308bf40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:58:01.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.896+0000 7fbd3308bf40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:58:01.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.896+0000 7fbd3308bf40 1 Processor -- start 2024-09-13T23:58:01.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.896+0000 7fbd18812700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:01.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.896+0000 7fbd3308bf40 1 -- start start 2024-09-13T23:58:01.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.896+0000 7fbd3308bf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459d189400 0x56459d039180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.896+0000 7fbd3308bf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56459cd76780 con 0x56459d189400 2024-09-13T23:58:01.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.896+0000 7fbd31043700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459d189400 0x56459d039180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.896+0000 7fbd31043700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459d189400 0x56459d039180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49640/0 (socket says 172.21.15.173:49640) 2024-09-13T23:58:01.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.896+0000 7fbd31043700 1 -- 172.21.15.173:0/3837076100 learned_addr learned my addr 172.21.15.173:0/3837076100 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.896+0000 7fbd31043700 1 -- 172.21.15.173:0/3837076100 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56459cd62b60 con 0x56459d189400 2024-09-13T23:58:01.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.896+0000 7fbd31043700 1 --2- 172.21.15.173:0/3837076100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459d189400 0x56459d039180 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x56459d1a86f0 tx=0x56459ce55980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0c384bb059fa1a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.896+0000 7fbd18011700 1 -- 172.21.15.173:0/3837076100 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56459cdf5760 con 0x56459d189400 2024-09-13T23:58:01.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.896+0000 7fbd18011700 1 -- 172.21.15.173:0/3837076100 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56459d11a900 con 0x56459d189400 2024-09-13T23:58:01.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.896+0000 7fbd18011700 1 -- 172.21.15.173:0/3837076100 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56459d19e160 con 0x56459d189400 2024-09-13T23:58:01.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.900+0000 7fbd3308bf40 1 -- 172.21.15.173:0/3837076100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459d189400 msgr2=0x56459d039180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.900+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/3837076100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459d189400 0x56459d039180 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x56459d1a86f0 tx=0x56459ce55980 comp rx=0 tx=0).stop 2024-09-13T23:58:01.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.900+0000 7fbd3308bf40 1 -- 172.21.15.173:0/3837076100 shutdown_connections 2024-09-13T23:58:01.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.900+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/3837076100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459d189400 0x56459d039180 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.900+0000 7fbd3308bf40 1 -- 172.21.15.173:0/3837076100 >> 172.21.15.173:0/3837076100 conn(0x56459d189800 msgr2=0x56459ce52000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.900+0000 7fbd3308bf40 1 -- 172.21.15.173:0/3837076100 shutdown_connections 2024-09-13T23:58:01.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.900+0000 7fbd3308bf40 1 -- 172.21.15.173:0/3837076100 wait complete. 2024-09-13T23:58:01.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.900+0000 7fbd3308bf40 1 Processor -- start 2024-09-13T23:58:01.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.900+0000 7fbd3308bf40 1 -- start start 2024-09-13T23:58:01.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.900+0000 7fbd3308bf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459d189400 0x56459d039180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.900+0000 7fbd3308bf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56459cdde000 con 0x56459d189400 2024-09-13T23:58:01.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.900+0000 7fbd31043700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459d189400 0x56459d039180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.900+0000 7fbd31043700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459d189400 0x56459d039180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49656/0 (socket says 172.21.15.173:49656) 2024-09-13T23:58:01.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.900+0000 7fbd31043700 1 -- 172.21.15.173:0/1203762447 learned_addr learned my addr 172.21.15.173:0/1203762447 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:01.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.900+0000 7fbd31043700 1 -- 172.21.15.173:0/1203762447 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56459cd62d00 con 0x56459d189400 2024-09-13T23:58:01.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.900+0000 7fbd31043700 1 --2- 172.21.15.173:0/1203762447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459d189400 0x56459d039180 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x56459d1a8900 tx=0x56459d1765a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.900+0000 7fbd1680e700 1 -- 172.21.15.173:0/1203762447 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56459d19e2c0 con 0x56459d189400 2024-09-13T23:58:01.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.900+0000 7fbd1680e700 1 -- 172.21.15.173:0/1203762447 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56459d11a600 con 0x56459d189400 2024-09-13T23:58:01.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.900+0000 7fbd3308bf40 1 -- 172.21.15.173:0/1203762447 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56459cd62340 con 0x56459d189400 2024-09-13T23:58:01.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.900+0000 7fbd1680e700 1 -- 172.21.15.173:0/1203762447 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x56459d19e420 con 0x56459d189400 2024-09-13T23:58:01.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.900+0000 7fbd3308bf40 1 -- 172.21.15.173:0/1203762447 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56459cd63d40 con 0x56459d189400 2024-09-13T23:58:01.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.900+0000 7fbd1680e700 1 -- 172.21.15.173:0/1203762447 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x56459ce4b8c0 con 0x56459d189400 2024-09-13T23:58:01.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.904+0000 7fbd1680e700 1 --2- 172.21.15.173:0/1203762447 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56459d188c00 0x56459d22c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:01.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.904+0000 7fbd1680e700 1 -- 172.21.15.173:0/1203762447 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x56459cdb76c0 con 0x56459d189400 2024-09-13T23:58:01.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.904+0000 7fbd32045700 1 --2- 172.21.15.173:0/1203762447 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56459d188c00 0x56459d22c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:01.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.904+0000 7fbd3308bf40 5 note: GC not initialized 2024-09-13T23:58:01.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.904+0000 7fbd32045700 1 --2- 172.21.15.173:0/1203762447 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56459d188c00 0x56459d22c000 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x56459d135ce0 tx=0x56459ce55da0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:01.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.904+0000 7fbd14009700 20 reqs_thread_entry: start 2024-09-13T23:58:01.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.904+0000 7fbd3308bf40 20 init_complete bucket index max shards: 11 2024-09-13T23:58:01.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.904+0000 7fbd3308bf40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:58:01.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.904+0000 7fbd12005700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:58:32 2024 2024-09-13T23:58:01.909 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:58:01.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.904+0000 7fbd3308bf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:01.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.904+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d0f0800 con 0x56459d0f1400 2024-09-13T23:58:01.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.904+0000 7fbd117e3700 20 reqs_thread_entry: start 2024-09-13T23:58:01.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.904+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv18 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x56459d144b40 con 0x56459d0f1400 2024-09-13T23:58:01.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.904+0000 7fbd3308bf40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:58:01.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.904+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d0f1800 con 0x56459d188400 2024-09-13T23:58:01.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.904+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x56459d145440 con 0x56459d188400 2024-09-13T23:58:01.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.908+0000 7fbd18812700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:01.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.908+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94856988459008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d19a800 con 0x56459d0f1400 2024-09-13T23:58:01.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.912+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94856988459008] v35'205 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x56459d144b40 con 0x56459d0f1400 2024-09-13T23:58:01.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.912+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94856986942208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d19a000 con 0x56459d0f1c00 2024-09-13T23:58:01.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.912+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94856986942208] v35'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56459d145200 con 0x56459d0f1c00 2024-09-13T23:58:01.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.912+0000 7fbd3308bf40 20 remove_watcher() i=0 2024-09-13T23:58:01.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.912+0000 7fbd3308bf40 2 removed watcher, disabling cache 2024-09-13T23:58:01.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.912+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94856986943360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d19ac00 con 0x56459d0f1400 2024-09-13T23:58:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.916+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94856986943360] v35'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56459d144b40 con 0x56459d0f1400 2024-09-13T23:58:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.916+0000 7fbd3308bf40 20 remove_watcher() i=1 2024-09-13T23:58:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.916+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94856986944512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d19b000 con 0x56459d0f1c00 2024-09-13T23:58:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.916+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94856986944512] v35'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56459d145200 con 0x56459d0f1c00 2024-09-13T23:58:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.916+0000 7fbd3308bf40 20 remove_watcher() i=2 2024-09-13T23:58:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.916+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94856986945664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d19a400 con 0x56459d188800 2024-09-13T23:58:01.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.920+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94856986945664] v35'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56459d144b40 con 0x56459d188800 2024-09-13T23:58:01.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.920+0000 7fbd3308bf40 20 remove_watcher() i=3 2024-09-13T23:58:01.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.920+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94856986946816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d189000 con 0x56459d0f1c00 2024-09-13T23:58:01.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.924+0000 7fbd31844700 1 -- 172.21.15.173:0/4268484181 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94856986946816] v35'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56459d145200 con 0x56459d0f1c00 2024-09-13T23:58:01.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.924+0000 7fbd3308bf40 20 remove_watcher() i=4 2024-09-13T23:58:01.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.924+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94856986947968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d130000 con 0x56459d188400 2024-09-13T23:58:01.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.924+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94856986947968] v35'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56459d145440 con 0x56459d188400 2024-09-13T23:58:01.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.924+0000 7fbd3308bf40 20 remove_watcher() i=5 2024-09-13T23:58:01.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.924+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94856986949120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d130400 con 0x56459d188400 2024-09-13T23:58:01.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.928+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94856986949120] v35'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56459d145440 con 0x56459d188400 2024-09-13T23:58:01.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.928+0000 7fbd3308bf40 20 remove_watcher() i=6 2024-09-13T23:58:01.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.928+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94856986950272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56459d130800 con 0x56459d188800 2024-09-13T23:58:01.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.928+0000 7fbd32045700 1 -- 172.21.15.173:0/4268484181 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94856986950272] v35'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x56459d144b40 con 0x56459d188800 2024-09-13T23:58:01.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.928+0000 7fbd3308bf40 20 remove_watcher() i=7 2024-09-13T23:58:01.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.928+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56459d0f1c00 msgr2=0x56459d038100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.928+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/4268484181 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x56459d0f1c00 0x56459d038100 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.928+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56459d0f1400 msgr2=0x56459d037b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.928+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/4268484181 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x56459d0f1400 0x56459d037b80 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.928+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56459d188800 msgr2=0x56459d038c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.928+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/4268484181 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x56459d188800 0x56459d038c00 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.928+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56459d188400 msgr2=0x56459d038680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.928+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/4268484181 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x56459d188400 0x56459d038680 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.928+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56459d0f1000 msgr2=0x56459d037600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.928+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/4268484181 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56459d0f1000 0x56459d037600 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x56459d031920 tx=0x56459ce55800 comp rx=0 tx=0).stop 2024-09-13T23:58:01.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.928+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51800 msgr2=0x56459d036b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.928+0000 7fbd31043700 1 -- 172.21.15.173:0/4268484181 reap_dead start 2024-09-13T23:58:01.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.928+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/4268484181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51800 0x56459d036b00 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x56459d0f6bd0 tx=0x56459d0aafc0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.928+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 shutdown_connections 2024-09-13T23:58:01.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.928+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/4268484181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51800 0x56459d036b00 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.928+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 >> 172.21.15.173:0/4268484181 conn(0x56459cd51400 msgr2=0x56459ce51800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.928+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 shutdown_connections 2024-09-13T23:58:01.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.932+0000 7fbd3308bf40 1 -- 172.21.15.173:0/4268484181 wait complete. 2024-09-13T23:58:01.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.932+0000 7fbd3308bf40 1 -- 172.21.15.173:0/1203762447 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56459d188c00 msgr2=0x56459d22c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.932+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/1203762447 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56459d188c00 0x56459d22c000 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x56459d135ce0 tx=0x56459ce55da0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.932+0000 7fbd3308bf40 1 -- 172.21.15.173:0/1203762447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459d189400 msgr2=0x56459d039180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.932+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/1203762447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459d189400 0x56459d039180 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x56459d1a8900 tx=0x56459d1765a0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.932+0000 7fbd3308bf40 1 -- 172.21.15.173:0/1203762447 shutdown_connections 2024-09-13T23:58:01.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.932+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/1203762447 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56459d188c00 0x56459d22c000 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.932+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/1203762447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459d189400 0x56459d039180 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.932+0000 7fbd3308bf40 1 -- 172.21.15.173:0/1203762447 >> 172.21.15.173:0/1203762447 conn(0x56459d189800 msgr2=0x56459ce52000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.932+0000 7fbd3308bf40 1 -- 172.21.15.173:0/1203762447 shutdown_connections 2024-09-13T23:58:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.932+0000 7fbd3308bf40 1 -- 172.21.15.173:0/1203762447 wait complete. 2024-09-13T23:58:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.932+0000 7fbd3308bf40 1 -- 172.21.15.173:0/1331192197 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56459d0f0000 msgr2=0x56459d037080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.932+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/1331192197 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56459d0f0000 0x56459d037080 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x56459dbc8b10 tx=0x56459d0aade0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.932+0000 7fbd3308bf40 1 -- 172.21.15.173:0/1331192197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51000 msgr2=0x56459d036580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.932+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/1331192197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51000 0x56459d036580 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x56459dbb5aa0 tx=0x56459ce55a40 comp rx=0 tx=0).stop 2024-09-13T23:58:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.932+0000 7fbd3308bf40 1 -- 172.21.15.173:0/1331192197 shutdown_connections 2024-09-13T23:58:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.932+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/1331192197 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x56459d0f0000 0x56459d037080 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.932+0000 7fbd3308bf40 1 --2- 172.21.15.173:0/1331192197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56459cd51000 0x56459d036580 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.932+0000 7fbd3308bf40 1 -- 172.21.15.173:0/1331192197 >> 172.21.15.173:0/1331192197 conn(0x56459cd50c00 msgr2=0x56459ce51000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.932+0000 7fbd3308bf40 1 -- 172.21.15.173:0/1331192197 shutdown_connections 2024-09-13T23:58:01.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:01.932+0000 7fbd3308bf40 1 -- 172.21.15.173:0/1331192197 wait complete. 2024-09-13T23:58:01.939 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:58:01.939 INFO:teuthology.orchestra.run.smithi173.stdout: "entries": [ 2024-09-13T23:58:01.939 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.939 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:58:01.939 INFO:teuthology.orchestra.run.smithi173.stdout: "buckets": [ 2024-09-13T23:58:01.939 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.939 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "", 2024-09-13T23:58:01.940 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.940 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.940 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.940 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [] 2024-09-13T23:58:01.940 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.940 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.940 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo", 2024-09-13T23:58:01.940 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.940 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.940 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.940 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:01.940 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.940 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "put_obj", 2024-09-13T23:58:01.941 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.941 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 30000042, 2024-09-13T23:58:01.941 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 11, 2024-09-13T23:58:01.941 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 11 2024-09-13T23:58:01.941 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.941 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.941 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.941 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.941 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo2", 2024-09-13T23:58:01.941 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.941 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.941 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.941 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [] 2024-09-13T23:58:01.941 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.942 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.942 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo3", 2024-09-13T23:58:01.942 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.942 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.942 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.942 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [] 2024-09-13T23:58:01.942 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:01.942 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.942 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo4", 2024-09-13T23:58:01.942 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:01.942 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:01.942 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:01.942 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [] 2024-09-13T23:58:01.943 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.943 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.943 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.943 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:01.943 INFO:teuthology.orchestra.run.smithi173.stdout: "summary": [ 2024-09-13T23:58:01.943 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.943 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:58:01.943 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:01.943 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:01.943 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "put_obj", 2024-09-13T23:58:01.943 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.943 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 30000042, 2024-09-13T23:58:01.943 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 11, 2024-09-13T23:58:01.943 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 11 2024-09-13T23:58:01.943 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.944 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:01.944 INFO:teuthology.orchestra.run.smithi173.stdout: "total": { 2024-09-13T23:58:01.944 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:01.944 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 30000042, 2024-09-13T23:58:01.944 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 11, 2024-09-13T23:58:01.944 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 11 2024-09-13T23:58:01.944 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.944 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:01.944 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:01.944 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:58:01.945 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-09-13T23:58:01.946 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-13T23:58:01.946 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-13T23:58:01.946 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-13T23:58:02.033 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:58:02.034 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:58:02.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.032+0000 7fde4d301f40 1 Processor -- start 2024-09-13T23:58:02.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.032+0000 7fde4d301f40 1 -- start start 2024-09-13T23:58:02.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.032+0000 7fde4d301f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55cb1d305400 0x55cb1d5ea580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.032+0000 7fde4d301f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cb1d3c9500 con 0x55cb1d305000 2024-09-13T23:58:02.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.032+0000 7fde4d301f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cb1d392a00 con 0x55cb1d305400 2024-09-13T23:58:02.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.032+0000 7fde4b2b9700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55cb1d305400 0x55cb1d5ea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.032+0000 7fde4baba700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55cb1d305000 0x55cb1d404800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:38624/0 (socket says 172.21.15.173:38624) 2024-09-13T23:58:02.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.032+0000 7fde4baba700 1 -- 172.21.15.173:0/2841857411 learned_addr learned my addr 172.21.15.173:0/2841857411 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:58:02.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.032+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2841857411 >> v1:172.21.15.87:6789/0 conn(0x55cb1d305000 legacy=0x55cb1d404800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.032+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2841857411 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb1d317d40 con 0x55cb1d305400 2024-09-13T23:58:02.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.032+0000 7fde4b2b9700 1 --2- 172.21.15.173:0/2841857411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305400 0x55cb1d5ea580 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x55cb1d5e5920 tx=0x55cb1d409920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a077c48fac4fd1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.032+0000 7fde4aab8700 1 -- 172.21.15.173:0/2841857411 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cb1d3a94a0 con 0x55cb1d305400 2024-09-13T23:58:02.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.032+0000 7fde4aab8700 1 -- 172.21.15.173:0/2841857411 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cb1d3c9800 con 0x55cb1d305400 2024-09-13T23:58:02.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.032+0000 7fde4aab8700 1 -- 172.21.15.173:0/2841857411 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cb1d3a9600 con 0x55cb1d305400 2024-09-13T23:58:02.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.032+0000 7fde4d301f40 1 -- 172.21.15.173:0/2841857411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305400 msgr2=0x55cb1d5ea580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.032+0000 7fde4d301f40 1 --2- 172.21.15.173:0/2841857411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305400 0x55cb1d5ea580 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x55cb1d5e5920 tx=0x55cb1d409920 comp rx=0 tx=0).stop 2024-09-13T23:58:02.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.036+0000 7fde4d301f40 1 -- 172.21.15.173:0/2841857411 shutdown_connections 2024-09-13T23:58:02.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.036+0000 7fde4d301f40 1 --2- 172.21.15.173:0/2841857411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305400 0x55cb1d5ea580 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.036+0000 7fde4d301f40 1 -- 172.21.15.173:0/2841857411 >> 172.21.15.173:0/2841857411 conn(0x55cb1d304c00 msgr2=0x55cb1d404000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.036+0000 7fde4d301f40 1 -- 172.21.15.173:0/2841857411 shutdown_connections 2024-09-13T23:58:02.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.036+0000 7fde4d301f40 1 -- 172.21.15.173:0/2841857411 wait complete. 2024-09-13T23:58:02.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.036+0000 7fde4d301f40 1 Processor -- start 2024-09-13T23:58:02.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.036+0000 7fde4d301f40 1 -- start start 2024-09-13T23:58:02.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.036+0000 7fde4d301f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305000 0x55cb1d5ea580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.036+0000 7fde4d301f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb1d392500 con 0x55cb1d305000 2024-09-13T23:58:02.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.036+0000 7fde4baba700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305000 0x55cb1d5ea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.036+0000 7fde4baba700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305000 0x55cb1d5ea580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49678/0 (socket says 172.21.15.173:49678) 2024-09-13T23:58:02.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.036+0000 7fde4baba700 1 -- 172.21.15.173:0/819824893 learned_addr learned my addr 172.21.15.173:0/819824893 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:02.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.036+0000 7fde4baba700 1 -- 172.21.15.173:0/819824893 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb1d317ba0 con 0x55cb1d305000 2024-09-13T23:58:02.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.036+0000 7fde4baba700 1 --2- 172.21.15.173:0/819824893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305000 0x55cb1d5ea580 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x55cb1d461e00 tx=0x55cb1d409b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d88ab9339666d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.036+0000 7fde4a2b7700 1 -- 172.21.15.173:0/819824893 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cb1d3a94a0 con 0x55cb1d305000 2024-09-13T23:58:02.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.036+0000 7fde4a2b7700 1 -- 172.21.15.173:0/819824893 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cb1d3c9b00 con 0x55cb1d305000 2024-09-13T23:58:02.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.036+0000 7fde4a2b7700 1 -- 172.21.15.173:0/819824893 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cb1d3a9600 con 0x55cb1d305000 2024-09-13T23:58:02.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.040+0000 7fde4d301f40 1 -- 172.21.15.173:0/819824893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305000 msgr2=0x55cb1d5ea580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.040+0000 7fde4d301f40 1 --2- 172.21.15.173:0/819824893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305000 0x55cb1d5ea580 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x55cb1d461e00 tx=0x55cb1d409b60 comp rx=0 tx=0).stop 2024-09-13T23:58:02.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.040+0000 7fde4d301f40 1 -- 172.21.15.173:0/819824893 shutdown_connections 2024-09-13T23:58:02.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.040+0000 7fde4d301f40 1 --2- 172.21.15.173:0/819824893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305000 0x55cb1d5ea580 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.040+0000 7fde4d301f40 1 -- 172.21.15.173:0/819824893 >> 172.21.15.173:0/819824893 conn(0x55cb1d304c00 msgr2=0x55cb1d405000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.040+0000 7fde4d301f40 1 -- 172.21.15.173:0/819824893 shutdown_connections 2024-09-13T23:58:02.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.040+0000 7fde4d301f40 1 -- 172.21.15.173:0/819824893 wait complete. 2024-09-13T23:58:02.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.040+0000 7fde4d301f40 1 Processor -- start 2024-09-13T23:58:02.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.040+0000 7fde4d301f40 1 -- start start 2024-09-13T23:58:02.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.040+0000 7fde4d301f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305000 0x55cb1d5ea580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.040+0000 7fde4d301f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb1d3923c0 con 0x55cb1d305000 2024-09-13T23:58:02.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.040+0000 7fde4baba700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305000 0x55cb1d5ea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.040+0000 7fde4baba700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305000 0x55cb1d5ea580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49692/0 (socket says 172.21.15.173:49692) 2024-09-13T23:58:02.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.040+0000 7fde4baba700 1 -- 172.21.15.173:0/2032799235 learned_addr learned my addr 172.21.15.173:0/2032799235 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:02.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.040+0000 7fde4baba700 1 -- 172.21.15.173:0/2032799235 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb1d317a00 con 0x55cb1d305000 2024-09-13T23:58:02.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.040+0000 7fde4baba700 1 --2- 172.21.15.173:0/2032799235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305000 0x55cb1d5ea580 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x55cb1d461e60 tx=0x55cb1d409a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.040+0000 7fde48ab4700 1 -- 172.21.15.173:0/2032799235 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cb1d3a98c0 con 0x55cb1d305000 2024-09-13T23:58:02.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.040+0000 7fde4d301f40 1 -- 172.21.15.173:0/2032799235 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cb1d317860 con 0x55cb1d305000 2024-09-13T23:58:02.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.040+0000 7fde48ab4700 1 -- 172.21.15.173:0/2032799235 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cb1d3c9c80 con 0x55cb1d305000 2024-09-13T23:58:02.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.040+0000 7fde48ab4700 1 -- 172.21.15.173:0/2032799235 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cb1d3a94a0 con 0x55cb1d305000 2024-09-13T23:58:02.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.040+0000 7fde4d301f40 1 -- 172.21.15.173:0/2032799235 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cb1d3176c0 con 0x55cb1d305000 2024-09-13T23:58:02.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.044+0000 7fde4d301f40 1 Processor -- start 2024-09-13T23:58:02.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.044+0000 7fde4d301f40 1 -- start start 2024-09-13T23:58:02.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.044+0000 7fde48ab4700 1 -- 172.21.15.173:0/2032799235 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55cb1d3feb00 con 0x55cb1d305000 2024-09-13T23:58:02.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.044+0000 7fde4d301f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305800 0x55cb1d5eab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.044+0000 7fde4d301f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb1d392000 con 0x55cb1d305800 2024-09-13T23:58:02.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.044+0000 7fde48ab4700 1 --2- 172.21.15.173:0/2032799235 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cb1d6b0000 0x55cb1d5eb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.044+0000 7fde48ab4700 1 -- 172.21.15.173:0/2032799235 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55cb1d36b180 con 0x55cb1d305000 2024-09-13T23:58:02.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.044+0000 7fde4baba700 1 --2- 172.21.15.173:0/2032799235 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cb1d6b0000 0x55cb1d5eb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.044+0000 7fde4c2bb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305800 0x55cb1d5eab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.044+0000 7fde4c2bb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305800 0x55cb1d5eab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49696/0 (socket says 172.21.15.173:49696) 2024-09-13T23:58:02.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.044+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2929036372 learned_addr learned my addr 172.21.15.173:0/2929036372 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:02.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.044+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2929036372 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb1d316000 con 0x55cb1d305800 2024-09-13T23:58:02.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.044+0000 7fde4baba700 1 --2- 172.21.15.173:0/2032799235 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cb1d6b0000 0x55cb1d5eb080 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x55cb1d634f60 tx=0x55cb1d668240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.044+0000 7fde4c2bb700 1 --2- 172.21.15.173:0/2929036372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305800 0x55cb1d5eab00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x55cb1d634240 tx=0x55cb1d6690e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465f94d3c0ca8e6b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.044+0000 7fde462af700 1 -- 172.21.15.173:0/2929036372 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cb1d3a98c0 con 0x55cb1d305800 2024-09-13T23:58:02.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.044+0000 7fde462af700 1 -- 172.21.15.173:0/2929036372 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cb1d6c2000 con 0x55cb1d305800 2024-09-13T23:58:02.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.044+0000 7fde462af700 1 -- 172.21.15.173:0/2929036372 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cb1d3a94a0 con 0x55cb1d305800 2024-09-13T23:58:02.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.048+0000 7fde4d301f40 1 -- 172.21.15.173:0/2929036372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305800 msgr2=0x55cb1d5eab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.048+0000 7fde4d301f40 1 --2- 172.21.15.173:0/2929036372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305800 0x55cb1d5eab00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x55cb1d634240 tx=0x55cb1d6690e0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.048+0000 7fde4d301f40 1 -- 172.21.15.173:0/2929036372 shutdown_connections 2024-09-13T23:58:02.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.048+0000 7fde4d301f40 1 --2- 172.21.15.173:0/2929036372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305800 0x55cb1d5eab00 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.048+0000 7fde4d301f40 1 -- 172.21.15.173:0/2929036372 >> 172.21.15.173:0/2929036372 conn(0x55cb1d305400 msgr2=0x55cb1d405800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.048+0000 7fde4d301f40 1 -- 172.21.15.173:0/2929036372 shutdown_connections 2024-09-13T23:58:02.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.048+0000 7fde4d301f40 1 -- 172.21.15.173:0/2929036372 wait complete. 2024-09-13T23:58:02.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.048+0000 7fde4d301f40 1 Processor -- start 2024-09-13T23:58:02.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.048+0000 7fde4d301f40 1 -- start start 2024-09-13T23:58:02.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.048+0000 7fde4d301f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305800 0x55cb1d5eab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.048+0000 7fde4d301f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb1d32a640 con 0x55cb1d305800 2024-09-13T23:58:02.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.048+0000 7fde4c2bb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305800 0x55cb1d5eab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.048+0000 7fde4c2bb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305800 0x55cb1d5eab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49710/0 (socket says 172.21.15.173:49710) 2024-09-13T23:58:02.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.048+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 learned_addr learned my addr 172.21.15.173:0/2736694445 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:02.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.048+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb1d316ea0 con 0x55cb1d305800 2024-09-13T23:58:02.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.048+0000 7fde4c2bb700 1 --2- 172.21.15.173:0/2736694445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305800 0x55cb1d5eab00 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x55cb1d634810 tx=0x55cb1d668cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.048+0000 7fde44aac700 1 -- 172.21.15.173:0/2736694445 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cb1d3a9b80 con 0x55cb1d305800 2024-09-13T23:58:02.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.048+0000 7fde44aac700 1 -- 172.21.15.173:0/2736694445 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cb1d6c2180 con 0x55cb1d305800 2024-09-13T23:58:02.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.048+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cb1d316820 con 0x55cb1d305800 2024-09-13T23:58:02.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.048+0000 7fde44aac700 1 -- 172.21.15.173:0/2736694445 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cb1d3a98c0 con 0x55cb1d305800 2024-09-13T23:58:02.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.048+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cb1d3169c0 con 0x55cb1d305800 2024-09-13T23:58:02.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde4d301f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde44aac700 1 -- 172.21.15.173:0/2736694445 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55cb1d3ff080 con 0x55cb1d305800 2024-09-13T23:58:02.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde44aac700 1 --2- 172.21.15.173:0/2736694445 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cb1d6b0c00 0x55cb1d5eb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde44aac700 1 -- 172.21.15.173:0/2736694445 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55cb1d36b340 con 0x55cb1d305800 2024-09-13T23:58:02.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde4b2b9700 1 --2- 172.21.15.173:0/2736694445 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cb1d6b0c00 0x55cb1d5eb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde4d301f40 1 --2- 172.21.15.173:0/2736694445 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55cb1d6b1000 0x55cb1d5ebb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1400 con 0x55cb1d6b1000 2024-09-13T23:58:02.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde4c2bb700 1 --2- 172.21.15.173:0/2736694445 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55cb1d6b1000 0x55cb1d5ebb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde4b2b9700 1 --2- 172.21.15.173:0/2736694445 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cb1d6b0c00 0x55cb1d5eb600 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55cb1d5e5920 tx=0x55cb1d409800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde4c2bb700 1 --2- 172.21.15.173:0/2736694445 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55cb1d6b1000 0x55cb1d5ebb80 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d6b1000 2024-09-13T23:58:02.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde4d301f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde4d301f40 20 realm 2024-09-13T23:58:02.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde4d301f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1000 2024-09-13T23:58:02.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d6b1000 2024-09-13T23:58:02.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde4d301f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde4d301f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:58:02.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde4d301f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1c00 con 0x55cb1d6b1000 2024-09-13T23:58:02.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d6b1000 2024-09-13T23:58:02.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde4d301f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde4d301f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde4d301f40 1 --2- 172.21.15.173:0/2736694445 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55cb1d6b1400 0x55cb1d5ec100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1400 2024-09-13T23:58:02.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.052+0000 7fde4baba700 1 --2- 172.21.15.173:0/2736694445 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55cb1d6b1400 0x55cb1d5ec100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.056+0000 7fde4baba700 1 --2- 172.21.15.173:0/2736694445 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55cb1d6b1400 0x55cb1d5ec100 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.056+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55cb1d759200 con 0x55cb1d6b1400 2024-09-13T23:58:02.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.056+0000 7fde4d301f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:02.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.056+0000 7fde4d301f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.056+0000 7fde4d301f40 1 --2- 172.21.15.173:0/2736694445 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55cb1d6b1c00 0x55cb1d5ec680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.056+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d76e000 con 0x55cb1d6b1c00 2024-09-13T23:58:02.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.056+0000 7fde4b2b9700 1 --2- 172.21.15.173:0/2736694445 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55cb1d6b1c00 0x55cb1d5ec680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.056+0000 7fde4b2b9700 1 --2- 172.21.15.173:0/2736694445 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55cb1d6b1c00 0x55cb1d5ec680 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.056+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55cb1d759440 con 0x55cb1d6b1c00 2024-09-13T23:58:02.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.056+0000 7fde4d301f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:58:02.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.056+0000 7fde4d301f40 20 searching for the correct realm 2024-09-13T23:58:02.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.056+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d76e400 con 0x55cb1d6b1c00 2024-09-13T23:58:02.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.056+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55cb1d759440 con 0x55cb1d6b1c00 2024-09-13T23:58:02.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.056+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d76e000 con 0x55cb1d6b1400 2024-09-13T23:58:02.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.056+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d759200 con 0x55cb1d6b1400 2024-09-13T23:58:02.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.056+0000 7fde4baba700 1 --2- 172.21.15.173:0/2736694445 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55cb1d76e000 0x55cb1d5ecc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.056+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d76e000 2024-09-13T23:58:02.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.056+0000 7fde4c2bb700 1 --2- 172.21.15.173:0/2736694445 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55cb1d76e000 0x55cb1d5ecc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.060+0000 7fde4c2bb700 1 --2- 172.21.15.173:0/2736694445 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55cb1d76e000 0x55cb1d5ecc00 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.060+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d76e000 2024-09-13T23:58:02.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.060+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d76e000 2024-09-13T23:58:02.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.060+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d76e000 2024-09-13T23:58:02.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.060+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1000 2024-09-13T23:58:02.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.060+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d6b1000 2024-09-13T23:58:02.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.060+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1c00 2024-09-13T23:58:02.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.060+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d759440 con 0x55cb1d6b1c00 2024-09-13T23:58:02.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.060+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1000 2024-09-13T23:58:02.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.060+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d6b1000 2024-09-13T23:58:02.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.060+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1400 2024-09-13T23:58:02.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.060+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d759200 con 0x55cb1d6b1400 2024-09-13T23:58:02.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.060+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1400 2024-09-13T23:58:02.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.064+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d759200 con 0x55cb1d6b1400 2024-09-13T23:58:02.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.064+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1000 2024-09-13T23:58:02.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.064+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d6b1000 2024-09-13T23:58:02.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.064+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d76e000 2024-09-13T23:58:02.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.064+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d76e000 2024-09-13T23:58:02.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.064+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1000 2024-09-13T23:58:02.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.064+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d6b1000 2024-09-13T23:58:02.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.064+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d76e000 2024-09-13T23:58:02.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.064+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d76e000 2024-09-13T23:58:02.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.064+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1400 2024-09-13T23:58:02.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.064+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d759200 con 0x55cb1d6b1400 2024-09-13T23:58:02.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.064+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1c00 2024-09-13T23:58:02.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.064+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d759440 con 0x55cb1d6b1c00 2024-09-13T23:58:02.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.064+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1000 2024-09-13T23:58:02.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.068+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d6b1000 2024-09-13T23:58:02.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.068+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1400 2024-09-13T23:58:02.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.068+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d759200 con 0x55cb1d6b1400 2024-09-13T23:58:02.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.068+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1c00 2024-09-13T23:58:02.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.068+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d759440 con 0x55cb1d6b1c00 2024-09-13T23:58:02.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.068+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1000 2024-09-13T23:58:02.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.068+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d6b1000 2024-09-13T23:58:02.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.068+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1000 2024-09-13T23:58:02.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.068+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d6b1000 2024-09-13T23:58:02.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.068+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1000 2024-09-13T23:58:02.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.068+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d6b1000 2024-09-13T23:58:02.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.068+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1c00 2024-09-13T23:58:02.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.068+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d759440 con 0x55cb1d6b1c00 2024-09-13T23:58:02.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.068+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d76e000 2024-09-13T23:58:02.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.072+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d76e000 2024-09-13T23:58:02.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.072+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1000 2024-09-13T23:58:02.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.072+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d6b1000 2024-09-13T23:58:02.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.072+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d76e000 2024-09-13T23:58:02.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.072+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d76e000 2024-09-13T23:58:02.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.072+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1c00 2024-09-13T23:58:02.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.072+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d759440 con 0x55cb1d6b1c00 2024-09-13T23:58:02.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.072+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d76e000 2024-09-13T23:58:02.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.072+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d76e000 2024-09-13T23:58:02.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.072+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1400 2024-09-13T23:58:02.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.072+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d759200 con 0x55cb1d6b1400 2024-09-13T23:58:02.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.072+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1400 2024-09-13T23:58:02.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.072+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d759200 con 0x55cb1d6b1400 2024-09-13T23:58:02.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.076+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1c00 2024-09-13T23:58:02.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.076+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d759440 con 0x55cb1d6b1c00 2024-09-13T23:58:02.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.076+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1400 2024-09-13T23:58:02.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.076+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55cb1d759200 con 0x55cb1d6b1400 2024-09-13T23:58:02.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.076+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d6b1400 2024-09-13T23:58:02.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.076+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cb1d759200 con 0x55cb1d6b1400 2024-09-13T23:58:02.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.076+0000 7fde4d301f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:58:02.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.076+0000 7fde4d301f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:58:02.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.076+0000 7fde4d301f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:58:02.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.076+0000 7fde4d301f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:58:02.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.076+0000 7fde4d301f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.076+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d76e800 con 0x55cb1d6b1000 2024-09-13T23:58:02.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.076+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d6b1000 2024-09-13T23:58:02.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.076+0000 7fde4d301f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.076+0000 7fde4d301f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.076+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d76ec00 con 0x55cb1d6b1400 2024-09-13T23:58:02.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.076+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55cb1d759200 con 0x55cb1d6b1400 2024-09-13T23:58:02.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.076+0000 7fde4d301f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:02.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.076+0000 7fde4d301f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.076+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d76f000 con 0x55cb1d76e000 2024-09-13T23:58:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.080+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d76e000 2024-09-13T23:58:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.080+0000 7fde4d301f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:58:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.080+0000 7fde4d301f40 20 zone default found 2024-09-13T23:58:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.080+0000 7fde4d301f40 4 Realm: () 2024-09-13T23:58:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.080+0000 7fde4d301f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:58:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.080+0000 7fde4d301f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:58:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.080+0000 7fde4d301f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:58:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.080+0000 7fde4d301f40 20 zonegroup default 2024-09-13T23:58:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.080+0000 7fde4d301f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.080+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d76f400 con 0x55cb1d76e000 2024-09-13T23:58:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.080+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d76e000 2024-09-13T23:58:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.080+0000 7fde4d301f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.080+0000 7fde4d301f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.080+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d76f800 con 0x55cb1d6b1c00 2024-09-13T23:58:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.080+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55cb1d759440 con 0x55cb1d6b1c00 2024-09-13T23:58:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.080+0000 7fde4d301f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.080+0000 7fde4d301f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.080+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d76fc00 con 0x55cb1d6b1c00 2024-09-13T23:58:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.080+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55cb1d759440 con 0x55cb1d6b1c00 2024-09-13T23:58:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.080+0000 7fde4d301f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.080+0000 7fde4d301f40 20 started sync module instance, tier type = 2024-09-13T23:58:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.080+0000 7fde4d301f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:58:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.080+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d64e000 con 0x55cb1d6b1400 2024-09-13T23:58:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.084+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v35'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cb1d759200 con 0x55cb1d6b1400 2024-09-13T23:58:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.084+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94330859428608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d64e400 con 0x55cb1d6b1400 2024-09-13T23:58:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.084+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d64e800 con 0x55cb1d6b1000 2024-09-13T23:58:02.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.088+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94330859428608] v35'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cb1d759200 con 0x55cb1d6b1400 2024-09-13T23:58:02.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.088+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v35'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d6b1000 2024-09-13T23:58:02.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.088+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94330859429760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d64ec00 con 0x55cb1d6b1000 2024-09-13T23:58:02.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.088+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d64f000 con 0x55cb1d6b1400 2024-09-13T23:58:02.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.088+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94330859429760] v35'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d6b1000 2024-09-13T23:58:02.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.088+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v35'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cb1d759200 con 0x55cb1d6b1400 2024-09-13T23:58:02.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.088+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94330859430912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d64f400 con 0x55cb1d6b1400 2024-09-13T23:58:02.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.088+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d64f800 con 0x55cb1d76e000 2024-09-13T23:58:02.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.092+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v35'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d76e000 2024-09-13T23:58:02.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.092+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94330859432064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d64fc00 con 0x55cb1d76e000 2024-09-13T23:58:02.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.092+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d64e800 con 0x55cb1d6b1400 2024-09-13T23:58:02.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.092+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94330859430912] v35'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cb1d759200 con 0x55cb1d6b1400 2024-09-13T23:58:02.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.096+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94330859432064] v35'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d76e000 2024-09-13T23:58:02.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.096+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v35'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cb1d759200 con 0x55cb1d6b1400 2024-09-13T23:58:02.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.096+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94330859433216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d64e000 con 0x55cb1d6b1400 2024-09-13T23:58:02.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.096+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d76e800 con 0x55cb1d6b1c00 2024-09-13T23:58:02.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.096+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v35'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cb1d759440 con 0x55cb1d6b1c00 2024-09-13T23:58:02.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.096+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94330859434368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d76f000 con 0x55cb1d6b1c00 2024-09-13T23:58:02.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.100+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d76f400 con 0x55cb1d6b1c00 2024-09-13T23:58:02.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.100+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94330859433216] v35'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cb1d759200 con 0x55cb1d6b1400 2024-09-13T23:58:02.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.100+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94330859434368] v35'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cb1d759440 con 0x55cb1d6b1c00 2024-09-13T23:58:02.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.100+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v35'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cb1d759440 con 0x55cb1d6b1c00 2024-09-13T23:58:02.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.100+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94330859435520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d76ec00 con 0x55cb1d6b1c00 2024-09-13T23:58:02.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.100+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6b1800 con 0x55cb1d76e000 2024-09-13T23:58:02.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.104+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v35'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d76e000 2024-09-13T23:58:02.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.104+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94330859436672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d64e400 con 0x55cb1d76e000 2024-09-13T23:58:02.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.104+0000 7fde4d301f40 20 add_watcher() i=0 2024-09-13T23:58:02.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.104+0000 7fde4d301f40 20 add_watcher() i=1 2024-09-13T23:58:02.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.104+0000 7fde4d301f40 20 add_watcher() i=2 2024-09-13T23:58:02.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.104+0000 7fde4d301f40 20 add_watcher() i=3 2024-09-13T23:58:02.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.104+0000 7fde4d301f40 20 add_watcher() i=4 2024-09-13T23:58:02.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.104+0000 7fde4d301f40 20 add_watcher() i=5 2024-09-13T23:58:02.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.104+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94330859435520] v35'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cb1d759440 con 0x55cb1d6b1c00 2024-09-13T23:58:02.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.104+0000 7fde4d301f40 20 add_watcher() i=6 2024-09-13T23:58:02.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.104+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94330859436672] v35'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d76e000 2024-09-13T23:58:02.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.104+0000 7fde4d301f40 20 add_watcher() i=7 2024-09-13T23:58:02.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.104+0000 7fde4d301f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:58:02.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.104+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d64f000 con 0x55cb1d6b1000 2024-09-13T23:58:02.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.104+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d6b1000 2024-09-13T23:58:02.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.104+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94330861125632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d64f400 con 0x55cb1d6b1000 2024-09-13T23:58:02.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.108+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94330861125632] v35'206 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d6b1000 2024-09-13T23:58:02.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.108+0000 7fde32a88700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.108+0000 7fde4d301f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:58:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.108+0000 7fde4d301f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:58:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.108+0000 7fde4d301f40 1 Processor -- start 2024-09-13T23:58:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.108+0000 7fde4d301f40 1 -- start start 2024-09-13T23:58:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.108+0000 7fde4d301f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d76e400 0x55cb1d5ed180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.108+0000 7fde4d301f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb1d32a780 con 0x55cb1d76e400 2024-09-13T23:58:02.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.108+0000 7fde4b2b9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d76e400 0x55cb1d5ed180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.108+0000 7fde4b2b9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d76e400 0x55cb1d5ed180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49722/0 (socket says 172.21.15.173:49722) 2024-09-13T23:58:02.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.108+0000 7fde4b2b9700 1 -- 172.21.15.173:0/708563748 learned_addr learned my addr 172.21.15.173:0/708563748 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:02.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.108+0000 7fde4b2b9700 1 -- 172.21.15.173:0/708563748 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb1d316b60 con 0x55cb1d76e400 2024-09-13T23:58:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.108+0000 7fde4b2b9700 1 --2- 172.21.15.173:0/708563748 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d76e400 0x55cb1d5ed180 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x55cb1d7880f0 tx=0x55cb1d409980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38adb6bf46bb8f4b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.108+0000 7fde32287700 1 -- 172.21.15.173:0/708563748 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cb1d3a9760 con 0x55cb1d76e400 2024-09-13T23:58:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.108+0000 7fde32287700 1 -- 172.21.15.173:0/708563748 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cb1d6c2600 con 0x55cb1d76e400 2024-09-13T23:58:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.108+0000 7fde32287700 1 -- 172.21.15.173:0/708563748 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cb1d78c000 con 0x55cb1d76e400 2024-09-13T23:58:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.112+0000 7fde4d301f40 1 -- 172.21.15.173:0/708563748 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d76e400 msgr2=0x55cb1d5ed180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.112+0000 7fde4d301f40 1 --2- 172.21.15.173:0/708563748 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d76e400 0x55cb1d5ed180 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x55cb1d7880f0 tx=0x55cb1d409980 comp rx=0 tx=0).stop 2024-09-13T23:58:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.112+0000 7fde4d301f40 1 -- 172.21.15.173:0/708563748 shutdown_connections 2024-09-13T23:58:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.112+0000 7fde4d301f40 1 --2- 172.21.15.173:0/708563748 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d76e400 0x55cb1d5ed180 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.112+0000 7fde4d301f40 1 -- 172.21.15.173:0/708563748 >> 172.21.15.173:0/708563748 conn(0x55cb1d64e800 msgr2=0x55cb1d406000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.112+0000 7fde4d301f40 1 -- 172.21.15.173:0/708563748 shutdown_connections 2024-09-13T23:58:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.112+0000 7fde4d301f40 1 -- 172.21.15.173:0/708563748 wait complete. 2024-09-13T23:58:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.112+0000 7fde4d301f40 1 Processor -- start 2024-09-13T23:58:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.112+0000 7fde4d301f40 1 -- start start 2024-09-13T23:58:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.112+0000 7fde4d301f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d76e400 0x55cb1d5ed180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.112+0000 7fde4d301f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb1d392000 con 0x55cb1d76e400 2024-09-13T23:58:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.112+0000 7fde4b2b9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d76e400 0x55cb1d5ed180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.112+0000 7fde4b2b9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d76e400 0x55cb1d5ed180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49738/0 (socket says 172.21.15.173:49738) 2024-09-13T23:58:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.112+0000 7fde4b2b9700 1 -- 172.21.15.173:0/1271417032 learned_addr learned my addr 172.21.15.173:0/1271417032 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:02.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.112+0000 7fde4b2b9700 1 -- 172.21.15.173:0/1271417032 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb1d316d00 con 0x55cb1d76e400 2024-09-13T23:58:02.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.112+0000 7fde4b2b9700 1 --2- 172.21.15.173:0/1271417032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d76e400 0x55cb1d5ed180 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x55cb1d788330 tx=0x55cb1d75a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.112+0000 7fde30a84700 1 -- 172.21.15.173:0/1271417032 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cb1d78c160 con 0x55cb1d76e400 2024-09-13T23:58:02.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.112+0000 7fde30a84700 1 -- 172.21.15.173:0/1271417032 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cb1d6c2300 con 0x55cb1d76e400 2024-09-13T23:58:02.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.112+0000 7fde4d301f40 1 -- 172.21.15.173:0/1271417032 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cb1d316340 con 0x55cb1d76e400 2024-09-13T23:58:02.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.112+0000 7fde30a84700 1 -- 172.21.15.173:0/1271417032 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cb1d78c2c0 con 0x55cb1d76e400 2024-09-13T23:58:02.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.112+0000 7fde4d301f40 1 -- 172.21.15.173:0/1271417032 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cb1d317d40 con 0x55cb1d76e400 2024-09-13T23:58:02.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.116+0000 7fde30a84700 1 -- 172.21.15.173:0/1271417032 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55cb1d3ffb80 con 0x55cb1d76e400 2024-09-13T23:58:02.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.116+0000 7fde30a84700 1 --2- 172.21.15.173:0/1271417032 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cb1d6b1800 0x55cb1d806000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.116+0000 7fde30a84700 1 -- 172.21.15.173:0/1271417032 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55cb1d36b500 con 0x55cb1d76e400 2024-09-13T23:58:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.116+0000 7fde4d301f40 5 note: GC not initialized 2024-09-13T23:58:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.116+0000 7fde4c2bb700 1 --2- 172.21.15.173:0/1271417032 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cb1d6b1800 0x55cb1d806000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.116+0000 7fde4c2bb700 1 --2- 172.21.15.173:0/1271417032 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cb1d6b1800 0x55cb1d806000 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55cb1d71d7d0 tx=0x55cb1d75b5c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.116+0000 7fde2e27f700 20 reqs_thread_entry: start 2024-09-13T23:58:02.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.116+0000 7fde4d301f40 20 init_complete bucket index max shards: 11 2024-09-13T23:58:02.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.116+0000 7fde4d301f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:58:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.116+0000 7fde2c27b700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:58:32 2024 2024-09-13T23:58:02.122 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:58:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.120+0000 7fde4d301f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.120+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d76e800 con 0x55cb1d6b1000 2024-09-13T23:58:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.120+0000 7fde2ba59700 20 reqs_thread_entry: start 2024-09-13T23:58:02.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.120+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv18 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d6b1000 2024-09-13T23:58:02.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.120+0000 7fde4d301f40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:58:02.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.120+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d64ec00 con 0x55cb1d6b1c00 2024-09-13T23:58:02.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.120+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x55cb1d759440 con 0x55cb1d6b1c00 2024-09-13T23:58:02.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.120+0000 7fde32a88700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:02.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.120+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94330861125632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d64f800 con 0x55cb1d6b1000 2024-09-13T23:58:02.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.124+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94330861125632] v35'207 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d6b1000 2024-09-13T23:58:02.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.124+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94330859428608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d64fc00 con 0x55cb1d6b1400 2024-09-13T23:58:02.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.128+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94330859428608] v35'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cb1d759200 con 0x55cb1d6b1400 2024-09-13T23:58:02.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.128+0000 7fde4d301f40 20 remove_watcher() i=0 2024-09-13T23:58:02.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.128+0000 7fde4d301f40 2 removed watcher, disabling cache 2024-09-13T23:58:02.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.128+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94330859429760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d64e400 con 0x55cb1d6b1000 2024-09-13T23:58:02.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.128+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94330859429760] v35'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d6b1000 2024-09-13T23:58:02.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.128+0000 7fde4d301f40 20 remove_watcher() i=1 2024-09-13T23:58:02.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.128+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94330859430912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6d6000 con 0x55cb1d6b1400 2024-09-13T23:58:02.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.132+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94330859430912] v35'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cb1d759200 con 0x55cb1d6b1400 2024-09-13T23:58:02.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.132+0000 7fde4d301f40 20 remove_watcher() i=2 2024-09-13T23:58:02.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.132+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94330859432064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6d6400 con 0x55cb1d76e000 2024-09-13T23:58:02.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.132+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94330859432064] v35'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d76e000 2024-09-13T23:58:02.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.132+0000 7fde4d301f40 20 remove_watcher() i=3 2024-09-13T23:58:02.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.132+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94330859433216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6d6800 con 0x55cb1d6b1400 2024-09-13T23:58:02.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.136+0000 7fde4baba700 1 -- 172.21.15.173:0/2736694445 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94330859433216] v35'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cb1d759200 con 0x55cb1d6b1400 2024-09-13T23:58:02.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.136+0000 7fde4d301f40 20 remove_watcher() i=4 2024-09-13T23:58:02.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.136+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94330859434368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6d6c00 con 0x55cb1d6b1c00 2024-09-13T23:58:02.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.140+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94330859434368] v35'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cb1d759440 con 0x55cb1d6b1c00 2024-09-13T23:58:02.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.140+0000 7fde4d301f40 20 remove_watcher() i=5 2024-09-13T23:58:02.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.140+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94330859435520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6d7000 con 0x55cb1d6b1c00 2024-09-13T23:58:02.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.140+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94330859435520] v35'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cb1d759440 con 0x55cb1d6b1c00 2024-09-13T23:58:02.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.140+0000 7fde4d301f40 20 remove_watcher() i=6 2024-09-13T23:58:02.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.140+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94330859436672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55cb1d6d7400 con 0x55cb1d76e000 2024-09-13T23:58:02.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4c2bb700 1 -- 172.21.15.173:0/2736694445 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94330859436672] v35'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55cb1d758b40 con 0x55cb1d76e000 2024-09-13T23:58:02.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 20 remove_watcher() i=7 2024-09-13T23:58:02.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55cb1d6b1400 msgr2=0x55cb1d5ec100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 --2- 172.21.15.173:0/2736694445 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55cb1d6b1400 0x55cb1d5ec100 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55cb1d6b1000 msgr2=0x55cb1d5ebb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 --2- 172.21.15.173:0/2736694445 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55cb1d6b1000 0x55cb1d5ebb80 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55cb1d76e000 msgr2=0x55cb1d5ecc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 --2- 172.21.15.173:0/2736694445 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55cb1d76e000 0x55cb1d5ecc00 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55cb1d6b1c00 msgr2=0x55cb1d5ec680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 --2- 172.21.15.173:0/2736694445 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55cb1d6b1c00 0x55cb1d5ec680 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cb1d6b0c00 msgr2=0x55cb1d5eb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 --2- 172.21.15.173:0/2736694445 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cb1d6b0c00 0x55cb1d5eb600 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55cb1d5e5920 tx=0x55cb1d409800 comp rx=0 tx=0).stop 2024-09-13T23:58:02.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305800 msgr2=0x55cb1d5eab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 --2- 172.21.15.173:0/2736694445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305800 0x55cb1d5eab00 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x55cb1d634810 tx=0x55cb1d668cc0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 reap_dead start 2024-09-13T23:58:02.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4b2b9700 1 -- 172.21.15.173:0/2736694445 reap_dead start 2024-09-13T23:58:02.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 shutdown_connections 2024-09-13T23:58:02.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 >> 172.21.15.173:0/2736694445 conn(0x55cb1d305400 msgr2=0x55cb1d405800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 shutdown_connections 2024-09-13T23:58:02.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 -- 172.21.15.173:0/2736694445 wait complete. 2024-09-13T23:58:02.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 -- 172.21.15.173:0/1271417032 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cb1d6b1800 msgr2=0x55cb1d806000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 --2- 172.21.15.173:0/1271417032 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cb1d6b1800 0x55cb1d806000 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55cb1d71d7d0 tx=0x55cb1d75b5c0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 -- 172.21.15.173:0/1271417032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d76e400 msgr2=0x55cb1d5ed180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 --2- 172.21.15.173:0/1271417032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d76e400 0x55cb1d5ed180 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x55cb1d788330 tx=0x55cb1d75a5a0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 -- 172.21.15.173:0/1271417032 shutdown_connections 2024-09-13T23:58:02.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 --2- 172.21.15.173:0/1271417032 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cb1d6b1800 0x55cb1d806000 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 --2- 172.21.15.173:0/1271417032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d76e400 0x55cb1d5ed180 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 -- 172.21.15.173:0/1271417032 >> 172.21.15.173:0/1271417032 conn(0x55cb1d64e800 msgr2=0x55cb1d406000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 -- 172.21.15.173:0/1271417032 shutdown_connections 2024-09-13T23:58:02.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 -- 172.21.15.173:0/1271417032 wait complete. 2024-09-13T23:58:02.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 -- 172.21.15.173:0/2032799235 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cb1d6b0000 msgr2=0x55cb1d5eb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 --2- 172.21.15.173:0/2032799235 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cb1d6b0000 0x55cb1d5eb080 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x55cb1d634f60 tx=0x55cb1d668240 comp rx=0 tx=0).stop 2024-09-13T23:58:02.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 -- 172.21.15.173:0/2032799235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305000 msgr2=0x55cb1d5ea580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 --2- 172.21.15.173:0/2032799235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305000 0x55cb1d5ea580 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x55cb1d461e60 tx=0x55cb1d409a40 comp rx=0 tx=0).stop 2024-09-13T23:58:02.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 -- 172.21.15.173:0/2032799235 shutdown_connections 2024-09-13T23:58:02.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 --2- 172.21.15.173:0/2032799235 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55cb1d6b0000 0x55cb1d5eb080 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 --2- 172.21.15.173:0/2032799235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cb1d305000 0x55cb1d5ea580 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 -- 172.21.15.173:0/2032799235 >> 172.21.15.173:0/2032799235 conn(0x55cb1d304c00 msgr2=0x55cb1d405000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 -- 172.21.15.173:0/2032799235 shutdown_connections 2024-09-13T23:58:02.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.144+0000 7fde4d301f40 1 -- 172.21.15.173:0/2032799235 wait complete. 2024-09-13T23:58:02.152 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:58:02.152 INFO:teuthology.orchestra.run.smithi173.stdout: "entries": [ 2024-09-13T23:58:02.152 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:02.153 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:58:02.153 INFO:teuthology.orchestra.run.smithi173.stdout: "buckets": [ 2024-09-13T23:58:02.153 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:02.153 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "", 2024-09-13T23:58:02.153 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:02.153 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:02.153 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:02.153 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [] 2024-09-13T23:58:02.154 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:02.154 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:02.154 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo", 2024-09-13T23:58:02.154 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:02.154 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:02.154 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:02.154 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:02.154 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:02.154 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "delete_obj", 2024-09-13T23:58:02.154 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:02.154 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:02.154 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 4, 2024-09-13T23:58:02.154 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 4 2024-09-13T23:58:02.154 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:02.155 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:02.155 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:02.155 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:02.155 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo2", 2024-09-13T23:58:02.155 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:02.155 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:02.155 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:02.155 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [] 2024-09-13T23:58:02.155 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:02.155 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:02.155 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo3", 2024-09-13T23:58:02.155 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:02.155 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:02.155 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [] 2024-09-13T23:58:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo4", 2024-09-13T23:58:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [] 2024-09-13T23:58:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:02.156 INFO:teuthology.orchestra.run.smithi173.stdout: "summary": [ 2024-09-13T23:58:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:58:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "delete_obj", 2024-09-13T23:58:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 4, 2024-09-13T23:58:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 4 2024-09-13T23:58:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: "total": { 2024-09-13T23:58:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:02.157 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:02.158 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 4, 2024-09-13T23:58:02.158 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 4 2024-09-13T23:58:02.158 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:02.158 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:02.158 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:02.158 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:58:02.159 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-13T23:58:02.159 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-13T23:58:02.159 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-13T23:58:02.159 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-13T23:58:02.202 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:58:02.203 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:58:02.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.200+0000 7fef0c029f40 1 Processor -- start 2024-09-13T23:58:02.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.200+0000 7fef0c029f40 1 -- start start 2024-09-13T23:58:02.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.200+0000 7fef0c029f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x5565f1b4b400 0x5565f1e30580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.200+0000 7fef0c029f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5565f1c0f500 con 0x5565f1b4b000 2024-09-13T23:58:02.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.200+0000 7fef0c029f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x5565f1bd8a00 con 0x5565f1b4b400 2024-09-13T23:58:02.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.200+0000 7fef09fe1700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x5565f1b4b400 0x5565f1e30580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.200+0000 7fef0a7e2700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x5565f1b4b000 0x5565f1c4a800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:38638/0 (socket says 172.21.15.173:38638) 2024-09-13T23:58:02.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.200+0000 7fef09fe1700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x5565f1b4b400 0x5565f1e30580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49750/0 (socket says 172.21.15.173:49750) 2024-09-13T23:58:02.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.200+0000 7fef0a7e2700 1 -- 172.21.15.173:0/719427042 learned_addr learned my addr 172.21.15.173:0/719427042 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:58:02.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.200+0000 7fef09fe1700 1 -- 172.21.15.173:0/719427042 >> v1:172.21.15.87:6789/0 conn(0x5565f1b4b000 legacy=0x5565f1c4a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.200+0000 7fef09fe1700 1 -- 172.21.15.173:0/719427042 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565f1b5dd40 con 0x5565f1b4b400 2024-09-13T23:58:02.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.204+0000 7fef09fe1700 1 --2- 172.21.15.173:0/719427042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4b400 0x5565f1e30580 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x5565f1e2b920 tx=0x5565f1c4f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ce1d2d3a84ccda server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.204+0000 7fef097e0700 1 -- 172.21.15.173:0/719427042 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5565f1bef4a0 con 0x5565f1b4b400 2024-09-13T23:58:02.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.204+0000 7fef097e0700 1 -- 172.21.15.173:0/719427042 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5565f1c0f800 con 0x5565f1b4b400 2024-09-13T23:58:02.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.204+0000 7fef097e0700 1 -- 172.21.15.173:0/719427042 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5565f1bef600 con 0x5565f1b4b400 2024-09-13T23:58:02.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.204+0000 7fef0c029f40 1 -- 172.21.15.173:0/719427042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4b400 msgr2=0x5565f1e30580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.204+0000 7fef0c029f40 1 --2- 172.21.15.173:0/719427042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4b400 0x5565f1e30580 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x5565f1e2b920 tx=0x5565f1c4f920 comp rx=0 tx=0).stop 2024-09-13T23:58:02.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.204+0000 7fef0c029f40 1 -- 172.21.15.173:0/719427042 shutdown_connections 2024-09-13T23:58:02.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.204+0000 7fef0c029f40 1 --2- 172.21.15.173:0/719427042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4b400 0x5565f1e30580 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.204+0000 7fef0c029f40 1 -- 172.21.15.173:0/719427042 >> 172.21.15.173:0/719427042 conn(0x5565f1b4ac00 msgr2=0x5565f1c4a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.204+0000 7fef0c029f40 1 -- 172.21.15.173:0/719427042 shutdown_connections 2024-09-13T23:58:02.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.204+0000 7fef0c029f40 1 -- 172.21.15.173:0/719427042 wait complete. 2024-09-13T23:58:02.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.204+0000 7fef0c029f40 1 Processor -- start 2024-09-13T23:58:02.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.204+0000 7fef0c029f40 1 -- start start 2024-09-13T23:58:02.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.204+0000 7fef0c029f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4b000 0x5565f1e30580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.204+0000 7fef0c029f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565f1bd8500 con 0x5565f1b4b000 2024-09-13T23:58:02.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.204+0000 7fef0a7e2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4b000 0x5565f1e30580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.204+0000 7fef0a7e2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4b000 0x5565f1e30580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49754/0 (socket says 172.21.15.173:49754) 2024-09-13T23:58:02.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.204+0000 7fef0a7e2700 1 -- 172.21.15.173:0/2288748997 learned_addr learned my addr 172.21.15.173:0/2288748997 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:02.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.204+0000 7fef0a7e2700 1 -- 172.21.15.173:0/2288748997 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565f1b5dba0 con 0x5565f1b4b000 2024-09-13T23:58:02.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.204+0000 7fef0a7e2700 1 --2- 172.21.15.173:0/2288748997 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4b000 0x5565f1e30580 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x5565f1ca7e90 tx=0x5565f1c4fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5c546b91e62790 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.204+0000 7fef08fdf700 1 -- 172.21.15.173:0/2288748997 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5565f1bef4a0 con 0x5565f1b4b000 2024-09-13T23:58:02.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.204+0000 7fef08fdf700 1 -- 172.21.15.173:0/2288748997 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5565f1c0fb00 con 0x5565f1b4b000 2024-09-13T23:58:02.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.204+0000 7fef08fdf700 1 -- 172.21.15.173:0/2288748997 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5565f1bef600 con 0x5565f1b4b000 2024-09-13T23:58:02.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.208+0000 7fef0c029f40 1 -- 172.21.15.173:0/2288748997 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4b000 msgr2=0x5565f1e30580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.208+0000 7fef0c029f40 1 --2- 172.21.15.173:0/2288748997 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4b000 0x5565f1e30580 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x5565f1ca7e90 tx=0x5565f1c4fb60 comp rx=0 tx=0).stop 2024-09-13T23:58:02.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.208+0000 7fef0c029f40 1 -- 172.21.15.173:0/2288748997 shutdown_connections 2024-09-13T23:58:02.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.208+0000 7fef0c029f40 1 --2- 172.21.15.173:0/2288748997 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4b000 0x5565f1e30580 secure :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0x5565f1ca7e90 tx=0x5565f1c4fb60 comp rx=0 tx=0).stop 2024-09-13T23:58:02.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.208+0000 7fef0c029f40 1 -- 172.21.15.173:0/2288748997 >> 172.21.15.173:0/2288748997 conn(0x5565f1b4ac00 msgr2=0x5565f1c4b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.208+0000 7fef0c029f40 1 -- 172.21.15.173:0/2288748997 shutdown_connections 2024-09-13T23:58:02.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.208+0000 7fef0c029f40 1 -- 172.21.15.173:0/2288748997 wait complete. 2024-09-13T23:58:02.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.208+0000 7fef0c029f40 1 Processor -- start 2024-09-13T23:58:02.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.208+0000 7fef0c029f40 1 -- start start 2024-09-13T23:58:02.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.208+0000 7fef0c029f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4b400 0x5565f1e30b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.208+0000 7fef0c029f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565f1bd83c0 con 0x5565f1b4b400 2024-09-13T23:58:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.208+0000 7fef0a7e2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4b400 0x5565f1e30b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.208+0000 7fef0a7e2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4b400 0x5565f1e30b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49768/0 (socket says 172.21.15.173:49768) 2024-09-13T23:58:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.208+0000 7fef0a7e2700 1 -- 172.21.15.173:0/1649508411 learned_addr learned my addr 172.21.15.173:0/1649508411 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.208+0000 7fef0a7e2700 1 -- 172.21.15.173:0/1649508411 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565f1b5da00 con 0x5565f1b4b400 2024-09-13T23:58:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.208+0000 7fef0a7e2700 1 --2- 172.21.15.173:0/1649508411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4b400 0x5565f1e30b00 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x5565f1ca7f80 tx=0x5565f1c4fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.208+0000 7fef077dc700 1 -- 172.21.15.173:0/1649508411 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5565f1bef8c0 con 0x5565f1b4b400 2024-09-13T23:58:02.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.208+0000 7fef0c029f40 1 -- 172.21.15.173:0/1649508411 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5565f1b5d860 con 0x5565f1b4b400 2024-09-13T23:58:02.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.208+0000 7fef077dc700 1 -- 172.21.15.173:0/1649508411 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5565f1c0fc80 con 0x5565f1b4b400 2024-09-13T23:58:02.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.208+0000 7fef077dc700 1 -- 172.21.15.173:0/1649508411 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5565f1bef4a0 con 0x5565f1b4b400 2024-09-13T23:58:02.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.208+0000 7fef0c029f40 1 -- 172.21.15.173:0/1649508411 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5565f1b5d6c0 con 0x5565f1b4b400 2024-09-13T23:58:02.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.212+0000 7fef0c029f40 1 Processor -- start 2024-09-13T23:58:02.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.212+0000 7fef0c029f40 1 -- start start 2024-09-13T23:58:02.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.212+0000 7fef077dc700 1 -- 172.21.15.173:0/1649508411 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x5565f1c44b00 con 0x5565f1b4b400 2024-09-13T23:58:02.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.212+0000 7fef0c029f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4bc00 0x5565f1e31080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.212+0000 7fef0c029f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565f1bd8000 con 0x5565f1b4bc00 2024-09-13T23:58:02.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.212+0000 7fef077dc700 1 --2- 172.21.15.173:0/1649508411 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5565f1ef8000 0x5565f1e32100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.212+0000 7fef077dc700 1 -- 172.21.15.173:0/1649508411 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x5565f1bb1180 con 0x5565f1b4b400 2024-09-13T23:58:02.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.212+0000 7fef0a7e2700 1 --2- 172.21.15.173:0/1649508411 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5565f1ef8000 0x5565f1e32100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.212+0000 7fef0afe3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4bc00 0x5565f1e31080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.212+0000 7fef0afe3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4bc00 0x5565f1e31080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49772/0 (socket says 172.21.15.173:49772) 2024-09-13T23:58:02.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.212+0000 7fef0afe3700 1 -- 172.21.15.173:0/1672026001 learned_addr learned my addr 172.21.15.173:0/1672026001 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:02.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.212+0000 7fef0a7e2700 1 --2- 172.21.15.173:0/1649508411 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5565f1ef8000 0x5565f1e32100 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x5565f29bd560 tx=0x5565f1eae240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.212+0000 7fef0afe3700 1 -- 172.21.15.173:0/1672026001 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565f1b5c000 con 0x5565f1b4bc00 2024-09-13T23:58:02.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.212+0000 7fef0afe3700 1 --2- 172.21.15.173:0/1672026001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4bc00 0x5565f1e31080 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x5565f29bc300 tx=0x5565f1eaf0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d3f71068b64504 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.212+0000 7fef04fd7700 1 -- 172.21.15.173:0/1672026001 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5565f1bef8c0 con 0x5565f1b4bc00 2024-09-13T23:58:02.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.212+0000 7fef04fd7700 1 -- 172.21.15.173:0/1672026001 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5565f1f0e000 con 0x5565f1b4bc00 2024-09-13T23:58:02.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.212+0000 7fef04fd7700 1 -- 172.21.15.173:0/1672026001 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5565f1bef4a0 con 0x5565f1b4bc00 2024-09-13T23:58:02.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.216+0000 7fef0c029f40 1 -- 172.21.15.173:0/1672026001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4bc00 msgr2=0x5565f1e31080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.216+0000 7fef0c029f40 1 --2- 172.21.15.173:0/1672026001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4bc00 0x5565f1e31080 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x5565f29bc300 tx=0x5565f1eaf0e0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.216+0000 7fef0c029f40 1 -- 172.21.15.173:0/1672026001 shutdown_connections 2024-09-13T23:58:02.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.216+0000 7fef0c029f40 1 --2- 172.21.15.173:0/1672026001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4bc00 0x5565f1e31080 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.216+0000 7fef0c029f40 1 -- 172.21.15.173:0/1672026001 >> 172.21.15.173:0/1672026001 conn(0x5565f1b4b800 msgr2=0x5565f1c4b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.216+0000 7fef0c029f40 1 -- 172.21.15.173:0/1672026001 shutdown_connections 2024-09-13T23:58:02.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.216+0000 7fef0c029f40 1 -- 172.21.15.173:0/1672026001 wait complete. 2024-09-13T23:58:02.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.216+0000 7fef0c029f40 1 Processor -- start 2024-09-13T23:58:02.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.216+0000 7fef0c029f40 1 -- start start 2024-09-13T23:58:02.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.216+0000 7fef0c029f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4bc00 0x5565f1e31080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.216+0000 7fef0c029f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565f1b70640 con 0x5565f1b4bc00 2024-09-13T23:58:02.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.216+0000 7fef0afe3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4bc00 0x5565f1e31080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.216+0000 7fef0afe3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4bc00 0x5565f1e31080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49786/0 (socket says 172.21.15.173:49786) 2024-09-13T23:58:02.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.216+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 learned_addr learned my addr 172.21.15.173:0/963087645 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:02.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.216+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565f1b5cea0 con 0x5565f1b4bc00 2024-09-13T23:58:02.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.216+0000 7fef0afe3700 1 --2- 172.21.15.173:0/963087645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4bc00 0x5565f1e31080 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x5565f29bc6c0 tx=0x5565f1eaecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.216+0000 7fef037d4700 1 -- 172.21.15.173:0/963087645 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5565f1befb80 con 0x5565f1b4bc00 2024-09-13T23:58:02.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.216+0000 7fef037d4700 1 -- 172.21.15.173:0/963087645 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5565f1f0e180 con 0x5565f1b4bc00 2024-09-13T23:58:02.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.216+0000 7fef037d4700 1 -- 172.21.15.173:0/963087645 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5565f1bef8c0 con 0x5565f1b4bc00 2024-09-13T23:58:02.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.216+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5565f1b5c820 con 0x5565f1b4bc00 2024-09-13T23:58:02.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.216+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5565f1b5c9c0 con 0x5565f1b4bc00 2024-09-13T23:58:02.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.220+0000 7fef037d4700 1 -- 172.21.15.173:0/963087645 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x5565f1c44dc0 con 0x5565f1b4bc00 2024-09-13T23:58:02.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.220+0000 7fef037d4700 1 --2- 172.21.15.173:0/963087645 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5565f1ef8c00 0x5565f1e32680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.220+0000 7fef037d4700 1 -- 172.21.15.173:0/963087645 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x5565f1bb1340 con 0x5565f1b4bc00 2024-09-13T23:58:02.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.220+0000 7fef09fe1700 1 --2- 172.21.15.173:0/963087645 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5565f1ef8c00 0x5565f1e32680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.220+0000 7fef0c029f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.220+0000 7fef0c029f40 1 --2- 172.21.15.173:0/963087645 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5565f1ef9000 0x5565f1e31600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.220+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9400 con 0x5565f1ef9000 2024-09-13T23:58:02.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.220+0000 7fef0afe3700 1 --2- 172.21.15.173:0/963087645 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5565f1ef9000 0x5565f1e31600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.220+0000 7fef09fe1700 1 --2- 172.21.15.173:0/963087645 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5565f1ef8c00 0x5565f1e32680 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x5565f1e2b920 tx=0x5565f1c4f800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.220+0000 7fef0afe3700 1 --2- 172.21.15.173:0/963087645 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5565f1ef9000 0x5565f1e31600 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.220+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1ef9000 2024-09-13T23:58:02.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.220+0000 7fef0c029f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.220+0000 7fef0c029f40 20 realm 2024-09-13T23:58:02.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.220+0000 7fef0c029f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.220+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9000 2024-09-13T23:58:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.220+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1ef9000 2024-09-13T23:58:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.220+0000 7fef0c029f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.220+0000 7fef0c029f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:58:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.220+0000 7fef0c029f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.220+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9c00 con 0x5565f1ef9000 2024-09-13T23:58:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.224+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1ef9000 2024-09-13T23:58:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.224+0000 7fef0c029f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.224+0000 7fef0c029f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.224+0000 7fef0c029f40 1 --2- 172.21.15.173:0/963087645 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5565f1ef9400 0x5565f1e31b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.224+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9400 2024-09-13T23:58:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.224+0000 7fef0a7e2700 1 --2- 172.21.15.173:0/963087645 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5565f1ef9400 0x5565f1e31b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.224+0000 7fef0a7e2700 1 --2- 172.21.15.173:0/963087645 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5565f1ef9400 0x5565f1e31b80 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.224+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5565f1fab200 con 0x5565f1ef9400 2024-09-13T23:58:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.224+0000 7fef0c029f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.224+0000 7fef0c029f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.224+0000 7fef0c029f40 1 --2- 172.21.15.173:0/963087645 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5565f1ef9c00 0x5565f1e32c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.224+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1fb6000 con 0x5565f1ef9c00 2024-09-13T23:58:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.224+0000 7fef09fe1700 1 --2- 172.21.15.173:0/963087645 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5565f1ef9c00 0x5565f1e32c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.224+0000 7fef09fe1700 1 --2- 172.21.15.173:0/963087645 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5565f1ef9c00 0x5565f1e32c00 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.224+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5565f1fab440 con 0x5565f1ef9c00 2024-09-13T23:58:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.224+0000 7fef0c029f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:58:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.224+0000 7fef0c029f40 20 searching for the correct realm 2024-09-13T23:58:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.224+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1fb6400 con 0x5565f1ef9c00 2024-09-13T23:58:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.224+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5565f1fab440 con 0x5565f1ef9c00 2024-09-13T23:58:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.224+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1fb6000 con 0x5565f1ef9400 2024-09-13T23:58:02.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.228+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1fab200 con 0x5565f1ef9400 2024-09-13T23:58:02.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.228+0000 7fef0a7e2700 1 --2- 172.21.15.173:0/963087645 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5565f1fb6000 0x5565f1e30580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.228+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1fb6000 2024-09-13T23:58:02.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.228+0000 7fef0afe3700 1 --2- 172.21.15.173:0/963087645 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5565f1fb6000 0x5565f1e30580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.228+0000 7fef0afe3700 1 --2- 172.21.15.173:0/963087645 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5565f1fb6000 0x5565f1e30580 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.228+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1fb6000 2024-09-13T23:58:02.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.228+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1fb6000 2024-09-13T23:58:02.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.228+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1fb6000 2024-09-13T23:58:02.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.228+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9000 2024-09-13T23:58:02.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.228+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1ef9000 2024-09-13T23:58:02.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.228+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9c00 2024-09-13T23:58:02.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.228+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1fab440 con 0x5565f1ef9c00 2024-09-13T23:58:02.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.228+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9000 2024-09-13T23:58:02.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.228+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1ef9000 2024-09-13T23:58:02.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.228+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9400 2024-09-13T23:58:02.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.232+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1fab200 con 0x5565f1ef9400 2024-09-13T23:58:02.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.232+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9400 2024-09-13T23:58:02.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.232+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1fab200 con 0x5565f1ef9400 2024-09-13T23:58:02.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.232+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9000 2024-09-13T23:58:02.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.232+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1ef9000 2024-09-13T23:58:02.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.232+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1fb6000 2024-09-13T23:58:02.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.232+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1fb6000 2024-09-13T23:58:02.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.232+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9000 2024-09-13T23:58:02.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.232+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1ef9000 2024-09-13T23:58:02.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.232+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1fb6000 2024-09-13T23:58:02.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.232+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1fb6000 2024-09-13T23:58:02.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.232+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9400 2024-09-13T23:58:02.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.236+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1fab200 con 0x5565f1ef9400 2024-09-13T23:58:02.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.236+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9c00 2024-09-13T23:58:02.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.236+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1fab440 con 0x5565f1ef9c00 2024-09-13T23:58:02.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.236+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9000 2024-09-13T23:58:02.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.236+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1ef9000 2024-09-13T23:58:02.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.236+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9400 2024-09-13T23:58:02.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.236+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1fab200 con 0x5565f1ef9400 2024-09-13T23:58:02.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.236+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9c00 2024-09-13T23:58:02.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.236+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1fab440 con 0x5565f1ef9c00 2024-09-13T23:58:02.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.236+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9000 2024-09-13T23:58:02.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.236+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1ef9000 2024-09-13T23:58:02.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.236+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9000 2024-09-13T23:58:02.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.240+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1ef9000 2024-09-13T23:58:02.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.240+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9000 2024-09-13T23:58:02.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.240+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1ef9000 2024-09-13T23:58:02.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.240+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9c00 2024-09-13T23:58:02.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.240+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1fab440 con 0x5565f1ef9c00 2024-09-13T23:58:02.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.240+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1fb6000 2024-09-13T23:58:02.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.240+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1fb6000 2024-09-13T23:58:02.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.240+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9000 2024-09-13T23:58:02.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.240+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1ef9000 2024-09-13T23:58:02.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.240+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1fb6000 2024-09-13T23:58:02.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.240+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1fb6000 2024-09-13T23:58:02.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.240+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9c00 2024-09-13T23:58:02.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.240+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1fab440 con 0x5565f1ef9c00 2024-09-13T23:58:02.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.240+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1fb6000 2024-09-13T23:58:02.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.244+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1fb6000 2024-09-13T23:58:02.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.244+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9400 2024-09-13T23:58:02.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.244+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1fab200 con 0x5565f1ef9400 2024-09-13T23:58:02.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.244+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9400 2024-09-13T23:58:02.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.244+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1fab200 con 0x5565f1ef9400 2024-09-13T23:58:02.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.244+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9c00 2024-09-13T23:58:02.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.244+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1fab440 con 0x5565f1ef9c00 2024-09-13T23:58:02.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.244+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9400 2024-09-13T23:58:02.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.244+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5565f1fab200 con 0x5565f1ef9400 2024-09-13T23:58:02.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.244+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9400 2024-09-13T23:58:02.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.244+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5565f1fab200 con 0x5565f1ef9400 2024-09-13T23:58:02.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:58:02.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:58:02.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:58:02.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:58:02.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1fb6800 con 0x5565f1ef9000 2024-09-13T23:58:02.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1ef9000 2024-09-13T23:58:02.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1fb6c00 con 0x5565f1ef9400 2024-09-13T23:58:02.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5565f1fab200 con 0x5565f1ef9400 2024-09-13T23:58:02.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:02.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1fb7000 con 0x5565f1fb6000 2024-09-13T23:58:02.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1fb6000 2024-09-13T23:58:02.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:58:02.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 20 zone default found 2024-09-13T23:58:02.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 4 Realm: () 2024-09-13T23:58:02.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:58:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:58:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:58:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 20 zonegroup default 2024-09-13T23:58:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1fb7400 con 0x5565f1fb6000 2024-09-13T23:58:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1fb6000 2024-09-13T23:58:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1fb7800 con 0x5565f1ef9c00 2024-09-13T23:58:02.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5565f1fab440 con 0x5565f1ef9c00 2024-09-13T23:58:02.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.248+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1fb7c00 con 0x5565f1ef9c00 2024-09-13T23:58:02.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.252+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5565f1fab440 con 0x5565f1ef9c00 2024-09-13T23:58:02.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.252+0000 7fef0c029f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.252+0000 7fef0c029f40 20 started sync module instance, tier type = 2024-09-13T23:58:02.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.252+0000 7fef0c029f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:58:02.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.252+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1e94000 con 0x5565f1ef9400 2024-09-13T23:58:02.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.252+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v35'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5565f1fab200 con 0x5565f1ef9400 2024-09-13T23:58:02.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.252+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93896338209536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1e94400 con 0x5565f1ef9400 2024-09-13T23:58:02.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.252+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1e94800 con 0x5565f1ef9000 2024-09-13T23:58:02.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.256+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93896338209536] v35'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5565f1fab200 con 0x5565f1ef9400 2024-09-13T23:58:02.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.256+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v35'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1ef9000 2024-09-13T23:58:02.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.256+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93896338210688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1e94c00 con 0x5565f1ef9000 2024-09-13T23:58:02.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.256+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1e95000 con 0x5565f1ef9400 2024-09-13T23:58:02.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.260+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 93896338210688] v35'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1ef9000 2024-09-13T23:58:02.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.260+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v35'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5565f1fab200 con 0x5565f1ef9400 2024-09-13T23:58:02.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.260+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93896338211840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1e95400 con 0x5565f1ef9400 2024-09-13T23:58:02.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.260+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1e95800 con 0x5565f1fb6000 2024-09-13T23:58:02.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.260+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v35'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1fb6000 2024-09-13T23:58:02.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.260+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93896338212992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1e95c00 con 0x5565f1fb6000 2024-09-13T23:58:02.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.260+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1e94800 con 0x5565f1ef9400 2024-09-13T23:58:02.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.260+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93896338211840] v35'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5565f1fab200 con 0x5565f1ef9400 2024-09-13T23:58:02.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.264+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v35'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5565f1fab200 con 0x5565f1ef9400 2024-09-13T23:58:02.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.264+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93896338214144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1e94000 con 0x5565f1ef9400 2024-09-13T23:58:02.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.264+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1e94400 con 0x5565f1ef9c00 2024-09-13T23:58:02.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.264+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93896338212992] v35'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1fb6000 2024-09-13T23:58:02.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.264+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93896338214144] v35'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5565f1fab200 con 0x5565f1ef9400 2024-09-13T23:58:02.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.264+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v35'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5565f1fab440 con 0x5565f1ef9c00 2024-09-13T23:58:02.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.268+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93896338215296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1fb6800 con 0x5565f1ef9c00 2024-09-13T23:58:02.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.268+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1fb7000 con 0x5565f1ef9c00 2024-09-13T23:58:02.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.268+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93896338215296] v35'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5565f1fab440 con 0x5565f1ef9c00 2024-09-13T23:58:02.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.268+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v35'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5565f1fab440 con 0x5565f1ef9c00 2024-09-13T23:58:02.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.268+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93896338216448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1fb7400 con 0x5565f1ef9c00 2024-09-13T23:58:02.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.268+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1fb6c00 con 0x5565f1fb6000 2024-09-13T23:58:02.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.272+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v35'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1fb6000 2024-09-13T23:58:02.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.272+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93896338217600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1fb6000 2024-09-13T23:58:02.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.272+0000 7fef0c029f40 20 add_watcher() i=0 2024-09-13T23:58:02.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.272+0000 7fef0c029f40 20 add_watcher() i=1 2024-09-13T23:58:02.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.272+0000 7fef0c029f40 20 add_watcher() i=2 2024-09-13T23:58:02.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.272+0000 7fef0c029f40 20 add_watcher() i=3 2024-09-13T23:58:02.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.272+0000 7fef0c029f40 20 add_watcher() i=4 2024-09-13T23:58:02.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.272+0000 7fef0c029f40 20 add_watcher() i=5 2024-09-13T23:58:02.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.272+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93896338216448] v35'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5565f1fab440 con 0x5565f1ef9c00 2024-09-13T23:58:02.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.272+0000 7fef0c029f40 20 add_watcher() i=6 2024-09-13T23:58:02.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.272+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93896338217600] v35'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1fb6000 2024-09-13T23:58:02.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.272+0000 7fef0c029f40 20 add_watcher() i=7 2024-09-13T23:58:02.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.272+0000 7fef0c029f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:58:02.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.272+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1e94c00 con 0x5565f1ef9000 2024-09-13T23:58:02.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.272+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1ef9000 2024-09-13T23:58:02.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.272+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93896339914752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1e95800 con 0x5565f1ef9000 2024-09-13T23:58:02.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.276+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93896339914752] v35'208 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1ef9000 2024-09-13T23:58:02.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.276+0000 7feef17b0700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:02.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.276+0000 7fef0c029f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:58:02.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.276+0000 7fef0c029f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:58:02.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.276+0000 7fef0c029f40 1 Processor -- start 2024-09-13T23:58:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.276+0000 7fef0c029f40 1 -- start start 2024-09-13T23:58:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.276+0000 7fef0c029f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1e94400 0x5565f1e33180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.276+0000 7fef0c029f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565f1b70780 con 0x5565f1e94400 2024-09-13T23:58:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.276+0000 7fef09fe1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1e94400 0x5565f1e33180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.276+0000 7fef09fe1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1e94400 0x5565f1e33180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49794/0 (socket says 172.21.15.173:49794) 2024-09-13T23:58:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.276+0000 7fef09fe1700 1 -- 172.21.15.173:0/3177012210 learned_addr learned my addr 172.21.15.173:0/3177012210 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.276+0000 7fef09fe1700 1 -- 172.21.15.173:0/3177012210 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565f1b5cb60 con 0x5565f1e94400 2024-09-13T23:58:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.276+0000 7fef09fe1700 1 --2- 172.21.15.173:0/3177012210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1e94400 0x5565f1e33180 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x5565f1fcc6f0 tx=0x5565f1c4f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c1770be7d95194 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.276+0000 7feef0faf700 1 -- 172.21.15.173:0/3177012210 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5565f1bef760 con 0x5565f1e94400 2024-09-13T23:58:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.276+0000 7feef0faf700 1 -- 172.21.15.173:0/3177012210 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5565f1f0e600 con 0x5565f1e94400 2024-09-13T23:58:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.276+0000 7feef0faf700 1 -- 172.21.15.173:0/3177012210 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5565f1fd4000 con 0x5565f1e94400 2024-09-13T23:58:02.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.280+0000 7fef0c029f40 1 -- 172.21.15.173:0/3177012210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1e94400 msgr2=0x5565f1e33180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.280+0000 7fef0c029f40 1 --2- 172.21.15.173:0/3177012210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1e94400 0x5565f1e33180 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x5565f1fcc6f0 tx=0x5565f1c4f980 comp rx=0 tx=0).stop 2024-09-13T23:58:02.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.280+0000 7fef0c029f40 1 -- 172.21.15.173:0/3177012210 shutdown_connections 2024-09-13T23:58:02.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.280+0000 7fef0c029f40 1 --2- 172.21.15.173:0/3177012210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1e94400 0x5565f1e33180 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.280+0000 7fef0c029f40 1 -- 172.21.15.173:0/3177012210 >> 172.21.15.173:0/3177012210 conn(0x5565f1e95c00 msgr2=0x5565f1c4c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.280+0000 7fef0c029f40 1 -- 172.21.15.173:0/3177012210 shutdown_connections 2024-09-13T23:58:02.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.280+0000 7fef0c029f40 1 -- 172.21.15.173:0/3177012210 wait complete. 2024-09-13T23:58:02.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.280+0000 7fef0c029f40 1 Processor -- start 2024-09-13T23:58:02.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.280+0000 7fef0c029f40 1 -- start start 2024-09-13T23:58:02.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.280+0000 7fef0c029f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1fb6c00 0x5565f1e33700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.280+0000 7fef0c029f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565f1bd8000 con 0x5565f1fb6c00 2024-09-13T23:58:02.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.280+0000 7fef09fe1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1fb6c00 0x5565f1e33700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.280+0000 7fef09fe1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1fb6c00 0x5565f1e33700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49804/0 (socket says 172.21.15.173:49804) 2024-09-13T23:58:02.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.280+0000 7fef09fe1700 1 -- 172.21.15.173:0/569871957 learned_addr learned my addr 172.21.15.173:0/569871957 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:02.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.280+0000 7fef09fe1700 1 -- 172.21.15.173:0/569871957 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565f1b5cd00 con 0x5565f1fb6c00 2024-09-13T23:58:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.280+0000 7fef09fe1700 1 --2- 172.21.15.173:0/569871957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1fb6c00 0x5565f1e33700 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x5565f1fcc900 tx=0x5565f1f9a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.280+0000 7feeef7ac700 1 -- 172.21.15.173:0/569871957 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5565f1fd4160 con 0x5565f1fb6c00 2024-09-13T23:58:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.280+0000 7fef0c029f40 1 -- 172.21.15.173:0/569871957 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5565f1b5c340 con 0x5565f1fb6c00 2024-09-13T23:58:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.280+0000 7feeef7ac700 1 -- 172.21.15.173:0/569871957 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5565f1f0e300 con 0x5565f1fb6c00 2024-09-13T23:58:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.280+0000 7feeef7ac700 1 -- 172.21.15.173:0/569871957 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5565f1fd42c0 con 0x5565f1fb6c00 2024-09-13T23:58:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.280+0000 7fef0c029f40 1 -- 172.21.15.173:0/569871957 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5565f1b5dd40 con 0x5565f1fb6c00 2024-09-13T23:58:02.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.284+0000 7feeef7ac700 1 -- 172.21.15.173:0/569871957 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x5565f1c45b80 con 0x5565f1fb6c00 2024-09-13T23:58:02.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.284+0000 7feeef7ac700 1 --2- 172.21.15.173:0/569871957 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5565f204e000 0x5565f2054000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.284+0000 7feeef7ac700 1 -- 172.21.15.173:0/569871957 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x5565f1bb1500 con 0x5565f1fb6c00 2024-09-13T23:58:02.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.284+0000 7fef0afe3700 1 --2- 172.21.15.173:0/569871957 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5565f204e000 0x5565f2054000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.284+0000 7fef0c029f40 5 note: GC not initialized 2024-09-13T23:58:02.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.284+0000 7fef0afe3700 1 --2- 172.21.15.173:0/569871957 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5565f204e000 0x5565f2054000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x5565f1f59980 tx=0x5565f1f9b5c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.284+0000 7fef0c029f40 20 init_complete bucket index max shards: 11 2024-09-13T23:58:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.284+0000 7fef0c029f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:58:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.284+0000 7feeeafa3700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:58:32 2024 2024-09-13T23:58:02.289 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:58:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.284+0000 7feeea781700 20 reqs_thread_entry: start 2024-09-13T23:58:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.284+0000 7fef0c029f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.284+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1fb7c00 con 0x5565f1ef9000 2024-09-13T23:58:02.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.284+0000 7feeecfa7700 20 reqs_thread_entry: start 2024-09-13T23:58:02.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.288+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv18 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1ef9000 2024-09-13T23:58:02.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.288+0000 7fef0c029f40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:58:02.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.288+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f1ef9800 con 0x5565f1ef9c00 2024-09-13T23:58:02.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.288+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x5565f1fab440 con 0x5565f1ef9c00 2024-09-13T23:58:02.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.288+0000 7feef17b0700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:02.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.288+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93896339914752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f204e400 con 0x5565f1ef9000 2024-09-13T23:58:02.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.292+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93896339914752] v35'209 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1ef9000 2024-09-13T23:58:02.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.292+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93896338209536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f204e800 con 0x5565f1ef9400 2024-09-13T23:58:02.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.292+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93896338209536] v35'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5565f1fab200 con 0x5565f1ef9400 2024-09-13T23:58:02.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.292+0000 7fef0c029f40 20 remove_watcher() i=0 2024-09-13T23:58:02.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.292+0000 7fef0c029f40 2 removed watcher, disabling cache 2024-09-13T23:58:02.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.292+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93896338210688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f204ec00 con 0x5565f1ef9000 2024-09-13T23:58:02.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.296+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93896338210688] v35'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1ef9000 2024-09-13T23:58:02.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.296+0000 7fef0c029f40 20 remove_watcher() i=1 2024-09-13T23:58:02.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.296+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93896338211840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f204f000 con 0x5565f1ef9400 2024-09-13T23:58:02.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.300+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93896338211840] v35'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5565f1fab200 con 0x5565f1ef9400 2024-09-13T23:58:02.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.300+0000 7fef0c029f40 20 remove_watcher() i=2 2024-09-13T23:58:02.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.300+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93896338212992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f204f400 con 0x5565f1fb6000 2024-09-13T23:58:02.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.300+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93896338212992] v35'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1fb6000 2024-09-13T23:58:02.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.300+0000 7fef0c029f40 20 remove_watcher() i=3 2024-09-13T23:58:02.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.300+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93896338214144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f204f800 con 0x5565f1ef9400 2024-09-13T23:58:02.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.304+0000 7fef0a7e2700 1 -- 172.21.15.173:0/963087645 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93896338214144] v35'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5565f1fab200 con 0x5565f1ef9400 2024-09-13T23:58:02.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.304+0000 7fef0c029f40 20 remove_watcher() i=4 2024-09-13T23:58:02.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.304+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93896338215296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f204fc00 con 0x5565f1ef9c00 2024-09-13T23:58:02.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.308+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93896338215296] v35'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5565f1fab440 con 0x5565f1ef9c00 2024-09-13T23:58:02.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.308+0000 7fef0c029f40 20 remove_watcher() i=5 2024-09-13T23:58:02.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.308+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93896338216448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f204fc00 con 0x5565f1ef9c00 2024-09-13T23:58:02.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.308+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93896338216448] v35'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5565f1fab440 con 0x5565f1ef9c00 2024-09-13T23:58:02.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.308+0000 7fef0c029f40 20 remove_watcher() i=6 2024-09-13T23:58:02.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.308+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93896338217600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x5565f204e400 con 0x5565f1fb6000 2024-09-13T23:58:02.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.312+0000 7fef0afe3700 1 -- 172.21.15.173:0/963087645 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93896338217600] v35'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5565f1faab40 con 0x5565f1fb6000 2024-09-13T23:58:02.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.312+0000 7fef0c029f40 20 remove_watcher() i=7 2024-09-13T23:58:02.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.312+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5565f1ef9400 msgr2=0x5565f1e31b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.312+0000 7fef0c029f40 1 --2- 172.21.15.173:0/963087645 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5565f1ef9400 0x5565f1e31b80 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.312+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5565f1ef9000 msgr2=0x5565f1e31600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.312+0000 7fef0c029f40 1 --2- 172.21.15.173:0/963087645 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5565f1ef9000 0x5565f1e31600 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.312+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5565f1fb6000 msgr2=0x5565f1e30580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.312+0000 7fef0c029f40 1 --2- 172.21.15.173:0/963087645 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5565f1fb6000 0x5565f1e30580 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.312+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5565f1ef9c00 msgr2=0x5565f1e32c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.312+0000 7fef0c029f40 1 --2- 172.21.15.173:0/963087645 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5565f1ef9c00 0x5565f1e32c00 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.312+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5565f1ef8c00 msgr2=0x5565f1e32680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.312+0000 7fef0c029f40 1 --2- 172.21.15.173:0/963087645 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5565f1ef8c00 0x5565f1e32680 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x5565f1e2b920 tx=0x5565f1c4f800 comp rx=0 tx=0).stop 2024-09-13T23:58:02.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.312+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4bc00 msgr2=0x5565f1e31080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.312+0000 7fef09fe1700 1 -- 172.21.15.173:0/963087645 reap_dead start 2024-09-13T23:58:02.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.312+0000 7fef0c029f40 1 --2- 172.21.15.173:0/963087645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4bc00 0x5565f1e31080 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x5565f29bc6c0 tx=0x5565f1eaecc0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.312+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 shutdown_connections 2024-09-13T23:58:02.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.312+0000 7fef0c029f40 1 --2- 172.21.15.173:0/963087645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4bc00 0x5565f1e31080 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.312+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 >> 172.21.15.173:0/963087645 conn(0x5565f1b4b800 msgr2=0x5565f1c4b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.312+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 shutdown_connections 2024-09-13T23:58:02.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.312+0000 7fef0c029f40 1 -- 172.21.15.173:0/963087645 wait complete. 2024-09-13T23:58:02.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.312+0000 7fef0c029f40 1 -- 172.21.15.173:0/569871957 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5565f204e000 msgr2=0x5565f2054000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.312+0000 7fef0c029f40 1 --2- 172.21.15.173:0/569871957 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5565f204e000 0x5565f2054000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x5565f1f59980 tx=0x5565f1f9b5c0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.316+0000 7fef0c029f40 1 -- 172.21.15.173:0/569871957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1fb6c00 msgr2=0x5565f1e33700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.316+0000 7fef0c029f40 1 --2- 172.21.15.173:0/569871957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1fb6c00 0x5565f1e33700 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x5565f1fcc900 tx=0x5565f1f9a5a0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.316+0000 7fef0c029f40 1 -- 172.21.15.173:0/569871957 shutdown_connections 2024-09-13T23:58:02.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.316+0000 7fef0c029f40 1 --2- 172.21.15.173:0/569871957 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5565f204e000 0x5565f2054000 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.316+0000 7fef0c029f40 1 --2- 172.21.15.173:0/569871957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1fb6c00 0x5565f1e33700 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.316+0000 7fef0c029f40 1 -- 172.21.15.173:0/569871957 >> 172.21.15.173:0/569871957 conn(0x5565f1e95c00 msgr2=0x5565f1c4c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.316+0000 7fef0c029f40 1 -- 172.21.15.173:0/569871957 shutdown_connections 2024-09-13T23:58:02.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.316+0000 7fef0c029f40 1 -- 172.21.15.173:0/569871957 wait complete. 2024-09-13T23:58:02.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.316+0000 7fef0c029f40 1 -- 172.21.15.173:0/1649508411 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5565f1ef8000 msgr2=0x5565f1e32100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.316+0000 7fef0c029f40 1 --2- 172.21.15.173:0/1649508411 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5565f1ef8000 0x5565f1e32100 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x5565f29bd560 tx=0x5565f1eae240 comp rx=0 tx=0).stop 2024-09-13T23:58:02.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.316+0000 7fef0c029f40 1 -- 172.21.15.173:0/1649508411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4b400 msgr2=0x5565f1e30b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.316+0000 7fef0c029f40 1 --2- 172.21.15.173:0/1649508411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4b400 0x5565f1e30b00 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x5565f1ca7f80 tx=0x5565f1c4fa40 comp rx=0 tx=0).stop 2024-09-13T23:58:02.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.316+0000 7fef0c029f40 1 -- 172.21.15.173:0/1649508411 shutdown_connections 2024-09-13T23:58:02.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.316+0000 7fef0c029f40 1 --2- 172.21.15.173:0/1649508411 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5565f1ef8000 0x5565f1e32100 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.316+0000 7fef0c029f40 1 --2- 172.21.15.173:0/1649508411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5565f1b4b400 0x5565f1e30b00 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.316+0000 7fef0c029f40 1 -- 172.21.15.173:0/1649508411 >> 172.21.15.173:0/1649508411 conn(0x5565f1b4ac00 msgr2=0x5565f1c4b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.316+0000 7fef0c029f40 1 -- 172.21.15.173:0/1649508411 shutdown_connections 2024-09-13T23:58:02.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.316+0000 7fef0c029f40 1 -- 172.21.15.173:0/1649508411 wait complete. 2024-09-13T23:58:02.321 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:58:02.321 INFO:teuthology.orchestra.run.smithi173.stdout: "entries": [ 2024-09-13T23:58:02.321 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:02.321 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:58:02.321 INFO:teuthology.orchestra.run.smithi173.stdout: "buckets": [ 2024-09-13T23:58:02.321 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:02.321 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "", 2024-09-13T23:58:02.321 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:02.322 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:02.322 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:02.322 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [] 2024-09-13T23:58:02.322 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:02.322 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:02.322 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo", 2024-09-13T23:58:02.322 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:02.322 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:02.322 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:02.322 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:02.322 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:02.322 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "delete_bucket", 2024-09-13T23:58:02.322 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 236, 2024-09-13T23:58:02.322 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:02.323 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 2, 2024-09-13T23:58:02.323 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:02.323 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:02.323 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:02.323 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:02.323 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:02.323 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo2", 2024-09-13T23:58:02.323 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:02.323 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:02.323 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:02.323 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:02.323 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:02.323 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "delete_bucket", 2024-09-13T23:58:02.323 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:02.324 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:02.324 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:02.324 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:02.324 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:02.324 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:02.324 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:02.324 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:02.324 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo3", 2024-09-13T23:58:02.324 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:02.324 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:02.324 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:02.324 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:02.324 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:02.324 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "delete_bucket", 2024-09-13T23:58:02.325 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:02.325 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:02.325 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:02.325 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:02.325 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:02.325 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:02.325 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:02.325 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:02.325 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket": "myfoo4", 2024-09-13T23:58:02.325 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2024-09-13T23:00:00.000000Z", 2024-09-13T23:58:02.325 INFO:teuthology.orchestra.run.smithi173.stdout: "epoch": 1726268400, 2024-09-13T23:58:02.325 INFO:teuthology.orchestra.run.smithi173.stdout: "owner": "foo", 2024-09-13T23:58:02.325 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:02.325 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:02.326 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "delete_bucket", 2024-09-13T23:58:02.326 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 0, 2024-09-13T23:58:02.326 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:02.326 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 1, 2024-09-13T23:58:02.326 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 1 2024-09-13T23:58:02.326 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:02.326 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:02.326 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:02.326 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:02.326 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:02.326 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:02.326 INFO:teuthology.orchestra.run.smithi173.stdout: "summary": [ 2024-09-13T23:58:02.326 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:02.327 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "foo", 2024-09-13T23:58:02.327 INFO:teuthology.orchestra.run.smithi173.stdout: "categories": [ 2024-09-13T23:58:02.327 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:02.327 INFO:teuthology.orchestra.run.smithi173.stdout: "category": "delete_bucket", 2024-09-13T23:58:02.327 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 236, 2024-09-13T23:58:02.327 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:02.327 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 5, 2024-09-13T23:58:02.327 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 4 2024-09-13T23:58:02.327 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:02.327 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:02.327 INFO:teuthology.orchestra.run.smithi173.stdout: "total": { 2024-09-13T23:58:02.327 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_sent": 236, 2024-09-13T23:58:02.327 INFO:teuthology.orchestra.run.smithi173.stdout: "bytes_received": 0, 2024-09-13T23:58:02.327 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": 5, 2024-09-13T23:58:02.328 INFO:teuthology.orchestra.run.smithi173.stdout: "successful_ops": 4 2024-09-13T23:58:02.328 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:02.328 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:02.328 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:02.328 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:58:02.329 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-09-13T23:58:02.329 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-13T23:58:02.329 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-13T23:58:02.329 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-13T23:58:02.379 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:58:02.380 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:58:02.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.376+0000 7f52538a8f40 1 Processor -- start 2024-09-13T23:58:02.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.376+0000 7f52538a8f40 1 -- start start 2024-09-13T23:58:02.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.376+0000 7f52538a8f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55b492be9000 0x55b492ece580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.376+0000 7f52538a8f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b492cad500 con 0x55b492be9400 2024-09-13T23:58:02.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.376+0000 7f52538a8f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b492c76a00 con 0x55b492be9000 2024-09-13T23:58:02.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.376+0000 7f5252061700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55b492be9000 0x55b492ece580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.376+0000 7f5251860700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55b492be9400 0x55b492ce8800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:38652/0 (socket says 172.21.15.173:38652) 2024-09-13T23:58:02.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.376+0000 7f5252061700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55b492be9000 0x55b492ece580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49812/0 (socket says 172.21.15.173:49812) 2024-09-13T23:58:02.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.376+0000 7f5251860700 1 -- 172.21.15.173:0/3470743855 learned_addr learned my addr 172.21.15.173:0/3470743855 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:58:02.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.380+0000 7f5252061700 1 -- 172.21.15.173:0/3470743855 >> v1:172.21.15.87:6789/0 conn(0x55b492be9400 legacy=0x55b492ce8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.380+0000 7f5252061700 1 -- 172.21.15.173:0/3470743855 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b492bfbd40 con 0x55b492be9000 2024-09-13T23:58:02.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.380+0000 7f5252061700 1 --2- 172.21.15.173:0/3470743855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9000 0x55b492ece580 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x55b492ec9a70 tx=0x55b492ced920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a60d2b42bd0a8fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.380+0000 7f525105f700 1 -- 172.21.15.173:0/3470743855 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b492c8d4a0 con 0x55b492be9000 2024-09-13T23:58:02.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.380+0000 7f525105f700 1 -- 172.21.15.173:0/3470743855 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b492cad800 con 0x55b492be9000 2024-09-13T23:58:02.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.380+0000 7f525105f700 1 -- 172.21.15.173:0/3470743855 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b492c8d600 con 0x55b492be9000 2024-09-13T23:58:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.380+0000 7f52538a8f40 1 -- 172.21.15.173:0/3470743855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9000 msgr2=0x55b492ece580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.380+0000 7f52538a8f40 1 --2- 172.21.15.173:0/3470743855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9000 0x55b492ece580 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x55b492ec9a70 tx=0x55b492ced920 comp rx=0 tx=0).stop 2024-09-13T23:58:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.380+0000 7f52538a8f40 1 -- 172.21.15.173:0/3470743855 shutdown_connections 2024-09-13T23:58:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.380+0000 7f52538a8f40 1 --2- 172.21.15.173:0/3470743855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9000 0x55b492ece580 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.380+0000 7f52538a8f40 1 -- 172.21.15.173:0/3470743855 >> 172.21.15.173:0/3470743855 conn(0x55b492be8c00 msgr2=0x55b492ce8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.380+0000 7f52538a8f40 1 -- 172.21.15.173:0/3470743855 shutdown_connections 2024-09-13T23:58:02.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.380+0000 7f52538a8f40 1 -- 172.21.15.173:0/3470743855 wait complete. 2024-09-13T23:58:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.384+0000 7f52538a8f40 1 Processor -- start 2024-09-13T23:58:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.384+0000 7f52538a8f40 1 -- start start 2024-09-13T23:58:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.384+0000 7f52538a8f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9000 0x55b492ece580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.384+0000 7f52538a8f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b492c76500 con 0x55b492be9000 2024-09-13T23:58:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.384+0000 7f5252061700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9000 0x55b492ece580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.384+0000 7f5252061700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9000 0x55b492ece580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49818/0 (socket says 172.21.15.173:49818) 2024-09-13T23:58:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.384+0000 7f5252061700 1 -- 172.21.15.173:0/2700790248 learned_addr learned my addr 172.21.15.173:0/2700790248 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.384+0000 7f5252061700 1 -- 172.21.15.173:0/2700790248 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b492bfbba0 con 0x55b492be9000 2024-09-13T23:58:02.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.384+0000 7f5252061700 1 --2- 172.21.15.173:0/2700790248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9000 0x55b492ece580 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x55b492d44120 tx=0x55b492ced800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89250cab9a33c44b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.384+0000 7f525085e700 1 -- 172.21.15.173:0/2700790248 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b492c8d760 con 0x55b492be9000 2024-09-13T23:58:02.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.384+0000 7f525085e700 1 -- 172.21.15.173:0/2700790248 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b492cadb00 con 0x55b492be9000 2024-09-13T23:58:02.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.384+0000 7f525085e700 1 -- 172.21.15.173:0/2700790248 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b492c8d4a0 con 0x55b492be9000 2024-09-13T23:58:02.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.384+0000 7f52538a8f40 1 -- 172.21.15.173:0/2700790248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9000 msgr2=0x55b492ece580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.384+0000 7f52538a8f40 1 --2- 172.21.15.173:0/2700790248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9000 0x55b492ece580 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x55b492d44120 tx=0x55b492ced800 comp rx=0 tx=0).stop 2024-09-13T23:58:02.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.384+0000 7f52538a8f40 1 -- 172.21.15.173:0/2700790248 shutdown_connections 2024-09-13T23:58:02.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.384+0000 7f52538a8f40 1 --2- 172.21.15.173:0/2700790248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9000 0x55b492ece580 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.384+0000 7f52538a8f40 1 -- 172.21.15.173:0/2700790248 >> 172.21.15.173:0/2700790248 conn(0x55b492be8c00 msgr2=0x55b492ce9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.384+0000 7f52538a8f40 1 -- 172.21.15.173:0/2700790248 shutdown_connections 2024-09-13T23:58:02.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.388+0000 7f52538a8f40 1 -- 172.21.15.173:0/2700790248 wait complete. 2024-09-13T23:58:02.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.388+0000 7f52538a8f40 1 Processor -- start 2024-09-13T23:58:02.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.388+0000 7f52538a8f40 1 -- start start 2024-09-13T23:58:02.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.388+0000 7f52538a8f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9000 0x55b492ece580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.388+0000 7f52538a8f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b492c763c0 con 0x55b492be9000 2024-09-13T23:58:02.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.388+0000 7f5252061700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9000 0x55b492ece580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.388+0000 7f5252061700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9000 0x55b492ece580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49832/0 (socket says 172.21.15.173:49832) 2024-09-13T23:58:02.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.388+0000 7f5252061700 1 -- 172.21.15.173:0/2693863033 learned_addr learned my addr 172.21.15.173:0/2693863033 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:02.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.388+0000 7f5252061700 1 -- 172.21.15.173:0/2693863033 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b492bfba00 con 0x55b492be9000 2024-09-13T23:58:02.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.388+0000 7f5252061700 1 --2- 172.21.15.173:0/2693863033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9000 0x55b492ece580 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x55b492d45f50 tx=0x55b492ced920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.388+0000 7f524f05b700 1 -- 172.21.15.173:0/2693863033 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b492c8d600 con 0x55b492be9000 2024-09-13T23:58:02.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.388+0000 7f524f05b700 1 -- 172.21.15.173:0/2693863033 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b492cadc80 con 0x55b492be9000 2024-09-13T23:58:02.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.388+0000 7f524f05b700 1 -- 172.21.15.173:0/2693863033 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b492c8d8c0 con 0x55b492be9000 2024-09-13T23:58:02.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.388+0000 7f52538a8f40 1 -- 172.21.15.173:0/2693863033 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b492bfb860 con 0x55b492be9000 2024-09-13T23:58:02.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.388+0000 7f52538a8f40 1 -- 172.21.15.173:0/2693863033 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b492bfb6c0 con 0x55b492be9000 2024-09-13T23:58:02.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.392+0000 7f52538a8f40 1 Processor -- start 2024-09-13T23:58:02.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.392+0000 7f524f05b700 1 -- 172.21.15.173:0/2693863033 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55b492ce2b00 con 0x55b492be9000 2024-09-13T23:58:02.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.392+0000 7f52538a8f40 1 -- start start 2024-09-13T23:58:02.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.392+0000 7f524f05b700 1 --2- 172.21.15.173:0/2693863033 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b492f88000 0x55b492ecf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.392+0000 7f524f05b700 1 -- 172.21.15.173:0/2693863033 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55b492c4f180 con 0x55b492be9000 2024-09-13T23:58:02.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.392+0000 7f52538a8f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9800 0x55b492eceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.392+0000 7f52538a8f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b492c0e640 con 0x55b492be9800 2024-09-13T23:58:02.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.392+0000 7f5252862700 1 --2- 172.21.15.173:0/2693863033 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b492f88000 0x55b492ecf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.392+0000 7f5252061700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9800 0x55b492eceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.392+0000 7f5252061700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9800 0x55b492eceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49844/0 (socket says 172.21.15.173:49844) 2024-09-13T23:58:02.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.392+0000 7f5252061700 1 -- 172.21.15.173:0/1048066045 learned_addr learned my addr 172.21.15.173:0/1048066045 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:02.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.392+0000 7f5252061700 1 -- 172.21.15.173:0/1048066045 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b492bfa000 con 0x55b492be9800 2024-09-13T23:58:02.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.392+0000 7f5252862700 1 --2- 172.21.15.173:0/2693863033 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b492f88000 0x55b492ecf080 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55b492f0c8d0 tx=0x55b492f4cb40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.392+0000 7f5252061700 1 --2- 172.21.15.173:0/1048066045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9800 0x55b492eceb00 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x55b492f0cf60 tx=0x55b492f4cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34ce6478e13dbdd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.392+0000 7f524c856700 1 -- 172.21.15.173:0/1048066045 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b492c8d600 con 0x55b492be9800 2024-09-13T23:58:02.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.392+0000 7f524c856700 1 -- 172.21.15.173:0/1048066045 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b492cadc80 con 0x55b492be9800 2024-09-13T23:58:02.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.392+0000 7f524c856700 1 -- 172.21.15.173:0/1048066045 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b492c8d8c0 con 0x55b492be9800 2024-09-13T23:58:02.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.396+0000 7f52538a8f40 1 -- 172.21.15.173:0/1048066045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9800 msgr2=0x55b492eceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.396+0000 7f52538a8f40 1 --2- 172.21.15.173:0/1048066045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9800 0x55b492eceb00 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x55b492f0cf60 tx=0x55b492f4cc60 comp rx=0 tx=0).stop 2024-09-13T23:58:02.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.396+0000 7f52538a8f40 1 -- 172.21.15.173:0/1048066045 shutdown_connections 2024-09-13T23:58:02.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.396+0000 7f52538a8f40 1 --2- 172.21.15.173:0/1048066045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9800 0x55b492eceb00 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.396+0000 7f52538a8f40 1 -- 172.21.15.173:0/1048066045 >> 172.21.15.173:0/1048066045 conn(0x55b492be9400 msgr2=0x55b492ce9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.396+0000 7f52538a8f40 1 -- 172.21.15.173:0/1048066045 shutdown_connections 2024-09-13T23:58:02.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.396+0000 7f52538a8f40 1 -- 172.21.15.173:0/1048066045 wait complete. 2024-09-13T23:58:02.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.396+0000 7f52538a8f40 1 Processor -- start 2024-09-13T23:58:02.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.396+0000 7f52538a8f40 1 -- start start 2024-09-13T23:58:02.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.396+0000 7f52538a8f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9800 0x55b492eceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.396+0000 7f52538a8f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b492c0e8c0 con 0x55b492be9800 2024-09-13T23:58:02.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.396+0000 7f5252061700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9800 0x55b492eceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.396+0000 7f5252061700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9800 0x55b492eceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49856/0 (socket says 172.21.15.173:49856) 2024-09-13T23:58:02.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.396+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 learned_addr learned my addr 172.21.15.173:0/2892839207 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:02.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.396+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b492bfaea0 con 0x55b492be9800 2024-09-13T23:58:02.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.396+0000 7f5252061700 1 --2- 172.21.15.173:0/2892839207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9800 0x55b492eceb00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x55b492f0c180 tx=0x55b492f4ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.396+0000 7f524b053700 1 -- 172.21.15.173:0/2892839207 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b492c8d760 con 0x55b492be9800 2024-09-13T23:58:02.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.396+0000 7f524b053700 1 -- 172.21.15.173:0/2892839207 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b492fa8000 con 0x55b492be9800 2024-09-13T23:58:02.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.396+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b492bfa820 con 0x55b492be9800 2024-09-13T23:58:02.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.396+0000 7f524b053700 1 -- 172.21.15.173:0/2892839207 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b492c8d4a0 con 0x55b492be9800 2024-09-13T23:58:02.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.396+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b492bfa9c0 con 0x55b492be9800 2024-09-13T23:58:02.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f52538a8f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f524b053700 1 -- 172.21.15.173:0/2892839207 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55b492ce2dc0 con 0x55b492be9800 2024-09-13T23:58:02.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f524b053700 1 --2- 172.21.15.173:0/2892839207 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b492f89000 0x55b492ecf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f524b053700 1 -- 172.21.15.173:0/2892839207 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55b492c4f340 con 0x55b492be9800 2024-09-13T23:58:02.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f5251860700 1 --2- 172.21.15.173:0/2892839207 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b492f89000 0x55b492ecf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f52538a8f40 1 --2- 172.21.15.173:0/2892839207 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55b492f89400 0x55b492ecfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b492f89800 con 0x55b492f89400 2024-09-13T23:58:02.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f5252862700 1 --2- 172.21.15.173:0/2892839207 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55b492f89400 0x55b492ecfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f5251860700 1 --2- 172.21.15.173:0/2892839207 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b492f89000 0x55b492ecf600 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55b492f73f50 tx=0x55b493014000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f5252862700 1 --2- 172.21.15.173:0/2892839207 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55b492f89400 0x55b492ecfb80 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55b492fecb40 con 0x55b492f89400 2024-09-13T23:58:02.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f52538a8f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f52538a8f40 20 realm 2024-09-13T23:58:02.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f52538a8f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b492f89c00 con 0x55b492f89400 2024-09-13T23:58:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55b492fecb40 con 0x55b492f89400 2024-09-13T23:58:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f52538a8f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f52538a8f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:58:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f52538a8f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b492f89800 con 0x55b492f89400 2024-09-13T23:58:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55b492fecb40 con 0x55b492f89400 2024-09-13T23:58:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f52538a8f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f52538a8f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f52538a8f40 1 --2- 172.21.15.173:0/2892839207 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55b492f89c00 0x55b492ed0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.400+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b492f89c00 2024-09-13T23:58:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.404+0000 7f5252061700 1 --2- 172.21.15.173:0/2892839207 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55b492f89c00 0x55b492ed0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.404+0000 7f5252061700 1 --2- 172.21.15.173:0/2892839207 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55b492f89c00 0x55b492ed0100 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.404+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55b492fed200 con 0x55b492f89c00 2024-09-13T23:58:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.404+0000 7f52538a8f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.404+0000 7f52538a8f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.404+0000 7f52538a8f40 1 --2- 172.21.15.173:0/2892839207 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55b493026400 0x55b492ed0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.404+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026800 con 0x55b493026400 2024-09-13T23:58:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.404+0000 7f5251860700 1 --2- 172.21.15.173:0/2892839207 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55b493026400 0x55b492ed0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.404+0000 7f5251860700 1 --2- 172.21.15.173:0/2892839207 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55b493026400 0x55b492ed0680 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.404+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55b492fed440 con 0x55b493026400 2024-09-13T23:58:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.404+0000 7f52538a8f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:58:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.404+0000 7f52538a8f40 20 searching for the correct realm 2024-09-13T23:58:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.404+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026c00 con 0x55b493026400 2024-09-13T23:58:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.404+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55b492fed440 con 0x55b493026400 2024-09-13T23:58:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.408+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026800 con 0x55b492f89c00 2024-09-13T23:58:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.408+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fed200 con 0x55b492f89c00 2024-09-13T23:58:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.408+0000 7f5252061700 1 --2- 172.21.15.173:0/2892839207 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55b493026800 0x55b492ed0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.408+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b493026800 2024-09-13T23:58:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.408+0000 7f5252862700 1 --2- 172.21.15.173:0/2892839207 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55b493026800 0x55b492ed0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.408+0000 7f5252862700 1 --2- 172.21.15.173:0/2892839207 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55b493026800 0x55b492ed0c00 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.408+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fecb40 con 0x55b493026800 2024-09-13T23:58:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.408+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b493026800 2024-09-13T23:58:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.408+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55b492fecb40 con 0x55b493026800 2024-09-13T23:58:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.408+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b492f89400 2024-09-13T23:58:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.408+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fecb40 con 0x55b492f89400 2024-09-13T23:58:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.408+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b493026400 2024-09-13T23:58:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.408+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fed440 con 0x55b493026400 2024-09-13T23:58:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.408+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b492f89400 2024-09-13T23:58:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.408+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fecb40 con 0x55b492f89400 2024-09-13T23:58:02.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.412+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b492f89c00 2024-09-13T23:58:02.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.412+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fed200 con 0x55b492f89c00 2024-09-13T23:58:02.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.412+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b492f89c00 2024-09-13T23:58:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.412+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fed200 con 0x55b492f89c00 2024-09-13T23:58:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.412+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b492f89400 2024-09-13T23:58:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.412+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fecb40 con 0x55b492f89400 2024-09-13T23:58:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.412+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b493026800 2024-09-13T23:58:02.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.412+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fecb40 con 0x55b493026800 2024-09-13T23:58:02.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.412+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b492f89400 2024-09-13T23:58:02.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.412+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fecb40 con 0x55b492f89400 2024-09-13T23:58:02.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.412+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b493026800 2024-09-13T23:58:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.412+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fecb40 con 0x55b493026800 2024-09-13T23:58:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.412+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b492f89c00 2024-09-13T23:58:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.416+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fed200 con 0x55b492f89c00 2024-09-13T23:58:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.416+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b493026400 2024-09-13T23:58:02.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.416+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fed440 con 0x55b493026400 2024-09-13T23:58:02.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.416+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b492f89400 2024-09-13T23:58:02.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.416+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fecb40 con 0x55b492f89400 2024-09-13T23:58:02.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.416+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b492f89c00 2024-09-13T23:58:02.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.416+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fed200 con 0x55b492f89c00 2024-09-13T23:58:02.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.416+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b493026400 2024-09-13T23:58:02.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.416+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fed440 con 0x55b493026400 2024-09-13T23:58:02.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.416+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b492f89400 2024-09-13T23:58:02.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.416+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fecb40 con 0x55b492f89400 2024-09-13T23:58:02.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.416+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b492f89400 2024-09-13T23:58:02.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.416+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fecb40 con 0x55b492f89400 2024-09-13T23:58:02.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.416+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b492f89400 2024-09-13T23:58:02.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.420+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fecb40 con 0x55b492f89400 2024-09-13T23:58:02.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.420+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b493026400 2024-09-13T23:58:02.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.420+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fed440 con 0x55b493026400 2024-09-13T23:58:02.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.420+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b493026800 2024-09-13T23:58:02.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.420+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fecb40 con 0x55b493026800 2024-09-13T23:58:02.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.420+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b492f89400 2024-09-13T23:58:02.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.420+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fecb40 con 0x55b492f89400 2024-09-13T23:58:02.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.420+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b493026800 2024-09-13T23:58:02.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.420+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fecb40 con 0x55b493026800 2024-09-13T23:58:02.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.420+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b493026400 2024-09-13T23:58:02.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.420+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fed440 con 0x55b493026400 2024-09-13T23:58:02.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.420+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b493026800 2024-09-13T23:58:02.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.420+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fecb40 con 0x55b493026800 2024-09-13T23:58:02.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.420+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b492f89c00 2024-09-13T23:58:02.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.424+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fed200 con 0x55b492f89c00 2024-09-13T23:58:02.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.424+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b492f89c00 2024-09-13T23:58:02.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.424+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fed200 con 0x55b492f89c00 2024-09-13T23:58:02.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.424+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b493026400 2024-09-13T23:58:02.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.424+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fed440 con 0x55b493026400 2024-09-13T23:58:02.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.424+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b492f89c00 2024-09-13T23:58:02.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.424+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55b492fed200 con 0x55b492f89c00 2024-09-13T23:58:02.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.424+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b492f89c00 2024-09-13T23:58:02.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.424+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b492fed200 con 0x55b492f89c00 2024-09-13T23:58:02.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.424+0000 7f52538a8f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:58:02.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.424+0000 7f52538a8f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:58:02.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.424+0000 7f52538a8f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:58:02.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.424+0000 7f52538a8f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:58:02.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.424+0000 7f52538a8f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.424+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493027000 con 0x55b492f89400 2024-09-13T23:58:02.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55b492fecb40 con 0x55b492f89400 2024-09-13T23:58:02.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493027400 con 0x55b492f89c00 2024-09-13T23:58:02.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55b492fed200 con 0x55b492f89c00 2024-09-13T23:58:02.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:02.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493027800 con 0x55b493026800 2024-09-13T23:58:02.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55b492fecb40 con 0x55b493026800 2024-09-13T23:58:02.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:58:02.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 20 zone default found 2024-09-13T23:58:02.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 4 Realm: () 2024-09-13T23:58:02.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:58:02.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:58:02.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:58:02.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 20 zonegroup default 2024-09-13T23:58:02.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493027c00 con 0x55b493026800 2024-09-13T23:58:02.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55b492fecb40 con 0x55b493026800 2024-09-13T23:58:02.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493027000 con 0x55b493026400 2024-09-13T23:58:02.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55b492fed440 con 0x55b493026400 2024-09-13T23:58:02.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493027800 con 0x55b493026400 2024-09-13T23:58:02.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55b492fed440 con 0x55b493026400 2024-09-13T23:58:02.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 20 started sync module instance, tier type = 2024-09-13T23:58:02.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:58:02.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.428+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b492f89800 con 0x55b492f89c00 2024-09-13T23:58:02.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.432+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v35'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fed200 con 0x55b492f89c00 2024-09-13T23:58:02.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.432+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94234047437568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b492f88800 con 0x55b492f89c00 2024-09-13T23:58:02.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.432+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b492f89800 con 0x55b492f89400 2024-09-13T23:58:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.436+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v35'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fecb40 con 0x55b492f89400 2024-09-13T23:58:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.436+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94234047438720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026000 con 0x55b492f89400 2024-09-13T23:58:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.436+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94234047437568] v35'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fed200 con 0x55b492f89c00 2024-09-13T23:58:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.436+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493027400 con 0x55b492f89c00 2024-09-13T23:58:02.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.440+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94234047438720] v35'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fecb40 con 0x55b492f89400 2024-09-13T23:58:02.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.440+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v35'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fed200 con 0x55b492f89c00 2024-09-13T23:58:02.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.440+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94234047439872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b49302e000 con 0x55b492f89c00 2024-09-13T23:58:02.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.440+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b49302e400 con 0x55b493026800 2024-09-13T23:58:02.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.444+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94234047439872] v35'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fed200 con 0x55b492f89c00 2024-09-13T23:58:02.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.444+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v35'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fecb40 con 0x55b493026800 2024-09-13T23:58:02.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.444+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94234047441024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b49302e800 con 0x55b493026800 2024-09-13T23:58:02.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.444+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b49302ec00 con 0x55b492f89c00 2024-09-13T23:58:02.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.444+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v35'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fed200 con 0x55b492f89c00 2024-09-13T23:58:02.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.444+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94234047442176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b49302f000 con 0x55b492f89c00 2024-09-13T23:58:02.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.444+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b49302f400 con 0x55b493026400 2024-09-13T23:58:02.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.448+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94234047441024] v35'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fecb40 con 0x55b493026800 2024-09-13T23:58:02.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.448+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v35'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fed440 con 0x55b493026400 2024-09-13T23:58:02.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.448+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94234047443328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b49302f800 con 0x55b493026400 2024-09-13T23:58:02.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.448+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b49302fc00 con 0x55b493026400 2024-09-13T23:58:02.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.448+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94234047442176] v35'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fed200 con 0x55b492f89c00 2024-09-13T23:58:02.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.448+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94234047443328] v35'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fed440 con 0x55b493026400 2024-09-13T23:58:02.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.448+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v35'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fed440 con 0x55b493026400 2024-09-13T23:58:02.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.448+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94234047444480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b49302f400 con 0x55b493026400 2024-09-13T23:58:02.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.448+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b49302e000 con 0x55b493026800 2024-09-13T23:58:02.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.452+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94234047444480] v35'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fed440 con 0x55b493026400 2024-09-13T23:58:02.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.452+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v35'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fecb40 con 0x55b493026800 2024-09-13T23:58:02.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.452+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94234047445632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b49302ec00 con 0x55b493026800 2024-09-13T23:58:02.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.452+0000 7f52538a8f40 20 add_watcher() i=0 2024-09-13T23:58:02.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.452+0000 7f52538a8f40 20 add_watcher() i=1 2024-09-13T23:58:02.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.452+0000 7f52538a8f40 20 add_watcher() i=2 2024-09-13T23:58:02.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.452+0000 7f52538a8f40 20 add_watcher() i=3 2024-09-13T23:58:02.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.452+0000 7f52538a8f40 20 add_watcher() i=4 2024-09-13T23:58:02.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.452+0000 7f52538a8f40 20 add_watcher() i=5 2024-09-13T23:58:02.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.452+0000 7f52538a8f40 20 add_watcher() i=6 2024-09-13T23:58:02.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.452+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94234047445632] v35'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fecb40 con 0x55b493026800 2024-09-13T23:58:02.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.452+0000 7f52538a8f40 20 add_watcher() i=7 2024-09-13T23:58:02.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.452+0000 7f52538a8f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:58:02.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.452+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493026c00 con 0x55b492f89400 2024-09-13T23:58:02.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.456+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55b492fecb40 con 0x55b492f89400 2024-09-13T23:58:02.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.456+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94234048954368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493027000 con 0x55b492f89400 2024-09-13T23:58:02.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.456+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94234048954368] v35'210 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55b492fecb40 con 0x55b492f89400 2024-09-13T23:58:02.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.456+0000 7f523902f700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:02.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.456+0000 7f52538a8f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:58:02.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.456+0000 7f52538a8f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:58:02.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.456+0000 7f52538a8f40 1 Processor -- start 2024-09-13T23:58:02.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.456+0000 7f52538a8f40 1 -- start start 2024-09-13T23:58:02.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.456+0000 7f52538a8f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b493027400 0x55b492ed1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.456+0000 7f52538a8f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b492c763c0 con 0x55b493027400 2024-09-13T23:58:02.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.460+0000 7f5251860700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b493027400 0x55b492ed1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.460+0000 7f5251860700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b493027400 0x55b492ed1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49862/0 (socket says 172.21.15.173:49862) 2024-09-13T23:58:02.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.460+0000 7f5251860700 1 -- 172.21.15.173:0/1663058941 learned_addr learned my addr 172.21.15.173:0/1663058941 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:02.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.460+0000 7f5251860700 1 -- 172.21.15.173:0/1663058941 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b492bfab60 con 0x55b493027400 2024-09-13T23:58:02.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.460+0000 7f5251860700 1 --2- 172.21.15.173:0/1663058941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b493027400 0x55b492ed1180 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x55b492fc3e90 tx=0x55b492cedf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6a70304c2f0a76 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.460+0000 7f523882e700 1 -- 172.21.15.173:0/1663058941 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b493036160 con 0x55b493027400 2024-09-13T23:58:02.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.460+0000 7f523882e700 1 -- 172.21.15.173:0/1663058941 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b492fa8a80 con 0x55b493027400 2024-09-13T23:58:02.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.460+0000 7f523882e700 1 -- 172.21.15.173:0/1663058941 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b4930362c0 con 0x55b493027400 2024-09-13T23:58:02.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.460+0000 7f52538a8f40 1 -- 172.21.15.173:0/1663058941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b493027400 msgr2=0x55b492ed1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.460+0000 7f52538a8f40 1 --2- 172.21.15.173:0/1663058941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b493027400 0x55b492ed1180 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x55b492fc3e90 tx=0x55b492cedf80 comp rx=0 tx=0).stop 2024-09-13T23:58:02.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.460+0000 7f52538a8f40 1 -- 172.21.15.173:0/1663058941 shutdown_connections 2024-09-13T23:58:02.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.460+0000 7f52538a8f40 1 --2- 172.21.15.173:0/1663058941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b493027400 0x55b492ed1180 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.460+0000 7f52538a8f40 1 -- 172.21.15.173:0/1663058941 >> 172.21.15.173:0/1663058941 conn(0x55b493027800 msgr2=0x55b492cea000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.460+0000 7f52538a8f40 1 -- 172.21.15.173:0/1663058941 shutdown_connections 2024-09-13T23:58:02.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.460+0000 7f52538a8f40 1 -- 172.21.15.173:0/1663058941 wait complete. 2024-09-13T23:58:02.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.460+0000 7f52538a8f40 1 Processor -- start 2024-09-13T23:58:02.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.460+0000 7f52538a8f40 1 -- start start 2024-09-13T23:58:02.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.460+0000 7f52538a8f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b493027400 0x55b492ed1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.460+0000 7f52538a8f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b492c76500 con 0x55b493027400 2024-09-13T23:58:02.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.464+0000 7f5251860700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b493027400 0x55b492ed1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.464+0000 7f5251860700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b493027400 0x55b492ed1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49864/0 (socket says 172.21.15.173:49864) 2024-09-13T23:58:02.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.464+0000 7f5251860700 1 -- 172.21.15.173:0/3121527041 learned_addr learned my addr 172.21.15.173:0/3121527041 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:02.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.464+0000 7f5251860700 1 -- 172.21.15.173:0/3121527041 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b492bfad00 con 0x55b493027400 2024-09-13T23:58:02.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.464+0000 7f5251860700 1 --2- 172.21.15.173:0/3121527041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b493027400 0x55b492ed1180 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x55b493045260 tx=0x55b493014240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.464+0000 7f523702b700 1 -- 172.21.15.173:0/3121527041 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b493036420 con 0x55b493027400 2024-09-13T23:58:02.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.464+0000 7f523702b700 1 -- 172.21.15.173:0/3121527041 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b492fa8780 con 0x55b493027400 2024-09-13T23:58:02.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.464+0000 7f52538a8f40 1 -- 172.21.15.173:0/3121527041 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b492bfa340 con 0x55b493027400 2024-09-13T23:58:02.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.464+0000 7f523702b700 1 -- 172.21.15.173:0/3121527041 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55b493036160 con 0x55b493027400 2024-09-13T23:58:02.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.464+0000 7f52538a8f40 1 -- 172.21.15.173:0/3121527041 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b492bfab60 con 0x55b493027400 2024-09-13T23:58:02.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.464+0000 7f523702b700 1 -- 172.21.15.173:0/3121527041 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55b492ce3b80 con 0x55b493027400 2024-09-13T23:58:02.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.464+0000 7f523702b700 1 --2- 172.21.15.173:0/3121527041 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b493026c00 0x55b4930c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.464+0000 7f523702b700 1 -- 172.21.15.173:0/3121527041 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55b492c4f6c0 con 0x55b493027400 2024-09-13T23:58:02.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.464+0000 7f52538a8f40 5 note: GC not initialized 2024-09-13T23:58:02.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.464+0000 7f5252862700 1 --2- 172.21.15.173:0/3121527041 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b493026c00 0x55b4930c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.468+0000 7f5252862700 1 --2- 172.21.15.173:0/3121527041 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b493026c00 0x55b4930c4000 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55b492fc2690 tx=0x55b492f4cae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.468+0000 7f5234826700 20 reqs_thread_entry: start 2024-09-13T23:58:02.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.468+0000 7f52538a8f40 20 init_complete bucket index max shards: 11 2024-09-13T23:58:02.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.468+0000 7f52538a8f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:58:02.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.468+0000 7f5232822700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:58:32 2024 2024-09-13T23:58:02.471 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:58:02.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.468+0000 7f5232000700 20 reqs_thread_entry: start 2024-09-13T23:58:02.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.468+0000 7f52538a8f40 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-13T23:58:02.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.468+0000 7f52538a8f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.468+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b492f88800 con 0x55b493026800 2024-09-13T23:58:02.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.468+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x55b492fecb40 con 0x55b493026800 2024-09-13T23:58:02.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.468+0000 7f52538a8f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.468+0000 7f52538a8f40 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-13T23:58:02.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.468+0000 7f52538a8f40 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T23:58:02.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.468+0000 7f52538a8f40 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-13T23:58:02.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.468+0000 7f52538a8f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.468+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b492f89800 con 0x55b492f89400 2024-09-13T23:58:02.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.468+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x55b492fecb40 con 0x55b492f89400 2024-09-13T23:58:02.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.468+0000 7f52538a8f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.468+0000 7f52538a8f40 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-13T23:58:02.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.468+0000 7f52538a8f40 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T23:58:02.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.468+0000 7f52538a8f40 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-13T23:58:02.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.468+0000 7f52538a8f40 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-13T23:58:02.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.468+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b49302e800 con 0x55b493026800 2024-09-13T23:58:02.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.472+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~346] v35'4 uv4 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x55b492fecb40 con 0x55b493026800 2024-09-13T23:58:02.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.472+0000 7f52538a8f40 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-13T23:58:02.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.472+0000 7f52538a8f40 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T23:58:02.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.472+0000 7f52538a8f40 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-13T23:58:02.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.472+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94234048956672 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b49302e000 con 0x55b493026800 2024-09-13T23:58:02.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.472+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== watch-notify(notify (1) cookie 94234047445632 notify 150323855370 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x55b49312c000 con 0x55b493026800 2024-09-13T23:58:02.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.472+0000 7f524c856700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855370 cookie 94234047445632 notifier 4799 bl.length()=522 2024-09-13T23:58:02.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.472+0000 7f524c856700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-13T23:58:02.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.472+0000 7f524c856700 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T23:58:02.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.472+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(65 notify.7 [notify cookie 94234048956672 out=8b] v0'0 uv210 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55b492fecb40 con 0x55b493026800 2024-09-13T23:58:02.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.472+0000 7f524c856700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493136000 con 0x55b493026800 2024-09-13T23:58:02.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.472+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.2 v2:172.21.15.173:6809/889985573 18 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fecb40 con 0x55b493026800 2024-09-13T23:58:02.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.472+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.2 v2:172.21.15.173:6809/889985573 19 ==== watch-notify(notify_complete (2) cookie 94234048956672 notify 150323855370 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55b49312c1a0 con 0x55b493026800 2024-09-13T23:58:02.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.472+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b49302ec00 con 0x55b492f89400 2024-09-13T23:58:02.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.476+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v35'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55b492fecb40 con 0x55b492f89400 2024-09-13T23:58:02.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.476+0000 7f52538a8f40 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T23:58:02.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.476+0000 7f52538a8f40 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T23:58:02.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.476+0000 7f52538a8f40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-13T23:58:02.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.476+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94234048956672 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b49302f000 con 0x55b493026400 2024-09-13T23:58:02.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.476+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== watch-notify(notify (1) cookie 94234047443328 notify 150323855383 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55b49308cb60 con 0x55b493026400 2024-09-13T23:58:02.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.476+0000 7f524c856700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855383 cookie 94234047443328 notifier 4799 bl.length()=177 2024-09-13T23:58:02.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.476+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(68 notify.5 [notify cookie 94234048956672 out=8b] v0'0 uv210 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55b492fed440 con 0x55b493026400 2024-09-13T23:58:02.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.476+0000 7f524c856700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T23:58:02.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.476+0000 7f524c856700 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T23:58:02.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.476+0000 7f524c856700 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493136400 con 0x55b493026400 2024-09-13T23:58:02.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.476+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fed440 con 0x55b493026400 2024-09-13T23:58:02.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.476+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== watch-notify(notify_complete (2) cookie 94234048956672 notify 150323855383 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55b49308cd00 con 0x55b493026400 2024-09-13T23:58:02.481 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:58:02.481 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "bar", 2024-09-13T23:58:02.482 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Bar", 2024-09-13T23:58:02.482 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "", 2024-09-13T23:58:02.482 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:58:02.482 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:58:02.482 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [], 2024-09-13T23:58:02.482 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:58:02.482 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:02.482 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "bar", 2024-09-13T23:58:02.482 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "NX5QOQKC6BH2IDN8HC7A", 2024-09-13T23:58:02.482 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn" 2024-09-13T23:58:02.482 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:02.482 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:02.482 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [], 2024-09-13T23:58:02.482 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:58:02.483 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:58:02.483 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:58:02.483 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:58:02.483 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:58:02.483 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:58:02.483 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:58:02.483 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:58:02.483 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:58:02.483 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:58:02.483 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:58:02.483 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:02.483 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:58:02.483 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:58:02.483 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:58:02.484 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:58:02.484 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:58:02.484 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:58:02.484 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:02.484 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:58:02.484 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:58:02.484 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:58:02.484 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:58:02.484 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:58:02.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.480+0000 7f523902f700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:02.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.480+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94234048954368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b49302e400 con 0x55b492f89400 2024-09-13T23:58:02.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.480+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94234048954368] v35'211 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55b492fecb40 con 0x55b492f89400 2024-09-13T23:58:02.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.480+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94234047437568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493027000 con 0x55b492f89c00 2024-09-13T23:58:02.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.484+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94234047437568] v35'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fed200 con 0x55b492f89c00 2024-09-13T23:58:02.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.484+0000 7f52538a8f40 20 remove_watcher() i=0 2024-09-13T23:58:02.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.484+0000 7f52538a8f40 2 removed watcher, disabling cache 2024-09-13T23:58:02.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.484+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94234047438720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493136000 con 0x55b492f89400 2024-09-13T23:58:02.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.488+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94234047438720] v35'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fecb40 con 0x55b492f89400 2024-09-13T23:58:02.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.488+0000 7f52538a8f40 20 remove_watcher() i=1 2024-09-13T23:58:02.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.488+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94234047439872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493136800 con 0x55b492f89c00 2024-09-13T23:58:02.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.488+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94234047439872] v35'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fed200 con 0x55b492f89c00 2024-09-13T23:58:02.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.488+0000 7f52538a8f40 20 remove_watcher() i=2 2024-09-13T23:58:02.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.488+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94234047441024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493136c00 con 0x55b493026800 2024-09-13T23:58:02.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.492+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.2 v2:172.21.15.173:6809/889985573 20 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94234047441024] v35'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fecb40 con 0x55b493026800 2024-09-13T23:58:02.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.492+0000 7f52538a8f40 20 remove_watcher() i=3 2024-09-13T23:58:02.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.492+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94234047442176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493137000 con 0x55b492f89c00 2024-09-13T23:58:02.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.496+0000 7f5252061700 1 -- 172.21.15.173:0/2892839207 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94234047442176] v35'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fed200 con 0x55b492f89c00 2024-09-13T23:58:02.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.496+0000 7f52538a8f40 20 remove_watcher() i=4 2024-09-13T23:58:02.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.496+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94234047443328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493137400 con 0x55b493026400 2024-09-13T23:58:02.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.496+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94234047443328] v35'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fed440 con 0x55b493026400 2024-09-13T23:58:02.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.496+0000 7f52538a8f40 20 remove_watcher() i=5 2024-09-13T23:58:02.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.496+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94234047444480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493137800 con 0x55b493026400 2024-09-13T23:58:02.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.500+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 <== osd.3 v2:172.21.15.173:6800/4020038786 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94234047444480] v35'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fed440 con 0x55b493026400 2024-09-13T23:58:02.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.500+0000 7f52538a8f40 20 remove_watcher() i=6 2024-09-13T23:58:02.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.500+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94234047445632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55b493137c00 con 0x55b493026800 2024-09-13T23:58:02.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f5252862700 1 -- 172.21.15.173:0/2892839207 <== osd.2 v2:172.21.15.173:6809/889985573 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94234047445632] v35'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55b492fecb40 con 0x55b493026800 2024-09-13T23:58:02.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 20 remove_watcher() i=7 2024-09-13T23:58:02.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55b492f89c00 msgr2=0x55b492ed0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 --2- 172.21.15.173:0/2892839207 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55b492f89c00 0x55b492ed0100 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55b492f89400 msgr2=0x55b492ecfb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 --2- 172.21.15.173:0/2892839207 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55b492f89400 0x55b492ecfb80 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55b493026800 msgr2=0x55b492ed0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 --2- 172.21.15.173:0/2892839207 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55b493026800 0x55b492ed0c00 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55b493026400 msgr2=0x55b492ed0680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 --2- 172.21.15.173:0/2892839207 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55b493026400 0x55b492ed0680 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b492f89000 msgr2=0x55b492ecf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 --2- 172.21.15.173:0/2892839207 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b492f89000 0x55b492ecf600 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55b492f73f50 tx=0x55b493014000 comp rx=0 tx=0).stop 2024-09-13T23:58:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9800 msgr2=0x55b492eceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 --2- 172.21.15.173:0/2892839207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9800 0x55b492eceb00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x55b492f0c180 tx=0x55b492f4ce40 comp rx=0 tx=0).stop 2024-09-13T23:58:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f5251860700 1 -- 172.21.15.173:0/2892839207 reap_dead start 2024-09-13T23:58:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 shutdown_connections 2024-09-13T23:58:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 --2- 172.21.15.173:0/2892839207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9800 0x55b492eceb00 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 >> 172.21.15.173:0/2892839207 conn(0x55b492be9400 msgr2=0x55b492ce9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 shutdown_connections 2024-09-13T23:58:02.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 -- 172.21.15.173:0/2892839207 wait complete. 2024-09-13T23:58:02.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 -- 172.21.15.173:0/3121527041 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b493026c00 msgr2=0x55b4930c4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 --2- 172.21.15.173:0/3121527041 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b493026c00 0x55b4930c4000 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55b492fc2690 tx=0x55b492f4cae0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 -- 172.21.15.173:0/3121527041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b493027400 msgr2=0x55b492ed1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 --2- 172.21.15.173:0/3121527041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b493027400 0x55b492ed1180 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x55b493045260 tx=0x55b493014240 comp rx=0 tx=0).stop 2024-09-13T23:58:02.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 -- 172.21.15.173:0/3121527041 shutdown_connections 2024-09-13T23:58:02.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 --2- 172.21.15.173:0/3121527041 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b493026c00 0x55b4930c4000 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 --2- 172.21.15.173:0/3121527041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b493027400 0x55b492ed1180 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 -- 172.21.15.173:0/3121527041 >> 172.21.15.173:0/3121527041 conn(0x55b493027800 msgr2=0x55b492cea000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 -- 172.21.15.173:0/3121527041 shutdown_connections 2024-09-13T23:58:02.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 -- 172.21.15.173:0/3121527041 wait complete. 2024-09-13T23:58:02.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 -- 172.21.15.173:0/2693863033 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b492f88000 msgr2=0x55b492ecf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 --2- 172.21.15.173:0/2693863033 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b492f88000 0x55b492ecf080 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55b492f0c8d0 tx=0x55b492f4cb40 comp rx=0 tx=0).stop 2024-09-13T23:58:02.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 -- 172.21.15.173:0/2693863033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9000 msgr2=0x55b492ece580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 --2- 172.21.15.173:0/2693863033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9000 0x55b492ece580 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x55b492d45f50 tx=0x55b492ced920 comp rx=0 tx=0).stop 2024-09-13T23:58:02.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 -- 172.21.15.173:0/2693863033 shutdown_connections 2024-09-13T23:58:02.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 --2- 172.21.15.173:0/2693863033 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55b492f88000 0x55b492ecf080 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 --2- 172.21.15.173:0/2693863033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b492be9000 0x55b492ece580 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 -- 172.21.15.173:0/2693863033 >> 172.21.15.173:0/2693863033 conn(0x55b492be8c00 msgr2=0x55b492ce9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.504+0000 7f52538a8f40 1 -- 172.21.15.173:0/2693863033 shutdown_connections 2024-09-13T23:58:02.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.508+0000 7f52538a8f40 1 -- 172.21.15.173:0/2693863033 wait complete. 2024-09-13T23:58:02.513 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:58:02.543 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:58:02.552 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-13T23:58:02.552 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-13T23:58:02.552 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-13T23:58:02.552 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-13T23:58:02.593 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:58:02.593 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:58:02.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.592+0000 7f53a88daf40 1 Processor -- start 2024-09-13T23:58:02.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.592+0000 7f53a88daf40 1 -- start start 2024-09-13T23:58:02.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.592+0000 7f53a88daf40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x558763ca5400 0x558763f8a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.592+0000 7f53a88daf40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558763d69500 con 0x558763ca5000 2024-09-13T23:58:02.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.592+0000 7f53a88daf40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x558763d32a00 con 0x558763ca5400 2024-09-13T23:58:02.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.592+0000 7f53a7093700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x558763ca5000 0x558763da4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:38664/0 (socket says 172.21.15.173:38664) 2024-09-13T23:58:02.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.592+0000 7f53a7093700 1 -- 172.21.15.173:0/1440868707 learned_addr learned my addr 172.21.15.173:0/1440868707 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:58:02.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.592+0000 7f53a6892700 1 --2- 172.21.15.173:0/1440868707 >> v2:172.21.15.87:3300/0 conn(0x558763ca5400 0x558763f8a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.592+0000 7f53a6091700 1 -- 172.21.15.173:0/1440868707 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1014127113 0 0) 0x558763e00000 con 0x558763ca5000 2024-09-13T23:58:02.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.592+0000 7f53a6091700 1 -- 172.21.15.173:0/1440868707 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x558763d69680 con 0x558763ca5000 2024-09-13T23:58:02.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.592+0000 7f53a6892700 1 -- 172.21.15.173:0/1440868707 >> v1:172.21.15.87:6789/0 conn(0x558763ca5000 legacy=0x558763da4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.592+0000 7f53a6892700 1 -- 172.21.15.173:0/1440868707 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558763cb7d40 con 0x558763ca5400 2024-09-13T23:58:02.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.592+0000 7f53a6892700 1 --2- 172.21.15.173:0/1440868707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5400 0x558763f8a580 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x558763f85920 tx=0x558763da9980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47669c07a5824081 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.592+0000 7f53a6091700 1 -- 172.21.15.173:0/1440868707 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558763d494a0 con 0x558763ca5400 2024-09-13T23:58:02.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.592+0000 7f53a6091700 1 -- 172.21.15.173:0/1440868707 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558763d69680 con 0x558763ca5400 2024-09-13T23:58:02.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.592+0000 7f53a6091700 1 -- 172.21.15.173:0/1440868707 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558763d49600 con 0x558763ca5400 2024-09-13T23:58:02.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.592+0000 7f53a88daf40 1 -- 172.21.15.173:0/1440868707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5400 msgr2=0x558763f8a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.592+0000 7f53a88daf40 1 --2- 172.21.15.173:0/1440868707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5400 0x558763f8a580 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x558763f85920 tx=0x558763da9980 comp rx=0 tx=0).stop 2024-09-13T23:58:02.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.592+0000 7f53a88daf40 1 -- 172.21.15.173:0/1440868707 shutdown_connections 2024-09-13T23:58:02.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.592+0000 7f53a88daf40 1 --2- 172.21.15.173:0/1440868707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5400 0x558763f8a580 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.592+0000 7f53a88daf40 1 -- 172.21.15.173:0/1440868707 >> 172.21.15.173:0/1440868707 conn(0x558763ca4c00 msgr2=0x558763da4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.592+0000 7f53a88daf40 1 -- 172.21.15.173:0/1440868707 shutdown_connections 2024-09-13T23:58:02.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.592+0000 7f53a88daf40 1 -- 172.21.15.173:0/1440868707 wait complete. 2024-09-13T23:58:02.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a88daf40 1 Processor -- start 2024-09-13T23:58:02.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a88daf40 1 -- start start 2024-09-13T23:58:02.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a88daf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5000 0x558763f8a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a88daf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558763d32500 con 0x558763ca5000 2024-09-13T23:58:02.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a7093700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5000 0x558763f8a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a7093700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5000 0x558763f8a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49868/0 (socket says 172.21.15.173:49868) 2024-09-13T23:58:02.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a7093700 1 -- 172.21.15.173:0/3946797082 learned_addr learned my addr 172.21.15.173:0/3946797082 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:02.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a7093700 1 -- 172.21.15.173:0/3946797082 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558763cb7ba0 con 0x558763ca5000 2024-09-13T23:58:02.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a7093700 1 --2- 172.21.15.173:0/3946797082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5000 0x558763f8a580 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x558764a6fd70 tx=0x558763da9b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b18a76f72d0df5d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a5890700 1 -- 172.21.15.173:0/3946797082 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558763d494a0 con 0x558763ca5000 2024-09-13T23:58:02.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a5890700 1 -- 172.21.15.173:0/3946797082 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558763d69b00 con 0x558763ca5000 2024-09-13T23:58:02.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a5890700 1 -- 172.21.15.173:0/3946797082 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558763d49600 con 0x558763ca5000 2024-09-13T23:58:02.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a88daf40 1 -- 172.21.15.173:0/3946797082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5000 msgr2=0x558763f8a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a88daf40 1 --2- 172.21.15.173:0/3946797082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5000 0x558763f8a580 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x558764a6fd70 tx=0x558763da9b60 comp rx=0 tx=0).stop 2024-09-13T23:58:02.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a88daf40 1 -- 172.21.15.173:0/3946797082 shutdown_connections 2024-09-13T23:58:02.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a88daf40 1 --2- 172.21.15.173:0/3946797082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5000 0x558763f8a580 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a88daf40 1 -- 172.21.15.173:0/3946797082 >> 172.21.15.173:0/3946797082 conn(0x558763ca4c00 msgr2=0x558763da5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a88daf40 1 -- 172.21.15.173:0/3946797082 shutdown_connections 2024-09-13T23:58:02.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a88daf40 1 -- 172.21.15.173:0/3946797082 wait complete. 2024-09-13T23:58:02.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a88daf40 1 Processor -- start 2024-09-13T23:58:02.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a88daf40 1 -- start start 2024-09-13T23:58:02.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a88daf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5000 0x558763f8a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a88daf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558763d323c0 con 0x558763ca5000 2024-09-13T23:58:02.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a7093700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5000 0x558763f8a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a7093700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5000 0x558763f8a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49874/0 (socket says 172.21.15.173:49874) 2024-09-13T23:58:02.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.596+0000 7f53a7093700 1 -- 172.21.15.173:0/1012256008 learned_addr learned my addr 172.21.15.173:0/1012256008 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:02.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.600+0000 7f53a7093700 1 -- 172.21.15.173:0/1012256008 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558763cb7a00 con 0x558763ca5000 2024-09-13T23:58:02.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.600+0000 7f53a7093700 1 --2- 172.21.15.173:0/1012256008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5000 0x558763f8a580 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x558764a6fe60 tx=0x558763da9920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.600+0000 7f53a408d700 1 -- 172.21.15.173:0/1012256008 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558763d498c0 con 0x558763ca5000 2024-09-13T23:58:02.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.600+0000 7f53a408d700 1 -- 172.21.15.173:0/1012256008 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558763d69c80 con 0x558763ca5000 2024-09-13T23:58:02.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.600+0000 7f53a88daf40 1 -- 172.21.15.173:0/1012256008 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558763cb7860 con 0x558763ca5000 2024-09-13T23:58:02.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.600+0000 7f53a408d700 1 -- 172.21.15.173:0/1012256008 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558763d494a0 con 0x558763ca5000 2024-09-13T23:58:02.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.600+0000 7f53a88daf40 1 -- 172.21.15.173:0/1012256008 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558763cb76c0 con 0x558763ca5000 2024-09-13T23:58:02.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.600+0000 7f53a408d700 1 -- 172.21.15.173:0/1012256008 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x558763d9eb00 con 0x558763ca5000 2024-09-13T23:58:02.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.600+0000 7f53a88daf40 1 Processor -- start 2024-09-13T23:58:02.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.600+0000 7f53a88daf40 1 -- start start 2024-09-13T23:58:02.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.600+0000 7f53a88daf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5800 0x558763f8ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.600+0000 7f53a88daf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558763cca640 con 0x558763ca5800 2024-09-13T23:58:02.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.600+0000 7f53a408d700 1 --2- 172.21.15.173:0/1012256008 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558764042000 0x558763f8b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.600+0000 7f53a408d700 1 -- 172.21.15.173:0/1012256008 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x558763d0b180 con 0x558763ca5000 2024-09-13T23:58:02.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.600+0000 7f53a7093700 1 --2- 172.21.15.173:0/1012256008 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558764042000 0x558763f8b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.600+0000 7f53a7894700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5800 0x558763f8ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.600+0000 7f53a7894700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5800 0x558763f8ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49884/0 (socket says 172.21.15.173:49884) 2024-09-13T23:58:02.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.600+0000 7f53a7894700 1 -- 172.21.15.173:0/576062993 learned_addr learned my addr 172.21.15.173:0/576062993 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:02.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.600+0000 7f53a7093700 1 --2- 172.21.15.173:0/1012256008 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558764042000 0x558763f8b080 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x558763fc8ed0 tx=0x558763ff8240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.600+0000 7f53a7894700 1 -- 172.21.15.173:0/576062993 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558763cb6000 con 0x558763ca5800 2024-09-13T23:58:02.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.600+0000 7f53a7894700 1 --2- 172.21.15.173:0/576062993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5800 0x558763f8ab00 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x558763fc8390 tx=0x558763ff90e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20120f0e82ed69e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.604+0000 7f53a1888700 1 -- 172.21.15.173:0/576062993 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558763d498c0 con 0x558763ca5800 2024-09-13T23:58:02.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.604+0000 7f53a1888700 1 -- 172.21.15.173:0/576062993 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55876404a000 con 0x558763ca5800 2024-09-13T23:58:02.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.604+0000 7f53a1888700 1 -- 172.21.15.173:0/576062993 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558763d494a0 con 0x558763ca5800 2024-09-13T23:58:02.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.604+0000 7f53a88daf40 1 -- 172.21.15.173:0/576062993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5800 msgr2=0x558763f8ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.604+0000 7f53a88daf40 1 --2- 172.21.15.173:0/576062993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5800 0x558763f8ab00 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x558763fc8390 tx=0x558763ff90e0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.604+0000 7f53a88daf40 1 -- 172.21.15.173:0/576062993 shutdown_connections 2024-09-13T23:58:02.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.604+0000 7f53a88daf40 1 --2- 172.21.15.173:0/576062993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5800 0x558763f8ab00 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.604+0000 7f53a88daf40 1 -- 172.21.15.173:0/576062993 >> 172.21.15.173:0/576062993 conn(0x558763ca5400 msgr2=0x558763da5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.604+0000 7f53a88daf40 1 -- 172.21.15.173:0/576062993 shutdown_connections 2024-09-13T23:58:02.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.604+0000 7f53a88daf40 1 -- 172.21.15.173:0/576062993 wait complete. 2024-09-13T23:58:02.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.604+0000 7f53a88daf40 1 Processor -- start 2024-09-13T23:58:02.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.604+0000 7f53a88daf40 1 -- start start 2024-09-13T23:58:02.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.604+0000 7f53a88daf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5800 0x558763f8ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.604+0000 7f53a88daf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558763cca8c0 con 0x558763ca5800 2024-09-13T23:58:02.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.604+0000 7f53a7894700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5800 0x558763f8ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.604+0000 7f53a7894700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5800 0x558763f8ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49896/0 (socket says 172.21.15.173:49896) 2024-09-13T23:58:02.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.604+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 learned_addr learned my addr 172.21.15.173:0/1925795127 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:02.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.604+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558763cb6ea0 con 0x558763ca5800 2024-09-13T23:58:02.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.604+0000 7f53a7894700 1 --2- 172.21.15.173:0/1925795127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5800 0x558763f8ab00 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x558763fc80f0 tx=0x558763ff8cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.604+0000 7f53a0085700 1 -- 172.21.15.173:0/1925795127 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558763d49b80 con 0x558763ca5800 2024-09-13T23:58:02.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.604+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558763cb6820 con 0x558763ca5800 2024-09-13T23:58:02.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.604+0000 7f53a0085700 1 -- 172.21.15.173:0/1925795127 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55876404a180 con 0x558763ca5800 2024-09-13T23:58:02.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.604+0000 7f53a0085700 1 -- 172.21.15.173:0/1925795127 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558763d498c0 con 0x558763ca5800 2024-09-13T23:58:02.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.604+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558763cb69c0 con 0x558763ca5800 2024-09-13T23:58:02.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.608+0000 7f53a88daf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.608+0000 7f53a0085700 1 -- 172.21.15.173:0/1925795127 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x558763d9f080 con 0x558763ca5800 2024-09-13T23:58:02.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.608+0000 7f53a0085700 1 --2- 172.21.15.173:0/1925795127 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558764042c00 0x558763f8b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.608+0000 7f53a0085700 1 -- 172.21.15.173:0/1925795127 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x558763d0b340 con 0x558763ca5800 2024-09-13T23:58:02.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.608+0000 7f53a6892700 1 --2- 172.21.15.173:0/1925795127 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558764042c00 0x558763f8b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.608+0000 7f53a88daf40 1 --2- 172.21.15.173:0/1925795127 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x558764043000 0x558763f8bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.608+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043400 con 0x558764043000 2024-09-13T23:58:02.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.608+0000 7f53a7894700 1 --2- 172.21.15.173:0/1925795127 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x558764043000 0x558763f8bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.608+0000 7f53a6892700 1 --2- 172.21.15.173:0/1925795127 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558764042c00 0x558763f8b600 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x558763f85920 tx=0x558763da9800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.608+0000 7f53a7894700 1 --2- 172.21.15.173:0/1925795127 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x558764043000 0x558763f8bb80 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.612+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.612+0000 7f53a88daf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.612+0000 7f53a88daf40 20 realm 2024-09-13T23:58:02.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.612+0000 7f53a88daf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.612+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043000 2024-09-13T23:58:02.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.612+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.612+0000 7f53a88daf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.612+0000 7f53a88daf40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:58:02.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.612+0000 7f53a88daf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.612+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043c00 con 0x558764043000 2024-09-13T23:58:02.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.612+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.612+0000 7f53a88daf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.612+0000 7f53a88daf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.612+0000 7f53a88daf40 1 --2- 172.21.15.173:0/1925795127 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558764043400 0x558763f8c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.612+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043400 2024-09-13T23:58:02.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.612+0000 7f53a7093700 1 --2- 172.21.15.173:0/1925795127 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558764043400 0x558763f8c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.612+0000 7f53a7093700 1 --2- 172.21.15.173:0/1925795127 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558764043400 0x558763f8c100 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.612+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x5587640a3200 con 0x558764043400 2024-09-13T23:58:02.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.612+0000 7f53a88daf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:02.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.612+0000 7f53a88daf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.612+0000 7f53a88daf40 1 --2- 172.21.15.173:0/1925795127 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558764043c00 0x558763f8c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.612+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876410e000 con 0x558764043c00 2024-09-13T23:58:02.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.612+0000 7f53a6892700 1 --2- 172.21.15.173:0/1925795127 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558764043c00 0x558763f8c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.616+0000 7f53a6892700 1 --2- 172.21.15.173:0/1925795127 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558764043c00 0x558763f8c680 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.616+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.616+0000 7f53a88daf40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:58:02.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.616+0000 7f53a88daf40 20 searching for the correct realm 2024-09-13T23:58:02.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.616+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876410e400 con 0x558764043c00 2024-09-13T23:58:02.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.616+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.616+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876410e000 con 0x558764043400 2024-09-13T23:58:02.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.616+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a3200 con 0x558764043400 2024-09-13T23:58:02.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.616+0000 7f53a7093700 1 --2- 172.21.15.173:0/1925795127 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55876410e000 0x558763f8cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.616+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x55876410e000 2024-09-13T23:58:02.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.616+0000 7f53a7894700 1 --2- 172.21.15.173:0/1925795127 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55876410e000 0x558763f8cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.616+0000 7f53a7894700 1 --2- 172.21.15.173:0/1925795127 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55876410e000 0x558763f8cc00 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.616+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.616+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x55876410e000 2024-09-13T23:58:02.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.620+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.620+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043000 2024-09-13T23:58:02.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.620+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.620+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043c00 2024-09-13T23:58:02.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.620+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.620+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043000 2024-09-13T23:58:02.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.620+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.620+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043400 2024-09-13T23:58:02.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.620+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a3200 con 0x558764043400 2024-09-13T23:58:02.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.620+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043400 2024-09-13T23:58:02.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.620+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a3200 con 0x558764043400 2024-09-13T23:58:02.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.620+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043000 2024-09-13T23:58:02.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.620+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.620+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x55876410e000 2024-09-13T23:58:02.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.624+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.624+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043000 2024-09-13T23:58:02.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.624+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.624+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x55876410e000 2024-09-13T23:58:02.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.624+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.624+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043400 2024-09-13T23:58:02.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.624+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a3200 con 0x558764043400 2024-09-13T23:58:02.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.624+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043c00 2024-09-13T23:58:02.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.624+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.624+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043000 2024-09-13T23:58:02.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.624+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.624+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043400 2024-09-13T23:58:02.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.628+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a3200 con 0x558764043400 2024-09-13T23:58:02.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.628+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043c00 2024-09-13T23:58:02.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.628+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.628+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043000 2024-09-13T23:58:02.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.628+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.628+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043000 2024-09-13T23:58:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.628+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.628+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043000 2024-09-13T23:58:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.628+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.628+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043c00 2024-09-13T23:58:02.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.628+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.628+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x55876410e000 2024-09-13T23:58:02.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.628+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.628+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043000 2024-09-13T23:58:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.628+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.628+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x55876410e000 2024-09-13T23:58:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.632+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.632+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043c00 2024-09-13T23:58:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.632+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.632+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x55876410e000 2024-09-13T23:58:02.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.632+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.632+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043400 2024-09-13T23:58:02.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.632+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a3200 con 0x558764043400 2024-09-13T23:58:02.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.632+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043400 2024-09-13T23:58:02.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.632+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a3200 con 0x558764043400 2024-09-13T23:58:02.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.632+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043c00 2024-09-13T23:58:02.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.632+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.632+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043400 2024-09-13T23:58:02.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.636+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x5587640a3200 con 0x558764043400 2024-09-13T23:58:02.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.636+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x558764043400 2024-09-13T23:58:02.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.636+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5587640a3200 con 0x558764043400 2024-09-13T23:58:02.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.636+0000 7f53a88daf40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:58:02.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.636+0000 7f53a88daf40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:58:02.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.636+0000 7f53a88daf40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:58:02.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.636+0000 7f53a88daf40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:58:02.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.636+0000 7f53a88daf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.636+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876410e800 con 0x558764043000 2024-09-13T23:58:02.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.636+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.636+0000 7f53a88daf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.636+0000 7f53a88daf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.636+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876410ec00 con 0x558764043400 2024-09-13T23:58:02.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.636+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5587640a3200 con 0x558764043400 2024-09-13T23:58:02.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.636+0000 7f53a88daf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:02.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.636+0000 7f53a88daf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.636+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876410f000 con 0x55876410e000 2024-09-13T23:58:02.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.640+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.640+0000 7f53a88daf40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:58:02.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.640+0000 7f53a88daf40 20 zone default found 2024-09-13T23:58:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.640+0000 7f53a88daf40 4 Realm: () 2024-09-13T23:58:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.640+0000 7f53a88daf40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:58:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.640+0000 7f53a88daf40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:58:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.640+0000 7f53a88daf40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:58:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.640+0000 7f53a88daf40 20 zonegroup default 2024-09-13T23:58:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.640+0000 7f53a88daf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.640+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876410f400 con 0x55876410e000 2024-09-13T23:58:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.640+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.640+0000 7f53a88daf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.640+0000 7f53a88daf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.640+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876410f800 con 0x558764043c00 2024-09-13T23:58:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.640+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.640+0000 7f53a88daf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.640+0000 7f53a88daf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.640+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876410fc00 con 0x558764043c00 2024-09-13T23:58:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.640+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.640+0000 7f53a88daf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.640+0000 7f53a88daf40 20 started sync module instance, tier type = 2024-09-13T23:58:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.640+0000 7f53a88daf40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:58:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.640+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764118000 con 0x558764043400 2024-09-13T23:58:02.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.644+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v35'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a3200 con 0x558764043400 2024-09-13T23:58:02.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.644+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94039986150144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764118400 con 0x558764043400 2024-09-13T23:58:02.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.644+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764118800 con 0x558764043000 2024-09-13T23:58:02.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.648+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94039986150144] v35'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a3200 con 0x558764043400 2024-09-13T23:58:02.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.648+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v35'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.648+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94039986151296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764118c00 con 0x558764043000 2024-09-13T23:58:02.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.648+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764119000 con 0x558764043400 2024-09-13T23:58:02.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.648+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94039986151296] v35'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.648+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v35'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a3200 con 0x558764043400 2024-09-13T23:58:02.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.648+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94039986152448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764119400 con 0x558764043400 2024-09-13T23:58:02.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.652+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764119800 con 0x55876410e000 2024-09-13T23:58:02.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.652+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v35'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.652+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94039986153600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764119c00 con 0x55876410e000 2024-09-13T23:58:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.652+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764118800 con 0x558764043400 2024-09-13T23:58:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.652+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94039986152448] v35'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a3200 con 0x558764043400 2024-09-13T23:58:02.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.656+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v35'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a3200 con 0x558764043400 2024-09-13T23:58:02.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.656+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94039986154752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764118000 con 0x558764043400 2024-09-13T23:58:02.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.656+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876410e800 con 0x558764043c00 2024-09-13T23:58:02.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.656+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94039986153600] v35'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.656+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94039986154752] v35'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a3200 con 0x558764043400 2024-09-13T23:58:02.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.656+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v35'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.656+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94039986155904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876410f000 con 0x558764043c00 2024-09-13T23:58:02.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.656+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876410f400 con 0x558764043c00 2024-09-13T23:58:02.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.660+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94039986155904] v35'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.660+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v35'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.660+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94039986157056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876410ec00 con 0x558764043c00 2024-09-13T23:58:02.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.660+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764043800 con 0x55876410e000 2024-09-13T23:58:02.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.660+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v35'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.660+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94039986158208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764118400 con 0x55876410e000 2024-09-13T23:58:02.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.660+0000 7f53a88daf40 20 add_watcher() i=0 2024-09-13T23:58:02.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.660+0000 7f53a88daf40 20 add_watcher() i=1 2024-09-13T23:58:02.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.660+0000 7f53a88daf40 20 add_watcher() i=2 2024-09-13T23:58:02.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.660+0000 7f53a88daf40 20 add_watcher() i=3 2024-09-13T23:58:02.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.660+0000 7f53a88daf40 20 add_watcher() i=4 2024-09-13T23:58:02.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.660+0000 7f53a88daf40 20 add_watcher() i=5 2024-09-13T23:58:02.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.660+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94039986157056] v35'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.664+0000 7f53a88daf40 20 add_watcher() i=6 2024-09-13T23:58:02.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.664+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94039986158208] v35'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.664+0000 7f53a88daf40 20 add_watcher() i=7 2024-09-13T23:58:02.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.664+0000 7f53a88daf40 2 all 8 watchers are set, enabling cache 2024-09-13T23:58:02.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.664+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764119000 con 0x558764043000 2024-09-13T23:58:02.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.664+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.664+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94039987822592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764119400 con 0x558764043000 2024-09-13T23:58:02.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.668+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94039987822592] v35'212 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.668+0000 7f538e061700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:02.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.668+0000 7f53a88daf40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:58:02.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.668+0000 7f53a88daf40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:58:02.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.668+0000 7f53a88daf40 1 Processor -- start 2024-09-13T23:58:02.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.668+0000 7f53a88daf40 1 -- start start 2024-09-13T23:58:02.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.668+0000 7f53a88daf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55876410e400 0x558763f8d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.668+0000 7f53a88daf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558763d323c0 con 0x55876410e400 2024-09-13T23:58:02.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.668+0000 7f53a6892700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55876410e400 0x558763f8d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.668+0000 7f53a6892700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55876410e400 0x558763f8d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49906/0 (socket says 172.21.15.173:49906) 2024-09-13T23:58:02.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.668+0000 7f53a6892700 1 -- 172.21.15.173:0/4095786672 learned_addr learned my addr 172.21.15.173:0/4095786672 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:02.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.668+0000 7f53a6892700 1 -- 172.21.15.173:0/4095786672 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558763cb6b60 con 0x55876410e400 2024-09-13T23:58:02.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.668+0000 7f53a6892700 1 --2- 172.21.15.173:0/4095786672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55876410e400 0x558763f8d180 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x5587641280c0 tx=0x558763da99e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae54362b7c39e75 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.668+0000 7f538d860700 1 -- 172.21.15.173:0/4095786672 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558763d49760 con 0x55876410e400 2024-09-13T23:58:02.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.668+0000 7f538d860700 1 -- 172.21.15.173:0/4095786672 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55876404a600 con 0x55876410e400 2024-09-13T23:58:02.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.668+0000 7f538d860700 1 -- 172.21.15.173:0/4095786672 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558764130000 con 0x55876410e400 2024-09-13T23:58:02.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.668+0000 7f53a88daf40 1 -- 172.21.15.173:0/4095786672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55876410e400 msgr2=0x558763f8d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.668+0000 7f53a88daf40 1 --2- 172.21.15.173:0/4095786672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55876410e400 0x558763f8d180 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x5587641280c0 tx=0x558763da99e0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.668+0000 7f53a88daf40 1 -- 172.21.15.173:0/4095786672 shutdown_connections 2024-09-13T23:58:02.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.668+0000 7f53a88daf40 1 --2- 172.21.15.173:0/4095786672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55876410e400 0x558763f8d180 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.668+0000 7f53a88daf40 1 -- 172.21.15.173:0/4095786672 >> 172.21.15.173:0/4095786672 conn(0x558764118800 msgr2=0x558763da6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.668+0000 7f53a88daf40 1 -- 172.21.15.173:0/4095786672 shutdown_connections 2024-09-13T23:58:02.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.668+0000 7f53a88daf40 1 -- 172.21.15.173:0/4095786672 wait complete. 2024-09-13T23:58:02.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.672+0000 7f53a88daf40 1 Processor -- start 2024-09-13T23:58:02.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.672+0000 7f53a88daf40 1 -- start start 2024-09-13T23:58:02.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.672+0000 7f53a88daf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55876410f800 0x558763f8d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.672+0000 7f53a88daf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558763d32500 con 0x55876410f800 2024-09-13T23:58:02.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.672+0000 7f53a6892700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55876410f800 0x558763f8d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.672+0000 7f53a6892700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55876410f800 0x558763f8d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49920/0 (socket says 172.21.15.173:49920) 2024-09-13T23:58:02.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.672+0000 7f53a6892700 1 -- 172.21.15.173:0/3445858807 learned_addr learned my addr 172.21.15.173:0/3445858807 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:02.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.672+0000 7f53a6892700 1 -- 172.21.15.173:0/3445858807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558763cb6d00 con 0x55876410f800 2024-09-13T23:58:02.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.672+0000 7f53a6892700 1 --2- 172.21.15.173:0/3445858807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55876410f800 0x558763f8d700 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x558764128270 tx=0x5587640f25a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.672+0000 7f538c05d700 1 -- 172.21.15.173:0/3445858807 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558764130160 con 0x55876410f800 2024-09-13T23:58:02.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.672+0000 7f538c05d700 1 -- 172.21.15.173:0/3445858807 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55876404a300 con 0x55876410f800 2024-09-13T23:58:02.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.672+0000 7f53a88daf40 1 -- 172.21.15.173:0/3445858807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558763cb6340 con 0x55876410f800 2024-09-13T23:58:02.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.672+0000 7f538c05d700 1 -- 172.21.15.173:0/3445858807 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5587641302c0 con 0x55876410f800 2024-09-13T23:58:02.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.672+0000 7f53a88daf40 1 -- 172.21.15.173:0/3445858807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558763cb7d40 con 0x55876410f800 2024-09-13T23:58:02.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.672+0000 7f538c05d700 1 -- 172.21.15.173:0/3445858807 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x558763d9fb80 con 0x55876410f800 2024-09-13T23:58:02.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.676+0000 7f538c05d700 1 --2- 172.21.15.173:0/3445858807 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558764043800 0x5587641b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:02.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.676+0000 7f538c05d700 1 -- 172.21.15.173:0/3445858807 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x558763d0b500 con 0x55876410f800 2024-09-13T23:58:02.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.676+0000 7f53a88daf40 5 note: GC not initialized 2024-09-13T23:58:02.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.676+0000 7f53a7894700 1 --2- 172.21.15.173:0/3445858807 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558764043800 0x5587641b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:02.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.676+0000 7f53a7894700 1 --2- 172.21.15.173:0/3445858807 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558764043800 0x5587641b0000 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x558764088690 tx=0x5587640f35c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:02.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.676+0000 7f5389858700 20 reqs_thread_entry: start 2024-09-13T23:58:02.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.676+0000 7f53a88daf40 20 init_complete bucket index max shards: 11 2024-09-13T23:58:02.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.676+0000 7f53a88daf40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:58:02.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.676+0000 7f5387854700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:58:33 2024 2024-09-13T23:58:02.680 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:58:02.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.676+0000 7f5387032700 20 reqs_thread_entry: start 2024-09-13T23:58:02.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.676+0000 7f53a88daf40 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-13T23:58:02.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.676+0000 7f53a88daf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.676+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764118c00 con 0x55876410e000 2024-09-13T23:58:02.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.676+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(62 bar [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.676+0000 7f53a88daf40 20 rados_obj.operate() r=0 bl.length=346 2024-09-13T23:58:02.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.676+0000 7f53a88daf40 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-13T23:58:02.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.676+0000 7f53a88daf40 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T23:58:02.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.676+0000 7f53a88daf40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:58:02.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.676+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764119800 con 0x55876410e000 2024-09-13T23:58:02.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.680+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(63 bud [create,call,writefull 0~181] v35'1 uv1 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.680+0000 7f53a88daf40 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T23:58:02.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.680+0000 7f53a88daf40 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T23:58:02.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.680+0000 7f53a88daf40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-13T23:58:02.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.680+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94039987824896 in=369b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764119c00 con 0x558764043c00 2024-09-13T23:58:02.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.680+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== watch-notify(notify (1) cookie 94039986155904 notify 150323855385 ret 0) v3 ==== 399+0+0 (crc 0 0 0) 0x5587641749c0 con 0x558764043c00 2024-09-13T23:58:02.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.680+0000 7f53a1888700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855385 cookie 94039986155904 notifier 4807 bl.length()=357 2024-09-13T23:58:02.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.680+0000 7f53a1888700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T23:58:02.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.680+0000 7f53a1888700 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T23:58:02.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.680+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(64 notify.5 [notify cookie 94039987824896 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.680+0000 7f53a1888700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876421c000 con 0x558764043c00 2024-09-13T23:58:02.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.680+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.680+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== watch-notify(notify_complete (2) cookie 94039987824896 notify 150323855385 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x558764174b60 con 0x558764043c00 2024-09-13T23:58:02.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.680+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764118400 con 0x558764043000 2024-09-13T23:58:02.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.684+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) v8 ==== 155+0+184 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.684+0000 7f53a88daf40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 : miss 2024-09-13T23:58:02.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.684+0000 7f53a88daf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.684+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:67 8.1 8:80f63ef4:root::.bucket.meta.myfoo6%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876421c000 con 0x558764043000 2024-09-13T23:58:02.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.684+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(67 .bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 [call out=48b,stat out=16b,read 0~353 out=353b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 333+0+635 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.684+0000 7f53a88daf40 20 rados_obj.operate() r=0 bl.length=353 2024-09-13T23:58:02.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.684+0000 7f53a88daf40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 info.flags=0x17 2024-09-13T23:58:02.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.684+0000 7f53a88daf40 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 to cache LRU end 2024-09-13T23:58:02.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.684+0000 7f53a88daf40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:58:02.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.684+0000 7f53a88daf40 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:58:02.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.684+0000 7f53a88daf40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 2024-09-13T23:58:02.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.684+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:68 8.1 8:80f63ef4:root::.bucket.meta.myfoo6%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.7:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~353 in=353b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876421cc00 con 0x558764043000 2024-09-13T23:58:02.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.688+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(68 .bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 [delete,create,call,call,writefull 0~353,setxattr (117)] v35'6 uv6 ondisk = 0) v8 ==== 417+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.688+0000 7f53a88daf40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 info.flags=0x17 2024-09-13T23:58:02.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.688+0000 7f53a88daf40 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 to cache LRU end 2024-09-13T23:58:02.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.688+0000 7f53a88daf40 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T23:58:02.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.688+0000 7f53a88daf40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7, ofs0, ns] 2024-09-13T23:58:02.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.688+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify cookie 94039987824896 in=733b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876421d400 con 0x558764043c00 2024-09-13T23:58:02.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.688+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== watch-notify(notify (1) cookie 94039986155904 notify 150323855386 ret 0) v3 ==== 763+0+0 (crc 0 0 0) 0x558764174b60 con 0x558764043c00 2024-09-13T23:58:02.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.688+0000 7f53a1888700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855386 cookie 94039986155904 notifier 4807 bl.length()=721 2024-09-13T23:58:02.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.688+0000 7f53a1888700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 info.flags=0x17 2024-09-13T23:58:02.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.688+0000 7f53a1888700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 to cache LRU end 2024-09-13T23:58:02.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.688+0000 7f53a1888700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T23:58:02.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.688+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 20 ==== osd_op_reply(69 notify.5 [notify cookie 94039987824896 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.688+0000 7f53a1888700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876421c400 con 0x558764043c00 2024-09-13T23:58:02.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.688+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 21 ==== osd_op_reply(70 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.688+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 22 ==== watch-notify(notify_complete (2) cookie 94039987824896 notify 150323855386 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x558764174d00 con 0x558764043c00 2024-09-13T23:58:02.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.688+0000 7f53a88daf40 20 handle_bi_update(): bucket=:myfoo6[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7]): orig_sources= new_sources= 2024-09-13T23:58:02.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.688+0000 7f53a88daf40 20 handle_bi_update(): bucket=:myfoo6[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7]): potential sources added=[] removed=[] 2024-09-13T23:58:02.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.688+0000 7f53a88daf40 20 handle_bi_update(): bucket=:myfoo6[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7]): orig_dests= new_dests= 2024-09-13T23:58:02.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.688+0000 7f53a88daf40 20 handle_bi_update(): bucket=:myfoo6[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7]): potential dests added=[] removed=[] 2024-09-13T23:58:02.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.688+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:71 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876421d800 con 0x558764043000 2024-09-13T23:58:02.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.692+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(71 bar.buckets [call] v35'4 uv4 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.692+0000 7f53a88daf40 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-13T23:58:02.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.692+0000 7f53a88daf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:02.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.692+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:72 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876421dc00 con 0x558764043000 2024-09-13T23:58:02.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.692+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(72 myfoo6 [call out=48b,read 0~166 out=166b,getxattrs out=75b] v0'0 uv19 ondisk = 0) v8 ==== 234+0+289 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.692+0000 7f53a88daf40 20 rados_obj.operate() r=0 bl.length=166 2024-09-13T23:58:02.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.692+0000 7f53a88daf40 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x13 2024-09-13T23:58:02.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.692+0000 7f53a88daf40 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T23:58:02.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.692+0000 7f53a88daf40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:58:02.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.692+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876410f000 con 0x558764043000 2024-09-13T23:58:02.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.692+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(73 myfoo6 [delete,create,call,call,writefull 0~166] v35'20 uv20 ondisk = 0) v8 ==== 318+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.692+0000 7f53a88daf40 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x17 2024-09-13T23:58:02.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.692+0000 7f53a88daf40 10 moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T23:58:02.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.692+0000 7f53a88daf40 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-13T23:58:02.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.692+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94039987824896 in=352b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876410f400 con 0x55876410e000 2024-09-13T23:58:02.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.696+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== watch-notify(notify (1) cookie 94039986153600 notify 150323855372 ret 0) v3 ==== 382+0+0 (crc 0 0 0) 0x5587640b4820 con 0x55876410e000 2024-09-13T23:58:02.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.696+0000 7f53a1888700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855372 cookie 94039986153600 notifier 4807 bl.length()=340 2024-09-13T23:58:02.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.696+0000 7f53a1888700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x17 2024-09-13T23:58:02.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.696+0000 7f53a1888700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T23:58:02.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.696+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(74 notify.3 [notify cookie 94039987824896 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.696+0000 7f53a1888700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764119c00 con 0x55876410e000 2024-09-13T23:58:02.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.696+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 18 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.696+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 19 ==== watch-notify(notify_complete (2) cookie 94039987824896 notify 150323855372 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5587640b5380 con 0x55876410e000 2024-09-13T23:58:02.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.696+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:76 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876410ec00 con 0x558764043400 2024-09-13T23:58:02.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.696+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(76 bud.buckets [call] v35'6 uv6 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x5587640a3200 con 0x558764043400 2024-09-13T23:58:02.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.696+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:77 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876421d000 con 0x558764043000 2024-09-13T23:58:02.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.700+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 24 ==== osd_op_reply(77 myfoo6 [delete,create,call,writefull 0~166] v35'21 uv21 ondisk = 0) v8 ==== 276+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.700+0000 7f53a88daf40 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-13T23:58:02.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.700+0000 7f53a88daf40 10 moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T23:58:02.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.700+0000 7f53a88daf40 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-13T23:58:02.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.700+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [notify cookie 94039987824896 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876421c800 con 0x55876410e000 2024-09-13T23:58:02.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.700+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 20 ==== watch-notify(notify (1) cookie 94039986153600 notify 150323855373 ret 0) v3 ==== 358+0+0 (crc 0 0 0) 0x5587640b5380 con 0x55876410e000 2024-09-13T23:58:02.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.700+0000 7f53a1087700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855373 cookie 94039986153600 notifier 4807 bl.length()=316 2024-09-13T23:58:02.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.700+0000 7f53a1087700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-13T23:58:02.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.700+0000 7f53a1087700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T23:58:02.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.700+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 21 ==== osd_op_reply(78 notify.3 [notify cookie 94039987824896 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.700+0000 7f53a1087700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:79 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764112000 con 0x55876410e000 2024-09-13T23:58:02.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.700+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 22 ==== watch-notify(notify_complete (2) cookie 94039987824896 notify 150323855373 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5587640b5520 con 0x55876410e000 2024-09-13T23:58:02.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.700+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 23 ==== osd_op_reply(79 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.700+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:80 4.1e 4:7a88eac8:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876421cc00 con 0x558764043000 2024-09-13T23:58:02.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.704+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 25 ==== osd_op_reply(80 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.0 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.704+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:81 4.f 4:f12d74b5:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876421d800 con 0x55876410e000 2024-09-13T23:58:02.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.704+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 24 ==== osd_op_reply(81 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.704+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:82 4.17 4:e8081258:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876421dc00 con 0x558764043c00 2024-09-13T23:58:02.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.704+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 23 ==== osd_op_reply(82 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.704+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:83 4.15 4:a960d1c2:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876421c000 con 0x558764043c00 2024-09-13T23:58:02.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.704+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 24 ==== osd_op_reply(83 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.3 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.704+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:84 4.38 4:1c5940cd:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764119400 con 0x558764043400 2024-09-13T23:58:02.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.704+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(84 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x5587640a3200 con 0x558764043400 2024-09-13T23:58:02.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.708+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:85 4.12 4:4b12116a:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764118c00 con 0x558764043000 2024-09-13T23:58:02.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.708+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 26 ==== osd_op_reply(85 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.708+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:86 4.32 4:4e7a5279:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764119800 con 0x558764043400 2024-09-13T23:58:02.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.708+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(86 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.6 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x5587640a3200 con 0x558764043400 2024-09-13T23:58:02.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.708+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:87 4.39 4:9ef5416b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764118400 con 0x558764043c00 2024-09-13T23:58:02.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.708+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 25 ==== osd_op_reply(87 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.708+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:88 4.2e 4:746522c9:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764119c00 con 0x558764043c00 2024-09-13T23:58:02.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.708+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 26 ==== osd_op_reply(88 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.8 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.708+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:89 4.1c 4:3a6fb91a:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764118c00 con 0x55876410e000 2024-09-13T23:58:02.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.708+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 25 ==== osd_op_reply(89 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.9 [call out=377b] v0'0 uv6 ondisk = 0) v8 ==== 194+0+377 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.708+0000 7f53a88daf40 10 cls_bucket_list_unordered: got thirteen 2024-09-13T23:58:02.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.712+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:90 4.11 4:8983e62c:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876421d000 con 0x558764043c00 2024-09-13T23:58:02.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.712+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 27 ==== osd_op_reply(90 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.712+0000 7f53a88daf40 20 get_obj_state: rctx=0x558763d35b90 obj=myfoo6:thirteen state=0x55876422e1e8 s->prefetch_data=0 2024-09-13T23:58:02.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.712+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:91 3.26s0 3:64529768:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876421c800 con 0x55876410e000 2024-09-13T23:58:02.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.712+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 26 ==== osd_op_reply(91 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 238+0+870 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.712+0000 7f53a88daf40 10 manifest: total_size = 8 2024-09-13T23:58:02.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.712+0000 7f53a88daf40 20 get_obj_state: setting s->obj_tag to d342d0db-d035-4a54-bae7-2e0f76db6818.4232.4926739625105090582 2024-09-13T23:58:02.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.712+0000 7f53a88daf40 20 Read xattr rgw_rados: user.rgw.acl 2024-09-13T23:58:02.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.712+0000 7f53a88daf40 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-13T23:58:02.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.712+0000 7f53a88daf40 20 Read xattr rgw_rados: user.rgw.etag 2024-09-13T23:58:02.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.712+0000 7f53a88daf40 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-13T23:58:02.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.712+0000 7f53a88daf40 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-13T23:58:02.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.712+0000 7f53a88daf40 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-13T23:58:02.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.712+0000 7f53a88daf40 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-13T23:58:02.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.712+0000 7f53a88daf40 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-13T23:58:02.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.712+0000 7f53a88daf40 20 get_obj_state: rctx=0x558763d35b90 obj=myfoo6:thirteen state=0x55876422e1e8 s->prefetch_data=0 2024-09-13T23:58:02.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.712+0000 7f53a88daf40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 : hit (requested=0x17, cached=0x17) 2024-09-13T23:58:02.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.712+0000 7f53a88daf40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 2024-09-13T23:58:02.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.712+0000 7f53a88daf40 20 bucket index object: default.rgw.buckets.index:.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.9 2024-09-13T23:58:02.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.712+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:92 4.1c 4:3a6fb91a:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876421cc00 con 0x55876410e000 2024-09-13T23:58:02.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.712+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 27 ==== osd_op_reply(92 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.9 [stat,call,call] v35'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.712+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:93 3.26s0 3:64529768:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876421d800 con 0x55876410e000 2024-09-13T23:58:02.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.716+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 28 ==== osd_op_reply(93 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v35'2 uv2 ondisk = 0) v8 ==== 280+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.716+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:94 4.1c 4:3a6fb91a:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=267b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764118400 con 0x55876410e000 2024-09-13T23:58:02.721 INFO:teuthology.orchestra.run.smithi173.stderr:1 objects processed in :myfoo6[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7]). Next marker thirteen 2024-09-13T23:58:02.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.716+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:95 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764119c00 con 0x55876410e000 2024-09-13T23:58:02.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.720+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 29 ==== osd_op_reply(95 bud [delete,create,call,writefull 0~346] v35'2 uv2 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.720+0000 7f53a88daf40 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T23:58:02.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.720+0000 7f53a88daf40 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T23:58:02.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.720+0000 7f53a88daf40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-13T23:58:02.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.720+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 30 ==== osd_op_reply(94 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.9 [stat,call,call] v35'8 uv8 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.720+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify cookie 94039987824896 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876421d400 con 0x558764043c00 2024-09-13T23:58:02.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.720+0000 7f53a1087700 20 handle_completion(): completion ok for obj=thirteen 2024-09-13T23:58:02.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.720+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 28 ==== watch-notify(notify (1) cookie 94039986155904 notify 150323855387 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x558764174d00 con 0x558764043c00 2024-09-13T23:58:02.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.720+0000 7f53a1888700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855387 cookie 94039986155904 notifier 4807 bl.length()=522 2024-09-13T23:58:02.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.720+0000 7f53a1888700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T23:58:02.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.720+0000 7f53a1888700 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T23:58:02.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.720+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 29 ==== osd_op_reply(96 notify.5 [notify cookie 94039987824896 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.720+0000 7f53a1888700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x558764119000 con 0x558764043c00 2024-09-13T23:58:02.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.720+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 30 ==== osd_op_reply(97 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.720+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 31 ==== watch-notify(notify_complete (2) cookie 94039987824896 notify 150323855387 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x558764174ea0 con 0x558764043c00 2024-09-13T23:58:02.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.720+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:98 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876421c400 con 0x558764043000 2024-09-13T23:58:02.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.724+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 27 ==== osd_op_reply(98 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v35'2 uv2 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.724+0000 7f53a88daf40 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T23:58:02.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.724+0000 7f53a88daf40 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T23:58:02.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.724+0000 7f53a88daf40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-13T23:58:02.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.724+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify cookie 94039987824896 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876421dc00 con 0x558764043c00 2024-09-13T23:58:02.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.724+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 32 ==== watch-notify(notify (1) cookie 94039986155904 notify 150323855388 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x558764174ea0 con 0x558764043c00 2024-09-13T23:58:02.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.724+0000 7f53a1087700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855388 cookie 94039986155904 notifier 4807 bl.length()=177 2024-09-13T23:58:02.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.724+0000 7f53a1087700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T23:58:02.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.724+0000 7f53a1087700 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T23:58:02.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.724+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 33 ==== osd_op_reply(99 notify.5 [notify cookie 94039987824896 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.724+0000 7f53a1087700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876410f400 con 0x558764043c00 2024-09-13T23:58:02.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.724+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 34 ==== watch-notify(notify_complete (2) cookie 94039987824896 notify 150323855388 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x558764175040 con 0x558764043c00 2024-09-13T23:58:02.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.724+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 35 ==== osd_op_reply(100 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.724+0000 7f53a88daf40 10 removing user index: bar 2024-09-13T23:58:02.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.724+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:101 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876421c000 con 0x55876410e000 2024-09-13T23:58:02.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.728+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 31 ==== osd_op_reply(101 bar [delete] v35'5 uv5 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.728+0000 7f53a88daf40 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-13T23:58:02.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.728+0000 7f53a88daf40 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-13T23:58:02.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.728+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify cookie 94039987824896 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876423a000 con 0x55876410e000 2024-09-13T23:58:02.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.728+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 32 ==== watch-notify(notify (1) cookie 94039986158208 notify 150323855374 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x5587640b5520 con 0x55876410e000 2024-09-13T23:58:02.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.728+0000 7f53a1888700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855374 cookie 94039986158208 notifier 4807 bl.length()=152 2024-09-13T23:58:02.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.728+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 33 ==== osd_op_reply(102 notify.7 [notify cookie 94039987824896 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.728+0000 7f53a1888700 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876410f000 con 0x55876410e000 2024-09-13T23:58:02.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.728+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 34 ==== osd_op_reply(103 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.728+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 35 ==== watch-notify(notify_complete (2) cookie 94039987824896 notify 150323855374 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5587640b56c0 con 0x55876410e000 2024-09-13T23:58:02.732 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:58:02.732 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "bud", 2024-09-13T23:58:02.732 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Bar", 2024-09-13T23:58:02.733 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "", 2024-09-13T23:58:02.733 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:58:02.733 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:58:02.733 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [], 2024-09-13T23:58:02.733 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:58:02.733 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:02.733 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "bud", 2024-09-13T23:58:02.733 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "NX5QOQKC6BH2IDN8HC7A", 2024-09-13T23:58:02.733 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn" 2024-09-13T23:58:02.733 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:02.733 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:02.733 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [], 2024-09-13T23:58:02.733 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:58:02.734 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:58:02.734 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:58:02.734 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:58:02.734 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:58:02.734 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:58:02.734 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:58:02.734 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:58:02.734 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:58:02.734 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:58:02.734 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:58:02.734 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:02.734 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:58:02.734 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:58:02.734 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:58:02.735 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:58:02.735 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:58:02.735 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:58:02.735 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:02.735 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:58:02.735 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:58:02.735 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:58:02.735 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:58:02.735 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:58:02.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.728+0000 7f538e061700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:02.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.728+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:104 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94039987822592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876423b000 con 0x558764043000 2024-09-13T23:58:02.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.732+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 28 ==== osd_op_reply(104 data_loggenerations_metadata [watch unwatch cookie 94039987822592] v35'213 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.732+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94039986150144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876423b400 con 0x558764043400 2024-09-13T23:58:02.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.736+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94039986150144] v35'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a3200 con 0x558764043400 2024-09-13T23:58:02.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.736+0000 7f53a88daf40 20 remove_watcher() i=0 2024-09-13T23:58:02.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.736+0000 7f53a88daf40 2 removed watcher, disabling cache 2024-09-13T23:58:02.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.736+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94039986151296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876423b800 con 0x558764043000 2024-09-13T23:58:02.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.736+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.1 v2:172.21.15.173:6808/3256211813 29 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94039986151296] v35'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x558764043000 2024-09-13T23:58:02.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.736+0000 7f53a88daf40 20 remove_watcher() i=1 2024-09-13T23:58:02.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.736+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94039986152448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876423bc00 con 0x558764043400 2024-09-13T23:58:02.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.740+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94039986152448] v35'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a3200 con 0x558764043400 2024-09-13T23:58:02.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.740+0000 7f53a88daf40 20 remove_watcher() i=2 2024-09-13T23:58:02.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.740+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94039986153600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876423b400 con 0x55876410e000 2024-09-13T23:58:02.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.740+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 36 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94039986153600] v35'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.740+0000 7f53a88daf40 20 remove_watcher() i=3 2024-09-13T23:58:02.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.740+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94039986154752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876423ac00 con 0x558764043400 2024-09-13T23:58:02.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.744+0000 7f53a7093700 1 -- 172.21.15.173:0/1925795127 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94039986154752] v35'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a3200 con 0x558764043400 2024-09-13T23:58:02.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.744+0000 7f53a88daf40 20 remove_watcher() i=4 2024-09-13T23:58:02.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.744+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94039986155904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876423a800 con 0x558764043c00 2024-09-13T23:58:02.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.744+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 36 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94039986155904] v35'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.744+0000 7f53a88daf40 20 remove_watcher() i=5 2024-09-13T23:58:02.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.744+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94039986157056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876423a400 con 0x558764043c00 2024-09-13T23:58:02.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.748+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 <== osd.3 v2:172.21.15.173:6800/4020038786 37 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94039986157056] v35'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a3440 con 0x558764043c00 2024-09-13T23:58:02.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.748+0000 7f53a88daf40 20 remove_watcher() i=6 2024-09-13T23:58:02.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.748+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94039986158208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55876423a000 con 0x55876410e000 2024-09-13T23:58:02.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a7894700 1 -- 172.21.15.173:0/1925795127 <== osd.2 v2:172.21.15.173:6809/889985573 37 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94039986158208] v35'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x5587640a2b40 con 0x55876410e000 2024-09-13T23:58:02.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 20 remove_watcher() i=7 2024-09-13T23:58:02.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558764043400 msgr2=0x558763f8c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 --2- 172.21.15.173:0/1925795127 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558764043400 0x558763f8c100 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x558764043000 msgr2=0x558763f8bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 --2- 172.21.15.173:0/1925795127 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x558764043000 0x558763f8bb80 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55876410e000 msgr2=0x558763f8cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 --2- 172.21.15.173:0/1925795127 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55876410e000 0x558763f8cc00 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558764043c00 msgr2=0x558763f8c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 --2- 172.21.15.173:0/1925795127 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558764043c00 0x558763f8c680 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558764042c00 msgr2=0x558763f8b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 --2- 172.21.15.173:0/1925795127 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558764042c00 0x558763f8b600 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x558763f85920 tx=0x558763da9800 comp rx=0 tx=0).stop 2024-09-13T23:58:02.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5800 msgr2=0x558763f8ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 --2- 172.21.15.173:0/1925795127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5800 0x558763f8ab00 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x558763fc80f0 tx=0x558763ff8cc0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 reap_dead start 2024-09-13T23:58:02.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 shutdown_connections 2024-09-13T23:58:02.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a6892700 1 -- 172.21.15.173:0/1925795127 reap_dead start 2024-09-13T23:58:02.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 >> 172.21.15.173:0/1925795127 conn(0x558763ca5400 msgr2=0x558763da5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 shutdown_connections 2024-09-13T23:58:02.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 -- 172.21.15.173:0/1925795127 wait complete. 2024-09-13T23:58:02.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 -- 172.21.15.173:0/3445858807 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558764043800 msgr2=0x5587641b0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 --2- 172.21.15.173:0/3445858807 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558764043800 0x5587641b0000 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x558764088690 tx=0x5587640f35c0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 -- 172.21.15.173:0/3445858807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55876410f800 msgr2=0x558763f8d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 --2- 172.21.15.173:0/3445858807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55876410f800 0x558763f8d700 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x558764128270 tx=0x5587640f25a0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 -- 172.21.15.173:0/3445858807 shutdown_connections 2024-09-13T23:58:02.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 --2- 172.21.15.173:0/3445858807 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558764043800 0x5587641b0000 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 --2- 172.21.15.173:0/3445858807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55876410f800 0x558763f8d700 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 -- 172.21.15.173:0/3445858807 >> 172.21.15.173:0/3445858807 conn(0x558764118800 msgr2=0x558763da6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 -- 172.21.15.173:0/3445858807 shutdown_connections 2024-09-13T23:58:02.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 -- 172.21.15.173:0/3445858807 wait complete. 2024-09-13T23:58:02.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 -- 172.21.15.173:0/1012256008 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558764042000 msgr2=0x558763f8b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 --2- 172.21.15.173:0/1012256008 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558764042000 0x558763f8b080 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x558763fc8ed0 tx=0x558763ff8240 comp rx=0 tx=0).stop 2024-09-13T23:58:02.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 -- 172.21.15.173:0/1012256008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5000 msgr2=0x558763f8a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:02.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 --2- 172.21.15.173:0/1012256008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5000 0x558763f8a580 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x558764a6fe60 tx=0x558763da9920 comp rx=0 tx=0).stop 2024-09-13T23:58:02.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 -- 172.21.15.173:0/1012256008 shutdown_connections 2024-09-13T23:58:02.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 --2- 172.21.15.173:0/1012256008 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558764042000 0x558763f8b080 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 --2- 172.21.15.173:0/1012256008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558763ca5000 0x558763f8a580 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:02.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 -- 172.21.15.173:0/1012256008 >> 172.21.15.173:0/1012256008 conn(0x558763ca4c00 msgr2=0x558763da5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:02.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 -- 172.21.15.173:0/1012256008 shutdown_connections 2024-09-13T23:58:02.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:02.752+0000 7f53a88daf40 1 -- 172.21.15.173:0/1012256008 wait complete. 2024-09-13T23:58:02.762 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:58:07.775 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:58:07.775 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-13T23:58:07.775 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-13T23:58:07.775 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-13T23:58:07.776 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-13T23:58:07.825 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:58:07.825 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:58:07.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.824+0000 7f93cb7d5f40 1 Processor -- start 2024-09-13T23:58:07.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.824+0000 7f93cb7d5f40 1 -- start start 2024-09-13T23:58:07.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.824+0000 7f93cb7d5f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55f2d2933000 0x55f2d2c18580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:07.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.824+0000 7f93cb7d5f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f2d29f7500 con 0x55f2d2933400 2024-09-13T23:58:07.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.824+0000 7f93cb7d5f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f2d29c0a00 con 0x55f2d2933000 2024-09-13T23:58:07.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.824+0000 7f93c9f8e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55f2d2933000 0x55f2d2c18580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:07.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.824+0000 7f93c978d700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55f2d2933400 0x55f2d2a32800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:38680/0 (socket says 172.21.15.173:38680) 2024-09-13T23:58:07.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.824+0000 7f93c978d700 1 -- 172.21.15.173:0/447653751 learned_addr learned my addr 172.21.15.173:0/447653751 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:58:07.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.824+0000 7f93c9f8e700 1 -- 172.21.15.173:0/447653751 >> v1:172.21.15.87:6789/0 conn(0x55f2d2933400 legacy=0x55f2d2a32800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:07.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.824+0000 7f93c9f8e700 1 -- 172.21.15.173:0/447653751 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2d2945d40 con 0x55f2d2933000 2024-09-13T23:58:07.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.824+0000 7f93c9f8e700 1 --2- 172.21.15.173:0/447653751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933000 0x55f2d2c18580 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x55f2d2c13a70 tx=0x55f2d2a37920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec98d4949934b3b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:07.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.824+0000 7f93c8f8c700 1 -- 172.21.15.173:0/447653751 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f2d29d74a0 con 0x55f2d2933000 2024-09-13T23:58:07.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.824+0000 7f93c8f8c700 1 -- 172.21.15.173:0/447653751 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f2d29f7800 con 0x55f2d2933000 2024-09-13T23:58:07.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.824+0000 7f93c8f8c700 1 -- 172.21.15.173:0/447653751 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f2d29d7600 con 0x55f2d2933000 2024-09-13T23:58:07.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.824+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/447653751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933000 msgr2=0x55f2d2c18580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:07.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.824+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/447653751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933000 0x55f2d2c18580 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x55f2d2c13a70 tx=0x55f2d2a37920 comp rx=0 tx=0).stop 2024-09-13T23:58:07.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.824+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/447653751 shutdown_connections 2024-09-13T23:58:07.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.824+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/447653751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933000 0x55f2d2c18580 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:07.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.824+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/447653751 >> 172.21.15.173:0/447653751 conn(0x55f2d2932c00 msgr2=0x55f2d2a32000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:07.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.824+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/447653751 shutdown_connections 2024-09-13T23:58:07.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.824+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/447653751 wait complete. 2024-09-13T23:58:07.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93cb7d5f40 1 Processor -- start 2024-09-13T23:58:07.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93cb7d5f40 1 -- start start 2024-09-13T23:58:07.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93cb7d5f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933000 0x55f2d2c18580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:07.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93cb7d5f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2d29c0500 con 0x55f2d2933000 2024-09-13T23:58:07.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93c9f8e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933000 0x55f2d2c18580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:07.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93c9f8e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933000 0x55f2d2c18580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49944/0 (socket says 172.21.15.173:49944) 2024-09-13T23:58:07.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93c9f8e700 1 -- 172.21.15.173:0/2052397977 learned_addr learned my addr 172.21.15.173:0/2052397977 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:07.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93c9f8e700 1 -- 172.21.15.173:0/2052397977 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2d2945ba0 con 0x55f2d2933000 2024-09-13T23:58:07.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93c9f8e700 1 --2- 172.21.15.173:0/2052397977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933000 0x55f2d2c18580 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x55f2d3793e00 tx=0x55f2d2a37800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0944ec88f32b57c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:07.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93c878b700 1 -- 172.21.15.173:0/2052397977 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f2d29d7760 con 0x55f2d2933000 2024-09-13T23:58:07.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93c878b700 1 -- 172.21.15.173:0/2052397977 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f2d29f7b00 con 0x55f2d2933000 2024-09-13T23:58:07.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93c878b700 1 -- 172.21.15.173:0/2052397977 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f2d29d74a0 con 0x55f2d2933000 2024-09-13T23:58:07.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/2052397977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933000 msgr2=0x55f2d2c18580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:07.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/2052397977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933000 0x55f2d2c18580 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x55f2d3793e00 tx=0x55f2d2a37800 comp rx=0 tx=0).stop 2024-09-13T23:58:07.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/2052397977 shutdown_connections 2024-09-13T23:58:07.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/2052397977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933000 0x55f2d2c18580 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:07.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/2052397977 >> 172.21.15.173:0/2052397977 conn(0x55f2d2932c00 msgr2=0x55f2d2a33000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:07.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/2052397977 shutdown_connections 2024-09-13T23:58:07.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/2052397977 wait complete. 2024-09-13T23:58:07.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93cb7d5f40 1 Processor -- start 2024-09-13T23:58:07.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93cb7d5f40 1 -- start start 2024-09-13T23:58:07.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93cb7d5f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933000 0x55f2d2c18580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:07.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93cb7d5f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2d29c03c0 con 0x55f2d2933000 2024-09-13T23:58:07.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93c9f8e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933000 0x55f2d2c18580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:07.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93c9f8e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933000 0x55f2d2c18580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49946/0 (socket says 172.21.15.173:49946) 2024-09-13T23:58:07.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.828+0000 7f93c9f8e700 1 -- 172.21.15.173:0/225582185 learned_addr learned my addr 172.21.15.173:0/225582185 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:07.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.832+0000 7f93c9f8e700 1 -- 172.21.15.173:0/225582185 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2d2945a00 con 0x55f2d2933000 2024-09-13T23:58:07.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.832+0000 7f93c9f8e700 1 --2- 172.21.15.173:0/225582185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933000 0x55f2d2c18580 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x55f2d3793f20 tx=0x55f2d2a37920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:07.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.832+0000 7f93c6f88700 1 -- 172.21.15.173:0/225582185 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f2d29d7600 con 0x55f2d2933000 2024-09-13T23:58:07.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.832+0000 7f93c6f88700 1 -- 172.21.15.173:0/225582185 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f2d29f7c80 con 0x55f2d2933000 2024-09-13T23:58:07.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.832+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/225582185 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f2d2945860 con 0x55f2d2933000 2024-09-13T23:58:07.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.832+0000 7f93c6f88700 1 -- 172.21.15.173:0/225582185 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f2d29d78c0 con 0x55f2d2933000 2024-09-13T23:58:07.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.832+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/225582185 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f2d29456c0 con 0x55f2d2933000 2024-09-13T23:58:07.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.832+0000 7f93cb7d5f40 1 Processor -- start 2024-09-13T23:58:07.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.832+0000 7f93cb7d5f40 1 -- start start 2024-09-13T23:58:07.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.832+0000 7f93cb7d5f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933800 0x55f2d2c18b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:07.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.832+0000 7f93cb7d5f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2d2958640 con 0x55f2d2933800 2024-09-13T23:58:07.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.832+0000 7f93c6f88700 1 -- 172.21.15.173:0/225582185 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55f2d2a2cb00 con 0x55f2d2933000 2024-09-13T23:58:07.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.832+0000 7f93ca78f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933800 0x55f2d2c18b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:07.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.832+0000 7f93ca78f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933800 0x55f2d2c18b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49962/0 (socket says 172.21.15.173:49962) 2024-09-13T23:58:07.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.832+0000 7f93ca78f700 1 -- 172.21.15.173:0/2147290558 learned_addr learned my addr 172.21.15.173:0/2147290558 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:07.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.832+0000 7f93c6f88700 1 --2- 172.21.15.173:0/225582185 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f2d2cd8000 0x55f2d2c19080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:07.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.832+0000 7f93c6f88700 1 -- 172.21.15.173:0/225582185 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55f2d2999180 con 0x55f2d2933000 2024-09-13T23:58:07.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.832+0000 7f93ca78f700 1 -- 172.21.15.173:0/2147290558 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2d2944000 con 0x55f2d2933800 2024-09-13T23:58:07.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.832+0000 7f93c9f8e700 1 --2- 172.21.15.173:0/225582185 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f2d2cd8000 0x55f2d2c19080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:07.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.832+0000 7f93ca78f700 1 --2- 172.21.15.173:0/2147290558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933800 0x55f2d2c18b00 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x55f2d2cca000 tx=0x55f2d2a37ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e9b80c16bfc0e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:07.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.832+0000 7f93c4783700 1 -- 172.21.15.173:0/2147290558 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f2d29d7600 con 0x55f2d2933800 2024-09-13T23:58:07.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.836+0000 7f93c4783700 1 -- 172.21.15.173:0/2147290558 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f2d2cda000 con 0x55f2d2933800 2024-09-13T23:58:07.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.836+0000 7f93c4783700 1 -- 172.21.15.173:0/2147290558 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f2d29d78c0 con 0x55f2d2933800 2024-09-13T23:58:07.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.836+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/2147290558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933800 msgr2=0x55f2d2c18b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:07.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.836+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/2147290558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933800 0x55f2d2c18b00 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x55f2d2cca000 tx=0x55f2d2a37ce0 comp rx=0 tx=0).stop 2024-09-13T23:58:07.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.836+0000 7f93c9f8e700 1 --2- 172.21.15.173:0/225582185 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f2d2cd8000 0x55f2d2c19080 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55f2d2c56f90 tx=0x55f2d2c96c60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:07.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.836+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/2147290558 shutdown_connections 2024-09-13T23:58:07.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.836+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/2147290558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933800 0x55f2d2c18b00 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:07.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.836+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/2147290558 >> 172.21.15.173:0/2147290558 conn(0x55f2d2933400 msgr2=0x55f2d2a33800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:07.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.836+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/2147290558 shutdown_connections 2024-09-13T23:58:07.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.836+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/2147290558 wait complete. 2024-09-13T23:58:07.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.836+0000 7f93cb7d5f40 1 Processor -- start 2024-09-13T23:58:07.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.836+0000 7f93cb7d5f40 1 -- start start 2024-09-13T23:58:07.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.836+0000 7f93cb7d5f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933800 0x55f2d2c18b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:07.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.836+0000 7f93cb7d5f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2d29588c0 con 0x55f2d2933800 2024-09-13T23:58:07.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.836+0000 7f93ca78f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933800 0x55f2d2c18b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:07.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.836+0000 7f93ca78f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933800 0x55f2d2c18b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49968/0 (socket says 172.21.15.173:49968) 2024-09-13T23:58:07.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.836+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 learned_addr learned my addr 172.21.15.173:0/3535736720 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:07.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.836+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2d2944ea0 con 0x55f2d2933800 2024-09-13T23:58:07.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.836+0000 7f93ca78f700 1 --2- 172.21.15.173:0/3535736720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933800 0x55f2d2c18b00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x55f2d2ccac90 tx=0x55f2d2c96660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:07.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.840+0000 7f93c2f80700 1 -- 172.21.15.173:0/3535736720 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f2d29d7760 con 0x55f2d2933800 2024-09-13T23:58:07.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.840+0000 7f93c2f80700 1 -- 172.21.15.173:0/3535736720 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f2d2cda180 con 0x55f2d2933800 2024-09-13T23:58:07.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.840+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f2d2944820 con 0x55f2d2933800 2024-09-13T23:58:07.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.840+0000 7f93c2f80700 1 -- 172.21.15.173:0/3535736720 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f2d29d7600 con 0x55f2d2933800 2024-09-13T23:58:07.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.840+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f2d29449c0 con 0x55f2d2933800 2024-09-13T23:58:07.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.840+0000 7f93cb7d5f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:07.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.840+0000 7f93c2f80700 1 -- 172.21.15.173:0/3535736720 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55f2d2a2cdc0 con 0x55f2d2933800 2024-09-13T23:58:07.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.840+0000 7f93c2f80700 1 --2- 172.21.15.173:0/3535736720 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f2d2cd8c00 0x55f2d2c19600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:07.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.840+0000 7f93c2f80700 1 -- 172.21.15.173:0/3535736720 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55f2d2999340 con 0x55f2d2933800 2024-09-13T23:58:07.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.840+0000 7f93c978d700 1 --2- 172.21.15.173:0/3535736720 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f2d2cd8c00 0x55f2d2c19600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:07.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.840+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/3535736720 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f2d2cd9000 0x55f2d2c19b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:07.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.840+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9400 con 0x55f2d2cd9000 2024-09-13T23:58:07.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.840+0000 7f93ca78f700 1 --2- 172.21.15.173:0/3535736720 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f2d2cd9000 0x55f2d2c19b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:07.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.840+0000 7f93c978d700 1 --2- 172.21.15.173:0/3535736720 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f2d2cd8c00 0x55f2d2c19600 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55f2d2ccbe60 tx=0x55f2d2d880c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:07.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.840+0000 7f93ca78f700 1 --2- 172.21.15.173:0/3535736720 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f2d2cd9000 0x55f2d2c19b80 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:07.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.844+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2cd9000 2024-09-13T23:58:07.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.844+0000 7f93cb7d5f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:07.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.844+0000 7f93cb7d5f40 20 realm 2024-09-13T23:58:07.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.844+0000 7f93cb7d5f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:07.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.844+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9000 2024-09-13T23:58:07.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.844+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2cd9000 2024-09-13T23:58:07.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.844+0000 7f93cb7d5f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:07.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.844+0000 7f93cb7d5f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:58:07.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.844+0000 7f93cb7d5f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:07.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.844+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9c00 con 0x55f2d2cd9000 2024-09-13T23:58:07.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.844+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2cd9000 2024-09-13T23:58:07.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.844+0000 7f93cb7d5f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:07.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.844+0000 7f93cb7d5f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:07.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.844+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/3535736720 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f2d2cd9400 0x55f2d2c1a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:07.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.844+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9400 2024-09-13T23:58:07.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.844+0000 7f93c9f8e700 1 --2- 172.21.15.173:0/3535736720 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f2d2cd9400 0x55f2d2c1a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:07.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.844+0000 7f93c9f8e700 1 --2- 172.21.15.173:0/3535736720 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f2d2cd9400 0x55f2d2c1a100 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:07.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.844+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55f2d2d49200 con 0x55f2d2cd9400 2024-09-13T23:58:07.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.844+0000 7f93cb7d5f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:07.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.844+0000 7f93cb7d5f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:07.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.844+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/3535736720 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f2d2cd9c00 0x55f2d2c1a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:07.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.844+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da0000 con 0x55f2d2cd9c00 2024-09-13T23:58:07.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.844+0000 7f93c978d700 1 --2- 172.21.15.173:0/3535736720 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f2d2cd9c00 0x55f2d2c1a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:07.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.848+0000 7f93c978d700 1 --2- 172.21.15.173:0/3535736720 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f2d2cd9c00 0x55f2d2c1a680 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:07.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.848+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55f2d2d49440 con 0x55f2d2cd9c00 2024-09-13T23:58:07.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.848+0000 7f93cb7d5f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:58:07.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.848+0000 7f93cb7d5f40 20 searching for the correct realm 2024-09-13T23:58:07.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.848+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da0400 con 0x55f2d2cd9c00 2024-09-13T23:58:07.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.848+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55f2d2d49440 con 0x55f2d2cd9c00 2024-09-13T23:58:07.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.848+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da0000 con 0x55f2d2cd9400 2024-09-13T23:58:07.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.848+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d49200 con 0x55f2d2cd9400 2024-09-13T23:58:07.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.848+0000 7f93c9f8e700 1 --2- 172.21.15.173:0/3535736720 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f2d2da0000 0x55f2d2c1ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:07.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.848+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2da0000 2024-09-13T23:58:07.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.848+0000 7f93ca78f700 1 --2- 172.21.15.173:0/3535736720 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f2d2da0000 0x55f2d2c1ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:07.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.848+0000 7f93ca78f700 1 --2- 172.21.15.173:0/3535736720 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f2d2da0000 0x55f2d2c1ac00 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:07.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.852+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2da0000 2024-09-13T23:58:07.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.852+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2da0000 2024-09-13T23:58:07.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.852+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2da0000 2024-09-13T23:58:07.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.852+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9000 2024-09-13T23:58:07.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.852+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2cd9000 2024-09-13T23:58:07.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.852+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9c00 2024-09-13T23:58:07.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.852+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d49440 con 0x55f2d2cd9c00 2024-09-13T23:58:07.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.852+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9000 2024-09-13T23:58:07.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.852+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2cd9000 2024-09-13T23:58:07.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.852+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9400 2024-09-13T23:58:07.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.852+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d49200 con 0x55f2d2cd9400 2024-09-13T23:58:07.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.852+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9400 2024-09-13T23:58:07.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.852+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d49200 con 0x55f2d2cd9400 2024-09-13T23:58:07.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.852+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9000 2024-09-13T23:58:07.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.856+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2cd9000 2024-09-13T23:58:07.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.856+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2da0000 2024-09-13T23:58:07.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.856+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2da0000 2024-09-13T23:58:07.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.856+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9000 2024-09-13T23:58:07.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.856+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2cd9000 2024-09-13T23:58:07.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.856+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2da0000 2024-09-13T23:58:07.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.856+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2da0000 2024-09-13T23:58:07.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.856+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9400 2024-09-13T23:58:07.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.856+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d49200 con 0x55f2d2cd9400 2024-09-13T23:58:07.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.856+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9c00 2024-09-13T23:58:07.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.856+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d49440 con 0x55f2d2cd9c00 2024-09-13T23:58:07.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.856+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9000 2024-09-13T23:58:07.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.860+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2cd9000 2024-09-13T23:58:07.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.860+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9400 2024-09-13T23:58:07.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.860+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d49200 con 0x55f2d2cd9400 2024-09-13T23:58:07.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.860+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9c00 2024-09-13T23:58:07.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.860+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d49440 con 0x55f2d2cd9c00 2024-09-13T23:58:07.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.860+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9000 2024-09-13T23:58:07.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.860+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2cd9000 2024-09-13T23:58:07.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.860+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9000 2024-09-13T23:58:07.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.860+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2cd9000 2024-09-13T23:58:07.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.860+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9000 2024-09-13T23:58:07.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.860+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2cd9000 2024-09-13T23:58:07.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.860+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9c00 2024-09-13T23:58:07.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.860+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d49440 con 0x55f2d2cd9c00 2024-09-13T23:58:07.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.860+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2da0000 2024-09-13T23:58:07.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.864+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2da0000 2024-09-13T23:58:07.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.864+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9000 2024-09-13T23:58:07.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.864+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2cd9000 2024-09-13T23:58:07.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.864+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2da0000 2024-09-13T23:58:07.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.864+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2da0000 2024-09-13T23:58:07.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.864+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9c00 2024-09-13T23:58:07.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.864+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d49440 con 0x55f2d2cd9c00 2024-09-13T23:58:07.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.864+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2da0000 2024-09-13T23:58:07.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.864+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2da0000 2024-09-13T23:58:07.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.864+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9400 2024-09-13T23:58:07.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.864+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d49200 con 0x55f2d2cd9400 2024-09-13T23:58:07.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.864+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9400 2024-09-13T23:58:07.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.864+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d49200 con 0x55f2d2cd9400 2024-09-13T23:58:07.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.864+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9c00 2024-09-13T23:58:07.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.868+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d49440 con 0x55f2d2cd9c00 2024-09-13T23:58:07.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.868+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9400 2024-09-13T23:58:07.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.868+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55f2d2d49200 con 0x55f2d2cd9400 2024-09-13T23:58:07.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.868+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2cd9400 2024-09-13T23:58:07.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.868+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f2d2d49200 con 0x55f2d2cd9400 2024-09-13T23:58:07.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.868+0000 7f93cb7d5f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:58:07.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.868+0000 7f93cb7d5f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:58:07.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.868+0000 7f93cb7d5f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:58:07.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.868+0000 7f93cb7d5f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:58:07.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.868+0000 7f93cb7d5f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:07.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.868+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da0800 con 0x55f2d2cd9000 2024-09-13T23:58:07.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.868+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2cd9000 2024-09-13T23:58:07.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.868+0000 7f93cb7d5f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:07.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.868+0000 7f93cb7d5f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:07.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.868+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da0c00 con 0x55f2d2cd9400 2024-09-13T23:58:07.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55f2d2d49200 con 0x55f2d2cd9400 2024-09-13T23:58:07.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93cb7d5f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:07.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93cb7d5f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:07.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da1000 con 0x55f2d2da0000 2024-09-13T23:58:07.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2da0000 2024-09-13T23:58:07.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93cb7d5f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:58:07.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93cb7d5f40 20 zone default found 2024-09-13T23:58:07.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93cb7d5f40 4 Realm: () 2024-09-13T23:58:07.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93cb7d5f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:58:07.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93cb7d5f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:58:07.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93cb7d5f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:58:07.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93cb7d5f40 20 zonegroup default 2024-09-13T23:58:07.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93cb7d5f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:07.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da1400 con 0x55f2d2da0000 2024-09-13T23:58:07.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2da0000 2024-09-13T23:58:07.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93cb7d5f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:07.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93cb7d5f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:07.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da1800 con 0x55f2d2cd9c00 2024-09-13T23:58:07.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55f2d2d49440 con 0x55f2d2cd9c00 2024-09-13T23:58:07.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93cb7d5f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:07.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93cb7d5f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:07.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da1c00 con 0x55f2d2cd9c00 2024-09-13T23:58:07.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55f2d2d49440 con 0x55f2d2cd9c00 2024-09-13T23:58:07.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93cb7d5f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:07.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93cb7d5f40 20 started sync module instance, tier type = 2024-09-13T23:58:07.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93cb7d5f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:58:07.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.872+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da2000 con 0x55f2d2cd9400 2024-09-13T23:58:07.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.876+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v35'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d49200 con 0x55f2d2cd9400 2024-09-13T23:58:07.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.876+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94501406309120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da2400 con 0x55f2d2cd9400 2024-09-13T23:58:07.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.876+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da2800 con 0x55f2d2cd9000 2024-09-13T23:58:07.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.880+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v35'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2cd9000 2024-09-13T23:58:07.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.880+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94501406310272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da2c00 con 0x55f2d2cd9000 2024-09-13T23:58:07.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.880+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da3000 con 0x55f2d2cd9400 2024-09-13T23:58:07.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.880+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94501406309120] v35'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d49200 con 0x55f2d2cd9400 2024-09-13T23:58:07.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.880+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94501406310272] v35'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2cd9000 2024-09-13T23:58:07.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.884+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v35'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d49200 con 0x55f2d2cd9400 2024-09-13T23:58:07.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.884+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94501406311424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da3400 con 0x55f2d2cd9400 2024-09-13T23:58:07.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.884+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da3800 con 0x55f2d2da0000 2024-09-13T23:58:07.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.884+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v35'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2da0000 2024-09-13T23:58:07.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.884+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94501406312576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da3c00 con 0x55f2d2da0000 2024-09-13T23:58:07.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.884+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da2800 con 0x55f2d2cd9400 2024-09-13T23:58:07.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.884+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94501406311424] v35'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d49200 con 0x55f2d2cd9400 2024-09-13T23:58:07.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.888+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v35'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d49200 con 0x55f2d2cd9400 2024-09-13T23:58:07.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.888+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94501406313728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da2000 con 0x55f2d2cd9400 2024-09-13T23:58:07.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.888+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da0800 con 0x55f2d2cd9c00 2024-09-13T23:58:07.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.888+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94501406312576] v35'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2da0000 2024-09-13T23:58:07.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.888+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v35'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d49440 con 0x55f2d2cd9c00 2024-09-13T23:58:07.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.892+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94501406314880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da1000 con 0x55f2d2cd9c00 2024-09-13T23:58:07.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.892+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94501406313728] v35'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d49200 con 0x55f2d2cd9400 2024-09-13T23:58:07.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.892+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da1400 con 0x55f2d2cd9c00 2024-09-13T23:58:07.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.892+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94501406314880] v35'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d49440 con 0x55f2d2cd9c00 2024-09-13T23:58:07.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.892+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v35'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d49440 con 0x55f2d2cd9c00 2024-09-13T23:58:07.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.892+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94501406316032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da0c00 con 0x55f2d2cd9c00 2024-09-13T23:58:07.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.892+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2cd9800 con 0x55f2d2da0000 2024-09-13T23:58:07.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.896+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94501406316032] v35'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d49440 con 0x55f2d2cd9c00 2024-09-13T23:58:07.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.896+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v35'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2da0000 2024-09-13T23:58:07.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.896+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94501406317184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da2400 con 0x55f2d2da0000 2024-09-13T23:58:07.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.896+0000 7f93cb7d5f40 20 add_watcher() i=0 2024-09-13T23:58:07.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.896+0000 7f93cb7d5f40 20 add_watcher() i=1 2024-09-13T23:58:07.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.896+0000 7f93cb7d5f40 20 add_watcher() i=2 2024-09-13T23:58:07.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.896+0000 7f93cb7d5f40 20 add_watcher() i=3 2024-09-13T23:58:07.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.896+0000 7f93cb7d5f40 20 add_watcher() i=4 2024-09-13T23:58:07.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.896+0000 7f93cb7d5f40 20 add_watcher() i=5 2024-09-13T23:58:07.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.896+0000 7f93cb7d5f40 20 add_watcher() i=6 2024-09-13T23:58:07.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.896+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94501406317184] v35'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2da0000 2024-09-13T23:58:07.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.896+0000 7f93cb7d5f40 20 add_watcher() i=7 2024-09-13T23:58:07.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.896+0000 7f93cb7d5f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:58:07.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.896+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da3000 con 0x55f2d2cd9000 2024-09-13T23:58:07.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.896+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2cd9000 2024-09-13T23:58:07.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.896+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94501407981568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da3400 con 0x55f2d2cd9000 2024-09-13T23:58:07.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.900+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94501407981568] v35'214 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2cd9000 2024-09-13T23:58:07.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.900+0000 7f93b0f5c700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:07.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.900+0000 7f93cb7d5f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:58:07.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.900+0000 7f93cb7d5f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:58:07.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.900+0000 7f93cb7d5f40 1 Processor -- start 2024-09-13T23:58:07.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.900+0000 7f93cb7d5f40 1 -- start start 2024-09-13T23:58:07.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.900+0000 7f93cb7d5f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2da0400 0x55f2d2c1b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:07.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.900+0000 7f93cb7d5f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2d29c03c0 con 0x55f2d2da0400 2024-09-13T23:58:07.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.900+0000 7f93c978d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2da0400 0x55f2d2c1b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:07.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.900+0000 7f93c978d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2da0400 0x55f2d2c1b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49978/0 (socket says 172.21.15.173:49978) 2024-09-13T23:58:07.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.900+0000 7f93c978d700 1 -- 172.21.15.173:0/2626743436 learned_addr learned my addr 172.21.15.173:0/2626743436 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:07.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.900+0000 7f93c978d700 1 -- 172.21.15.173:0/2626743436 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2d2944b60 con 0x55f2d2da0400 2024-09-13T23:58:07.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.900+0000 7f93c978d700 1 --2- 172.21.15.173:0/2626743436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2da0400 0x55f2d2c1b180 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55f2d2db2090 tx=0x55f2d2c97f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7725458c8395a36 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:07.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.904+0000 7f93b075b700 1 -- 172.21.15.173:0/2626743436 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f2d2dba000 con 0x55f2d2da0400 2024-09-13T23:58:07.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.904+0000 7f93b075b700 1 -- 172.21.15.173:0/2626743436 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f2d2cda600 con 0x55f2d2da0400 2024-09-13T23:58:07.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.904+0000 7f93b075b700 1 -- 172.21.15.173:0/2626743436 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f2d2dba160 con 0x55f2d2da0400 2024-09-13T23:58:07.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.904+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/2626743436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2da0400 msgr2=0x55f2d2c1b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:07.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.904+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/2626743436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2da0400 0x55f2d2c1b180 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55f2d2db2090 tx=0x55f2d2c97f80 comp rx=0 tx=0).stop 2024-09-13T23:58:07.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.904+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/2626743436 shutdown_connections 2024-09-13T23:58:07.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.904+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/2626743436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2da0400 0x55f2d2c1b180 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:07.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.904+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/2626743436 >> 172.21.15.173:0/2626743436 conn(0x55f2d2da2800 msgr2=0x55f2d2a34000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:07.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.904+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/2626743436 shutdown_connections 2024-09-13T23:58:07.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.904+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/2626743436 wait complete. 2024-09-13T23:58:07.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.904+0000 7f93cb7d5f40 1 Processor -- start 2024-09-13T23:58:07.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.904+0000 7f93cb7d5f40 1 -- start start 2024-09-13T23:58:07.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.904+0000 7f93cb7d5f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2da0400 0x55f2d2c1b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:07.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.904+0000 7f93cb7d5f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2d29c0500 con 0x55f2d2da0400 2024-09-13T23:58:07.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.904+0000 7f93c978d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2da0400 0x55f2d2c1b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:07.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.904+0000 7f93c978d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2da0400 0x55f2d2c1b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:49986/0 (socket says 172.21.15.173:49986) 2024-09-13T23:58:07.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.904+0000 7f93c978d700 1 -- 172.21.15.173:0/1608114599 learned_addr learned my addr 172.21.15.173:0/1608114599 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:07.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.904+0000 7f93c978d700 1 -- 172.21.15.173:0/1608114599 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2d2944d00 con 0x55f2d2da0400 2024-09-13T23:58:07.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.904+0000 7f93c978d700 1 --2- 172.21.15.173:0/1608114599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2da0400 0x55f2d2c1b180 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x55f2d2db22a0 tx=0x55f2d2d881e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:07.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.904+0000 7f93aef58700 1 -- 172.21.15.173:0/1608114599 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f2d2dba2c0 con 0x55f2d2da0400 2024-09-13T23:58:07.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.908+0000 7f93aef58700 1 -- 172.21.15.173:0/1608114599 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f2d2cda300 con 0x55f2d2da0400 2024-09-13T23:58:07.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.908+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/1608114599 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f2d2944340 con 0x55f2d2da0400 2024-09-13T23:58:07.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.908+0000 7f93aef58700 1 -- 172.21.15.173:0/1608114599 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55f2d2dba000 con 0x55f2d2da0400 2024-09-13T23:58:07.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.908+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/1608114599 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f2d2944b60 con 0x55f2d2da0400 2024-09-13T23:58:07.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.908+0000 7f93aef58700 1 -- 172.21.15.173:0/1608114599 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55f2d2a2db80 con 0x55f2d2da0400 2024-09-13T23:58:07.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.908+0000 7f93aef58700 1 --2- 172.21.15.173:0/1608114599 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f2d2cd9800 0x55f2d2e38000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:07.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.908+0000 7f93aef58700 1 -- 172.21.15.173:0/1608114599 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55f2d2999500 con 0x55f2d2da0400 2024-09-13T23:58:07.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.908+0000 7f93cb7d5f40 5 note: GC not initialized 2024-09-13T23:58:07.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.908+0000 7f93ca78f700 1 --2- 172.21.15.173:0/1608114599 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f2d2cd9800 0x55f2d2e38000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:07.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.908+0000 7f93ca78f700 1 --2- 172.21.15.173:0/1608114599 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f2d2cd9800 0x55f2d2e38000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55f2d2c57170 tx=0x55f2d2d89380 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:07.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.908+0000 7f93cb7d5f40 20 init_complete bucket index max shards: 11 2024-09-13T23:58:07.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.912+0000 7f93cb7d5f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:58:07.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.912+0000 7f93aa74f700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:58:38 2024 2024-09-13T23:58:07.914 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:58:07.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.912+0000 7f93cb7d5f40 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:58:07.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.912+0000 7f93cb7d5f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:07.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.912+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da0800 con 0x55f2d2da0000 2024-09-13T23:58:07.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.912+0000 7f93a9f2d700 20 reqs_thread_entry: start 2024-09-13T23:58:07.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.912+0000 7f93ac753700 20 reqs_thread_entry: start 2024-09-13T23:58:07.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.912+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2da0000 2024-09-13T23:58:07.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.912+0000 7f93cb7d5f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:07.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.912+0000 7f93cb7d5f40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T23:58:07.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.912+0000 7f93cb7d5f40 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:58:07.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.912+0000 7f93cb7d5f40 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T23:58:07.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.912+0000 7f93cb7d5f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:07.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.912+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da2c00 con 0x55f2d2cd9c00 2024-09-13T23:58:07.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.912+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x55f2d2d49440 con 0x55f2d2cd9c00 2024-09-13T23:58:07.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.912+0000 7f93cb7d5f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:07.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.912+0000 7f93cb7d5f40 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T23:58:07.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.912+0000 7f93cb7d5f40 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:58:07.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.912+0000 7f93cb7d5f40 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T23:58:07.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.912+0000 7f93cb7d5f40 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T23:58:07.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.912+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da3800 con 0x55f2d2da0000 2024-09-13T23:58:07.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.916+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~346] v35'6 uv6 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2da0000 2024-09-13T23:58:07.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.916+0000 7f93cb7d5f40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T23:58:07.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.916+0000 7f93cb7d5f40 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:58:07.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.916+0000 7f93cb7d5f40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T23:58:07.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.916+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94501407983872 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da3c00 con 0x55f2d2cd9c00 2024-09-13T23:58:07.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.916+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== watch-notify(notify (1) cookie 94501406314880 notify 150323855389 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x55f2d2dfeb60 con 0x55f2d2cd9c00 2024-09-13T23:58:07.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.916+0000 7f93c4783700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855389 cookie 94501406314880 notifier 4815 bl.length()=522 2024-09-13T23:58:07.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.916+0000 7f93c4783700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T23:58:07.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.916+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(65 notify.5 [notify cookie 94501407983872 out=8b] v0'0 uv216 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55f2d2d49440 con 0x55f2d2cd9c00 2024-09-13T23:58:07.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.916+0000 7f93c4783700 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:58:07.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.916+0000 7f93c4783700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2ea2000 con 0x55f2d2cd9c00 2024-09-13T23:58:07.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.916+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d49440 con 0x55f2d2cd9c00 2024-09-13T23:58:07.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.916+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== watch-notify(notify_complete (2) cookie 94501407983872 notify 150323855389 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55f2d2dfed00 con 0x55f2d2cd9c00 2024-09-13T23:58:07.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.916+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da2400 con 0x55f2d2cd9c00 2024-09-13T23:58:07.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.920+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 <== osd.3 v2:172.21.15.173:6800/4020038786 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v35'9 uv9 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x55f2d2d49440 con 0x55f2d2cd9c00 2024-09-13T23:58:07.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.920+0000 7f93cb7d5f40 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T23:58:07.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.920+0000 7f93cb7d5f40 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:58:07.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.920+0000 7f93cb7d5f40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T23:58:07.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.920+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94501407983872 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2ea2000 con 0x55f2d2cd9400 2024-09-13T23:58:07.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.920+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== watch-notify(notify (1) cookie 94501406311424 notify 150323855401 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55f2d2c8a680 con 0x55f2d2cd9400 2024-09-13T23:58:07.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.920+0000 7f93c4783700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855401 cookie 94501406311424 notifier 4815 bl.length()=177 2024-09-13T23:58:07.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.920+0000 7f93c4783700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T23:58:07.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.920+0000 7f93c4783700 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:58:07.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.920+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(68 notify.2 [notify cookie 94501407983872 out=8b] v0'0 uv216 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55f2d2d49200 con 0x55f2d2cd9400 2024-09-13T23:58:07.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.920+0000 7f93c4783700 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2ea2400 con 0x55f2d2cd9400 2024-09-13T23:58:07.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.920+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d49200 con 0x55f2d2cd9400 2024-09-13T23:58:07.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.920+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== watch-notify(notify_complete (2) cookie 94501407983872 notify 150323855401 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55f2d2c8a820 con 0x55f2d2cd9400 2024-09-13T23:58:07.924 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:58:07.924 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "fud", 2024-09-13T23:58:07.924 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Fud", 2024-09-13T23:58:07.924 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "", 2024-09-13T23:58:07.924 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:58:07.924 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 4, 2024-09-13T23:58:07.924 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [], 2024-09-13T23:58:07.924 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:58:07.924 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:07.924 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "fud", 2024-09-13T23:58:07.925 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "p5YnriCv1nAtykxBrupQ", 2024-09-13T23:58:07.925 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh" 2024-09-13T23:58:07.925 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:07.925 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:07.925 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [], 2024-09-13T23:58:07.925 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [], 2024-09-13T23:58:07.925 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:58:07.925 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:58:07.925 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:58:07.925 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:58:07.925 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:58:07.925 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:58:07.925 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:58:07.925 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:58:07.925 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:58:07.926 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:58:07.926 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:07.926 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:58:07.926 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:58:07.926 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:58:07.926 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:58:07.926 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:58:07.926 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:58:07.926 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:07.926 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:58:07.926 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:58:07.926 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:58:07.926 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:58:07.926 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:58:07.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.920+0000 7f93b0f5c700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:07.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.920+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94501407981568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2ea2800 con 0x55f2d2cd9000 2024-09-13T23:58:07.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.924+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94501407981568] v35'215 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2cd9000 2024-09-13T23:58:07.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.924+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94501406309120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2ea2c00 con 0x55f2d2cd9400 2024-09-13T23:58:07.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.928+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94501406309120] v35'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d49200 con 0x55f2d2cd9400 2024-09-13T23:58:07.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.928+0000 7f93cb7d5f40 20 remove_watcher() i=0 2024-09-13T23:58:07.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.928+0000 7f93cb7d5f40 2 removed watcher, disabling cache 2024-09-13T23:58:07.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.928+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94501406310272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2ea3000 con 0x55f2d2cd9000 2024-09-13T23:58:07.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.932+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94501406310272] v35'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2cd9000 2024-09-13T23:58:07.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.932+0000 7f93cb7d5f40 20 remove_watcher() i=1 2024-09-13T23:58:07.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.932+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94501406311424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2ea3400 con 0x55f2d2cd9400 2024-09-13T23:58:07.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.932+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94501406311424] v35'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d49200 con 0x55f2d2cd9400 2024-09-13T23:58:07.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.932+0000 7f93cb7d5f40 20 remove_watcher() i=2 2024-09-13T23:58:07.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.932+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94501406312576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2ea3800 con 0x55f2d2da0000 2024-09-13T23:58:07.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.936+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94501406312576] v35'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2da0000 2024-09-13T23:58:07.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.936+0000 7f93cb7d5f40 20 remove_watcher() i=3 2024-09-13T23:58:07.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.936+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94501406313728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2ea3c00 con 0x55f2d2cd9400 2024-09-13T23:58:07.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.940+0000 7f93c9f8e700 1 -- 172.21.15.173:0/3535736720 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94501406313728] v35'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d49200 con 0x55f2d2cd9400 2024-09-13T23:58:07.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.940+0000 7f93cb7d5f40 20 remove_watcher() i=4 2024-09-13T23:58:07.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.940+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94501406314880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da2c00 con 0x55f2d2cd9c00 2024-09-13T23:58:07.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.940+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 <== osd.3 v2:172.21.15.173:6800/4020038786 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94501406314880] v35'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d49440 con 0x55f2d2cd9c00 2024-09-13T23:58:07.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.940+0000 7f93cb7d5f40 20 remove_watcher() i=5 2024-09-13T23:58:07.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.940+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94501406316032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da3c00 con 0x55f2d2cd9c00 2024-09-13T23:58:07.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.944+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 <== osd.3 v2:172.21.15.173:6800/4020038786 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94501406316032] v35'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d49440 con 0x55f2d2cd9c00 2024-09-13T23:58:07.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.944+0000 7f93cb7d5f40 20 remove_watcher() i=6 2024-09-13T23:58:07.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.944+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94501406317184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55f2d2da1000 con 0x55f2d2da0000 2024-09-13T23:58:07.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.944+0000 7f93ca78f700 1 -- 172.21.15.173:0/3535736720 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94501406317184] v35'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55f2d2d48b40 con 0x55f2d2da0000 2024-09-13T23:58:07.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 20 remove_watcher() i=7 2024-09-13T23:58:07.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f2d2cd9400 msgr2=0x55f2d2c1a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:07.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/3535736720 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55f2d2cd9400 0x55f2d2c1a100 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:07.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f2d2cd9000 msgr2=0x55f2d2c19b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:07.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/3535736720 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55f2d2cd9000 0x55f2d2c19b80 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:07.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f2d2da0000 msgr2=0x55f2d2c1ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:07.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/3535736720 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55f2d2da0000 0x55f2d2c1ac00 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:07.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f2d2cd9c00 msgr2=0x55f2d2c1a680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:07.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/3535736720 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55f2d2cd9c00 0x55f2d2c1a680 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:07.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f2d2cd8c00 msgr2=0x55f2d2c19600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:07.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/3535736720 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f2d2cd8c00 0x55f2d2c19600 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55f2d2ccbe60 tx=0x55f2d2d880c0 comp rx=0 tx=0).stop 2024-09-13T23:58:07.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933800 msgr2=0x55f2d2c18b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:07.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/3535736720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933800 0x55f2d2c18b00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x55f2d2ccac90 tx=0x55f2d2c96660 comp rx=0 tx=0).stop 2024-09-13T23:58:07.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 reap_dead start 2024-09-13T23:58:07.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93c978d700 1 -- 172.21.15.173:0/3535736720 reap_dead start 2024-09-13T23:58:07.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 shutdown_connections 2024-09-13T23:58:07.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 >> 172.21.15.173:0/3535736720 conn(0x55f2d2933400 msgr2=0x55f2d2a33800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:07.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 shutdown_connections 2024-09-13T23:58:07.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/3535736720 wait complete. 2024-09-13T23:58:07.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/1608114599 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f2d2cd9800 msgr2=0x55f2d2e38000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:07.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/1608114599 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f2d2cd9800 0x55f2d2e38000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55f2d2c57170 tx=0x55f2d2d89380 comp rx=0 tx=0).stop 2024-09-13T23:58:07.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/1608114599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2da0400 msgr2=0x55f2d2c1b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:07.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/1608114599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2da0400 0x55f2d2c1b180 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x55f2d2db22a0 tx=0x55f2d2d881e0 comp rx=0 tx=0).stop 2024-09-13T23:58:07.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/1608114599 shutdown_connections 2024-09-13T23:58:07.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/1608114599 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f2d2cd9800 0x55f2d2e38000 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:07.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/1608114599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2da0400 0x55f2d2c1b180 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:07.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/1608114599 >> 172.21.15.173:0/1608114599 conn(0x55f2d2da2800 msgr2=0x55f2d2a34000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:07.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/1608114599 shutdown_connections 2024-09-13T23:58:07.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/1608114599 wait complete. 2024-09-13T23:58:07.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/225582185 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f2d2cd8000 msgr2=0x55f2d2c19080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:07.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/225582185 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f2d2cd8000 0x55f2d2c19080 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55f2d2c56f90 tx=0x55f2d2c96c60 comp rx=0 tx=0).stop 2024-09-13T23:58:07.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/225582185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933000 msgr2=0x55f2d2c18580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:07.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/225582185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933000 0x55f2d2c18580 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x55f2d3793f20 tx=0x55f2d2a37920 comp rx=0 tx=0).stop 2024-09-13T23:58:07.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/225582185 shutdown_connections 2024-09-13T23:58:07.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/225582185 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55f2d2cd8000 0x55f2d2c19080 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:07.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 --2- 172.21.15.173:0/225582185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2d2933000 0x55f2d2c18580 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:07.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/225582185 >> 172.21.15.173:0/225582185 conn(0x55f2d2932c00 msgr2=0x55f2d2a33000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:07.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/225582185 shutdown_connections 2024-09-13T23:58:07.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:07.948+0000 7f93cb7d5f40 1 -- 172.21.15.173:0/225582185 wait complete. 2024-09-13T23:58:07.958 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:58:08.007 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:58:08.016 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-13T23:58:08.016 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-13T23:58:08.016 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-13T23:58:08.016 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-13T23:58:08.059 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:58:08.059 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:58:08.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.056+0000 7f2073778f40 1 Processor -- start 2024-09-13T23:58:08.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.056+0000 7f2073778f40 1 -- start start 2024-09-13T23:58:08.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.056+0000 7f2073778f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55bc16f6b400 0x55bc17250580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.056+0000 7f2073778f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55bc1702f500 con 0x55bc16f6b000 2024-09-13T23:58:08.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.056+0000 7f2073778f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55bc16ff8a00 con 0x55bc16f6b400 2024-09-13T23:58:08.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.056+0000 7f2071730700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55bc16f6b400 0x55bc17250580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.056+0000 7f2071f31700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55bc16f6b000 0x55bc1706a800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:38696/0 (socket says 172.21.15.173:38696) 2024-09-13T23:58:08.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.056+0000 7f2071f31700 1 -- 172.21.15.173:0/1673151385 learned_addr learned my addr 172.21.15.173:0/1673151385 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:58:08.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.056+0000 7f2071730700 1 -- 172.21.15.173:0/1673151385 >> v1:172.21.15.87:6789/0 conn(0x55bc16f6b000 legacy=0x55bc1706a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.060+0000 7f2071730700 1 -- 172.21.15.173:0/1673151385 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc16f7dd40 con 0x55bc16f6b400 2024-09-13T23:58:08.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.060+0000 7f2071730700 1 --2- 172.21.15.173:0/1673151385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b400 0x55bc17250580 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x55bc1724b920 tx=0x55bc1706f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e17964ca4dd865 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.060+0000 7f2070f2f700 1 -- 172.21.15.173:0/1673151385 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc1700f4a0 con 0x55bc16f6b400 2024-09-13T23:58:08.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.060+0000 7f2070f2f700 1 -- 172.21.15.173:0/1673151385 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc1702f800 con 0x55bc16f6b400 2024-09-13T23:58:08.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.060+0000 7f2070f2f700 1 -- 172.21.15.173:0/1673151385 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc1700f600 con 0x55bc16f6b400 2024-09-13T23:58:08.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.060+0000 7f2073778f40 1 -- 172.21.15.173:0/1673151385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b400 msgr2=0x55bc17250580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.060+0000 7f2073778f40 1 --2- 172.21.15.173:0/1673151385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b400 0x55bc17250580 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x55bc1724b920 tx=0x55bc1706f920 comp rx=0 tx=0).stop 2024-09-13T23:58:08.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.060+0000 7f2073778f40 1 -- 172.21.15.173:0/1673151385 shutdown_connections 2024-09-13T23:58:08.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.060+0000 7f2073778f40 1 --2- 172.21.15.173:0/1673151385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b400 0x55bc17250580 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.060+0000 7f2073778f40 1 -- 172.21.15.173:0/1673151385 >> 172.21.15.173:0/1673151385 conn(0x55bc16f6ac00 msgr2=0x55bc1706a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:08.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.060+0000 7f2073778f40 1 -- 172.21.15.173:0/1673151385 shutdown_connections 2024-09-13T23:58:08.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.060+0000 7f2073778f40 1 -- 172.21.15.173:0/1673151385 wait complete. 2024-09-13T23:58:08.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.060+0000 7f2073778f40 1 Processor -- start 2024-09-13T23:58:08.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.060+0000 7f2073778f40 1 -- start start 2024-09-13T23:58:08.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.060+0000 7f2073778f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b000 0x55bc17250580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.060+0000 7f2073778f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc16ff8500 con 0x55bc16f6b000 2024-09-13T23:58:08.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.060+0000 7f2071f31700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b000 0x55bc17250580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.060+0000 7f2071f31700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b000 0x55bc17250580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50000/0 (socket says 172.21.15.173:50000) 2024-09-13T23:58:08.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.060+0000 7f2071f31700 1 -- 172.21.15.173:0/720548468 learned_addr learned my addr 172.21.15.173:0/720548468 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:08.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.060+0000 7f2071f31700 1 -- 172.21.15.173:0/720548468 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc16f7dba0 con 0x55bc16f6b000 2024-09-13T23:58:08.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.064+0000 7f2071f31700 1 --2- 172.21.15.173:0/720548468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b000 0x55bc17250580 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x55bc170c7e00 tx=0x55bc1706fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f17cd69caff523f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.064+0000 7f207072e700 1 -- 172.21.15.173:0/720548468 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc1700f4a0 con 0x55bc16f6b000 2024-09-13T23:58:08.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.064+0000 7f207072e700 1 -- 172.21.15.173:0/720548468 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc1702fb00 con 0x55bc16f6b000 2024-09-13T23:58:08.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.064+0000 7f207072e700 1 -- 172.21.15.173:0/720548468 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc1700f600 con 0x55bc16f6b000 2024-09-13T23:58:08.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.064+0000 7f2073778f40 1 -- 172.21.15.173:0/720548468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b000 msgr2=0x55bc17250580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.064+0000 7f2073778f40 1 --2- 172.21.15.173:0/720548468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b000 0x55bc17250580 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x55bc170c7e00 tx=0x55bc1706fb60 comp rx=0 tx=0).stop 2024-09-13T23:58:08.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.064+0000 7f2073778f40 1 -- 172.21.15.173:0/720548468 shutdown_connections 2024-09-13T23:58:08.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.064+0000 7f2073778f40 1 --2- 172.21.15.173:0/720548468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b000 0x55bc17250580 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.064+0000 7f2073778f40 1 -- 172.21.15.173:0/720548468 >> 172.21.15.173:0/720548468 conn(0x55bc16f6ac00 msgr2=0x55bc1706b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:08.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.064+0000 7f2073778f40 1 -- 172.21.15.173:0/720548468 shutdown_connections 2024-09-13T23:58:08.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.064+0000 7f2073778f40 1 -- 172.21.15.173:0/720548468 wait complete. 2024-09-13T23:58:08.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.064+0000 7f2073778f40 1 Processor -- start 2024-09-13T23:58:08.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.064+0000 7f2073778f40 1 -- start start 2024-09-13T23:58:08.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.064+0000 7f2073778f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b000 0x55bc17250580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.064+0000 7f2073778f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc16ff83c0 con 0x55bc16f6b000 2024-09-13T23:58:08.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.064+0000 7f2071f31700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b000 0x55bc17250580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.064+0000 7f2071f31700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b000 0x55bc17250580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50010/0 (socket says 172.21.15.173:50010) 2024-09-13T23:58:08.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.064+0000 7f2071f31700 1 -- 172.21.15.173:0/1164475117 learned_addr learned my addr 172.21.15.173:0/1164475117 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:08.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.064+0000 7f2071f31700 1 -- 172.21.15.173:0/1164475117 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc16f7da00 con 0x55bc16f6b000 2024-09-13T23:58:08.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.064+0000 7f2071f31700 1 --2- 172.21.15.173:0/1164475117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b000 0x55bc17250580 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x55bc170c7e60 tx=0x55bc1706fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.068+0000 7f206ef2b700 1 -- 172.21.15.173:0/1164475117 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc1700f8c0 con 0x55bc16f6b000 2024-09-13T23:58:08.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.068+0000 7f206ef2b700 1 -- 172.21.15.173:0/1164475117 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc1702fc80 con 0x55bc16f6b000 2024-09-13T23:58:08.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.068+0000 7f2073778f40 1 -- 172.21.15.173:0/1164475117 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bc16f7d860 con 0x55bc16f6b000 2024-09-13T23:58:08.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.068+0000 7f206ef2b700 1 -- 172.21.15.173:0/1164475117 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc1700f4a0 con 0x55bc16f6b000 2024-09-13T23:58:08.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.068+0000 7f2073778f40 1 -- 172.21.15.173:0/1164475117 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc16f7d6c0 con 0x55bc16f6b000 2024-09-13T23:58:08.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.068+0000 7f2073778f40 1 Processor -- start 2024-09-13T23:58:08.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.068+0000 7f206ef2b700 1 -- 172.21.15.173:0/1164475117 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55bc17064b00 con 0x55bc16f6b000 2024-09-13T23:58:08.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.068+0000 7f2073778f40 1 -- start start 2024-09-13T23:58:08.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.068+0000 7f206ef2b700 1 --2- 172.21.15.173:0/1164475117 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bc1730e000 0x55bc17251080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.068+0000 7f2073778f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b800 0x55bc17250b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.068+0000 7f206ef2b700 1 -- 172.21.15.173:0/1164475117 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55bc16fd1180 con 0x55bc16f6b000 2024-09-13T23:58:08.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.068+0000 7f2073778f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc16f90640 con 0x55bc16f6b800 2024-09-13T23:58:08.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.068+0000 7f2072732700 1 --2- 172.21.15.173:0/1164475117 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bc1730e000 0x55bc17251080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.072+0000 7f2071f31700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b800 0x55bc17250b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.072+0000 7f2071f31700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b800 0x55bc17250b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50016/0 (socket says 172.21.15.173:50016) 2024-09-13T23:58:08.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.072+0000 7f2071f31700 1 -- 172.21.15.173:0/2509197450 learned_addr learned my addr 172.21.15.173:0/2509197450 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:08.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.072+0000 7f2071f31700 1 -- 172.21.15.173:0/2509197450 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc16f7c000 con 0x55bc16f6b800 2024-09-13T23:58:08.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.072+0000 7f2072732700 1 --2- 172.21.15.173:0/1164475117 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bc1730e000 0x55bc17251080 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55bc17de2c00 tx=0x55bc172cade0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.072+0000 7f2071f31700 1 --2- 172.21.15.173:0/2509197450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b800 0x55bc17250b00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x55bc17de3020 tx=0x55bc172ca240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807fde9413de6222 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.072+0000 7f206c726700 1 -- 172.21.15.173:0/2509197450 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc1700f600 con 0x55bc16f6b800 2024-09-13T23:58:08.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.072+0000 7f206c726700 1 -- 172.21.15.173:0/2509197450 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc1702fc80 con 0x55bc16f6b800 2024-09-13T23:58:08.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.072+0000 7f206c726700 1 -- 172.21.15.173:0/2509197450 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc1700fa20 con 0x55bc16f6b800 2024-09-13T23:58:08.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.072+0000 7f2073778f40 1 -- 172.21.15.173:0/2509197450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b800 msgr2=0x55bc17250b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.072+0000 7f2073778f40 1 --2- 172.21.15.173:0/2509197450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b800 0x55bc17250b00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x55bc17de3020 tx=0x55bc172ca240 comp rx=0 tx=0).stop 2024-09-13T23:58:08.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.072+0000 7f2073778f40 1 -- 172.21.15.173:0/2509197450 shutdown_connections 2024-09-13T23:58:08.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.072+0000 7f2073778f40 1 --2- 172.21.15.173:0/2509197450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b800 0x55bc17250b00 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.072+0000 7f2073778f40 1 -- 172.21.15.173:0/2509197450 >> 172.21.15.173:0/2509197450 conn(0x55bc16f6b400 msgr2=0x55bc1706b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:08.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.072+0000 7f2073778f40 1 -- 172.21.15.173:0/2509197450 shutdown_connections 2024-09-13T23:58:08.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.072+0000 7f2073778f40 1 -- 172.21.15.173:0/2509197450 wait complete. 2024-09-13T23:58:08.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.072+0000 7f2073778f40 1 Processor -- start 2024-09-13T23:58:08.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.072+0000 7f2073778f40 1 -- start start 2024-09-13T23:58:08.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.072+0000 7f2073778f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b800 0x55bc17250b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.072+0000 7f2073778f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc16f908c0 con 0x55bc16f6b800 2024-09-13T23:58:08.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.076+0000 7f2071f31700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b800 0x55bc17250b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.076+0000 7f2071f31700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b800 0x55bc17250b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50022/0 (socket says 172.21.15.173:50022) 2024-09-13T23:58:08.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.076+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 learned_addr learned my addr 172.21.15.173:0/315669644 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:08.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.076+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc16f7cea0 con 0x55bc16f6b800 2024-09-13T23:58:08.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.076+0000 7f2071f31700 1 --2- 172.21.15.173:0/315669644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b800 0x55bc17250b00 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x55bc17de25a0 tx=0x55bc172cafc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.076+0000 7f206af23700 1 -- 172.21.15.173:0/315669644 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc1700f600 con 0x55bc16f6b800 2024-09-13T23:58:08.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.076+0000 7f206af23700 1 -- 172.21.15.173:0/315669644 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc1732e000 con 0x55bc16f6b800 2024-09-13T23:58:08.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.076+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bc16f7c820 con 0x55bc16f6b800 2024-09-13T23:58:08.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.076+0000 7f206af23700 1 -- 172.21.15.173:0/315669644 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc1700fa20 con 0x55bc16f6b800 2024-09-13T23:58:08.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.076+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc16f7c9c0 con 0x55bc16f6b800 2024-09-13T23:58:08.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.076+0000 7f206af23700 1 -- 172.21.15.173:0/315669644 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55bc17064dc0 con 0x55bc16f6b800 2024-09-13T23:58:08.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.076+0000 7f206af23700 1 --2- 172.21.15.173:0/315669644 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bc1730f000 0x55bc17251600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.076+0000 7f206af23700 1 -- 172.21.15.173:0/315669644 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55bc16fd1340 con 0x55bc16f6b800 2024-09-13T23:58:08.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.076+0000 7f2073778f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.076+0000 7f2071730700 1 --2- 172.21.15.173:0/315669644 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bc1730f000 0x55bc17251600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.076+0000 7f2073778f40 1 --2- 172.21.15.173:0/315669644 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55bc1730f400 0x55bc17251b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.080+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc1730f800 con 0x55bc1730f400 2024-09-13T23:58:08.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.080+0000 7f2072732700 1 --2- 172.21.15.173:0/315669644 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55bc1730f400 0x55bc17251b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.080+0000 7f2071730700 1 --2- 172.21.15.173:0/315669644 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bc1730f000 0x55bc17251600 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55bc1724b920 tx=0x55bc1706f800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.080+0000 7f2072732700 1 --2- 172.21.15.173:0/315669644 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55bc1730f400 0x55bc17251b80 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.080+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc1730f400 2024-09-13T23:58:08.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.080+0000 7f2073778f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:08.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.080+0000 7f2073778f40 20 realm 2024-09-13T23:58:08.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.080+0000 7f2073778f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.080+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc1730fc00 con 0x55bc1730f400 2024-09-13T23:58:08.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.080+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc1730f400 2024-09-13T23:58:08.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.080+0000 7f2073778f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:08.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.080+0000 7f2073778f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:58:08.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.080+0000 7f2073778f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.080+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc1730f800 con 0x55bc1730f400 2024-09-13T23:58:08.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.080+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc1730f400 2024-09-13T23:58:08.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.080+0000 7f2073778f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:08.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.080+0000 7f2073778f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.080+0000 7f2073778f40 1 --2- 172.21.15.173:0/315669644 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55bc1730fc00 0x55bc17252100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.080+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc1730fc00 2024-09-13T23:58:08.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.080+0000 7f2071f31700 1 --2- 172.21.15.173:0/315669644 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55bc1730fc00 0x55bc17252100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.080+0000 7f2071f31700 1 --2- 172.21.15.173:0/315669644 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55bc1730fc00 0x55bc17252100 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.084+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55bc173a1200 con 0x55bc1730fc00 2024-09-13T23:58:08.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.084+0000 7f2073778f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:08.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.084+0000 7f2073778f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.084+0000 7f2073778f40 1 --2- 172.21.15.173:0/315669644 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55bc173aa400 0x55bc17252680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.084+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa800 con 0x55bc173aa400 2024-09-13T23:58:08.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.084+0000 7f2071730700 1 --2- 172.21.15.173:0/315669644 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55bc173aa400 0x55bc17252680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.084+0000 7f2071730700 1 --2- 172.21.15.173:0/315669644 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55bc173aa400 0x55bc17252680 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.084+0000 7f2071730700 1 -- 172.21.15.173:0/315669644 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55bc173a1440 con 0x55bc173aa400 2024-09-13T23:58:08.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.084+0000 7f2073778f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:58:08.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.084+0000 7f2073778f40 20 searching for the correct realm 2024-09-13T23:58:08.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.084+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aac00 con 0x55bc173aa400 2024-09-13T23:58:08.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.084+0000 7f2071730700 1 -- 172.21.15.173:0/315669644 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55bc173a1440 con 0x55bc173aa400 2024-09-13T23:58:08.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.084+0000 7f2071730700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa800 con 0x55bc1730fc00 2024-09-13T23:58:08.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.084+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a1200 con 0x55bc1730fc00 2024-09-13T23:58:08.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.084+0000 7f2071f31700 1 --2- 172.21.15.173:0/315669644 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55bc173aa800 0x55bc17252c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.084+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc173aa800 2024-09-13T23:58:08.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.084+0000 7f2072732700 1 --2- 172.21.15.173:0/315669644 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55bc173aa800 0x55bc17252c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.088+0000 7f2072732700 1 --2- 172.21.15.173:0/315669644 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55bc173aa800 0x55bc17252c00 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.088+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc173aa800 2024-09-13T23:58:08.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.088+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc173aa800 2024-09-13T23:58:08.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.088+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc173aa800 2024-09-13T23:58:08.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.088+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc1730f400 2024-09-13T23:58:08.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.088+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc1730f400 2024-09-13T23:58:08.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.088+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc173aa400 2024-09-13T23:58:08.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.088+0000 7f2071730700 1 -- 172.21.15.173:0/315669644 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a1440 con 0x55bc173aa400 2024-09-13T23:58:08.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.088+0000 7f2071730700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc1730f400 2024-09-13T23:58:08.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.088+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc1730f400 2024-09-13T23:58:08.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.088+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc1730fc00 2024-09-13T23:58:08.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.088+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a1200 con 0x55bc1730fc00 2024-09-13T23:58:08.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.088+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc1730fc00 2024-09-13T23:58:08.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.092+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a1200 con 0x55bc1730fc00 2024-09-13T23:58:08.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.092+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc1730f400 2024-09-13T23:58:08.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.092+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc1730f400 2024-09-13T23:58:08.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.092+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc173aa800 2024-09-13T23:58:08.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.092+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc173aa800 2024-09-13T23:58:08.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.092+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc1730f400 2024-09-13T23:58:08.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.092+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc1730f400 2024-09-13T23:58:08.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.092+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc173aa800 2024-09-13T23:58:08.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.092+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc173aa800 2024-09-13T23:58:08.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.092+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc1730fc00 2024-09-13T23:58:08.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.092+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a1200 con 0x55bc1730fc00 2024-09-13T23:58:08.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.092+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc173aa400 2024-09-13T23:58:08.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.096+0000 7f2071730700 1 -- 172.21.15.173:0/315669644 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a1440 con 0x55bc173aa400 2024-09-13T23:58:08.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.096+0000 7f2071730700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc1730f400 2024-09-13T23:58:08.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.096+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc1730f400 2024-09-13T23:58:08.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.096+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc1730fc00 2024-09-13T23:58:08.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.096+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a1200 con 0x55bc1730fc00 2024-09-13T23:58:08.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.096+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc173aa400 2024-09-13T23:58:08.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.096+0000 7f2071730700 1 -- 172.21.15.173:0/315669644 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a1440 con 0x55bc173aa400 2024-09-13T23:58:08.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.096+0000 7f2071730700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc1730f400 2024-09-13T23:58:08.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.096+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc1730f400 2024-09-13T23:58:08.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.096+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc1730f400 2024-09-13T23:58:08.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.096+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc1730f400 2024-09-13T23:58:08.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.096+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc1730f400 2024-09-13T23:58:08.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.100+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc1730f400 2024-09-13T23:58:08.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.100+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc173aa400 2024-09-13T23:58:08.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.100+0000 7f2071730700 1 -- 172.21.15.173:0/315669644 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a1440 con 0x55bc173aa400 2024-09-13T23:58:08.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.100+0000 7f2071730700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc173aa800 2024-09-13T23:58:08.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.100+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc173aa800 2024-09-13T23:58:08.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.100+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc1730f400 2024-09-13T23:58:08.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.100+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc1730f400 2024-09-13T23:58:08.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.100+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc173aa800 2024-09-13T23:58:08.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.100+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc173aa800 2024-09-13T23:58:08.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.100+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc173aa400 2024-09-13T23:58:08.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.100+0000 7f2071730700 1 -- 172.21.15.173:0/315669644 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a1440 con 0x55bc173aa400 2024-09-13T23:58:08.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.100+0000 7f2071730700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc173aa800 2024-09-13T23:58:08.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.100+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc173aa800 2024-09-13T23:58:08.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.100+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc1730fc00 2024-09-13T23:58:08.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.104+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a1200 con 0x55bc1730fc00 2024-09-13T23:58:08.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.104+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc1730fc00 2024-09-13T23:58:08.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.104+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a1200 con 0x55bc1730fc00 2024-09-13T23:58:08.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.104+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc173aa400 2024-09-13T23:58:08.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.104+0000 7f2071730700 1 -- 172.21.15.173:0/315669644 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a1440 con 0x55bc173aa400 2024-09-13T23:58:08.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.104+0000 7f2071730700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc1730fc00 2024-09-13T23:58:08.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.104+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55bc173a1200 con 0x55bc1730fc00 2024-09-13T23:58:08.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.104+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc1730fc00 2024-09-13T23:58:08.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.104+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55bc173a1200 con 0x55bc1730fc00 2024-09-13T23:58:08.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.104+0000 7f2073778f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:58:08.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.104+0000 7f2073778f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:58:08.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.104+0000 7f2073778f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:58:08.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.104+0000 7f2073778f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:58:08.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.104+0000 7f2073778f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.104+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173ab000 con 0x55bc1730f400 2024-09-13T23:58:08.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.104+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc1730f400 2024-09-13T23:58:08.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.104+0000 7f2073778f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:08.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.104+0000 7f2073778f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.104+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173ab400 con 0x55bc1730fc00 2024-09-13T23:58:08.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55bc173a1200 con 0x55bc1730fc00 2024-09-13T23:58:08.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2073778f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:08.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2073778f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173ab800 con 0x55bc173aa800 2024-09-13T23:58:08.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc173aa800 2024-09-13T23:58:08.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2073778f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:58:08.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2073778f40 20 zone default found 2024-09-13T23:58:08.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2073778f40 4 Realm: () 2024-09-13T23:58:08.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2073778f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:58:08.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2073778f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:58:08.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2073778f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:58:08.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2073778f40 20 zonegroup default 2024-09-13T23:58:08.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2073778f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173abc00 con 0x55bc173aa800 2024-09-13T23:58:08.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc173aa800 2024-09-13T23:58:08.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2073778f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:08.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2073778f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173ab000 con 0x55bc173aa400 2024-09-13T23:58:08.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2071730700 1 -- 172.21.15.173:0/315669644 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55bc173a1440 con 0x55bc173aa400 2024-09-13T23:58:08.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2073778f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:08.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2073778f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173ab800 con 0x55bc173aa400 2024-09-13T23:58:08.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2071730700 1 -- 172.21.15.173:0/315669644 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55bc173a1440 con 0x55bc173aa400 2024-09-13T23:58:08.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2073778f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:08.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2073778f40 20 started sync module instance, tier type = 2024-09-13T23:58:08.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2073778f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:58:08.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.108+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc1730f800 con 0x55bc1730fc00 2024-09-13T23:58:08.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.112+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v35'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc173a1200 con 0x55bc1730fc00 2024-09-13T23:58:08.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.112+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94266330479360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc1730e800 con 0x55bc1730fc00 2024-09-13T23:58:08.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.112+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc1730f800 con 0x55bc1730f400 2024-09-13T23:58:08.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.116+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v35'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc1730f400 2024-09-13T23:58:08.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.116+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94266330479360] v35'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc173a1200 con 0x55bc1730fc00 2024-09-13T23:58:08.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.116+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94266330480512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aa000 con 0x55bc1730f400 2024-09-13T23:58:08.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.116+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173ab400 con 0x55bc1730fc00 2024-09-13T23:58:08.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.120+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94266330480512] v35'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc1730f400 2024-09-13T23:58:08.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.120+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v35'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc173a1200 con 0x55bc1730fc00 2024-09-13T23:58:08.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.120+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94266330481664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173b2000 con 0x55bc1730fc00 2024-09-13T23:58:08.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.120+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173b2400 con 0x55bc173aa800 2024-09-13T23:58:08.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.120+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94266330481664] v35'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc173a1200 con 0x55bc1730fc00 2024-09-13T23:58:08.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.120+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v35'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc173aa800 2024-09-13T23:58:08.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.120+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94266330482816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173b2800 con 0x55bc173aa800 2024-09-13T23:58:08.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.120+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173b2c00 con 0x55bc1730fc00 2024-09-13T23:58:08.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.124+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94266330482816] v35'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc173aa800 2024-09-13T23:58:08.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.124+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v35'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc173a1200 con 0x55bc1730fc00 2024-09-13T23:58:08.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.124+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94266330483968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173b3000 con 0x55bc1730fc00 2024-09-13T23:58:08.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.124+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173b3400 con 0x55bc173aa400 2024-09-13T23:58:08.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.128+0000 7f2071730700 1 -- 172.21.15.173:0/315669644 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v35'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc173a1440 con 0x55bc173aa400 2024-09-13T23:58:08.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.128+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94266330485120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173b3800 con 0x55bc173aa400 2024-09-13T23:58:08.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.128+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173b3c00 con 0x55bc173aa400 2024-09-13T23:58:08.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.128+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94266330483968] v35'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc173a1200 con 0x55bc1730fc00 2024-09-13T23:58:08.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.128+0000 7f2071730700 1 -- 172.21.15.173:0/315669644 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94266330485120] v35'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc173a1440 con 0x55bc173aa400 2024-09-13T23:58:08.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.128+0000 7f2071730700 1 -- 172.21.15.173:0/315669644 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v35'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc173a1440 con 0x55bc173aa400 2024-09-13T23:58:08.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.128+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94266330486272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173b3400 con 0x55bc173aa400 2024-09-13T23:58:08.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.128+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173b2000 con 0x55bc173aa800 2024-09-13T23:58:08.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.132+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v35'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc173aa800 2024-09-13T23:58:08.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.132+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94266330487424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173b2c00 con 0x55bc173aa800 2024-09-13T23:58:08.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.132+0000 7f2073778f40 20 add_watcher() i=0 2024-09-13T23:58:08.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.132+0000 7f2073778f40 20 add_watcher() i=1 2024-09-13T23:58:08.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.132+0000 7f2073778f40 20 add_watcher() i=2 2024-09-13T23:58:08.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.132+0000 7f2073778f40 20 add_watcher() i=3 2024-09-13T23:58:08.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.132+0000 7f2073778f40 20 add_watcher() i=4 2024-09-13T23:58:08.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.132+0000 7f2073778f40 20 add_watcher() i=5 2024-09-13T23:58:08.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.132+0000 7f2071730700 1 -- 172.21.15.173:0/315669644 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94266330486272] v35'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc173a1440 con 0x55bc173aa400 2024-09-13T23:58:08.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.132+0000 7f2073778f40 20 add_watcher() i=6 2024-09-13T23:58:08.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.132+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94266330487424] v35'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc173aa800 2024-09-13T23:58:08.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.132+0000 7f2073778f40 20 add_watcher() i=7 2024-09-13T23:58:08.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.132+0000 7f2073778f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:58:08.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.132+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173aac00 con 0x55bc1730f400 2024-09-13T23:58:08.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.132+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc1730f400 2024-09-13T23:58:08.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.132+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94266332004352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173ab000 con 0x55bc1730f400 2024-09-13T23:58:08.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.136+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94266332004352] v35'216 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc1730f400 2024-09-13T23:58:08.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.136+0000 7f2058eff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:08.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.136+0000 7f2073778f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:58:08.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.136+0000 7f2073778f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:58:08.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.136+0000 7f2073778f40 1 Processor -- start 2024-09-13T23:58:08.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.136+0000 7f2073778f40 1 -- start start 2024-09-13T23:58:08.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.136+0000 7f2073778f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc173ab400 0x55bc17253180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.136+0000 7f2073778f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc16ff83c0 con 0x55bc173ab400 2024-09-13T23:58:08.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.136+0000 7f2071730700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc173ab400 0x55bc17253180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.136+0000 7f2071730700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc173ab400 0x55bc17253180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50026/0 (socket says 172.21.15.173:50026) 2024-09-13T23:58:08.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.136+0000 7f2071730700 1 -- 172.21.15.173:0/3329889857 learned_addr learned my addr 172.21.15.173:0/3329889857 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:08.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.136+0000 7f2071730700 1 -- 172.21.15.173:0/3329889857 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc16f7cb60 con 0x55bc173ab400 2024-09-13T23:58:08.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.136+0000 7f2071730700 1 --2- 172.21.15.173:0/3329889857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc173ab400 0x55bc17253180 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x55bc1734ffb0 tx=0x55bc1706f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2938608443b01fbc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.136+0000 7f20586fe700 1 -- 172.21.15.173:0/3329889857 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc1700f760 con 0x55bc173ab400 2024-09-13T23:58:08.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.136+0000 7f20586fe700 1 -- 172.21.15.173:0/3329889857 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc1732e900 con 0x55bc173ab400 2024-09-13T23:58:08.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.136+0000 7f20586fe700 1 -- 172.21.15.173:0/3329889857 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc173ba160 con 0x55bc173ab400 2024-09-13T23:58:08.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.140+0000 7f2073778f40 1 -- 172.21.15.173:0/3329889857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc173ab400 msgr2=0x55bc17253180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.140+0000 7f2073778f40 1 --2- 172.21.15.173:0/3329889857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc173ab400 0x55bc17253180 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x55bc1734ffb0 tx=0x55bc1706f980 comp rx=0 tx=0).stop 2024-09-13T23:58:08.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.140+0000 7f2073778f40 1 -- 172.21.15.173:0/3329889857 shutdown_connections 2024-09-13T23:58:08.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.140+0000 7f2073778f40 1 --2- 172.21.15.173:0/3329889857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc173ab400 0x55bc17253180 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.140+0000 7f2073778f40 1 -- 172.21.15.173:0/3329889857 >> 172.21.15.173:0/3329889857 conn(0x55bc173ab800 msgr2=0x55bc1706c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:08.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.140+0000 7f2073778f40 1 -- 172.21.15.173:0/3329889857 shutdown_connections 2024-09-13T23:58:08.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.140+0000 7f2073778f40 1 -- 172.21.15.173:0/3329889857 wait complete. 2024-09-13T23:58:08.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.140+0000 7f2073778f40 1 Processor -- start 2024-09-13T23:58:08.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.140+0000 7f2073778f40 1 -- start start 2024-09-13T23:58:08.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.140+0000 7f2073778f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc173ab400 0x55bc17253180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.140+0000 7f2073778f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc16ff8500 con 0x55bc173ab400 2024-09-13T23:58:08.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.140+0000 7f2071730700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc173ab400 0x55bc17253180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.140+0000 7f2071730700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc173ab400 0x55bc17253180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50042/0 (socket says 172.21.15.173:50042) 2024-09-13T23:58:08.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.140+0000 7f2071730700 1 -- 172.21.15.173:0/2063301385 learned_addr learned my addr 172.21.15.173:0/2063301385 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:08.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.140+0000 7f2071730700 1 -- 172.21.15.173:0/2063301385 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc16f7cd00 con 0x55bc173ab400 2024-09-13T23:58:08.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.140+0000 7f2071730700 1 --2- 172.21.15.173:0/2063301385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc173ab400 0x55bc17253180 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x55bc173c5290 tx=0x55bc173885a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.140+0000 7f2056efb700 1 -- 172.21.15.173:0/2063301385 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc173ba2c0 con 0x55bc173ab400 2024-09-13T23:58:08.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.140+0000 7f2056efb700 1 -- 172.21.15.173:0/2063301385 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc1732e600 con 0x55bc173ab400 2024-09-13T23:58:08.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.140+0000 7f2073778f40 1 -- 172.21.15.173:0/2063301385 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bc16f7c340 con 0x55bc173ab400 2024-09-13T23:58:08.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.140+0000 7f2056efb700 1 -- 172.21.15.173:0/2063301385 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55bc173ba420 con 0x55bc173ab400 2024-09-13T23:58:08.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.140+0000 7f2073778f40 1 -- 172.21.15.173:0/2063301385 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc16f7dd40 con 0x55bc173ab400 2024-09-13T23:58:08.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.144+0000 7f2056efb700 1 -- 172.21.15.173:0/2063301385 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55bc17065b80 con 0x55bc173ab400 2024-09-13T23:58:08.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.144+0000 7f2056efb700 1 --2- 172.21.15.173:0/2063301385 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bc173aac00 0x55bc17444000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.144+0000 7f2056efb700 1 -- 172.21.15.173:0/2063301385 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55bc16fd16c0 con 0x55bc173ab400 2024-09-13T23:58:08.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.144+0000 7f2073778f40 5 note: GC not initialized 2024-09-13T23:58:08.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.144+0000 7f2072732700 1 --2- 172.21.15.173:0/2063301385 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bc173aac00 0x55bc17444000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.144+0000 7f2072732700 1 --2- 172.21.15.173:0/2063301385 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bc173aac00 0x55bc17444000 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55bc1734f710 tx=0x55bc172cad80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.144+0000 7f2073778f40 20 init_complete bucket index max shards: 11 2024-09-13T23:58:08.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.144+0000 7f20546f6700 20 reqs_thread_entry: start 2024-09-13T23:58:08.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.144+0000 7f2073778f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:58:08.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.144+0000 7f20526f2700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:58:38 2024 2024-09-13T23:58:08.149 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:58:08.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.144+0000 7f2051ed0700 20 reqs_thread_entry: start 2024-09-13T23:58:08.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.144+0000 7f2073778f40 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-13T23:58:08.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.144+0000 7f2073778f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.144+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc1730e800 con 0x55bc173aa800 2024-09-13T23:58:08.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.148+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(62 bud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc173aa800 2024-09-13T23:58:08.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.148+0000 7f2073778f40 20 rados_obj.operate() r=0 bl.length=346 2024-09-13T23:58:08.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.148+0000 7f2073778f40 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-13T23:58:08.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.148+0000 7f2073778f40 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T23:58:08.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.148+0000 7f2073778f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:58:08.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.148+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc1730f800 con 0x55bc173aa800 2024-09-13T23:58:08.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.148+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(63 fud [create,call,writefull 0~181] v35'7 uv6 ondisk = -17 ((17) File exists)) v8 ==== 231+0+0 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc173aa800 2024-09-13T23:58:08.153 INFO:teuthology.orchestra.run.smithi173.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-13T23:58:08.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.152+0000 7f2058eff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:08.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.152+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94266332004352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173b2800 con 0x55bc1730f400 2024-09-13T23:58:08.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.152+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94266332004352] v35'217 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc1730f400 2024-09-13T23:58:08.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.152+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94266330479360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173b2000 con 0x55bc1730fc00 2024-09-13T23:58:08.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.156+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94266330479360] v35'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc173a1200 con 0x55bc1730fc00 2024-09-13T23:58:08.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.156+0000 7f2073778f40 20 remove_watcher() i=0 2024-09-13T23:58:08.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.156+0000 7f2073778f40 2 removed watcher, disabling cache 2024-09-13T23:58:08.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.156+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94266330480512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173b2c00 con 0x55bc1730f400 2024-09-13T23:58:08.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.160+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94266330480512] v35'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc1730f400 2024-09-13T23:58:08.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.160+0000 7f2073778f40 20 remove_watcher() i=1 2024-09-13T23:58:08.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.160+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94266330481664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173b3000 con 0x55bc1730fc00 2024-09-13T23:58:08.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.160+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94266330481664] v35'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc173a1200 con 0x55bc1730fc00 2024-09-13T23:58:08.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.160+0000 7f2073778f40 20 remove_watcher() i=2 2024-09-13T23:58:08.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.160+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94266330482816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173b2400 con 0x55bc173aa800 2024-09-13T23:58:08.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.164+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94266330482816] v35'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc173aa800 2024-09-13T23:58:08.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.164+0000 7f2073778f40 20 remove_watcher() i=3 2024-09-13T23:58:08.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.164+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94266330483968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc173ab000 con 0x55bc1730fc00 2024-09-13T23:58:08.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.164+0000 7f2071f31700 1 -- 172.21.15.173:0/315669644 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94266330483968] v35'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc173a1200 con 0x55bc1730fc00 2024-09-13T23:58:08.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.164+0000 7f2073778f40 20 remove_watcher() i=4 2024-09-13T23:58:08.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.164+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94266330485120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc1738e000 con 0x55bc173aa400 2024-09-13T23:58:08.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.168+0000 7f2071730700 1 -- 172.21.15.173:0/315669644 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94266330485120] v35'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc173a1440 con 0x55bc173aa400 2024-09-13T23:58:08.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.168+0000 7f2073778f40 20 remove_watcher() i=5 2024-09-13T23:58:08.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.168+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94266330486272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc1738e400 con 0x55bc173aa400 2024-09-13T23:58:08.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.172+0000 7f2071730700 1 -- 172.21.15.173:0/315669644 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94266330486272] v35'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc173a1440 con 0x55bc173aa400 2024-09-13T23:58:08.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.172+0000 7f2073778f40 20 remove_watcher() i=6 2024-09-13T23:58:08.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.172+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94266330487424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55bc1738e800 con 0x55bc173aa800 2024-09-13T23:58:08.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.172+0000 7f2072732700 1 -- 172.21.15.173:0/315669644 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94266330487424] v35'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55bc173a0b40 con 0x55bc173aa800 2024-09-13T23:58:08.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.172+0000 7f2073778f40 20 remove_watcher() i=7 2024-09-13T23:58:08.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.172+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55bc1730fc00 msgr2=0x55bc17252100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.172+0000 7f2073778f40 1 --2- 172.21.15.173:0/315669644 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55bc1730fc00 0x55bc17252100 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.172+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55bc1730f400 msgr2=0x55bc17251b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.172+0000 7f2073778f40 1 --2- 172.21.15.173:0/315669644 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55bc1730f400 0x55bc17251b80 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.172+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55bc173aa800 msgr2=0x55bc17252c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.172+0000 7f2073778f40 1 --2- 172.21.15.173:0/315669644 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55bc173aa800 0x55bc17252c00 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.172+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55bc173aa400 msgr2=0x55bc17252680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.172+0000 7f2073778f40 1 --2- 172.21.15.173:0/315669644 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55bc173aa400 0x55bc17252680 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.172+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bc1730f000 msgr2=0x55bc17251600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.172+0000 7f2073778f40 1 --2- 172.21.15.173:0/315669644 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bc1730f000 0x55bc17251600 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55bc1724b920 tx=0x55bc1706f800 comp rx=0 tx=0).stop 2024-09-13T23:58:08.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.172+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b800 msgr2=0x55bc17250b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.172+0000 7f2073778f40 1 --2- 172.21.15.173:0/315669644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b800 0x55bc17250b00 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x55bc17de25a0 tx=0x55bc172cafc0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.172+0000 7f2071730700 1 -- 172.21.15.173:0/315669644 reap_dead start 2024-09-13T23:58:08.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.172+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 shutdown_connections 2024-09-13T23:58:08.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.172+0000 7f2073778f40 1 --2- 172.21.15.173:0/315669644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b800 0x55bc17250b00 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.172+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 >> 172.21.15.173:0/315669644 conn(0x55bc16f6b400 msgr2=0x55bc1706b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:08.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.172+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 shutdown_connections 2024-09-13T23:58:08.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.172+0000 7f2073778f40 1 -- 172.21.15.173:0/315669644 wait complete. 2024-09-13T23:58:08.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.176+0000 7f2073778f40 1 -- 172.21.15.173:0/2063301385 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bc173aac00 msgr2=0x55bc17444000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.176+0000 7f2073778f40 1 --2- 172.21.15.173:0/2063301385 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bc173aac00 0x55bc17444000 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55bc1734f710 tx=0x55bc172cad80 comp rx=0 tx=0).stop 2024-09-13T23:58:08.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.176+0000 7f2073778f40 1 -- 172.21.15.173:0/2063301385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc173ab400 msgr2=0x55bc17253180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.176+0000 7f2073778f40 1 --2- 172.21.15.173:0/2063301385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc173ab400 0x55bc17253180 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x55bc173c5290 tx=0x55bc173885a0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.176+0000 7f2073778f40 1 -- 172.21.15.173:0/2063301385 shutdown_connections 2024-09-13T23:58:08.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.176+0000 7f2073778f40 1 --2- 172.21.15.173:0/2063301385 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bc173aac00 0x55bc17444000 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.176+0000 7f2073778f40 1 --2- 172.21.15.173:0/2063301385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc173ab400 0x55bc17253180 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.176+0000 7f2073778f40 1 -- 172.21.15.173:0/2063301385 >> 172.21.15.173:0/2063301385 conn(0x55bc173ab800 msgr2=0x55bc1706c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:08.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.176+0000 7f2073778f40 1 -- 172.21.15.173:0/2063301385 shutdown_connections 2024-09-13T23:58:08.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.176+0000 7f2073778f40 1 -- 172.21.15.173:0/2063301385 wait complete. 2024-09-13T23:58:08.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.176+0000 7f2073778f40 1 -- 172.21.15.173:0/1164475117 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bc1730e000 msgr2=0x55bc17251080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.176+0000 7f2073778f40 1 --2- 172.21.15.173:0/1164475117 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bc1730e000 0x55bc17251080 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55bc17de2c00 tx=0x55bc172cade0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.176+0000 7f2073778f40 1 -- 172.21.15.173:0/1164475117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b000 msgr2=0x55bc17250580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.176+0000 7f2073778f40 1 --2- 172.21.15.173:0/1164475117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b000 0x55bc17250580 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x55bc170c7e60 tx=0x55bc1706fa40 comp rx=0 tx=0).stop 2024-09-13T23:58:08.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.176+0000 7f2073778f40 1 -- 172.21.15.173:0/1164475117 shutdown_connections 2024-09-13T23:58:08.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.176+0000 7f2073778f40 1 --2- 172.21.15.173:0/1164475117 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55bc1730e000 0x55bc17251080 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.176+0000 7f2073778f40 1 --2- 172.21.15.173:0/1164475117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55bc16f6b000 0x55bc17250580 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.176+0000 7f2073778f40 1 -- 172.21.15.173:0/1164475117 >> 172.21.15.173:0/1164475117 conn(0x55bc16f6ac00 msgr2=0x55bc1706b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:08.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.176+0000 7f2073778f40 1 -- 172.21.15.173:0/1164475117 shutdown_connections 2024-09-13T23:58:08.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.176+0000 7f2073778f40 1 -- 172.21.15.173:0/1164475117 wait complete. 2024-09-13T23:58:08.184 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T23:58:08.191 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:58:08.191 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-13T23:58:08.198 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:58:08.198 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-13T23:58:08.198 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-13T23:58:08.198 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-13T23:58:08.199 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-13T23:58:08.240 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:58:08.240 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:58:08.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.236+0000 7fe8b74f3f40 1 Processor -- start 2024-09-13T23:58:08.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.236+0000 7fe8b74f3f40 1 -- start start 2024-09-13T23:58:08.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.236+0000 7fe8b74f3f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x561b10b63400 0x561b10e48580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.236+0000 7fe8b74f3f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561b10c27500 con 0x561b10b63000 2024-09-13T23:58:08.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.236+0000 7fe8b74f3f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x561b10bf0a00 con 0x561b10b63400 2024-09-13T23:58:08.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.240+0000 7fe8b54ab700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x561b10b63400 0x561b10e48580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.240+0000 7fe8b5cac700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x561b10b63000 0x561b10c62800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:38700/0 (socket says 172.21.15.173:38700) 2024-09-13T23:58:08.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.240+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1401233558 learned_addr learned my addr 172.21.15.173:0/1401233558 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:58:08.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.240+0000 7fe8b54ab700 1 -- 172.21.15.173:0/1401233558 >> v1:172.21.15.87:6789/0 conn(0x561b10b63000 legacy=0x561b10c62800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.240+0000 7fe8b54ab700 1 -- 172.21.15.173:0/1401233558 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b10b75d40 con 0x561b10b63400 2024-09-13T23:58:08.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.240+0000 7fe8b54ab700 1 --2- 172.21.15.173:0/1401233558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63400 0x561b10e48580 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x561b10e43920 tx=0x561b10c67920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7ddf4ca5a75223 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.240+0000 7fe8b4caa700 1 -- 172.21.15.173:0/1401233558 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b10c074a0 con 0x561b10b63400 2024-09-13T23:58:08.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.240+0000 7fe8b4caa700 1 -- 172.21.15.173:0/1401233558 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561b10c27800 con 0x561b10b63400 2024-09-13T23:58:08.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.240+0000 7fe8b4caa700 1 -- 172.21.15.173:0/1401233558 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b10c07600 con 0x561b10b63400 2024-09-13T23:58:08.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.240+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1401233558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63400 msgr2=0x561b10e48580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.240+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/1401233558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63400 0x561b10e48580 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x561b10e43920 tx=0x561b10c67920 comp rx=0 tx=0).stop 2024-09-13T23:58:08.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.240+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1401233558 shutdown_connections 2024-09-13T23:58:08.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.240+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/1401233558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63400 0x561b10e48580 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.240+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1401233558 >> 172.21.15.173:0/1401233558 conn(0x561b10b62c00 msgr2=0x561b10c62000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:08.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.240+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1401233558 shutdown_connections 2024-09-13T23:58:08.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.240+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1401233558 wait complete. 2024-09-13T23:58:08.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.240+0000 7fe8b74f3f40 1 Processor -- start 2024-09-13T23:58:08.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.240+0000 7fe8b74f3f40 1 -- start start 2024-09-13T23:58:08.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.240+0000 7fe8b74f3f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63000 0x561b10e48580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.240+0000 7fe8b74f3f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b10bf0500 con 0x561b10b63000 2024-09-13T23:58:08.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.244+0000 7fe8b5cac700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63000 0x561b10e48580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.244+0000 7fe8b5cac700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63000 0x561b10e48580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50062/0 (socket says 172.21.15.173:50062) 2024-09-13T23:58:08.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.244+0000 7fe8b5cac700 1 -- 172.21.15.173:0/3236321335 learned_addr learned my addr 172.21.15.173:0/3236321335 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:08.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.244+0000 7fe8b5cac700 1 -- 172.21.15.173:0/3236321335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b10b75ba0 con 0x561b10b63000 2024-09-13T23:58:08.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.244+0000 7fe8b5cac700 1 --2- 172.21.15.173:0/3236321335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63000 0x561b10e48580 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x561b10cbfe00 tx=0x561b10c67b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e4f93487b83faa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.244+0000 7fe8b44a9700 1 -- 172.21.15.173:0/3236321335 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b10c074a0 con 0x561b10b63000 2024-09-13T23:58:08.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.244+0000 7fe8b44a9700 1 -- 172.21.15.173:0/3236321335 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561b10c27b00 con 0x561b10b63000 2024-09-13T23:58:08.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.244+0000 7fe8b44a9700 1 -- 172.21.15.173:0/3236321335 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b10c07600 con 0x561b10b63000 2024-09-13T23:58:08.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.244+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/3236321335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63000 msgr2=0x561b10e48580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.244+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/3236321335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63000 0x561b10e48580 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x561b10cbfe00 tx=0x561b10c67b60 comp rx=0 tx=0).stop 2024-09-13T23:58:08.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.244+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/3236321335 shutdown_connections 2024-09-13T23:58:08.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.244+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/3236321335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63000 0x561b10e48580 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.244+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/3236321335 >> 172.21.15.173:0/3236321335 conn(0x561b10b62c00 msgr2=0x561b10c63000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:08.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.244+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/3236321335 shutdown_connections 2024-09-13T23:58:08.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.244+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/3236321335 wait complete. 2024-09-13T23:58:08.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.244+0000 7fe8b74f3f40 1 Processor -- start 2024-09-13T23:58:08.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.244+0000 7fe8b74f3f40 1 -- start start 2024-09-13T23:58:08.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.248+0000 7fe8b74f3f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63000 0x561b10e48580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.248+0000 7fe8b74f3f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b10bf03c0 con 0x561b10b63000 2024-09-13T23:58:08.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.248+0000 7fe8b5cac700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63000 0x561b10e48580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.248+0000 7fe8b5cac700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63000 0x561b10e48580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50076/0 (socket says 172.21.15.173:50076) 2024-09-13T23:58:08.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.248+0000 7fe8b5cac700 1 -- 172.21.15.173:0/3276422532 learned_addr learned my addr 172.21.15.173:0/3276422532 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:08.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.248+0000 7fe8b5cac700 1 -- 172.21.15.173:0/3276422532 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b10b75a00 con 0x561b10b63000 2024-09-13T23:58:08.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.248+0000 7fe8b5cac700 1 --2- 172.21.15.173:0/3276422532 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63000 0x561b10e48580 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x561b10cbfef0 tx=0x561b10c67a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.248+0000 7fe8b2ca6700 1 -- 172.21.15.173:0/3276422532 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b10c078c0 con 0x561b10b63000 2024-09-13T23:58:08.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.248+0000 7fe8b2ca6700 1 -- 172.21.15.173:0/3276422532 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561b10c27c80 con 0x561b10b63000 2024-09-13T23:58:08.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.248+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/3276422532 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b10b75860 con 0x561b10b63000 2024-09-13T23:58:08.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.248+0000 7fe8b2ca6700 1 -- 172.21.15.173:0/3276422532 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b10c074a0 con 0x561b10b63000 2024-09-13T23:58:08.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.248+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/3276422532 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b10b756c0 con 0x561b10b63000 2024-09-13T23:58:08.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.248+0000 7fe8b74f3f40 1 Processor -- start 2024-09-13T23:58:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.248+0000 7fe8b2ca6700 1 -- 172.21.15.173:0/3276422532 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x561b10c5cb00 con 0x561b10b63000 2024-09-13T23:58:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.248+0000 7fe8b74f3f40 1 -- start start 2024-09-13T23:58:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.248+0000 7fe8b74f3f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63800 0x561b10e48b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.248+0000 7fe8b74f3f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b10b88640 con 0x561b10b63800 2024-09-13T23:58:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.252+0000 7fe8b2ca6700 1 --2- 172.21.15.173:0/3276422532 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561b10f0a000 0x561b10e49080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.252+0000 7fe8b2ca6700 1 -- 172.21.15.173:0/3276422532 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x561b10bc9180 con 0x561b10b63000 2024-09-13T23:58:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.252+0000 7fe8b64ad700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63800 0x561b10e48b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.252+0000 7fe8b64ad700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63800 0x561b10e48b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50088/0 (socket says 172.21.15.173:50088) 2024-09-13T23:58:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.252+0000 7fe8b64ad700 1 -- 172.21.15.173:0/1517168655 learned_addr learned my addr 172.21.15.173:0/1517168655 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:08.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.252+0000 7fe8b5cac700 1 --2- 172.21.15.173:0/3276422532 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561b10f0a000 0x561b10e49080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.252+0000 7fe8b64ad700 1 -- 172.21.15.173:0/1517168655 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b10b74000 con 0x561b10b63800 2024-09-13T23:58:08.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.252+0000 7fe8b5cac700 1 --2- 172.21.15.173:0/3276422532 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561b10f0a000 0x561b10e49080 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x561b119daf60 tx=0x561b10ec2240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.252+0000 7fe8b64ad700 1 --2- 172.21.15.173:0/1517168655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63800 0x561b10e48b00 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x561b10cbff50 tx=0x561b10ec30e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9482e295e9c8b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.252+0000 7fe8b04a1700 1 -- 172.21.15.173:0/1517168655 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b10c078c0 con 0x561b10b63800 2024-09-13T23:58:08.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.252+0000 7fe8b04a1700 1 -- 172.21.15.173:0/1517168655 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561b10f1c000 con 0x561b10b63800 2024-09-13T23:58:08.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.252+0000 7fe8b04a1700 1 -- 172.21.15.173:0/1517168655 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b10c074a0 con 0x561b10b63800 2024-09-13T23:58:08.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.252+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1517168655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63800 msgr2=0x561b10e48b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.252+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/1517168655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63800 0x561b10e48b00 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x561b10cbff50 tx=0x561b10ec30e0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.252+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1517168655 shutdown_connections 2024-09-13T23:58:08.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.252+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/1517168655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63800 0x561b10e48b00 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.252+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1517168655 >> 172.21.15.173:0/1517168655 conn(0x561b10b63400 msgr2=0x561b10c63800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:08.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.252+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1517168655 shutdown_connections 2024-09-13T23:58:08.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.252+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1517168655 wait complete. 2024-09-13T23:58:08.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.252+0000 7fe8b74f3f40 1 Processor -- start 2024-09-13T23:58:08.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.252+0000 7fe8b74f3f40 1 -- start start 2024-09-13T23:58:08.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.252+0000 7fe8b74f3f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63800 0x561b10e48b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.252+0000 7fe8b74f3f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b10b888c0 con 0x561b10b63800 2024-09-13T23:58:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.252+0000 7fe8b64ad700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63800 0x561b10e48b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.256+0000 7fe8b64ad700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63800 0x561b10e48b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50098/0 (socket says 172.21.15.173:50098) 2024-09-13T23:58:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.256+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 learned_addr learned my addr 172.21.15.173:0/608416042 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.256+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b10b74ea0 con 0x561b10b63800 2024-09-13T23:58:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.256+0000 7fe8b64ad700 1 --2- 172.21.15.173:0/608416042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63800 0x561b10e48b00 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x561b119da210 tx=0x561b10c67f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.256+0000 7fe8aec9e700 1 -- 172.21.15.173:0/608416042 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b10c07b80 con 0x561b10b63800 2024-09-13T23:58:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.256+0000 7fe8aec9e700 1 -- 172.21.15.173:0/608416042 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561b10f1c180 con 0x561b10b63800 2024-09-13T23:58:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.256+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b10b74820 con 0x561b10b63800 2024-09-13T23:58:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.256+0000 7fe8aec9e700 1 -- 172.21.15.173:0/608416042 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b10c078c0 con 0x561b10b63800 2024-09-13T23:58:08.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.256+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b10b749c0 con 0x561b10b63800 2024-09-13T23:58:08.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.256+0000 7fe8b74f3f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.256+0000 7fe8aec9e700 1 -- 172.21.15.173:0/608416042 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x561b10c5cdc0 con 0x561b10b63800 2024-09-13T23:58:08.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.256+0000 7fe8aec9e700 1 --2- 172.21.15.173:0/608416042 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561b10f0ac00 0x561b10e49600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.256+0000 7fe8aec9e700 1 -- 172.21.15.173:0/608416042 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x561b10bc9340 con 0x561b10b63800 2024-09-13T23:58:08.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.256+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/608416042 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x561b10f0b000 0x561b10e49b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.256+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b400 con 0x561b10f0b000 2024-09-13T23:58:08.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.256+0000 7fe8b54ab700 1 --2- 172.21.15.173:0/608416042 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561b10f0ac00 0x561b10e49600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.256+0000 7fe8b64ad700 1 --2- 172.21.15.173:0/608416042 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x561b10f0b000 0x561b10e49b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b54ab700 1 --2- 172.21.15.173:0/608416042 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561b10f0ac00 0x561b10e49600 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x561b10e43920 tx=0x561b10c67800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b64ad700 1 --2- 172.21.15.173:0/608416042 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x561b10f0b000 0x561b10e49b80 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b74f3f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:08.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b74f3f40 20 realm 2024-09-13T23:58:08.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b74f3f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0b000 2024-09-13T23:58:08.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b74f3f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:08.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b74f3f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:58:08.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b74f3f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0bc00 con 0x561b10f0b000 2024-09-13T23:58:08.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b74f3f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:08.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b74f3f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/608416042 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x561b10f0b400 0x561b10e4a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0b400 2024-09-13T23:58:08.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b5cac700 1 --2- 172.21.15.173:0/608416042 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x561b10f0b400 0x561b10e4a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b5cac700 1 --2- 172.21.15.173:0/608416042 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x561b10f0b400 0x561b10e4a100 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b74f3f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:08.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b74f3f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/608416042 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x561b10f0bc00 0x561b10e4a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fcc000 con 0x561b10f0bc00 2024-09-13T23:58:08.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.260+0000 7fe8b54ab700 1 --2- 172.21.15.173:0/608416042 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x561b10f0bc00 0x561b10e4a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.264+0000 7fe8b54ab700 1 --2- 172.21.15.173:0/608416042 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x561b10f0bc00 0x561b10e4a680 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.264+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.264+0000 7fe8b74f3f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:58:08.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.264+0000 7fe8b74f3f40 20 searching for the correct realm 2024-09-13T23:58:08.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.264+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fcc400 con 0x561b10f0bc00 2024-09-13T23:58:08.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.264+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.264+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fcc000 con 0x561b10f0b400 2024-09-13T23:58:08.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.264+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.264+0000 7fe8b5cac700 1 --2- 172.21.15.173:0/608416042 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x561b10fcc000 0x561b10e4ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.264+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10fcc000 2024-09-13T23:58:08.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.264+0000 7fe8b64ad700 1 --2- 172.21.15.173:0/608416042 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x561b10fcc000 0x561b10e4ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.264+0000 7fe8b64ad700 1 --2- 172.21.15.173:0/608416042 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x561b10fcc000 0x561b10e4ac00 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.264+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.264+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10fcc000 2024-09-13T23:58:08.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.268+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.268+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0b000 2024-09-13T23:58:08.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.268+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.268+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0bc00 2024-09-13T23:58:08.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.268+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.268+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0b000 2024-09-13T23:58:08.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.268+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.268+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0b400 2024-09-13T23:58:08.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.268+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.268+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0b400 2024-09-13T23:58:08.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.268+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.268+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0b000 2024-09-13T23:58:08.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.268+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.268+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10fcc000 2024-09-13T23:58:08.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.272+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.272+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0b000 2024-09-13T23:58:08.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.272+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.272+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10fcc000 2024-09-13T23:58:08.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.272+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.272+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0b400 2024-09-13T23:58:08.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.272+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.272+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0bc00 2024-09-13T23:58:08.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.272+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.272+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0b000 2024-09-13T23:58:08.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.272+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.272+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0b400 2024-09-13T23:58:08.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.276+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.276+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0bc00 2024-09-13T23:58:08.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.276+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.276+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0b000 2024-09-13T23:58:08.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.276+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.276+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0b000 2024-09-13T23:58:08.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.276+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.276+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0b000 2024-09-13T23:58:08.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.276+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.276+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0bc00 2024-09-13T23:58:08.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.276+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.276+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10fcc000 2024-09-13T23:58:08.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.276+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.276+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0b000 2024-09-13T23:58:08.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.280+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.280+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10fcc000 2024-09-13T23:58:08.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.280+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.280+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0bc00 2024-09-13T23:58:08.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.280+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.280+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10fcc000 2024-09-13T23:58:08.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.280+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.280+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0b400 2024-09-13T23:58:08.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.280+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.280+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0b400 2024-09-13T23:58:08.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.280+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.280+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0bc00 2024-09-13T23:58:08.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.284+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.284+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0b400 2024-09-13T23:58:08.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.284+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.284+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10f0b400 2024-09-13T23:58:08.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.284+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.284+0000 7fe8b74f3f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:58:08.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.284+0000 7fe8b74f3f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:58:08.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.284+0000 7fe8b74f3f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:58:08.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.284+0000 7fe8b74f3f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:58:08.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.284+0000 7fe8b74f3f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.284+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fcc800 con 0x561b10f0b000 2024-09-13T23:58:08.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.284+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.284+0000 7fe8b74f3f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:08.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.284+0000 7fe8b74f3f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.284+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fccc00 con 0x561b10f0b400 2024-09-13T23:58:08.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.284+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.284+0000 7fe8b74f3f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:08.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.284+0000 7fe8b74f3f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.284+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fcd000 con 0x561b10fcc000 2024-09-13T23:58:08.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.288+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.288+0000 7fe8b74f3f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:58:08.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.288+0000 7fe8b74f3f40 20 zone default found 2024-09-13T23:58:08.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.288+0000 7fe8b74f3f40 4 Realm: () 2024-09-13T23:58:08.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.288+0000 7fe8b74f3f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:58:08.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.288+0000 7fe8b74f3f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:58:08.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.288+0000 7fe8b74f3f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:58:08.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.288+0000 7fe8b74f3f40 20 zonegroup default 2024-09-13T23:58:08.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.288+0000 7fe8b74f3f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.288+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fcd400 con 0x561b10fcc000 2024-09-13T23:58:08.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.288+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.288+0000 7fe8b74f3f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:08.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.288+0000 7fe8b74f3f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.288+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fcd800 con 0x561b10f0bc00 2024-09-13T23:58:08.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.288+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.288+0000 7fe8b74f3f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:08.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.288+0000 7fe8b74f3f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.288+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fcdc00 con 0x561b10f0bc00 2024-09-13T23:58:08.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.288+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.288+0000 7fe8b74f3f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:08.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.288+0000 7fe8b74f3f40 20 started sync module instance, tier type = 2024-09-13T23:58:08.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.288+0000 7fe8b74f3f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:58:08.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.288+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb6000 con 0x561b10f0b400 2024-09-13T23:58:08.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.292+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v35'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.292+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94674247482112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb6400 con 0x561b10f0b400 2024-09-13T23:58:08.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.292+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb6800 con 0x561b10f0b000 2024-09-13T23:58:08.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.296+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94674247482112] v35'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.296+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v35'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.296+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94674247483264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb6c00 con 0x561b10f0b000 2024-09-13T23:58:08.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.296+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb7000 con 0x561b10f0b400 2024-09-13T23:58:08.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.300+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94674247483264] v35'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.300+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v35'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.300+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94674247484416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb7400 con 0x561b10f0b400 2024-09-13T23:58:08.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.300+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb7800 con 0x561b10fcc000 2024-09-13T23:58:08.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.300+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v35'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.300+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94674247485568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb7c00 con 0x561b10fcc000 2024-09-13T23:58:08.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.300+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb6800 con 0x561b10f0b400 2024-09-13T23:58:08.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.300+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94674247484416] v35'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.304+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94674247485568] v35'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.304+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v35'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.304+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94674247486720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb6000 con 0x561b10f0b400 2024-09-13T23:58:08.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.304+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fcc800 con 0x561b10f0bc00 2024-09-13T23:58:08.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.308+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94674247486720] v35'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.308+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v35'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.308+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94674247487872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fcd000 con 0x561b10f0bc00 2024-09-13T23:58:08.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.308+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fcd400 con 0x561b10f0bc00 2024-09-13T23:58:08.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.308+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v35'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.308+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94674247489024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fccc00 con 0x561b10f0bc00 2024-09-13T23:58:08.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.308+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10f0b800 con 0x561b10fcc000 2024-09-13T23:58:08.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.308+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94674247487872] v35'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.312+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v35'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.312+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94674247490176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb6400 con 0x561b10fcc000 2024-09-13T23:58:08.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.312+0000 7fe8b74f3f40 20 add_watcher() i=0 2024-09-13T23:58:08.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.312+0000 7fe8b74f3f40 20 add_watcher() i=1 2024-09-13T23:58:08.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.312+0000 7fe8b74f3f40 20 add_watcher() i=2 2024-09-13T23:58:08.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.312+0000 7fe8b74f3f40 20 add_watcher() i=3 2024-09-13T23:58:08.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.312+0000 7fe8b74f3f40 20 add_watcher() i=4 2024-09-13T23:58:08.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.312+0000 7fe8b74f3f40 20 add_watcher() i=5 2024-09-13T23:58:08.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.312+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94674247489024] v35'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.312+0000 7fe8b74f3f40 20 add_watcher() i=6 2024-09-13T23:58:08.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.312+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94674247490176] v35'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.312+0000 7fe8b74f3f40 20 add_watcher() i=7 2024-09-13T23:58:08.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.312+0000 7fe8b74f3f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:58:08.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.312+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb7000 con 0x561b10f0b000 2024-09-13T23:58:08.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.312+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.312+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94674249179136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb7400 con 0x561b10f0b000 2024-09-13T23:58:08.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.316+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94674249179136] v35'218 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.316+0000 7fe89cc7a700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:08.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.316+0000 7fe8b74f3f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:58:08.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.316+0000 7fe8b74f3f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:58:08.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.316+0000 7fe8b74f3f40 1 Processor -- start 2024-09-13T23:58:08.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.316+0000 7fe8b74f3f40 1 -- start start 2024-09-13T23:58:08.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.316+0000 7fe8b74f3f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10fcc400 0x561b10e4b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.316+0000 7fe8b74f3f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b10bf03c0 con 0x561b10fcc400 2024-09-13T23:58:08.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.316+0000 7fe8b54ab700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10fcc400 0x561b10e4b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.316+0000 7fe8b54ab700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10fcc400 0x561b10e4b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50114/0 (socket says 172.21.15.173:50114) 2024-09-13T23:58:08.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.316+0000 7fe8b54ab700 1 -- 172.21.15.173:0/1430246147 learned_addr learned my addr 172.21.15.173:0/1430246147 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:08.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.316+0000 7fe8b54ab700 1 -- 172.21.15.173:0/1430246147 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b10b74b60 con 0x561b10fcc400 2024-09-13T23:58:08.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.316+0000 7fe8b54ab700 1 --2- 172.21.15.173:0/1430246147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10fcc400 0x561b10e4b180 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x561b10fe60f0 tx=0x561b10c67980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8c82fadba60732 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.316+0000 7fe89c479700 1 -- 172.21.15.173:0/1430246147 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b10c07760 con 0x561b10fcc400 2024-09-13T23:58:08.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.316+0000 7fe89c479700 1 -- 172.21.15.173:0/1430246147 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561b10f1c600 con 0x561b10fcc400 2024-09-13T23:58:08.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.316+0000 7fe89c479700 1 -- 172.21.15.173:0/1430246147 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b10ff0000 con 0x561b10fcc400 2024-09-13T23:58:08.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.320+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1430246147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10fcc400 msgr2=0x561b10e4b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.320+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/1430246147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10fcc400 0x561b10e4b180 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x561b10fe60f0 tx=0x561b10c67980 comp rx=0 tx=0).stop 2024-09-13T23:58:08.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.320+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1430246147 shutdown_connections 2024-09-13T23:58:08.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.320+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/1430246147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10fcc400 0x561b10e4b180 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.320+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1430246147 >> 172.21.15.173:0/1430246147 conn(0x561b10eb6800 msgr2=0x561b10c64000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:08.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.320+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1430246147 shutdown_connections 2024-09-13T23:58:08.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.320+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1430246147 wait complete. 2024-09-13T23:58:08.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.320+0000 7fe8b74f3f40 1 Processor -- start 2024-09-13T23:58:08.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.320+0000 7fe8b74f3f40 1 -- start start 2024-09-13T23:58:08.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.320+0000 7fe8b74f3f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10fcd800 0x561b10e4b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.320+0000 7fe8b74f3f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b10bf0500 con 0x561b10fcd800 2024-09-13T23:58:08.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.320+0000 7fe8b54ab700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10fcd800 0x561b10e4b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.320+0000 7fe8b54ab700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10fcd800 0x561b10e4b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50120/0 (socket says 172.21.15.173:50120) 2024-09-13T23:58:08.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.320+0000 7fe8b54ab700 1 -- 172.21.15.173:0/1494970037 learned_addr learned my addr 172.21.15.173:0/1494970037 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:08.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.320+0000 7fe8b54ab700 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b10b74d00 con 0x561b10fcd800 2024-09-13T23:58:08.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.320+0000 7fe8b54ab700 1 --2- 172.21.15.173:0/1494970037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10fcd800 0x561b10e4b700 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x561b10fe6270 tx=0x561b10fb25a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.320+0000 7fe89ac76700 1 -- 172.21.15.173:0/1494970037 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b10ff0160 con 0x561b10fcd800 2024-09-13T23:58:08.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.320+0000 7fe89ac76700 1 -- 172.21.15.173:0/1494970037 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561b10f1c300 con 0x561b10fcd800 2024-09-13T23:58:08.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.320+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b10b74340 con 0x561b10fcd800 2024-09-13T23:58:08.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.320+0000 7fe89ac76700 1 -- 172.21.15.173:0/1494970037 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x561b10ff02c0 con 0x561b10fcd800 2024-09-13T23:58:08.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.320+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b10b75d40 con 0x561b10fcd800 2024-09-13T23:58:08.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.324+0000 7fe89ac76700 1 -- 172.21.15.173:0/1494970037 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x561b10c5db80 con 0x561b10fcd800 2024-09-13T23:58:08.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.324+0000 7fe89ac76700 1 --2- 172.21.15.173:0/1494970037 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561b10f0b800 0x561b1106a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.324+0000 7fe89ac76700 1 -- 172.21.15.173:0/1494970037 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x561b10bc9500 con 0x561b10fcd800 2024-09-13T23:58:08.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.324+0000 7fe8b64ad700 1 --2- 172.21.15.173:0/1494970037 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561b10f0b800 0x561b1106a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.324+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/1494970037 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x561b10fcdc00 0x561b1106a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.324+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fcc800 con 0x561b10fcdc00 2024-09-13T23:58:08.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.324+0000 7fe8b5cac700 1 --2- 172.21.15.173:0/1494970037 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x561b10fcdc00 0x561b1106a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.324+0000 7fe8b64ad700 1 --2- 172.21.15.173:0/1494970037 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561b10f0b800 0x561b1106a000 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x561b10f757a0 tx=0x561b10fb35c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.324+0000 7fe8b5cac700 1 --2- 172.21.15.173:0/1494970037 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x561b10fcdc00 0x561b1106a580 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.328+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v35'35 uv30 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10fcdc00 2024-09-13T23:58:08.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.328+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/1494970037 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x561b10eb6c00 0x561b1106ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.328+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb7800 con 0x561b10eb6c00 2024-09-13T23:58:08.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.328+0000 7fe8b54ab700 1 --2- 172.21.15.173:0/1494970037 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x561b10eb6c00 0x561b1106ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.328+0000 7fe8b54ab700 1 --2- 172.21.15.173:0/1494970037 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x561b10eb6c00 0x561b1106ab00 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.328+0000 7fe8b54ab700 1 -- 172.21.15.173:0/1494970037 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v35'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561b10fc3440 con 0x561b10eb6c00 2024-09-13T23:58:08.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.328+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/1494970037 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x561b10eb7c00 0x561b1106b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.328+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb6400 con 0x561b10eb7c00 2024-09-13T23:58:08.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.328+0000 7fe8b64ad700 1 --2- 172.21.15.173:0/1494970037 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x561b10eb7c00 0x561b1106b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.328+0000 7fe8b64ad700 1 --2- 172.21.15.173:0/1494970037 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x561b10eb7c00 0x561b1106b080 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.332+0000 7fe8b64ad700 1 -- 172.21.15.173:0/1494970037 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v35'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10eb7c00 2024-09-13T23:58:08.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.332+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/1494970037 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x561b11086000 0x561b1106b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.332+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11086400 con 0x561b11086000 2024-09-13T23:58:08.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.332+0000 7fe8b5cac700 1 --2- 172.21.15.173:0/1494970037 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x561b11086000 0x561b1106b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.332+0000 7fe8b5cac700 1 --2- 172.21.15.173:0/1494970037 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x561b11086000 0x561b1106b600 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.336+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v35'219 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b11086000 2024-09-13T23:58:08.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.336+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11086800 con 0x561b10fcdc00 2024-09-13T23:58:08.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.336+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v35'68 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10fcdc00 2024-09-13T23:58:08.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.336+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11086c00 con 0x561b10eb7c00 2024-09-13T23:58:08.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.340+0000 7fe8b64ad700 1 -- 172.21.15.173:0/1494970037 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v35'45 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10eb7c00 2024-09-13T23:58:08.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.340+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087000 con 0x561b10fcdc00 2024-09-13T23:58:08.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.340+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v35'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10fcdc00 2024-09-13T23:58:08.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.340+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087400 con 0x561b11086000 2024-09-13T23:58:08.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.344+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v35'45 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b11086000 2024-09-13T23:58:08.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.344+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087800 con 0x561b10fcdc00 2024-09-13T23:58:08.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.348+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v35'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10fcdc00 2024-09-13T23:58:08.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.348+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087c00 con 0x561b10fcdc00 2024-09-13T23:58:08.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.348+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v35'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10fcdc00 2024-09-13T23:58:08.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.348+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11086400 con 0x561b10fcdc00 2024-09-13T23:58:08.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.352+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v35'69 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10fcdc00 2024-09-13T23:58:08.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.352+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11086800 con 0x561b10eb7c00 2024-09-13T23:58:08.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.352+0000 7fe8b64ad700 1 -- 172.21.15.173:0/1494970037 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v35'30 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10eb7c00 2024-09-13T23:58:08.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.356+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087000 con 0x561b10fcdc00 2024-09-13T23:58:08.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.356+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v35'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10fcdc00 2024-09-13T23:58:08.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.356+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fcc800 con 0x561b11086000 2024-09-13T23:58:08.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.360+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v35'51 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b11086000 2024-09-13T23:58:08.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.360+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb6000 con 0x561b11086000 2024-09-13T23:58:08.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.360+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v35'220 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b11086000 2024-09-13T23:58:08.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.360+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fcc800 con 0x561b10fcdc00 2024-09-13T23:58:08.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.364+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v35'62 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10fcdc00 2024-09-13T23:58:08.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.364+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087400 con 0x561b10fcdc00 2024-09-13T23:58:08.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.368+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v35'70 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10fcdc00 2024-09-13T23:58:08.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.368+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087800 con 0x561b10eb7c00 2024-09-13T23:58:08.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.368+0000 7fe8b64ad700 1 -- 172.21.15.173:0/1494970037 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v35'29 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10eb7c00 2024-09-13T23:58:08.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.368+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087c00 con 0x561b10fcdc00 2024-09-13T23:58:08.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.372+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v35'34 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10fcdc00 2024-09-13T23:58:08.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.372+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11086400 con 0x561b11086000 2024-09-13T23:58:08.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.376+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v35'221 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b11086000 2024-09-13T23:58:08.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.376+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087000 con 0x561b10fcdc00 2024-09-13T23:58:08.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.376+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v35'63 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10fcdc00 2024-09-13T23:58:08.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.380+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11086c00 con 0x561b10fcdc00 2024-09-13T23:58:08.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.380+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v35'36 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10fcdc00 2024-09-13T23:58:08.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.380+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11086800 con 0x561b10eb7c00 2024-09-13T23:58:08.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.384+0000 7fe8b64ad700 1 -- 172.21.15.173:0/1494970037 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v35'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10eb7c00 2024-09-13T23:58:08.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.384+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087800 con 0x561b10fcdc00 2024-09-13T23:58:08.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.384+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v35'33 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10fcdc00 2024-09-13T23:58:08.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.384+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb7000 con 0x561b10eb7c00 2024-09-13T23:58:08.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.388+0000 7fe8b64ad700 1 -- 172.21.15.173:0/1494970037 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v35'22 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10eb7c00 2024-09-13T23:58:08.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.388+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb7400 con 0x561b10eb7c00 2024-09-13T23:58:08.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.392+0000 7fe8b64ad700 1 -- 172.21.15.173:0/1494970037 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v35'46 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10eb7c00 2024-09-13T23:58:08.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.392+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb6400 con 0x561b10eb7c00 2024-09-13T23:58:08.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.396+0000 7fe8b64ad700 1 -- 172.21.15.173:0/1494970037 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v35'34 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10eb7c00 2024-09-13T23:58:08.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.396+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087400 con 0x561b10fcdc00 2024-09-13T23:58:08.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.396+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v35'31 uv26 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10fcdc00 2024-09-13T23:58:08.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.396+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087c00 con 0x561b11086000 2024-09-13T23:58:08.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.400+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v35'46 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b11086000 2024-09-13T23:58:08.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.400+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11086400 con 0x561b10fcdc00 2024-09-13T23:58:08.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.400+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v35'64 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10fcdc00 2024-09-13T23:58:08.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.400+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087000 con 0x561b11086000 2024-09-13T23:58:08.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.404+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v35'52 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b11086000 2024-09-13T23:58:08.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.404+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11086c00 con 0x561b10eb6c00 2024-09-13T23:58:08.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.408+0000 7fe8b54ab700 1 -- 172.21.15.173:0/1494970037 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v35'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x561b10fc3440 con 0x561b10eb6c00 2024-09-13T23:58:08.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.408+0000 7fe898471700 20 reqs_thread_entry: start 2024-09-13T23:58:08.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.408+0000 7fe8b74f3f40 20 init_complete bucket index max shards: 11 2024-09-13T23:58:08.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.408+0000 7fe8b74f3f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:58:08.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.408+0000 7fe89646d700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:58:38 2024 2024-09-13T23:58:08.414 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:58:08.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.408+0000 7fe895c4b700 20 reqs_thread_entry: start 2024-09-13T23:58:08.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.412+0000 7fe8b74f3f40 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-13T23:58:08.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.412+0000 7fe8b74f3f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.412+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11086c00 con 0x561b10fcc000 2024-09-13T23:58:08.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.412+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(62 bud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.412+0000 7fe8b74f3f40 20 rados_obj.operate() r=0 bl.length=346 2024-09-13T23:58:08.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.412+0000 7fe8b74f3f40 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-13T23:58:08.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.412+0000 7fe8b74f3f40 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T23:58:08.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.412+0000 7fe8b74f3f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:58:08.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.412+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:63 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb7800 con 0x561b10f0b400 2024-09-13T23:58:08.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.412+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(63 bud.buckets [call out=184b] v0'0 uv6 ondisk = 0) v8 ==== 155+0+184 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.412+0000 7fe8b74f3f40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 : miss 2024-09-13T23:58:08.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.412+0000 7fe8b74f3f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.412+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 8.1 8:80f63ef4:root::.bucket.meta.myfoo6%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fcd000 con 0x561b10f0b000 2024-09-13T23:58:08.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.412+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(64 .bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 [call out=48b,stat out=16b,read 0~353 out=353b,getxattrs out=212b] v0'0 uv6 ondisk = 0) v8 ==== 333+0+629 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.412+0000 7fe8b74f3f40 20 rados_obj.operate() r=0 bl.length=353 2024-09-13T23:58:08.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.412+0000 7fe8b74f3f40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 info.flags=0x17 2024-09-13T23:58:08.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.412+0000 7fe8b74f3f40 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 to cache LRU end 2024-09-13T23:58:08.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.412+0000 7fe8b74f3f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:58:08.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.412+0000 7fe8b74f3f40 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T23:58:08.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.412+0000 7fe8b74f3f40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 2024-09-13T23:58:08.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.412+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 4.1e 4:7a88eac8:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fcd400 con 0x561b10f0b000 2024-09-13T23:58:08.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.416+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(65 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.0 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.416+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:66 4.f 4:f12d74b5:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fccc00 con 0x561b10fcc000 2024-09-13T23:58:08.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.416+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(66 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.416+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:67 4.17 4:e8081258:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fcd000 con 0x561b10f0bc00 2024-09-13T23:58:08.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.416+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(67 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.416+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:68 4.15 4:a960d1c2:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fcd400 con 0x561b10f0bc00 2024-09-13T23:58:08.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.416+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(68 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.3 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.416+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 4.38 4:1c5940cd:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11086800 con 0x561b10f0b400 2024-09-13T23:58:08.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.416+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(69 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.420+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:70 4.12 4:4b12116a:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11086c00 con 0x561b10f0b000 2024-09-13T23:58:08.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.420+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(70 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.420+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 4.32 4:4e7a5279:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb7000 con 0x561b10f0b400 2024-09-13T23:58:08.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.420+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(71 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.6 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.420+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:72 4.39 4:9ef5416b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb7400 con 0x561b10f0bc00 2024-09-13T23:58:08.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.420+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(72 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.420+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:73 4.2e 4:746522c9:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb6400 con 0x561b10f0bc00 2024-09-13T23:58:08.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.420+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(73 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.8 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.420+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:74 4.1c 4:3a6fb91a:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb7800 con 0x561b10fcc000 2024-09-13T23:58:08.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.424+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(74 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.9 [call out=289b] v0'0 uv8 ondisk = 0) v8 ==== 194+0+289 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.424+0000 7fe8b74f3f40 10 cls_bucket_list_unordered: got thirteen 2024-09-13T23:58:08.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.424+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:75 4.11 4:8983e62c:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb7000 con 0x561b10f0bc00 2024-09-13T23:58:08.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.424+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== osd_op_reply(75 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.424+0000 7fe8b74f3f40 20 get_obj_state: rctx=0x561b10bf38f0 obj=myfoo6:thirteen state=0x561b111181e8 s->prefetch_data=0 2024-09-13T23:58:08.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.424+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:76 3.26s0 3:64529768:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087800 con 0x561b10fcc000 2024-09-13T23:58:08.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.424+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(76 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7_thirteen [getxattrs out=819b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 238+0+835 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.424+0000 7fe8b74f3f40 10 manifest: total_size = 8 2024-09-13T23:58:08.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.424+0000 7fe8b74f3f40 20 get_obj_state: setting s->obj_tag to _KYE4MRfCAOy8kNg7kiIYCyjtO_FGp4e 2024-09-13T23:58:08.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.424+0000 7fe8b74f3f40 20 get_obj_state: rctx=0x561b10bf38f0 obj=myfoo6:thirteen state=0x561b111181e8 s->prefetch_data=0 2024-09-13T23:58:08.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.424+0000 7fe8b74f3f40 20 prepare_atomic_modification: state is not atomic. state=0x561b111181e8 2024-09-13T23:58:08.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.424+0000 7fe8b74f3f40 20 bucket index object: default.rgw.buckets.index:.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.9 2024-09-13T23:58:08.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.424+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:77 4.1c 4:3a6fb91a:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087400 con 0x561b10fcc000 2024-09-13T23:58:08.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.428+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 18 ==== osd_op_reply(77 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.9 [stat,call,call] v35'9 uv9 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.428+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:78 3.26s0 3:64529768:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087c00 con 0x561b10fcc000 2024-09-13T23:58:08.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.428+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 19 ==== osd_op_reply(78 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7_thirteen [call] v35'3 uv3 ondisk = 0) v8 ==== 196+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.428+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:79 4.1c 4:3a6fb91a:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087000 con 0x561b10fcc000 2024-09-13T23:58:08.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.428+0000 7fe8b74f3f40 20 list_objects_ordered: starting attempt 1 2024-09-13T23:58:08.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.428+0000 7fe8b74f3f40 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T23:58:08.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.428+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:80 4.1e 4:7a88eac8:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11086800 con 0x561b10f0b000 2024-09-13T23:58:08.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.428+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:81 4.f 4:f12d74b5:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11086c00 con 0x561b10fcc000 2024-09-13T23:58:08.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.428+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:82 4.17 4:e8081258:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087800 con 0x561b10f0bc00 2024-09-13T23:58:08.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.428+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:83 4.15 4:a960d1c2:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087400 con 0x561b10f0bc00 2024-09-13T23:58:08.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:84 4.38 4:1c5940cd:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087c00 con 0x561b10f0b400 2024-09-13T23:58:08.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:85 4.12 4:4b12116a:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087000 con 0x561b10f0b000 2024-09-13T23:58:08.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(80 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.0 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 20 ==== osd_op_reply(82 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 21 ==== osd_op_reply(83 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.3 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:86 4.32 4:4e7a5279:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11086800 con 0x561b10f0b400 2024-09-13T23:58:08.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(85 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(84 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 20 ==== osd_op_reply(81 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:87 4.39 4:9ef5416b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb7800 con 0x561b10f0bc00 2024-09-13T23:58:08.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:88 4.2e 4:746522c9:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fccc00 con 0x561b10f0bc00 2024-09-13T23:58:08.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:89 4.1c 4:3a6fb91a:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087800 con 0x561b10fcc000 2024-09-13T23:58:08.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:90 4.11 4:8983e62c:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb7400 con 0x561b10f0bc00 2024-09-13T23:58:08.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 21 ==== osd_op_reply(79 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.9 [stat,call,call] v35'10 uv10 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b04a1700 20 handle_completion(): completion ok for obj=thirteen 2024-09-13T23:58:08.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 22 ==== osd_op_reply(87 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 23 ==== osd_op_reply(88 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.8 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(86 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.6 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 24 ==== osd_op_reply(90 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 22 ==== osd_op_reply(89 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.9 [call out=124b] v0'0 uv10 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b74f3f40 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T23:58:08.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b74f3f40 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T23:58:08.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b74f3f40 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T23:58:08.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b74f3f40 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T23:58:08.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b74f3f40 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7])"; uploads.size()=0; is_truncated=0 2024-09-13T23:58:08.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b74f3f40 10 lifecycle: RGWRados::convert_old_bucket_info(): bucket=:myfoo6[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7]) 2024-09-13T23:58:08.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b74f3f40 10 lifecycle: cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-13T23:58:08.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b74f3f40 20 lifecycle: rados->read ofs=0 len=0 2024-09-13T23:58:08.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:91 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb6400 con 0x561b10f0b000 2024-09-13T23:58:08.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(91 myfoo6 [call out=48b,stat out=16b,read 0~166 out=166b,getxattrs out=75b] v0'0 uv21 ondisk = 0) v8 ==== 276+0+305 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b74f3f40 20 lifecycle: rados_obj.operate() r=0 bl.length=166 2024-09-13T23:58:08.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b74f3f40 10 lifecycle: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x17 2024-09-13T23:58:08.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b74f3f40 10 lifecycle: adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T23:58:08.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b74f3f40 10 lifecycle: updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:58:08.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.432+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:92 8.1 8:80f63ef4:root::.bucket.meta.myfoo6%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.7:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~353 in=353b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fcd000 con 0x561b10f0b000 2024-09-13T23:58:08.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.436+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 24 ==== osd_op_reply(92 .bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 [delete,create,call,call,writefull 0~353,setxattr (117)] v35'8 uv8 ondisk = 0) v8 ==== 417+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.436+0000 7fe8b74f3f40 10 lifecycle: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 info.flags=0x17 2024-09-13T23:58:08.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.436+0000 7fe8b74f3f40 10 lifecycle: moving default.rgw.meta+root+.bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 to cache LRU end 2024-09-13T23:58:08.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.436+0000 7fe8b74f3f40 10 lifecycle: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T23:58:08.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.436+0000 7fe8b74f3f40 10 lifecycle: distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7, ofs0, ns] 2024-09-13T23:58:08.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.436+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:93 7.3 7:c609908c:::notify.5:head [notify cookie 94674249182592 in=733b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11126000 con 0x561b10f0bc00 2024-09-13T23:58:08.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.436+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 25 ==== watch-notify(notify (1) cookie 94674247487872 notify 150323855391 ret 0) v3 ==== 763+0+0 (crc 0 0 0) 0x561b110329c0 con 0x561b10f0bc00 2024-09-13T23:58:08.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.436+0000 7fe8afca0700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855391 cookie 94674247487872 notifier 4831 bl.length()=721 2024-09-13T23:58:08.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.436+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 26 ==== osd_op_reply(93 notify.5 [notify cookie 94674249182592 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.436+0000 7fe8afca0700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 info.flags=0x17 2024-09-13T23:58:08.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.436+0000 7fe8afca0700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 to cache LRU end 2024-09-13T23:58:08.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.436+0000 7fe8afca0700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T23:58:08.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.436+0000 7fe8afca0700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b1112e000 con 0x561b10f0bc00 2024-09-13T23:58:08.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.436+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 27 ==== watch-notify(notify_complete (2) cookie 94674249182592 notify 150323855391 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561b11032b60 con 0x561b10f0bc00 2024-09-13T23:58:08.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.436+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 28 ==== osd_op_reply(94 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.436+0000 7fe8b74f3f40 20 lifecycle: handle_bi_update(): bucket=:myfoo6[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7]): orig_sources= new_sources= 2024-09-13T23:58:08.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.436+0000 7fe8b74f3f40 20 lifecycle: handle_bi_update(): bucket=:myfoo6[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7]): potential sources added=[] removed=[] 2024-09-13T23:58:08.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.436+0000 7fe8b74f3f40 20 lifecycle: handle_bi_update(): bucket=:myfoo6[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7]): orig_dests= new_dests= 2024-09-13T23:58:08.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.436+0000 7fe8b74f3f40 20 lifecycle: handle_bi_update(): bucket=:myfoo6[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7]): potential dests added=[] removed=[] 2024-09-13T23:58:08.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.436+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:33 6.1d 6:ba0c5e7b:lc::lc.31:head [call lock.lock in=65b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11126400 con 0x561b11086000 2024-09-13T23:58:08.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.440+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(33 lc.31 [call] v35'47 uv47 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b11086000 2024-09-13T23:58:08.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.440+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:34 6.1d 6:ba0c5e7b:lc::lc.31:head [call rgw.lc_rm_entry in=93b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11126800 con 0x561b11086000 2024-09-13T23:58:08.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.440+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(34 lc.31 [call] v35'48 uv48 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b11086000 2024-09-13T23:58:08.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.440+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:35 6.1d 6:ba0c5e7b:lc::lc.31:head [call lock.unlock in=49b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11126c00 con 0x561b11086000 2024-09-13T23:58:08.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.440+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(35 lc.31 [call] v35'49 uv49 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b11086000 2024-09-13T23:58:08.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.440+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:95 4.1e 4:7a88eac8:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11127000 con 0x561b10f0b000 2024-09-13T23:58:08.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.440+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:96 4.f 4:f12d74b5:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11127400 con 0x561b10fcc000 2024-09-13T23:58:08.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.440+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:97 4.17 4:e8081258:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11127800 con 0x561b10f0bc00 2024-09-13T23:58:08.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.440+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:98 4.15 4:a960d1c2:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11127c00 con 0x561b10f0bc00 2024-09-13T23:58:08.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.440+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:99 4.38 4:1c5940cd:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b1112e400 con 0x561b10f0b400 2024-09-13T23:58:08.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.444+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:100 4.12 4:4b12116a:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b1112e800 con 0x561b10f0b000 2024-09-13T23:58:08.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.444+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:101 4.32 4:4e7a5279:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b1112ec00 con 0x561b10f0b400 2024-09-13T23:58:08.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.444+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:102 4.39 4:9ef5416b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b1112f000 con 0x561b10f0bc00 2024-09-13T23:58:08.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.444+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:103 4.2e 4:746522c9:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b1112f400 con 0x561b10f0bc00 2024-09-13T23:58:08.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.444+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:104 4.1c 4:3a6fb91a:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b1112f800 con 0x561b10fcc000 2024-09-13T23:58:08.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.444+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 25 ==== osd_op_reply(95 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.0 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.444+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 23 ==== osd_op_reply(96 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.444+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:105 4.11 4:8983e62c:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b1112fc00 con 0x561b10f0bc00 2024-09-13T23:58:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.444+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(99 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.444+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(101 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.6 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.444+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 29 ==== osd_op_reply(97 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.444+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 26 ==== osd_op_reply(100 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.444+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 24 ==== osd_op_reply(104 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.9 [call out=124b] v0'0 uv10 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.444+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 30 ==== osd_op_reply(98 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.3 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.444+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 31 ==== osd_op_reply(103 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.8 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.444+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 32 ==== osd_op_reply(102 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.444+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 33 ==== osd_op_reply(105 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.444+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:106 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11127000 con 0x561b10f0b400 2024-09-13T23:58:08.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.444+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== osd_op_reply(106 bud.buckets [call] v35'7 uv7 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.444+0000 7fe8b74f3f40 10 cache get: name=default.rgw.meta+root+myfoo6 : hit (requested=0x11, cached=0x17) 2024-09-13T23:58:08.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.448+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:107 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11127400 con 0x561b10f0b000 2024-09-13T23:58:08.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.448+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 27 ==== osd_op_reply(107 myfoo6 [call,call,delete] v35'22 uv22 ondisk = 0) v8 ==== 234+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.448+0000 7fe8b74f3f40 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-13T23:58:08.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.448+0000 7fe8b74f3f40 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-13T23:58:08.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.448+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [notify cookie 94674249182592 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fcd400 con 0x561b10fcc000 2024-09-13T23:58:08.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.448+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 25 ==== watch-notify(notify (1) cookie 94674247485568 notify 150323855376 ret 0) v3 ==== 192+0+0 (crc 0 0 0) 0x561b10f77380 con 0x561b10fcc000 2024-09-13T23:58:08.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.448+0000 7fe8afca0700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855376 cookie 94674247485568 notifier 4831 bl.length()=150 2024-09-13T23:58:08.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.448+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 26 ==== osd_op_reply(108 notify.3 [notify cookie 94674249182592 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.448+0000 7fe8afca0700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fccc00 con 0x561b10fcc000 2024-09-13T23:58:08.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.448+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 27 ==== osd_op_reply(109 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.448+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 28 ==== watch-notify(notify_complete (2) cookie 94674249182592 notify 150323855376 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561b10f77520 con 0x561b10fcc000 2024-09-13T23:58:08.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.448+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:110 8.1 8:80f63ef4:root::.bucket.meta.myfoo6%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fcd000 con 0x561b10f0b000 2024-09-13T23:58:08.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.452+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 28 ==== osd_op_reply(110 .bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 [call,call,delete] v35'9 uv9 ondisk = 0) v8 ==== 291+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.452+0000 7fe8b74f3f40 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 from cache 2024-09-13T23:58:08.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.452+0000 7fe8b74f3f40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7, ofs0, ns] 2024-09-13T23:58:08.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.452+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [notify cookie 94674249182592 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb6400 con 0x561b10f0bc00 2024-09-13T23:58:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.452+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 34 ==== watch-notify(notify (1) cookie 94674247487872 notify 150323855392 ret 0) v3 ==== 249+0+0 (crc 0 0 0) 0x561b11032b60 con 0x561b10f0bc00 2024-09-13T23:58:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.452+0000 7fe8afca0700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855392 cookie 94674247487872 notifier 4831 bl.length()=207 2024-09-13T23:58:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.452+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 35 ==== osd_op_reply(111 notify.5 [notify cookie 94674249182592 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.452+0000 7fe8afca0700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:112 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087400 con 0x561b10f0bc00 2024-09-13T23:58:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.452+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 36 ==== watch-notify(notify_complete (2) cookie 94674249182592 notify 150323855392 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561b11032d00 con 0x561b10f0bc00 2024-09-13T23:58:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.452+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 37 ==== osd_op_reply(112 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.452+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:113 4.1e 4:7a88eac8:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb7000 con 0x561b10f0b000 2024-09-13T23:58:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.452+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:114 4.f 4:f12d74b5:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11086c00 con 0x561b10fcc000 2024-09-13T23:58:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.452+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:115 4.17 4:e8081258:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087000 con 0x561b10f0bc00 2024-09-13T23:58:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.452+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:116 4.15 4:a960d1c2:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087800 con 0x561b10f0bc00 2024-09-13T23:58:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.452+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:117 4.38 4:1c5940cd:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11126000 con 0x561b10f0b400 2024-09-13T23:58:08.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.452+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:118 4.12 4:4b12116a:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11127800 con 0x561b10f0b000 2024-09-13T23:58:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.452+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:119 4.32 4:4e7a5279:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b1112e000 con 0x561b10f0b400 2024-09-13T23:58:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.452+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:120 4.39 4:9ef5416b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb7800 con 0x561b10f0bc00 2024-09-13T23:58:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.452+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:121 4.2e 4:746522c9:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb7400 con 0x561b10f0bc00 2024-09-13T23:58:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.452+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:122 4.1c 4:3a6fb91a:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087c00 con 0x561b10fcc000 2024-09-13T23:58:08.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.452+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:123 4.11 4:8983e62c:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11086800 con 0x561b10f0bc00 2024-09-13T23:58:08.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.456+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 38 ==== osd_op_reply(115 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.2 [delete] v35'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.456+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 29 ==== osd_op_reply(114 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.1 [delete] v35'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.456+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== osd_op_reply(117 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.4 [delete] v35'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.456+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 29 ==== osd_op_reply(113 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.0 [delete] v35'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.456+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 39 ==== osd_op_reply(116 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.3 [delete] v35'7 uv7 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.456+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 30 ==== osd_op_reply(118 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.5 [delete] v35'5 uv5 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.456+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 40 ==== osd_op_reply(120 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.7 [delete] v35'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.456+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 41 ==== osd_op_reply(121 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.8 [delete] v35'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.456+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 30 ==== osd_op_reply(122 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.9 [delete] v35'11 uv11 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.456+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 27 ==== osd_op_reply(119 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.6 [delete] v35'11 uv11 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.460+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 42 ==== osd_op_reply(123 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7.10 [delete] v35'2 uv2 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.460+0000 7fe8b74f3f40 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 : miss 2024-09-13T23:58:08.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.460+0000 7fe8b74f3f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.460+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:124 6.1e 6:7a1cbb3f:::pubsub..bucket.myfoo6%2fd342d0db-d035-4a54-bae7-2e0f76db6818.4234.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087400 con 0x561b10f0bc00 2024-09-13T23:58:08.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.460+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 43 ==== osd_op_reply(124 pubsub..bucket.myfoo6/d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 209+0+0 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.460+0000 7fe8b74f3f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:08.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.460+0000 7fe8b74f3f40 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 info.flags=0x0 2024-09-13T23:58:08.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.460+0000 7fe8b74f3f40 10 adding default.rgw.log++pubsub..bucket.myfoo6/d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 to cache LRU end 2024-09-13T23:58:08.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.460+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:125 6.1e 6:7a1cbb3f:::pubsub..bucket.myfoo6%2fd342d0db-d035-4a54-bae7-2e0f76db6818.4234.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087000 con 0x561b10f0bc00 2024-09-13T23:58:08.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.464+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 44 ==== osd_op_reply(125 pubsub..bucket.myfoo6/d342d0db-d035-4a54-bae7-2e0f76db6818.4234.7 [delete] v35'11 uv10 ondisk = -2 ((2) No such file or directory)) v8 ==== 209+0+0 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.464+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:126 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087800 con 0x561b10f0b400 2024-09-13T23:58:08.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.468+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 28 ==== osd_op_reply(126 bud.buckets [call] v35'8 uv8 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.468+0000 7fe8b74f3f40 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-13T23:58:08.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.468+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:127 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10eb6400 con 0x561b10f0b000 2024-09-13T23:58:08.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.468+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 31 ==== osd_op_reply(127 NX5QOQKC6BH2IDN8HC7A [delete] v35'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.468+0000 7fe8b74f3f40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-13T23:58:08.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.468+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:128 7.3 7:c609908c:::notify.5:head [notify cookie 94674249182592 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b1112e400 con 0x561b10f0bc00 2024-09-13T23:58:08.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.468+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 45 ==== watch-notify(notify (1) cookie 94674247487872 notify 150323855393 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x561b11032d00 con 0x561b10f0bc00 2024-09-13T23:58:08.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.468+0000 7fe8b04a1700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855393 cookie 94674247487872 notifier 4831 bl.length()=170 2024-09-13T23:58:08.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.468+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 46 ==== osd_op_reply(128 notify.5 [notify cookie 94674249182592 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.468+0000 7fe8b04a1700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:129 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11086400 con 0x561b10f0bc00 2024-09-13T23:58:08.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.468+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 47 ==== osd_op_reply(129 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.468+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 48 ==== watch-notify(notify_complete (2) cookie 94674249182592 notify 150323855393 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561b11032ea0 con 0x561b10f0bc00 2024-09-13T23:58:08.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.468+0000 7fe8b74f3f40 10 removing email index: 2024-09-13T23:58:08.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.468+0000 7fe8b74f3f40 10 removing user buckets index 2024-09-13T23:58:08.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.468+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:130 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b1112ec00 con 0x561b10f0b400 2024-09-13T23:58:08.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.472+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 29 ==== osd_op_reply(130 bud.buckets [delete] v35'9 uv9 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.472+0000 7fe8b74f3f40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-13T23:58:08.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.472+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:131 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94674249182592 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b1112f000 con 0x561b10f0bc00 2024-09-13T23:58:08.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.472+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 49 ==== watch-notify(notify (1) cookie 94674247489024 notify 150323855394 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x561b11032ea0 con 0x561b10f0bc00 2024-09-13T23:58:08.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.472+0000 7fe8afca0700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855394 cookie 94674247489024 notifier 4831 bl.length()=160 2024-09-13T23:58:08.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.472+0000 7fe8afca0700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:132 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b10fcd400 con 0x561b10f0bc00 2024-09-13T23:58:08.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.472+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 50 ==== osd_op_reply(131 notify.6 [notify cookie 94674249182592 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.472+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 51 ==== osd_op_reply(132 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.472+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 52 ==== watch-notify(notify_complete (2) cookie 94674249182592 notify 150323855394 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561b11033040 con 0x561b10f0bc00 2024-09-13T23:58:08.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.476+0000 7fe8b74f3f40 10 removing user index: bud 2024-09-13T23:58:08.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.476+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:133 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b1112f400 con 0x561b10fcc000 2024-09-13T23:58:08.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.476+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 31 ==== osd_op_reply(133 bud [call,call,delete] v35'3 uv3 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.476+0000 7fe8b74f3f40 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-13T23:58:08.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.476+0000 7fe8b74f3f40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-13T23:58:08.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.476+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:134 7.3 7:c609908c:::notify.5:head [notify cookie 94674249182592 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b1112fc00 con 0x561b10f0bc00 2024-09-13T23:58:08.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.476+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 53 ==== watch-notify(notify (1) cookie 94674247487872 notify 150323855395 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x561b11033040 con 0x561b10f0bc00 2024-09-13T23:58:08.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.476+0000 7fe8b04a1700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855395 cookie 94674247487872 notifier 4831 bl.length()=152 2024-09-13T23:58:08.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.476+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 54 ==== osd_op_reply(134 notify.5 [notify cookie 94674249182592 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.476+0000 7fe8b04a1700 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:135 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b1112e400 con 0x561b10f0bc00 2024-09-13T23:58:08.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.476+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 55 ==== watch-notify(notify_complete (2) cookie 94674249182592 notify 150323855395 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561b110331e0 con 0x561b10f0bc00 2024-09-13T23:58:08.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.476+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 56 ==== osd_op_reply(135 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.480+0000 7fe89cc7a700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:08.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.480+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:136 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94674249179136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11127000 con 0x561b10f0b000 2024-09-13T23:58:08.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.480+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 32 ==== osd_op_reply(136 data_loggenerations_metadata [watch unwatch cookie 94674249179136] v35'222 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.480+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:137 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94674247482112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11126000 con 0x561b10f0b400 2024-09-13T23:58:08.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.484+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 30 ==== osd_op_reply(137 notify.0 [watch unwatch cookie 94674247482112] v35'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.484+0000 7fe8b74f3f40 20 remove_watcher() i=0 2024-09-13T23:58:08.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.484+0000 7fe8b74f3f40 2 removed watcher, disabling cache 2024-09-13T23:58:08.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.484+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:138 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94674247483264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11127c00 con 0x561b10f0b000 2024-09-13T23:58:08.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.484+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.1 v2:172.21.15.173:6808/3256211813 33 ==== osd_op_reply(138 notify.1 [watch unwatch cookie 94674247483264] v35'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10f0b000 2024-09-13T23:58:08.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.488+0000 7fe8b74f3f40 20 remove_watcher() i=1 2024-09-13T23:58:08.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.488+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:139 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94674247484416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11086800 con 0x561b10f0b400 2024-09-13T23:58:08.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.488+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 31 ==== osd_op_reply(139 notify.2 [watch unwatch cookie 94674247484416] v35'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.488+0000 7fe8b74f3f40 20 remove_watcher() i=2 2024-09-13T23:58:08.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.488+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:140 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94674247485568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087400 con 0x561b10fcc000 2024-09-13T23:58:08.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.492+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 32 ==== osd_op_reply(140 notify.3 [watch unwatch cookie 94674247485568] v35'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.492+0000 7fe8b74f3f40 20 remove_watcher() i=3 2024-09-13T23:58:08.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.492+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:141 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94674247486720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087000 con 0x561b10f0b400 2024-09-13T23:58:08.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.492+0000 7fe8b5cac700 1 -- 172.21.15.173:0/608416042 <== osd.0 v2:172.21.15.87:6800/3507919120 32 ==== osd_op_reply(141 notify.4 [watch unwatch cookie 94674247486720] v35'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc3200 con 0x561b10f0b400 2024-09-13T23:58:08.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.492+0000 7fe8b74f3f40 20 remove_watcher() i=4 2024-09-13T23:58:08.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.492+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:142 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94674247487872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11086400 con 0x561b10f0bc00 2024-09-13T23:58:08.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.496+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 57 ==== osd_op_reply(142 notify.5 [watch unwatch cookie 94674247487872] v35'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.496+0000 7fe8b74f3f40 20 remove_watcher() i=5 2024-09-13T23:58:08.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.496+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:143 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94674247489024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11086c00 con 0x561b10f0bc00 2024-09-13T23:58:08.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.496+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 <== osd.3 v2:172.21.15.173:6800/4020038786 58 ==== osd_op_reply(143 notify.6 [watch unwatch cookie 94674247489024] v35'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc3440 con 0x561b10f0bc00 2024-09-13T23:58:08.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.496+0000 7fe8b74f3f40 20 remove_watcher() i=6 2024-09-13T23:58:08.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.496+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:144 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94674247490176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x561b11087c00 con 0x561b10fcc000 2024-09-13T23:58:08.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.500+0000 7fe8b64ad700 1 -- 172.21.15.173:0/608416042 <== osd.2 v2:172.21.15.173:6809/889985573 33 ==== osd_op_reply(144 notify.7 [watch unwatch cookie 94674247490176] v35'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x561b10fc2b40 con 0x561b10fcc000 2024-09-13T23:58:08.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.500+0000 7fe8b74f3f40 20 remove_watcher() i=7 2024-09-13T23:58:08.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.500+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x561b10f0b400 msgr2=0x561b10e4a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.500+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/608416042 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x561b10f0b400 0x561b10e4a100 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.500+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x561b10f0b000 msgr2=0x561b10e49b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.500+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/608416042 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x561b10f0b000 0x561b10e49b80 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.500+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x561b10fcc000 msgr2=0x561b10e4ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.500+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/608416042 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x561b10fcc000 0x561b10e4ac00 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.500+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x561b10f0bc00 msgr2=0x561b10e4a680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.500+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/608416042 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x561b10f0bc00 0x561b10e4a680 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.500+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561b10f0ac00 msgr2=0x561b10e49600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.500+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/608416042 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561b10f0ac00 0x561b10e49600 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x561b10e43920 tx=0x561b10c67800 comp rx=0 tx=0).stop 2024-09-13T23:58:08.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.500+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63800 msgr2=0x561b10e48b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.500+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/608416042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63800 0x561b10e48b00 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x561b119da210 tx=0x561b10c67f20 comp rx=0 tx=0).stop 2024-09-13T23:58:08.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.500+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 reap_dead start 2024-09-13T23:58:08.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.500+0000 7fe8b54ab700 1 -- 172.21.15.173:0/608416042 reap_dead start 2024-09-13T23:58:08.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.500+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 shutdown_connections 2024-09-13T23:58:08.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.500+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 >> 172.21.15.173:0/608416042 conn(0x561b10b63400 msgr2=0x561b10c63800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:08.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.500+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 shutdown_connections 2024-09-13T23:58:08.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.500+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/608416042 wait complete. 2024-09-13T23:58:08.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x561b10fcdc00 msgr2=0x561b1106a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/1494970037 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x561b10fcdc00 0x561b1106a580 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x561b11086000 msgr2=0x561b1106b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/1494970037 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x561b11086000 0x561b1106b600 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x561b10eb6c00 msgr2=0x561b1106ab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/1494970037 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x561b10eb6c00 0x561b1106ab00 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x561b10eb7c00 msgr2=0x561b1106b080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/1494970037 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x561b10eb7c00 0x561b1106b080 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561b10f0b800 msgr2=0x561b1106a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/1494970037 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561b10f0b800 0x561b1106a000 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x561b10f757a0 tx=0x561b10fb35c0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b5cac700 1 -- 172.21.15.173:0/1494970037 reap_dead start 2024-09-13T23:58:08.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10fcd800 msgr2=0x561b10e4b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/1494970037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10fcd800 0x561b10e4b700 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x561b10fe6270 tx=0x561b10fb25a0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 shutdown_connections 2024-09-13T23:58:08.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/1494970037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10fcd800 0x561b10e4b700 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 >> 172.21.15.173:0/1494970037 conn(0x561b10eb6800 msgr2=0x561b10c64000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:08.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 shutdown_connections 2024-09-13T23:58:08.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/1494970037 wait complete. 2024-09-13T23:58:08.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/3276422532 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561b10f0a000 msgr2=0x561b10e49080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/3276422532 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561b10f0a000 0x561b10e49080 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x561b119daf60 tx=0x561b10ec2240 comp rx=0 tx=0).stop 2024-09-13T23:58:08.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/3276422532 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63000 msgr2=0x561b10e48580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/3276422532 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63000 0x561b10e48580 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x561b10cbfef0 tx=0x561b10c67a40 comp rx=0 tx=0).stop 2024-09-13T23:58:08.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/3276422532 shutdown_connections 2024-09-13T23:58:08.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/3276422532 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x561b10f0a000 0x561b10e49080 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 --2- 172.21.15.173:0/3276422532 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x561b10b63000 0x561b10e48580 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/3276422532 >> 172.21.15.173:0/3276422532 conn(0x561b10b62c00 msgr2=0x561b10c63000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:08.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/3276422532 shutdown_connections 2024-09-13T23:58:08.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.504+0000 7fe8b74f3f40 1 -- 172.21.15.173:0/3276422532 wait complete. 2024-09-13T23:58:08.513 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-13T23:58:08.513 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-13T23:58:08.513 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-13T23:58:08.600 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:58:08.600 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:58:08.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.596+0000 7f9769d7ef40 1 Processor -- start 2024-09-13T23:58:08.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.596+0000 7f9769d7ef40 1 -- start start 2024-09-13T23:58:08.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.596+0000 7f9769d7ef40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55666a58d000 0x55666a872580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.596+0000 7f9769d7ef40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55666a651500 con 0x55666a58d400 2024-09-13T23:58:08.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.596+0000 7f9769d7ef40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55666a61aa00 con 0x55666a58d000 2024-09-13T23:58:08.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.600+0000 7f9767d36700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55666a58d400 0x55666a68c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:38702/0 (socket says 172.21.15.173:38702) 2024-09-13T23:58:08.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.600+0000 7f9768537700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55666a58d000 0x55666a872580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.600+0000 7f9767d36700 1 -- 172.21.15.173:0/706353175 learned_addr learned my addr 172.21.15.173:0/706353175 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:58:08.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.600+0000 7f9767535700 1 -- 172.21.15.173:0/706353175 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528575706 0 0) 0x55666a6e8000 con 0x55666a58d400 2024-09-13T23:58:08.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.600+0000 7f9767535700 1 -- 172.21.15.173:0/706353175 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x55666a651680 con 0x55666a58d400 2024-09-13T23:58:08.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.600+0000 7f9768537700 1 -- 172.21.15.173:0/706353175 >> v1:172.21.15.87:6789/0 conn(0x55666a58d400 legacy=0x55666a68c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.600+0000 7f9768537700 1 -- 172.21.15.173:0/706353175 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55666a59fd40 con 0x55666a58d000 2024-09-13T23:58:08.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.600+0000 7f9768537700 1 --2- 172.21.15.173:0/706353175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a58d000 0x55666a872580 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x55666a86da70 tx=0x55666a691980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8033f741a9298e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.600+0000 7f9767535700 1 -- 172.21.15.173:0/706353175 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55666a6314a0 con 0x55666a58d000 2024-09-13T23:58:08.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.600+0000 7f9767535700 1 -- 172.21.15.173:0/706353175 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55666a651680 con 0x55666a58d000 2024-09-13T23:58:08.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.600+0000 7f9767535700 1 -- 172.21.15.173:0/706353175 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55666a631600 con 0x55666a58d000 2024-09-13T23:58:08.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.600+0000 7f9769d7ef40 1 -- 172.21.15.173:0/706353175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a58d000 msgr2=0x55666a872580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.600+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/706353175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a58d000 0x55666a872580 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x55666a86da70 tx=0x55666a691980 comp rx=0 tx=0).stop 2024-09-13T23:58:08.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.600+0000 7f9769d7ef40 1 -- 172.21.15.173:0/706353175 shutdown_connections 2024-09-13T23:58:08.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.600+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/706353175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a58d000 0x55666a872580 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.600+0000 7f9769d7ef40 1 -- 172.21.15.173:0/706353175 >> 172.21.15.173:0/706353175 conn(0x55666a58cc00 msgr2=0x55666a68c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:08.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.600+0000 7f9769d7ef40 1 -- 172.21.15.173:0/706353175 shutdown_connections 2024-09-13T23:58:08.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.600+0000 7f9769d7ef40 1 -- 172.21.15.173:0/706353175 wait complete. 2024-09-13T23:58:08.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.600+0000 7f9769d7ef40 1 Processor -- start 2024-09-13T23:58:08.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.600+0000 7f9769d7ef40 1 -- start start 2024-09-13T23:58:08.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.604+0000 7f9769d7ef40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a58d400 0x55666a872b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.604+0000 7f9769d7ef40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55666a61a500 con 0x55666a58d400 2024-09-13T23:58:08.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.604+0000 7f9768537700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a58d400 0x55666a872b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.604+0000 7f9768537700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a58d400 0x55666a872b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50148/0 (socket says 172.21.15.173:50148) 2024-09-13T23:58:08.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.604+0000 7f9768537700 1 -- 172.21.15.173:0/1339502305 learned_addr learned my addr 172.21.15.173:0/1339502305 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:08.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.604+0000 7f9768537700 1 -- 172.21.15.173:0/1339502305 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55666a59fba0 con 0x55666a58d400 2024-09-13T23:58:08.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.604+0000 7f9768537700 1 --2- 172.21.15.173:0/1339502305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a58d400 0x55666a872b00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x55666a86da70 tx=0x55666a691800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee56fdd8690ef0b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.604+0000 7f9766d34700 1 -- 172.21.15.173:0/1339502305 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55666a631760 con 0x55666a58d400 2024-09-13T23:58:08.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.604+0000 7f9766d34700 1 -- 172.21.15.173:0/1339502305 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55666a651980 con 0x55666a58d400 2024-09-13T23:58:08.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.604+0000 7f9766d34700 1 -- 172.21.15.173:0/1339502305 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55666a6314a0 con 0x55666a58d400 2024-09-13T23:58:08.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.604+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1339502305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a58d400 msgr2=0x55666a872b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.604+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/1339502305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a58d400 0x55666a872b00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x55666a86da70 tx=0x55666a691800 comp rx=0 tx=0).stop 2024-09-13T23:58:08.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.604+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1339502305 shutdown_connections 2024-09-13T23:58:08.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.604+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/1339502305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a58d400 0x55666a872b00 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.604+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1339502305 >> 172.21.15.173:0/1339502305 conn(0x55666a58cc00 msgr2=0x55666a68d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:08.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.604+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1339502305 shutdown_connections 2024-09-13T23:58:08.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.604+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1339502305 wait complete. 2024-09-13T23:58:08.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.604+0000 7f9769d7ef40 1 Processor -- start 2024-09-13T23:58:08.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.604+0000 7f9769d7ef40 1 -- start start 2024-09-13T23:58:08.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.604+0000 7f9769d7ef40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a58d800 0x55666a872580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.604+0000 7f9769d7ef40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55666a61a3c0 con 0x55666a58d800 2024-09-13T23:58:08.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.604+0000 7f9768537700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a58d800 0x55666a872580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.604+0000 7f9768537700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a58d800 0x55666a872580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50160/0 (socket says 172.21.15.173:50160) 2024-09-13T23:58:08.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.604+0000 7f9768537700 1 -- 172.21.15.173:0/1023379965 learned_addr learned my addr 172.21.15.173:0/1023379965 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:08.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.608+0000 7f9768537700 1 -- 172.21.15.173:0/1023379965 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55666a59fa00 con 0x55666a58d800 2024-09-13T23:58:08.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.608+0000 7f9768537700 1 --2- 172.21.15.173:0/1023379965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a58d800 0x55666a872580 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x55666b357ec0 tx=0x55666a691980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.608+0000 7f9765531700 1 -- 172.21.15.173:0/1023379965 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55666a631600 con 0x55666a58d800 2024-09-13T23:58:08.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.608+0000 7f9765531700 1 -- 172.21.15.173:0/1023379965 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55666a651b00 con 0x55666a58d800 2024-09-13T23:58:08.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.608+0000 7f9765531700 1 -- 172.21.15.173:0/1023379965 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55666a6318c0 con 0x55666a58d800 2024-09-13T23:58:08.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.608+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1023379965 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55666a59f860 con 0x55666a58d800 2024-09-13T23:58:08.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.608+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1023379965 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55666a59f6c0 con 0x55666a58d800 2024-09-13T23:58:08.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.608+0000 7f9769d7ef40 1 Processor -- start 2024-09-13T23:58:08.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.608+0000 7f9769d7ef40 1 -- start start 2024-09-13T23:58:08.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.608+0000 7f9769d7ef40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a8e2000 0x55666a872b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.608+0000 7f9769d7ef40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55666a5b2640 con 0x55666a8e2000 2024-09-13T23:58:08.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.608+0000 7f9765531700 1 -- 172.21.15.173:0/1023379965 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55666a686b00 con 0x55666a58d800 2024-09-13T23:58:08.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.608+0000 7f9768d38700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a8e2000 0x55666a872b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.608+0000 7f9768d38700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a8e2000 0x55666a872b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50166/0 (socket says 172.21.15.173:50166) 2024-09-13T23:58:08.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.608+0000 7f9768d38700 1 -- 172.21.15.173:0/1440008450 learned_addr learned my addr 172.21.15.173:0/1440008450 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:08.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.608+0000 7f9765531700 1 --2- 172.21.15.173:0/1023379965 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55666a8e3400 0x55666a873600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.608+0000 7f9765531700 1 -- 172.21.15.173:0/1023379965 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55666a5f3180 con 0x55666a58d800 2024-09-13T23:58:08.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.608+0000 7f9768537700 1 --2- 172.21.15.173:0/1023379965 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55666a8e3400 0x55666a873600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.612+0000 7f9768d38700 1 -- 172.21.15.173:0/1440008450 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55666a59e000 con 0x55666a8e2000 2024-09-13T23:58:08.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.612+0000 7f9768537700 1 --2- 172.21.15.173:0/1023379965 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55666a8e3400 0x55666a873600 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55666a8b5440 tx=0x55666a8fec60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.612+0000 7f9768d38700 1 --2- 172.21.15.173:0/1440008450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a8e2000 0x55666a872b00 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x55666a91c510 tx=0x55666a8feb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f3a4f4b3d97e76 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.612+0000 7f9762d2c700 1 -- 172.21.15.173:0/1440008450 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55666a631600 con 0x55666a8e2000 2024-09-13T23:58:08.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.612+0000 7f9762d2c700 1 -- 172.21.15.173:0/1440008450 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55666a651b00 con 0x55666a8e2000 2024-09-13T23:58:08.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.612+0000 7f9762d2c700 1 -- 172.21.15.173:0/1440008450 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55666a6318c0 con 0x55666a8e2000 2024-09-13T23:58:08.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.612+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1440008450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a8e2000 msgr2=0x55666a872b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.612+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/1440008450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a8e2000 0x55666a872b00 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x55666a91c510 tx=0x55666a8feb40 comp rx=0 tx=0).stop 2024-09-13T23:58:08.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.612+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1440008450 shutdown_connections 2024-09-13T23:58:08.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.612+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/1440008450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a8e2000 0x55666a872b00 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.612+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1440008450 >> 172.21.15.173:0/1440008450 conn(0x55666a58dc00 msgr2=0x55666a68d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:08.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.612+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1440008450 shutdown_connections 2024-09-13T23:58:08.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.612+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1440008450 wait complete. 2024-09-13T23:58:08.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.612+0000 7f9769d7ef40 1 Processor -- start 2024-09-13T23:58:08.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.612+0000 7f9769d7ef40 1 -- start start 2024-09-13T23:58:08.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.612+0000 7f9769d7ef40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a8e2000 0x55666a872b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.612+0000 7f9769d7ef40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55666a5b28c0 con 0x55666a8e2000 2024-09-13T23:58:08.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.612+0000 7f9768d38700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a8e2000 0x55666a872b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.612+0000 7f9768d38700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a8e2000 0x55666a872b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50174/0 (socket says 172.21.15.173:50174) 2024-09-13T23:58:08.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.612+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 learned_addr learned my addr 172.21.15.173:0/1783926961 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:08.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.616+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55666a59eea0 con 0x55666a8e2000 2024-09-13T23:58:08.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.616+0000 7f9768d38700 1 --2- 172.21.15.173:0/1783926961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a8e2000 0x55666a872b00 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x55666a8b4180 tx=0x55666a8fe5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.616+0000 7f9761529700 1 -- 172.21.15.173:0/1783926961 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55666a631760 con 0x55666a8e2000 2024-09-13T23:58:08.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.616+0000 7f9761529700 1 -- 172.21.15.173:0/1783926961 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55666a95a000 con 0x55666a8e2000 2024-09-13T23:58:08.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.616+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55666a59e820 con 0x55666a8e2000 2024-09-13T23:58:08.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.616+0000 7f9761529700 1 -- 172.21.15.173:0/1783926961 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55666a631600 con 0x55666a8e2000 2024-09-13T23:58:08.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.616+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55666a59e9c0 con 0x55666a8e2000 2024-09-13T23:58:08.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.616+0000 7f9761529700 1 -- 172.21.15.173:0/1783926961 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55666a686dc0 con 0x55666a8e2000 2024-09-13T23:58:08.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.616+0000 7f9761529700 1 --2- 172.21.15.173:0/1783926961 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55666a9d0000 0x55666a873b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.616+0000 7f9761529700 1 -- 172.21.15.173:0/1783926961 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55666a5f3340 con 0x55666a8e2000 2024-09-13T23:58:08.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.616+0000 7f9769d7ef40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.616+0000 7f9767d36700 1 --2- 172.21.15.173:0/1783926961 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55666a9d0000 0x55666a873b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.616+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/1783926961 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55666a8e2400 0x55666a873080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.616+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a8e2800 con 0x55666a8e2400 2024-09-13T23:58:08.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.616+0000 7f9768d38700 1 --2- 172.21.15.173:0/1783926961 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55666a8e2400 0x55666a873080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.616+0000 7f9767d36700 1 --2- 172.21.15.173:0/1783926961 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55666a9d0000 0x55666a873b80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55666b356030 tx=0x55666a9de0c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.620+0000 7f9768d38700 1 --2- 172.21.15.173:0/1783926961 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55666a8e2400 0x55666a873080 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.620+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.620+0000 7f9769d7ef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:08.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.620+0000 7f9769d7ef40 20 realm 2024-09-13T23:58:08.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.620+0000 7f9769d7ef40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.620+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a8e2c00 con 0x55666a8e2400 2024-09-13T23:58:08.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.620+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.620+0000 7f9769d7ef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:08.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.620+0000 7f9769d7ef40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:58:08.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.620+0000 7f9769d7ef40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.620+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a8e3000 con 0x55666a8e2400 2024-09-13T23:58:08.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.620+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.620+0000 7f9769d7ef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:08.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.620+0000 7f9769d7ef40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.620+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/1783926961 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55666a9d0400 0x55666a874100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.620+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a9d0400 2024-09-13T23:58:08.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.620+0000 7f9768537700 1 --2- 172.21.15.173:0/1783926961 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55666a9d0400 0x55666a874100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.620+0000 7f9768537700 1 --2- 172.21.15.173:0/1783926961 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55666a9d0400 0x55666a874100 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.620+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.620+0000 7f9769d7ef40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:08.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.620+0000 7f9769d7ef40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.620+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/1783926961 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55666a9d0c00 0x55666a874680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.620+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a8e2800 con 0x55666a9d0c00 2024-09-13T23:58:08.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.620+0000 7f9767d36700 1 --2- 172.21.15.173:0/1783926961 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55666a9d0c00 0x55666a874680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.624+0000 7f9767d36700 1 --2- 172.21.15.173:0/1783926961 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55666a9d0c00 0x55666a874680 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.624+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.624+0000 7f9769d7ef40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:58:08.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.624+0000 7f9769d7ef40 20 searching for the correct realm 2024-09-13T23:58:08.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.624+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a8e2c00 con 0x55666a9d0c00 2024-09-13T23:58:08.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.624+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.624+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a8e2800 con 0x55666a9d0400 2024-09-13T23:58:08.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.624+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.624+0000 7f9768537700 1 --2- 172.21.15.173:0/1783926961 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55666a8e2800 0x55666a875700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.624+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a8e2800 2024-09-13T23:58:08.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.624+0000 7f9768d38700 1 --2- 172.21.15.173:0/1783926961 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55666a8e2800 0x55666a875700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.624+0000 7f9768d38700 1 --2- 172.21.15.173:0/1783926961 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55666a8e2800 0x55666a875700 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.624+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.624+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a8e2800 2024-09-13T23:58:08.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.624+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.624+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a8e2400 2024-09-13T23:58:08.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.628+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.628+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a9d0c00 2024-09-13T23:58:08.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.628+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.628+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a8e2400 2024-09-13T23:58:08.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.628+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.628+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a9d0400 2024-09-13T23:58:08.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.628+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.628+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a9d0400 2024-09-13T23:58:08.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.628+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.628+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a8e2400 2024-09-13T23:58:08.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.628+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.628+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a8e2800 2024-09-13T23:58:08.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.628+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.628+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a8e2400 2024-09-13T23:58:08.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.632+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.632+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a8e2800 2024-09-13T23:58:08.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.632+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.632+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a9d0400 2024-09-13T23:58:08.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.632+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.632+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a9d0c00 2024-09-13T23:58:08.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.632+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.632+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a8e2400 2024-09-13T23:58:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.632+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.632+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a9d0400 2024-09-13T23:58:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.632+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.632+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a9d0c00 2024-09-13T23:58:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.632+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.632+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a8e2400 2024-09-13T23:58:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.636+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.636+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a8e2400 2024-09-13T23:58:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.636+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.636+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a8e2400 2024-09-13T23:58:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.636+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.636+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a9d0c00 2024-09-13T23:58:08.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.636+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.636+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a8e2800 2024-09-13T23:58:08.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.636+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.636+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a8e2400 2024-09-13T23:58:08.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.636+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.636+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a8e2800 2024-09-13T23:58:08.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.636+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.636+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a9d0c00 2024-09-13T23:58:08.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.640+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.640+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a8e2800 2024-09-13T23:58:08.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.640+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.640+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a9d0400 2024-09-13T23:58:08.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.640+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.640+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a9d0400 2024-09-13T23:58:08.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.640+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.640+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a9d0c00 2024-09-13T23:58:08.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.640+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.640+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a9d0400 2024-09-13T23:58:08.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.640+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.640+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a9d0400 2024-09-13T23:58:08.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9769d7ef40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:58:08.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9769d7ef40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:58:08.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9769d7ef40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:58:08.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9769d7ef40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:58:08.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9769d7ef40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a8e3000 con 0x55666a8e2400 2024-09-13T23:58:08.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9769d7ef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:08.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9769d7ef40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d1000 con 0x55666a9d0400 2024-09-13T23:58:08.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9769d7ef40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:08.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9769d7ef40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d1400 con 0x55666a8e2800 2024-09-13T23:58:08.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9769d7ef40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:58:08.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9769d7ef40 20 zone default found 2024-09-13T23:58:08.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9769d7ef40 4 Realm: () 2024-09-13T23:58:08.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9769d7ef40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:58:08.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9769d7ef40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:58:08.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9769d7ef40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:58:08.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9769d7ef40 20 zonegroup default 2024-09-13T23:58:08.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9769d7ef40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d1800 con 0x55666a8e2800 2024-09-13T23:58:08.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9769d7ef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:08.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9769d7ef40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.644+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d1c00 con 0x55666a9d0c00 2024-09-13T23:58:08.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.648+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.648+0000 7f9769d7ef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:08.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.648+0000 7f9769d7ef40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.648+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9fe000 con 0x55666a9d0c00 2024-09-13T23:58:08.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.648+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.648+0000 7f9769d7ef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:08.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.648+0000 7f9769d7ef40 20 started sync module instance, tier type = 2024-09-13T23:58:08.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.648+0000 7f9769d7ef40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:58:08.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.648+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9fe400 con 0x55666a9d0400 2024-09-13T23:58:08.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.652+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v35'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.652+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93898362231552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9fe800 con 0x55666a9d0400 2024-09-13T23:58:08.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.652+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9fec00 con 0x55666a8e2400 2024-09-13T23:58:08.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.652+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v35'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.652+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93898362232704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9ff000 con 0x55666a8e2400 2024-09-13T23:58:08.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.652+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9ff400 con 0x55666a9d0400 2024-09-13T23:58:08.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.652+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93898362231552] v35'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.656+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 93898362232704] v35'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.656+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v35'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.656+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93898362233856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9ff800 con 0x55666a9d0400 2024-09-13T23:58:08.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.656+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9ffc00 con 0x55666a8e2800 2024-09-13T23:58:08.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.660+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v35'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.660+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93898362235008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9fec00 con 0x55666a8e2800 2024-09-13T23:58:08.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.660+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9fe400 con 0x55666a9d0400 2024-09-13T23:58:08.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.660+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93898362233856] v35'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.660+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93898362235008] v35'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.664+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v35'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.664+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93898362236160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d1400 con 0x55666a9d0400 2024-09-13T23:58:08.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.664+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d1800 con 0x55666a9d0c00 2024-09-13T23:58:08.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.664+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v35'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.664+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93898362237312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a9d0c00 2024-09-13T23:58:08.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.664+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d1000 con 0x55666a9d0c00 2024-09-13T23:58:08.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.664+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93898362236160] v35'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.668+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v35'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.668+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93898362238464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a58d400 con 0x55666a9d0c00 2024-09-13T23:58:08.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.668+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a8e3000 con 0x55666a8e2800 2024-09-13T23:58:08.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.668+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93898362237312] v35'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.668+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93898362238464] v35'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.668+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v35'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.668+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93898362239616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d1c00 con 0x55666a8e2800 2024-09-13T23:58:08.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.668+0000 7f9769d7ef40 20 add_watcher() i=0 2024-09-13T23:58:08.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.668+0000 7f9769d7ef40 20 add_watcher() i=1 2024-09-13T23:58:08.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.668+0000 7f9769d7ef40 20 add_watcher() i=2 2024-09-13T23:58:08.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.668+0000 7f9769d7ef40 20 add_watcher() i=3 2024-09-13T23:58:08.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.668+0000 7f9769d7ef40 20 add_watcher() i=4 2024-09-13T23:58:08.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.668+0000 7f9769d7ef40 20 add_watcher() i=5 2024-09-13T23:58:08.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.668+0000 7f9769d7ef40 20 add_watcher() i=6 2024-09-13T23:58:08.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.672+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93898362239616] v35'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.672+0000 7f9769d7ef40 20 add_watcher() i=7 2024-09-13T23:58:08.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.672+0000 7f9769d7ef40 2 all 8 watchers are set, enabling cache 2024-09-13T23:58:08.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.672+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d1800 con 0x55666a8e2400 2024-09-13T23:58:08.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.672+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.672+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93898363912192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d1400 con 0x55666a8e2400 2024-09-13T23:58:08.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.676+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93898363912192] v35'223 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.676+0000 7f974f505700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:08.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.676+0000 7f9769d7ef40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:58:08.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.676+0000 7f9769d7ef40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:58:08.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.676+0000 7f9769d7ef40 1 Processor -- start 2024-09-13T23:58:08.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.676+0000 7f9769d7ef40 1 -- start start 2024-09-13T23:58:08.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.676+0000 7f9769d7ef40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a9fe800 0x55666a874c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.676+0000 7f9769d7ef40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55666a61a3c0 con 0x55666a9fe800 2024-09-13T23:58:08.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.676+0000 7f9767d36700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a9fe800 0x55666a874c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.676+0000 7f9767d36700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a9fe800 0x55666a874c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50176/0 (socket says 172.21.15.173:50176) 2024-09-13T23:58:08.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.676+0000 7f9767d36700 1 -- 172.21.15.173:0/1872596095 learned_addr learned my addr 172.21.15.173:0/1872596095 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:08.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.676+0000 7f9767d36700 1 -- 172.21.15.173:0/1872596095 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55666a59eb60 con 0x55666a9fe800 2024-09-13T23:58:08.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.676+0000 7f9767d36700 1 --2- 172.21.15.173:0/1872596095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a9fe800 0x55666a874c00 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x55666a99ff50 tx=0x55666a8fff80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88faae7cdfc2bf2f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.676+0000 7f974ed04700 1 -- 172.21.15.173:0/1872596095 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55666aa10000 con 0x55666a9fe800 2024-09-13T23:58:08.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.676+0000 7f974ed04700 1 -- 172.21.15.173:0/1872596095 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55666a95a480 con 0x55666a9fe800 2024-09-13T23:58:08.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.676+0000 7f974ed04700 1 -- 172.21.15.173:0/1872596095 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55666aa10160 con 0x55666a9fe800 2024-09-13T23:58:08.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.676+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1872596095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a9fe800 msgr2=0x55666a874c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.676+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/1872596095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a9fe800 0x55666a874c00 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x55666a99ff50 tx=0x55666a8fff80 comp rx=0 tx=0).stop 2024-09-13T23:58:08.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.676+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1872596095 shutdown_connections 2024-09-13T23:58:08.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.676+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/1872596095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a9fe800 0x55666a874c00 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.676+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1872596095 >> 172.21.15.173:0/1872596095 conn(0x55666a9fe000 msgr2=0x55666a68e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:08.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.676+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1872596095 shutdown_connections 2024-09-13T23:58:08.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.676+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1872596095 wait complete. 2024-09-13T23:58:08.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.680+0000 7f9769d7ef40 1 Processor -- start 2024-09-13T23:58:08.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.680+0000 7f9769d7ef40 1 -- start start 2024-09-13T23:58:08.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.680+0000 7f9769d7ef40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a9fe800 0x55666a874c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.680+0000 7f9769d7ef40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55666a61a500 con 0x55666a9fe800 2024-09-13T23:58:08.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.680+0000 7f9767d36700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a9fe800 0x55666a874c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.680+0000 7f9767d36700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a9fe800 0x55666a874c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50186/0 (socket says 172.21.15.173:50186) 2024-09-13T23:58:08.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.680+0000 7f9767d36700 1 -- 172.21.15.173:0/2560714065 learned_addr learned my addr 172.21.15.173:0/2560714065 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:08.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.680+0000 7f9767d36700 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55666a59ed00 con 0x55666a9fe800 2024-09-13T23:58:08.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.680+0000 7f9767d36700 1 --2- 172.21.15.173:0/2560714065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a9fe800 0x55666a874c00 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x55666aa12210 tx=0x55666a9de1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.680+0000 7f974d501700 1 -- 172.21.15.173:0/2560714065 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55666aa102c0 con 0x55666a9fe800 2024-09-13T23:58:08.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.680+0000 7f974d501700 1 -- 172.21.15.173:0/2560714065 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55666a95a600 con 0x55666a9fe800 2024-09-13T23:58:08.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.680+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55666a59e340 con 0x55666a9fe800 2024-09-13T23:58:08.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.680+0000 7f974d501700 1 -- 172.21.15.173:0/2560714065 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55666aa10000 con 0x55666a9fe800 2024-09-13T23:58:08.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.680+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55666a59eb60 con 0x55666a9fe800 2024-09-13T23:58:08.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.680+0000 7f974d501700 1 -- 172.21.15.173:0/2560714065 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55666a687b80 con 0x55666a9fe800 2024-09-13T23:58:08.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.680+0000 7f974d501700 1 --2- 172.21.15.173:0/2560714065 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55666a9ff000 0x55666aa96000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.680+0000 7f974d501700 1 -- 172.21.15.173:0/2560714065 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6328+0+0 (secure 0 0 0) 0x55666a5f3500 con 0x55666a9fe800 2024-09-13T23:58:08.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.680+0000 7f9768d38700 1 --2- 172.21.15.173:0/2560714065 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55666a9ff000 0x55666aa96000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.684+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/2560714065 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55666a9ff400 0x55666a875180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.684+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9ff800 con 0x55666a9ff400 2024-09-13T23:58:08.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.684+0000 7f9768537700 1 --2- 172.21.15.173:0/2560714065 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55666a9ff400 0x55666a875180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.684+0000 7f9768d38700 1 --2- 172.21.15.173:0/2560714065 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55666a9ff000 0x55666aa96000 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55666a99faa0 tx=0x55666a9df380 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.684+0000 7f9768537700 1 --2- 172.21.15.173:0/2560714065 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55666a9ff400 0x55666a875180 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.684+0000 7f9768537700 1 -- 172.21.15.173:0/2560714065 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v35'36 uv30 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9ff400 2024-09-13T23:58:08.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.684+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/2560714065 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55666a9fe400 0x55666aa96580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.684+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a8e2c00 con 0x55666a9fe400 2024-09-13T23:58:08.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.684+0000 7f9767d36700 1 --2- 172.21.15.173:0/2560714065 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55666a9fe400 0x55666aa96580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.688+0000 7f9767d36700 1 --2- 172.21.15.173:0/2560714065 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55666a9fe400 0x55666aa96580 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.688+0000 7f9767d36700 1 -- 172.21.15.173:0/2560714065 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v35'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9fe400 2024-09-13T23:58:08.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.688+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/2560714065 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55666a9d1c00 0x55666aa96b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.688+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a8e3000 con 0x55666a9d1c00 2024-09-13T23:58:08.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.688+0000 7f9768d38700 1 --2- 172.21.15.173:0/2560714065 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55666a9d1c00 0x55666aa96b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.688+0000 7f9768d38700 1 --2- 172.21.15.173:0/2560714065 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55666a9d1c00 0x55666aa96b00 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.692+0000 7f9768d38700 1 -- 172.21.15.173:0/2560714065 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v35'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a9d1c00 2024-09-13T23:58:08.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.692+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/2560714065 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55666a9ffc00 0x55666aa97080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:08.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.692+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9fec00 con 0x55666a9ffc00 2024-09-13T23:58:08.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.692+0000 7f9768537700 1 --2- 172.21.15.173:0/2560714065 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55666a9ffc00 0x55666aa97080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:08.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.692+0000 7f9768537700 1 --2- 172.21.15.173:0/2560714065 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55666a9ffc00 0x55666aa97080 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:08.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.696+0000 7f9768537700 1 -- 172.21.15.173:0/2560714065 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v35'224 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9ffc00 2024-09-13T23:58:08.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.696+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac0000 con 0x55666a9ff400 2024-09-13T23:58:08.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.696+0000 7f9768537700 1 -- 172.21.15.173:0/2560714065 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v35'71 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9ff400 2024-09-13T23:58:08.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.696+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac0400 con 0x55666a9d1c00 2024-09-13T23:58:08.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.700+0000 7f9768d38700 1 -- 172.21.15.173:0/2560714065 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v35'47 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a9d1c00 2024-09-13T23:58:08.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.700+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac0800 con 0x55666a9ff400 2024-09-13T23:58:08.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.704+0000 7f9768537700 1 -- 172.21.15.173:0/2560714065 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v35'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9ff400 2024-09-13T23:58:08.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.704+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac0c00 con 0x55666a9ffc00 2024-09-13T23:58:08.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.704+0000 7f9768537700 1 -- 172.21.15.173:0/2560714065 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v35'50 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9ffc00 2024-09-13T23:58:08.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.704+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac1000 con 0x55666a9ff400 2024-09-13T23:58:08.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.708+0000 7f9768537700 1 -- 172.21.15.173:0/2560714065 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v35'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9ff400 2024-09-13T23:58:08.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.708+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac1400 con 0x55666a9ff400 2024-09-13T23:58:08.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.712+0000 7f9768537700 1 -- 172.21.15.173:0/2560714065 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v35'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9ff400 2024-09-13T23:58:08.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.712+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac1800 con 0x55666a9ff400 2024-09-13T23:58:08.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.712+0000 7f9768537700 1 -- 172.21.15.173:0/2560714065 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v35'72 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9ff400 2024-09-13T23:58:08.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.712+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac1c00 con 0x55666a9d1c00 2024-09-13T23:58:08.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.716+0000 7f9768d38700 1 -- 172.21.15.173:0/2560714065 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v35'31 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a9d1c00 2024-09-13T23:58:08.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.716+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac0000 con 0x55666a9ff400 2024-09-13T23:58:08.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.720+0000 7f9768537700 1 -- 172.21.15.173:0/2560714065 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v35'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9ff400 2024-09-13T23:58:08.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.720+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac0800 con 0x55666a9ffc00 2024-09-13T23:58:08.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.720+0000 7f9768537700 1 -- 172.21.15.173:0/2560714065 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v35'53 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9ffc00 2024-09-13T23:58:08.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.720+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac0c00 con 0x55666a9ffc00 2024-09-13T23:58:08.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.724+0000 7f9768537700 1 -- 172.21.15.173:0/2560714065 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v35'225 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9ffc00 2024-09-13T23:58:08.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.724+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac1000 con 0x55666a9ff400 2024-09-13T23:58:08.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.728+0000 7f9768537700 1 -- 172.21.15.173:0/2560714065 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v35'65 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9ff400 2024-09-13T23:58:08.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.728+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9ff800 con 0x55666a9ff400 2024-09-13T23:58:08.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.728+0000 7f9768537700 1 -- 172.21.15.173:0/2560714065 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v35'73 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9ff400 2024-09-13T23:58:08.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.728+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9fec00 con 0x55666a9d1c00 2024-09-13T23:58:08.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.732+0000 7f9768d38700 1 -- 172.21.15.173:0/2560714065 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v35'30 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a9d1c00 2024-09-13T23:58:08.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.732+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9fec00 con 0x55666a9ff400 2024-09-13T23:58:08.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.736+0000 7f9768537700 1 -- 172.21.15.173:0/2560714065 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v35'35 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9ff400 2024-09-13T23:58:08.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.736+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9ff800 con 0x55666a9ffc00 2024-09-13T23:58:08.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.736+0000 7f9768537700 1 -- 172.21.15.173:0/2560714065 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v35'226 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9ffc00 2024-09-13T23:58:08.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.736+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a8e3000 con 0x55666a9ff400 2024-09-13T23:58:08.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.740+0000 7f9768537700 1 -- 172.21.15.173:0/2560714065 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v35'66 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9ff400 2024-09-13T23:58:08.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.740+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d1800 con 0x55666a9ff400 2024-09-13T23:58:08.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.744+0000 7f9768537700 1 -- 172.21.15.173:0/2560714065 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v35'37 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9ff400 2024-09-13T23:58:08.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.744+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d1400 con 0x55666a9d1c00 2024-09-13T23:58:08.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.748+0000 7f9768d38700 1 -- 172.21.15.173:0/2560714065 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v35'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a9d1c00 2024-09-13T23:58:08.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.748+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac4000 con 0x55666a9ff400 2024-09-13T23:58:08.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.748+0000 7f9768537700 1 -- 172.21.15.173:0/2560714065 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v35'34 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9ff400 2024-09-13T23:58:08.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.748+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac4400 con 0x55666a9d1c00 2024-09-13T23:58:08.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.752+0000 7f9768d38700 1 -- 172.21.15.173:0/2560714065 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v35'23 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a9d1c00 2024-09-13T23:58:08.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.752+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac4800 con 0x55666a9d1c00 2024-09-13T23:58:08.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.756+0000 7f9768d38700 1 -- 172.21.15.173:0/2560714065 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v35'48 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a9d1c00 2024-09-13T23:58:08.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.756+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac4c00 con 0x55666a9d1c00 2024-09-13T23:58:08.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.756+0000 7f9768d38700 1 -- 172.21.15.173:0/2560714065 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v35'35 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a9d1c00 2024-09-13T23:58:08.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.756+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac5000 con 0x55666a9ff400 2024-09-13T23:58:08.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.760+0000 7f9768537700 1 -- 172.21.15.173:0/2560714065 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v35'32 uv26 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9ff400 2024-09-13T23:58:08.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.760+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac5400 con 0x55666a9ffc00 2024-09-13T23:58:08.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.764+0000 7f9768537700 1 -- 172.21.15.173:0/2560714065 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v35'51 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9ffc00 2024-09-13T23:58:08.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.764+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac5800 con 0x55666a9ff400 2024-09-13T23:58:08.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.764+0000 7f9768537700 1 -- 172.21.15.173:0/2560714065 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v35'67 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9ff400 2024-09-13T23:58:08.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.764+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac5c00 con 0x55666a9ffc00 2024-09-13T23:58:08.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.768+0000 7f9768537700 1 -- 172.21.15.173:0/2560714065 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v35'54 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9ffc00 2024-09-13T23:58:08.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.768+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac4000 con 0x55666a9fe400 2024-09-13T23:58:08.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.768+0000 7f9767d36700 1 -- 172.21.15.173:0/2560714065 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v35'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9fe400 2024-09-13T23:58:08.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.772+0000 7f974acfc700 20 reqs_thread_entry: start 2024-09-13T23:58:08.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.772+0000 7f9769d7ef40 20 init_complete bucket index max shards: 11 2024-09-13T23:58:08.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.772+0000 7f9769d7ef40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:58:08.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.772+0000 7f9748cf8700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:58:39 2024 2024-09-13T23:58:08.776 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:58:08.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.772+0000 7f97484d6700 20 reqs_thread_entry: start 2024-09-13T23:58:08.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.772+0000 7f9769d7ef40 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:58:08.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.772+0000 7f9769d7ef40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.772+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac5800 con 0x55666a8e2800 2024-09-13T23:58:08.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.772+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(62 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv6 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.772+0000 7f9769d7ef40 20 rados_obj.operate() r=0 bl.length=346 2024-09-13T23:58:08.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.772+0000 7f9769d7ef40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T23:58:08.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.772+0000 7f9769d7ef40 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:58:08.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.772+0000 7f9769d7ef40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:58:08.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.772+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d1800 con 0x55666a8e2400 2024-09-13T23:58:08.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.776+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(63 fud.buckets [call out=184b] v0'0 uv7 ondisk = 0) v8 ==== 155+0+184 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.776+0000 7f9769d7ef40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8 : miss 2024-09-13T23:58:08.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.776+0000 7f9769d7ef40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.776+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 8.10 8:0b491bc9:root::.bucket.meta.myfoo7%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.8:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a8e3000 con 0x55666a9d0400 2024-09-13T23:58:08.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.776+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(64 .bucket.meta.myfoo7:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8 [call out=48b,stat out=16b,read 0~353 out=353b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 333+0+635 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.776+0000 7f9769d7ef40 20 rados_obj.operate() r=0 bl.length=353 2024-09-13T23:58:08.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.776+0000 7f9769d7ef40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8 info.flags=0x17 2024-09-13T23:58:08.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.776+0000 7f9769d7ef40 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8 to cache LRU end 2024-09-13T23:58:08.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.776+0000 7f9769d7ef40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:58:08.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.776+0000 7f9769d7ef40 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:58:08.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.776+0000 7f9769d7ef40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8 2024-09-13T23:58:08.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.776+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:65 4.2d 4:b77dc0c1:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9fec00 con 0x55666a8e2800 2024-09-13T23:58:08.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.776+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(65 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.776+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:66 4.10 4:0b143831:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9ff800 con 0x55666a9d0c00 2024-09-13T23:58:08.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.780+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(66 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.780+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:67 4.10 4:0a11cb4b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9ff800 con 0x55666a9d0c00 2024-09-13T23:58:08.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.780+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(67 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.2 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.780+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:68 4.22 4:46ac462e:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9fec00 con 0x55666a8e2400 2024-09-13T23:58:08.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.780+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(68 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.780+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:69 4.36 4:6e860eed:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a8e2400 2024-09-13T23:58:08.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.780+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(69 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.780+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:70 4.12 4:4b6de585:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d1000 con 0x55666a8e2400 2024-09-13T23:58:08.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.780+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(70 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.5 [call out=378b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+378 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.780+0000 7f9769d7ef40 10 cls_bucket_list_unordered: got fourteen 2024-09-13T23:58:08.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.780+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:71 4.22 4:4467c3d1:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d1400 con 0x55666a8e2400 2024-09-13T23:58:08.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.780+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(71 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.6 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.780+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:72 4.30 4:0d18017e:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d1800 con 0x55666a9d0400 2024-09-13T23:58:08.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.784+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(72 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.784+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:73 4.10 4:0b94c178:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac4000 con 0x55666a9d0c00 2024-09-13T23:58:08.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.784+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(73 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.784+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:74 4.32 4:4e92592c:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac4400 con 0x55666a9d0400 2024-09-13T23:58:08.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.784+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(74 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.9 [call out=85b] v0'0 uv10 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.784+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:75 4.1 4:82c66c68:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac4800 con 0x55666a8e2800 2024-09-13T23:58:08.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.784+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(75 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.10 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.784+0000 7f9769d7ef40 20 get_obj_state: rctx=0x55666a61d960 obj=myfoo7:fourteen state=0x55666ab421e8 s->prefetch_data=0 2024-09-13T23:58:08.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.784+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:76 3.4s0 3:2205f712:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac4c00 con 0x55666a8e2400 2024-09-13T23:58:08.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.788+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(76 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8_fourteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 238+0+872 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.788+0000 7f9769d7ef40 10 manifest: total_size = 8 2024-09-13T23:58:08.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.788+0000 7f9769d7ef40 20 get_obj_state: setting s->obj_tag to d342d0db-d035-4a54-bae7-2e0f76db6818.4232.12972141780250938286 2024-09-13T23:58:08.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.788+0000 7f9769d7ef40 20 get_obj_state: rctx=0x55666a61d960 obj=myfoo7:fourteen state=0x55666ab421e8 s->prefetch_data=0 2024-09-13T23:58:08.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.788+0000 7f9769d7ef40 20 prepare_atomic_modification: state is not atomic. state=0x55666ab421e8 2024-09-13T23:58:08.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.788+0000 7f9769d7ef40 20 bucket index object: default.rgw.buckets.index:.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.5 2024-09-13T23:58:08.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.788+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:77 4.12 4:4b6de585:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac5800 con 0x55666a8e2400 2024-09-13T23:58:08.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.788+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 24 ==== osd_op_reply(77 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.5 [stat,call,call] v35'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.788+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:78 3.4s0 3:2205f712:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a8e2c00 con 0x55666a8e2400 2024-09-13T23:58:08.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.792+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 25 ==== osd_op_reply(78 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8_fourteen [call] v35'2 uv2 ondisk = 0) v8 ==== 196+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.792+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:79 4.12 4:4b6de585:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac4800 con 0x55666a8e2400 2024-09-13T23:58:08.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.792+0000 7f9769d7ef40 20 list_objects_ordered: starting attempt 1 2024-09-13T23:58:08.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.792+0000 7f9769d7ef40 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T23:58:08.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.792+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:80 4.2d 4:b77dc0c1:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac4c00 con 0x55666a8e2800 2024-09-13T23:58:08.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.792+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:81 4.10 4:0b143831:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac5800 con 0x55666a9d0c00 2024-09-13T23:58:08.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.792+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:82 4.10 4:0a11cb4b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a9d0c00 2024-09-13T23:58:08.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(80 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:83 4.22 4:46ac462e:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d1000 con 0x55666a8e2400 2024-09-13T23:58:08.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:84 4.36 4:6e860eed:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d1400 con 0x55666a8e2400 2024-09-13T23:58:08.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 26 ==== osd_op_reply(83 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(81 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:85 4.12 4:4b6de585:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9fec00 con 0x55666a8e2400 2024-09-13T23:58:08.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:86 4.22 4:4467c3d1:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab4a000 con 0x55666a8e2400 2024-09-13T23:58:08.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 27 ==== osd_op_reply(84 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:87 4.30 4:0d18017e:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab4a400 con 0x55666a9d0400 2024-09-13T23:58:08.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:88 4.10 4:0b94c178:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab4a800 con 0x55666a9d0c00 2024-09-13T23:58:08.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:89 4.32 4:4e92592c:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab4ac00 con 0x55666a9d0400 2024-09-13T23:58:08.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== osd_op_reply(82 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.2 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:90 4.1 4:82c66c68:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab4b000 con 0x55666a8e2800 2024-09-13T23:58:08.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 28 ==== osd_op_reply(86 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.6 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 20 ==== osd_op_reply(88 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 18 ==== osd_op_reply(90 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.10 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(89 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.9 [call out=85b] v0'0 uv10 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(87 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 29 ==== osd_op_reply(79 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.5 [stat,call,call] v35'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9762d2c700 20 handle_completion(): completion ok for obj=fourteen 2024-09-13T23:58:08.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 30 ==== osd_op_reply(85 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.5 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9769d7ef40 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T23:58:08.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9769d7ef40 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T23:58:08.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9769d7ef40 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T23:58:08.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9769d7ef40 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T23:58:08.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9769d7ef40 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8])"; uploads.size()=0; is_truncated=0 2024-09-13T23:58:08.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9769d7ef40 10 lifecycle: RGWRados::convert_old_bucket_info(): bucket=:myfoo7[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8]) 2024-09-13T23:58:08.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9769d7ef40 10 lifecycle: cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-13T23:58:08.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9769d7ef40 20 lifecycle: rados->read ofs=0 len=0 2024-09-13T23:58:08.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.796+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:91 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab4b400 con 0x55666a8e2800 2024-09-13T23:58:08.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.800+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 19 ==== osd_op_reply(91 myfoo7 [call out=48b,stat out=16b,read 0~166 out=166b,getxattrs out=75b] v0'0 uv42 ondisk = 0) v8 ==== 276+0+305 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.800+0000 7f9769d7ef40 20 lifecycle: rados_obj.operate() r=0 bl.length=166 2024-09-13T23:58:08.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.800+0000 7f9769d7ef40 10 lifecycle: cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x17 2024-09-13T23:58:08.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.800+0000 7f9769d7ef40 10 lifecycle: adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-13T23:58:08.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.800+0000 7f9769d7ef40 10 lifecycle: updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:58:08.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.800+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:92 8.10 8:0b491bc9:root::.bucket.meta.myfoo7%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.8:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~353 in=353b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab4bc00 con 0x55666a9d0400 2024-09-13T23:58:08.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.800+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(92 .bucket.meta.myfoo7:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8 [delete,create,call,call,writefull 0~353,setxattr (123)] v35'2 uv2 ondisk = 0) v8 ==== 417+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.800+0000 7f9769d7ef40 10 lifecycle: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8 info.flags=0x17 2024-09-13T23:58:08.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.800+0000 7f9769d7ef40 10 lifecycle: moving default.rgw.meta+root+.bucket.meta.myfoo7:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8 to cache LRU end 2024-09-13T23:58:08.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.800+0000 7f9769d7ef40 10 lifecycle: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:58:08.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.800+0000 7f9769d7ef40 10 lifecycle: distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo7:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8, ofs0, ns] 2024-09-13T23:58:08.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.800+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:93 7.3 7:c609908c:::notify.5:head [notify cookie 93898363915648 in=739b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab46400 con 0x55666a9d0c00 2024-09-13T23:58:08.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.800+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 21 ==== watch-notify(notify (1) cookie 93898362237312 notify 150323855396 ret 0) v3 ==== 769+0+0 (crc 0 0 0) 0x55666aa5cd00 con 0x55666a9d0c00 2024-09-13T23:58:08.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.800+0000 7f9762d2c700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855396 cookie 93898362237312 notifier 4839 bl.length()=727 2024-09-13T23:58:08.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.800+0000 7f9762d2c700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8 info.flags=0x17 2024-09-13T23:58:08.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.800+0000 7f9762d2c700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo7:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8 to cache LRU end 2024-09-13T23:58:08.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.800+0000 7f9762d2c700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:58:08.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.800+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 22 ==== osd_op_reply(93 notify.5 [notify cookie 93898363915648 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.800+0000 7f9762d2c700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a8e2c00 con 0x55666a9d0c00 2024-09-13T23:58:08.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.800+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 23 ==== osd_op_reply(94 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.804+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 24 ==== watch-notify(notify_complete (2) cookie 93898363915648 notify 150323855396 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55666aa5cea0 con 0x55666a9d0c00 2024-09-13T23:58:08.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.804+0000 7f9769d7ef40 20 lifecycle: handle_bi_update(): bucket=:myfoo7[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8]): orig_sources= new_sources= 2024-09-13T23:58:08.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.804+0000 7f9769d7ef40 20 lifecycle: handle_bi_update(): bucket=:myfoo7[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8]): potential sources added=[] removed=[] 2024-09-13T23:58:08.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.804+0000 7f9769d7ef40 20 lifecycle: handle_bi_update(): bucket=:myfoo7[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8]): orig_dests= new_dests= 2024-09-13T23:58:08.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.804+0000 7f9769d7ef40 20 lifecycle: handle_bi_update(): bucket=:myfoo7[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8]): potential dests added=[] removed=[] 2024-09-13T23:58:08.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.804+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:33 6.18 6:1fdc4f8e:lc::lc.10:head [call lock.lock in=65b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab46800 con 0x55666a9fe400 2024-09-13T23:58:08.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.804+0000 7f9767d36700 1 -- 172.21.15.173:0/2560714065 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(33 lc.10 [call] v35'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9fe400 2024-09-13T23:58:08.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.804+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:34 6.18 6:1fdc4f8e:lc::lc.10:head [call rgw.lc_rm_entry in=93b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab46c00 con 0x55666a9fe400 2024-09-13T23:58:08.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.804+0000 7f9767d36700 1 -- 172.21.15.173:0/2560714065 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(34 lc.10 [call] v35'29 uv29 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9fe400 2024-09-13T23:58:08.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.804+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:35 6.18 6:1fdc4f8e:lc::lc.10:head [call lock.unlock in=49b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab47000 con 0x55666a9fe400 2024-09-13T23:58:08.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.808+0000 7f9767d36700 1 -- 172.21.15.173:0/2560714065 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(35 lc.10 [call] v35'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9fe400 2024-09-13T23:58:08.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.808+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:95 4.2d 4:b77dc0c1:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab47400 con 0x55666a8e2800 2024-09-13T23:58:08.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.808+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:96 4.10 4:0b143831:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab47800 con 0x55666a9d0c00 2024-09-13T23:58:08.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.808+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:97 4.10 4:0a11cb4b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab47c00 con 0x55666a9d0c00 2024-09-13T23:58:08.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.808+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:98 4.22 4:46ac462e:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab4a800 con 0x55666a8e2400 2024-09-13T23:58:08.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.808+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:99 4.36 4:6e860eed:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab4a400 con 0x55666a8e2400 2024-09-13T23:58:08.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.808+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:100 4.12 4:4b6de585:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab4ac00 con 0x55666a8e2400 2024-09-13T23:58:08.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.808+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:101 4.22 4:4467c3d1:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab4b800 con 0x55666a8e2400 2024-09-13T23:58:08.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.808+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:102 4.30 4:0d18017e:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab4bc00 con 0x55666a9d0400 2024-09-13T23:58:08.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.808+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 25 ==== osd_op_reply(96 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.808+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 20 ==== osd_op_reply(95 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.808+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:103 4.10 4:0b94c178:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab46400 con 0x55666a9d0c00 2024-09-13T23:58:08.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.808+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:104 4.32 4:4e92592c:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab46000 con 0x55666a9d0400 2024-09-13T23:58:08.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.808+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 31 ==== osd_op_reply(98 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.808+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:105 4.1 4:82c66c68:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac4000 con 0x55666a8e2800 2024-09-13T23:58:08.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.808+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 26 ==== osd_op_reply(97 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.2 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.808+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 32 ==== osd_op_reply(99 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.808+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 33 ==== osd_op_reply(100 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.5 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.808+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 34 ==== osd_op_reply(101 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.6 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.808+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 27 ==== osd_op_reply(103 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.808+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(104 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.9 [call out=85b] v0'0 uv10 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.808+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== osd_op_reply(102 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.808+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 21 ==== osd_op_reply(105 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.10 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.808+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:106 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac5800 con 0x55666a8e2400 2024-09-13T23:58:08.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.812+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 35 ==== osd_op_reply(106 fud.buckets [call] v35'10 uv10 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.812+0000 7f9769d7ef40 10 cache get: name=default.rgw.meta+root+myfoo7 : hit (requested=0x11, cached=0x17) 2024-09-13T23:58:08.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.812+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:107 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac5c00 con 0x55666a8e2800 2024-09-13T23:58:08.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.812+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 22 ==== osd_op_reply(107 myfoo7 [call,call,delete] v35'43 uv43 ondisk = 0) v8 ==== 234+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.812+0000 7f9769d7ef40 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-13T23:58:08.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.812+0000 7f9769d7ef40 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-13T23:58:08.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.812+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [notify cookie 93898363915648 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac4400 con 0x55666a8e2800 2024-09-13T23:58:08.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.812+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 23 ==== watch-notify(notify (1) cookie 93898362235008 notify 150323855377 ret 0) v3 ==== 192+0+0 (crc 0 0 0) 0x55666a995380 con 0x55666a8e2800 2024-09-13T23:58:08.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.812+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 24 ==== osd_op_reply(108 notify.3 [notify cookie 93898363915648 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.812+0000 7f976252b700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855377 cookie 93898362235008 notifier 4839 bl.length()=150 2024-09-13T23:58:08.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.812+0000 7f976252b700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a8e2c00 con 0x55666a8e2800 2024-09-13T23:58:08.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.816+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 25 ==== watch-notify(notify_complete (2) cookie 93898363915648 notify 150323855377 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55666a995520 con 0x55666a8e2800 2024-09-13T23:58:08.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.816+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 26 ==== osd_op_reply(109 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.816+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:110 8.10 8:0b491bc9:root::.bucket.meta.myfoo7%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.8:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d0800 con 0x55666a9d0400 2024-09-13T23:58:08.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.816+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== osd_op_reply(110 .bucket.meta.myfoo7:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8 [call,call,delete] v35'3 uv3 ondisk = 0) v8 ==== 291+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.816+0000 7f9769d7ef40 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8 from cache 2024-09-13T23:58:08.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.816+0000 7f9769d7ef40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8, ofs0, ns] 2024-09-13T23:58:08.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.816+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [notify cookie 93898363915648 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d1800 con 0x55666a9d0c00 2024-09-13T23:58:08.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.816+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 28 ==== watch-notify(notify (1) cookie 93898362237312 notify 150323855397 ret 0) v3 ==== 249+0+0 (crc 0 0 0) 0x55666aa5cea0 con 0x55666a9d0c00 2024-09-13T23:58:08.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.816+0000 7f976252b700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855397 cookie 93898362237312 notifier 4839 bl.length()=207 2024-09-13T23:58:08.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.816+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 29 ==== osd_op_reply(111 notify.5 [notify cookie 93898363915648 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.816+0000 7f976252b700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:112 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac4800 con 0x55666a9d0c00 2024-09-13T23:58:08.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.820+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 30 ==== osd_op_reply(112 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.820+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 31 ==== watch-notify(notify_complete (2) cookie 93898363915648 notify 150323855397 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55666aa5d040 con 0x55666a9d0c00 2024-09-13T23:58:08.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.820+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:113 4.2d 4:b77dc0c1:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a8e3000 con 0x55666a8e2800 2024-09-13T23:58:08.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.820+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:114 4.10 4:0b143831:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9ff800 con 0x55666a9d0c00 2024-09-13T23:58:08.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.820+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:115 4.10 4:0a11cb4b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab46800 con 0x55666a9d0c00 2024-09-13T23:58:08.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.820+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:116 4.22 4:46ac462e:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab46c00 con 0x55666a8e2400 2024-09-13T23:58:08.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.820+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:117 4.36 4:6e860eed:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab47000 con 0x55666a8e2400 2024-09-13T23:58:08.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.820+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:118 4.12 4:4b6de585:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab47800 con 0x55666a8e2400 2024-09-13T23:58:08.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.820+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:119 4.22 4:4467c3d1:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab47c00 con 0x55666a8e2400 2024-09-13T23:58:08.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.820+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:120 4.30 4:0d18017e:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab46400 con 0x55666a9d0400 2024-09-13T23:58:08.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.820+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:121 4.10 4:0b94c178:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab47400 con 0x55666a9d0c00 2024-09-13T23:58:08.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.820+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:122 4.32 4:4e92592c:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab4a000 con 0x55666a9d0400 2024-09-13T23:58:08.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.820+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:123 4.1 4:82c66c68:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab4b000 con 0x55666a8e2800 2024-09-13T23:58:08.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.820+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 36 ==== osd_op_reply(117 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.4 [delete] v35'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.824+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 32 ==== osd_op_reply(114 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.1 [delete] v35'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.824+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 33 ==== osd_op_reply(115 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.2 [delete] v35'5 uv5 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.824+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 27 ==== osd_op_reply(113 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.0 [delete] v35'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.824+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 37 ==== osd_op_reply(116 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.3 [delete] v35'5 uv5 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.824+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 38 ==== osd_op_reply(118 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.5 [delete] v35'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.824+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 27 ==== osd_op_reply(122 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.9 [delete] v35'12 uv12 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.824+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 28 ==== osd_op_reply(120 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.7 [delete] v35'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.824+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 28 ==== osd_op_reply(123 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.10 [delete] v35'4 uv4 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.824+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 34 ==== osd_op_reply(121 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.8 [delete] v35'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.824+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 39 ==== osd_op_reply(119 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8.6 [delete] v35'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.824+0000 7f9769d7ef40 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8 : miss 2024-09-13T23:58:08.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.824+0000 7f9769d7ef40 20 rados->read ofs=0 len=0 2024-09-13T23:58:08.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.824+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:124 6.16 6:6ff9d6de:::pubsub..bucket.myfoo7%2fd342d0db-d035-4a54-bae7-2e0f76db6818.4234.8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab4b400 con 0x55666a9d0c00 2024-09-13T23:58:08.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.824+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 35 ==== osd_op_reply(124 pubsub..bucket.myfoo7/d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 209+0+0 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.824+0000 7f9769d7ef40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:08.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.824+0000 7f9769d7ef40 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8 info.flags=0x0 2024-09-13T23:58:08.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.824+0000 7f9769d7ef40 10 adding default.rgw.log++pubsub..bucket.myfoo7/d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8 to cache LRU end 2024-09-13T23:58:08.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.824+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:125 6.16 6:6ff9d6de:::pubsub..bucket.myfoo7%2fd342d0db-d035-4a54-bae7-2e0f76db6818.4234.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9fec00 con 0x55666a9d0c00 2024-09-13T23:58:08.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.824+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 36 ==== osd_op_reply(125 pubsub..bucket.myfoo7/d342d0db-d035-4a54-bae7-2e0f76db6818.4234.8 [delete] v35'31 uv24 ondisk = -2 ((2) No such file or directory)) v8 ==== 209+0+0 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.824+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:126 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d1000 con 0x55666a8e2400 2024-09-13T23:58:08.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.828+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 40 ==== osd_op_reply(126 fud.buckets [call] v35'11 uv11 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.828+0000 7f9769d7ef40 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-13T23:58:08.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.828+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:127 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d1400 con 0x55666a9d0c00 2024-09-13T23:58:08.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.828+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 37 ==== osd_op_reply(127 p5YnriCv1nAtykxBrupQ [delete] v35'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.828+0000 7f9769d7ef40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T23:58:08.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.828+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:128 7.15 7:a93a5511:::notify.2:head [notify cookie 93898363915648 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a8e2c00 con 0x55666a9d0400 2024-09-13T23:58:08.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.828+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 29 ==== watch-notify(notify (1) cookie 93898362233856 notify 150323855402 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x55666a8ee680 con 0x55666a9d0400 2024-09-13T23:58:08.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.828+0000 7f976252b700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855402 cookie 93898362233856 notifier 4839 bl.length()=170 2024-09-13T23:58:08.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.828+0000 7f976252b700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:129 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac4c00 con 0x55666a9d0400 2024-09-13T23:58:08.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.832+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 30 ==== osd_op_reply(128 notify.2 [notify cookie 93898363915648 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.832+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 31 ==== watch-notify(notify_complete (2) cookie 93898363915648 notify 150323855402 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55666a8ee820 con 0x55666a9d0400 2024-09-13T23:58:08.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.832+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 32 ==== osd_op_reply(129 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.832+0000 7f9769d7ef40 10 removing email index: 2024-09-13T23:58:08.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.832+0000 7f9769d7ef40 10 removing user buckets index 2024-09-13T23:58:08.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.832+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:130 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a8e3000 con 0x55666a8e2400 2024-09-13T23:58:08.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.832+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 41 ==== osd_op_reply(130 fud.buckets [delete] v35'12 uv12 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.832+0000 7f9769d7ef40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-13T23:58:08.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.832+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:131 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93898363915648 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac4800 con 0x55666a9d0c00 2024-09-13T23:58:08.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.832+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 38 ==== watch-notify(notify (1) cookie 93898362238464 notify 150323855398 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x55666aa5d040 con 0x55666a9d0c00 2024-09-13T23:58:08.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.832+0000 7f9762d2c700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855398 cookie 93898362238464 notifier 4839 bl.length()=160 2024-09-13T23:58:08.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.832+0000 7f9762d2c700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:132 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aace000 con 0x55666a9d0c00 2024-09-13T23:58:08.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.832+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 39 ==== osd_op_reply(131 notify.6 [notify cookie 93898363915648 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.832+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 40 ==== osd_op_reply(132 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.832+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 41 ==== watch-notify(notify_complete (2) cookie 93898363915648 notify 150323855398 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55666aa5d1e0 con 0x55666a9d0c00 2024-09-13T23:58:08.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.832+0000 7f9769d7ef40 10 removing user index: fud 2024-09-13T23:58:08.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.832+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:133 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac4000 con 0x55666a8e2800 2024-09-13T23:58:08.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.836+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 29 ==== osd_op_reply(133 fud [call,call,delete] v35'8 uv8 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.836+0000 7f9769d7ef40 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-13T23:58:08.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.836+0000 7f9769d7ef40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T23:58:08.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.836+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:134 7.3 7:c609908c:::notify.5:head [notify cookie 93898363915648 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aac5800 con 0x55666a9d0c00 2024-09-13T23:58:08.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.836+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 42 ==== watch-notify(notify (1) cookie 93898362237312 notify 150323855399 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x55666aa5d1e0 con 0x55666a9d0c00 2024-09-13T23:58:08.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.836+0000 7f976252b700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855399 cookie 93898362237312 notifier 4839 bl.length()=152 2024-09-13T23:58:08.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.836+0000 7f976252b700 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:135 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aace800 con 0x55666a9d0c00 2024-09-13T23:58:08.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.836+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 43 ==== osd_op_reply(134 notify.5 [notify cookie 93898363915648 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.836+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 44 ==== osd_op_reply(135 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.836+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 45 ==== watch-notify(notify_complete (2) cookie 93898363915648 notify 150323855399 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55666aa5d380 con 0x55666a9d0c00 2024-09-13T23:58:08.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.840+0000 7f974f505700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:08.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.840+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:136 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93898363912192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab4b800 con 0x55666a8e2400 2024-09-13T23:58:08.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.840+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 42 ==== osd_op_reply(136 data_loggenerations_metadata [watch unwatch cookie 93898363912192] v35'227 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.840+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:137 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93898362231552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d1800 con 0x55666a9d0400 2024-09-13T23:58:08.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.844+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 33 ==== osd_op_reply(137 notify.0 [watch unwatch cookie 93898362231552] v35'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.844+0000 7f9769d7ef40 20 remove_watcher() i=0 2024-09-13T23:58:08.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.844+0000 7f9769d7ef40 2 removed watcher, disabling cache 2024-09-13T23:58:08.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.844+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:138 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93898362232704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9d1400 con 0x55666a8e2400 2024-09-13T23:58:08.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.844+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.1 v2:172.21.15.173:6808/3256211813 43 ==== osd_op_reply(138 notify.1 [watch unwatch cookie 93898362232704] v35'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2400 2024-09-13T23:58:08.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.844+0000 7f9769d7ef40 20 remove_watcher() i=1 2024-09-13T23:58:08.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.844+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:139 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93898362233856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9ff800 con 0x55666a9d0400 2024-09-13T23:58:08.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.848+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 34 ==== osd_op_reply(139 notify.2 [watch unwatch cookie 93898362233856] v35'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.848+0000 7f9769d7ef40 20 remove_watcher() i=2 2024-09-13T23:58:08.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.848+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:140 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93898362235008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666a9fec00 con 0x55666a8e2800 2024-09-13T23:58:08.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.852+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 30 ==== osd_op_reply(140 notify.3 [watch unwatch cookie 93898362235008] v35'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.852+0000 7f9769d7ef40 20 remove_watcher() i=3 2024-09-13T23:58:08.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.852+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:141 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93898362236160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab46800 con 0x55666a9d0400 2024-09-13T23:58:08.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.852+0000 7f9768537700 1 -- 172.21.15.173:0/1783926961 <== osd.0 v2:172.21.15.87:6800/3507919120 35 ==== osd_op_reply(141 notify.4 [watch unwatch cookie 93898362236160] v35'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e7200 con 0x55666a9d0400 2024-09-13T23:58:08.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.852+0000 7f9769d7ef40 20 remove_watcher() i=4 2024-09-13T23:58:08.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.852+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:142 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93898362237312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666ab47400 con 0x55666a9d0c00 2024-09-13T23:58:08.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.856+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 46 ==== osd_op_reply(142 notify.5 [watch unwatch cookie 93898362237312] v35'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.856+0000 7f9769d7ef40 20 remove_watcher() i=5 2024-09-13T23:58:08.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.856+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:143 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93898362238464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aacf400 con 0x55666a9d0c00 2024-09-13T23:58:08.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.856+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 <== osd.3 v2:172.21.15.173:6800/4020038786 47 ==== osd_op_reply(143 notify.6 [watch unwatch cookie 93898362238464] v35'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e7440 con 0x55666a9d0c00 2024-09-13T23:58:08.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.856+0000 7f9769d7ef40 20 remove_watcher() i=6 2024-09-13T23:58:08.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.860+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:144 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93898362239616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55666aacf800 con 0x55666a8e2800 2024-09-13T23:58:08.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.860+0000 7f9768d38700 1 -- 172.21.15.173:0/1783926961 <== osd.2 v2:172.21.15.173:6809/889985573 31 ==== osd_op_reply(144 notify.7 [watch unwatch cookie 93898362239616] v35'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55666a9e6b40 con 0x55666a8e2800 2024-09-13T23:58:08.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.860+0000 7f9769d7ef40 20 remove_watcher() i=7 2024-09-13T23:58:08.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.860+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55666a9d0400 msgr2=0x55666a874100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.860+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/1783926961 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55666a9d0400 0x55666a874100 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.860+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55666a8e2400 msgr2=0x55666a873080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.860+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/1783926961 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55666a8e2400 0x55666a873080 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.860+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55666a8e2800 msgr2=0x55666a875700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.860+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/1783926961 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55666a8e2800 0x55666a875700 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.860+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55666a9d0c00 msgr2=0x55666a874680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.860+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/1783926961 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55666a9d0c00 0x55666a874680 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.860+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55666a9d0000 msgr2=0x55666a873b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.860+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/1783926961 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55666a9d0000 0x55666a873b80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55666b356030 tx=0x55666a9de0c0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.860+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a8e2000 msgr2=0x55666a872b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.860+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/1783926961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a8e2000 0x55666a872b00 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x55666a8b4180 tx=0x55666a8fe5a0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.860+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 reap_dead start 2024-09-13T23:58:08.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.860+0000 7f9767d36700 1 -- 172.21.15.173:0/1783926961 reap_dead start 2024-09-13T23:58:08.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.860+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 shutdown_connections 2024-09-13T23:58:08.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.860+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 >> 172.21.15.173:0/1783926961 conn(0x55666a58dc00 msgr2=0x55666a68d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:08.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.860+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 shutdown_connections 2024-09-13T23:58:08.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.860+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1783926961 wait complete. 2024-09-13T23:58:08.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55666a9ff400 msgr2=0x55666a875180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/2560714065 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55666a9ff400 0x55666a875180 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55666a9ffc00 msgr2=0x55666aa97080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/2560714065 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55666a9ffc00 0x55666aa97080 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55666a9fe400 msgr2=0x55666aa96580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/2560714065 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55666a9fe400 0x55666aa96580 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55666a9d1c00 msgr2=0x55666aa96b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/2560714065 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55666a9d1c00 0x55666aa96b00 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55666a9ff000 msgr2=0x55666aa96000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/2560714065 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55666a9ff000 0x55666aa96000 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55666a99faa0 tx=0x55666a9df380 comp rx=0 tx=0).stop 2024-09-13T23:58:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a9fe800 msgr2=0x55666a874c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/2560714065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a9fe800 0x55666a874c00 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x55666aa12210 tx=0x55666a9de1e0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9768537700 1 -- 172.21.15.173:0/2560714065 reap_dead start 2024-09-13T23:58:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9768537700 1 -- 172.21.15.173:0/2560714065 reap_dead start 2024-09-13T23:58:08.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 shutdown_connections 2024-09-13T23:58:08.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 >> 172.21.15.173:0/2560714065 conn(0x55666a9fe000 msgr2=0x55666a68e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:08.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 shutdown_connections 2024-09-13T23:58:08.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 -- 172.21.15.173:0/2560714065 wait complete. 2024-09-13T23:58:08.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1023379965 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55666a8e3400 msgr2=0x55666a873600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/1023379965 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55666a8e3400 0x55666a873600 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55666a8b5440 tx=0x55666a8fec60 comp rx=0 tx=0).stop 2024-09-13T23:58:08.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1023379965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a58d800 msgr2=0x55666a872580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:08.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/1023379965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a58d800 0x55666a872580 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x55666b357ec0 tx=0x55666a691980 comp rx=0 tx=0).stop 2024-09-13T23:58:08.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1023379965 shutdown_connections 2024-09-13T23:58:08.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/1023379965 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55666a8e3400 0x55666a873600 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 --2- 172.21.15.173:0/1023379965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55666a58d800 0x55666a872580 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:08.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1023379965 >> 172.21.15.173:0/1023379965 conn(0x55666a58cc00 msgr2=0x55666a68d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:08.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1023379965 shutdown_connections 2024-09-13T23:58:08.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:08.864+0000 7f9769d7ef40 1 -- 172.21.15.173:0/1023379965 wait complete. 2024-09-13T23:58:48.873 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-13T23:58:48.873 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-13T23:58:48.874 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-13T23:58:48.916 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:58:48.917 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:58:48.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.911+0000 7fd905d47f40 1 Processor -- start 2024-09-13T23:58:48.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.911+0000 7fd905d47f40 1 -- start start 2024-09-13T23:58:48.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.911+0000 7fd905d47f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55cee9ca7000 0x55cee9f8c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:48.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.915+0000 7fd905d47f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cee9d6b500 con 0x55cee9ca7400 2024-09-13T23:58:48.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.915+0000 7fd905d47f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cee9d34a00 con 0x55cee9ca7000 2024-09-13T23:58:48.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.915+0000 7fd904500700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55cee9ca7000 0x55cee9f8c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:48.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.915+0000 7fd903cff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55cee9ca7400 0x55cee9da6800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:53562/0 (socket says 172.21.15.173:53562) 2024-09-13T23:58:48.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.915+0000 7fd903cff700 1 -- 172.21.15.173:0/1033864785 learned_addr learned my addr 172.21.15.173:0/1033864785 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:58:48.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.915+0000 7fd904500700 1 -- 172.21.15.173:0/1033864785 >> v1:172.21.15.87:6789/0 conn(0x55cee9ca7400 legacy=0x55cee9da6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:48.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.915+0000 7fd9034fe700 1 -- 172.21.15.173:0/1033864785 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980538724 0 0) 0x55cee9e02000 con 0x55cee9ca7400 2024-09-13T23:58:48.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.915+0000 7fd904500700 1 -- 172.21.15.173:0/1033864785 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cee9cb9d40 con 0x55cee9ca7000 2024-09-13T23:58:48.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.915+0000 7fd904500700 1 --2- 172.21.15.173:0/1033864785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7000 0x55cee9f8c580 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x55cee9f87a70 tx=0x55cee9dab920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64682f705665b59c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:48.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.915+0000 7fd9034fe700 1 -- 172.21.15.173:0/1033864785 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cee9d4b4a0 con 0x55cee9ca7000 2024-09-13T23:58:48.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.915+0000 7fd9034fe700 1 -- 172.21.15.173:0/1033864785 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cee9d6b800 con 0x55cee9ca7000 2024-09-13T23:58:48.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.915+0000 7fd9034fe700 1 -- 172.21.15.173:0/1033864785 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cee9d4b600 con 0x55cee9ca7000 2024-09-13T23:58:48.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.915+0000 7fd905d47f40 1 -- 172.21.15.173:0/1033864785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7000 msgr2=0x55cee9f8c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:48.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.915+0000 7fd905d47f40 1 --2- 172.21.15.173:0/1033864785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7000 0x55cee9f8c580 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x55cee9f87a70 tx=0x55cee9dab920 comp rx=0 tx=0).stop 2024-09-13T23:58:48.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.915+0000 7fd905d47f40 1 -- 172.21.15.173:0/1033864785 shutdown_connections 2024-09-13T23:58:48.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.915+0000 7fd905d47f40 1 --2- 172.21.15.173:0/1033864785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7000 0x55cee9f8c580 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:48.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.915+0000 7fd905d47f40 1 -- 172.21.15.173:0/1033864785 >> 172.21.15.173:0/1033864785 conn(0x55cee9ca6c00 msgr2=0x55cee9da6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:48.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.915+0000 7fd905d47f40 1 -- 172.21.15.173:0/1033864785 shutdown_connections 2024-09-13T23:58:48.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.915+0000 7fd905d47f40 1 -- 172.21.15.173:0/1033864785 wait complete. 2024-09-13T23:58:48.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.915+0000 7fd905d47f40 1 Processor -- start 2024-09-13T23:58:48.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.915+0000 7fd905d47f40 1 -- start start 2024-09-13T23:58:48.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.915+0000 7fd905d47f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7000 0x55cee9f8c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:48.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.915+0000 7fd905d47f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee9d34500 con 0x55cee9ca7000 2024-09-13T23:58:48.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.919+0000 7fd904500700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7000 0x55cee9f8c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:48.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.919+0000 7fd904500700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7000 0x55cee9f8c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50742/0 (socket says 172.21.15.173:50742) 2024-09-13T23:58:48.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.919+0000 7fd904500700 1 -- 172.21.15.173:0/1601441950 learned_addr learned my addr 172.21.15.173:0/1601441950 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:48.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.919+0000 7fd904500700 1 -- 172.21.15.173:0/1601441950 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cee9cb9ba0 con 0x55cee9ca7000 2024-09-13T23:58:48.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.919+0000 7fd904500700 1 --2- 172.21.15.173:0/1601441950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7000 0x55cee9f8c580 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x55ceeaa71e00 tx=0x55cee9dab800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a04432833c5597 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:48.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.919+0000 7fd902cfd700 1 -- 172.21.15.173:0/1601441950 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cee9d4b760 con 0x55cee9ca7000 2024-09-13T23:58:48.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.919+0000 7fd902cfd700 1 -- 172.21.15.173:0/1601441950 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cee9d6bb00 con 0x55cee9ca7000 2024-09-13T23:58:48.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.919+0000 7fd902cfd700 1 -- 172.21.15.173:0/1601441950 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cee9d4b4a0 con 0x55cee9ca7000 2024-09-13T23:58:48.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.919+0000 7fd905d47f40 1 -- 172.21.15.173:0/1601441950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7000 msgr2=0x55cee9f8c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:48.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.919+0000 7fd905d47f40 1 --2- 172.21.15.173:0/1601441950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7000 0x55cee9f8c580 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x55ceeaa71e00 tx=0x55cee9dab800 comp rx=0 tx=0).stop 2024-09-13T23:58:48.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.919+0000 7fd905d47f40 1 -- 172.21.15.173:0/1601441950 shutdown_connections 2024-09-13T23:58:48.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.919+0000 7fd905d47f40 1 --2- 172.21.15.173:0/1601441950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7000 0x55cee9f8c580 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:48.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.919+0000 7fd905d47f40 1 -- 172.21.15.173:0/1601441950 >> 172.21.15.173:0/1601441950 conn(0x55cee9ca6c00 msgr2=0x55cee9da7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:48.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.919+0000 7fd905d47f40 1 -- 172.21.15.173:0/1601441950 shutdown_connections 2024-09-13T23:58:48.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.919+0000 7fd905d47f40 1 -- 172.21.15.173:0/1601441950 wait complete. 2024-09-13T23:58:48.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.919+0000 7fd905d47f40 1 Processor -- start 2024-09-13T23:58:48.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.919+0000 7fd905d47f40 1 -- start start 2024-09-13T23:58:48.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.919+0000 7fd905d47f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7000 0x55cee9f8c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:48.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.919+0000 7fd905d47f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee9d343c0 con 0x55cee9ca7000 2024-09-13T23:58:48.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.919+0000 7fd904500700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7000 0x55cee9f8c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:48.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.919+0000 7fd904500700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7000 0x55cee9f8c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50748/0 (socket says 172.21.15.173:50748) 2024-09-13T23:58:48.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.919+0000 7fd904500700 1 -- 172.21.15.173:0/1539783622 learned_addr learned my addr 172.21.15.173:0/1539783622 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:48.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.923+0000 7fd904500700 1 -- 172.21.15.173:0/1539783622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cee9cb9a00 con 0x55cee9ca7000 2024-09-13T23:58:48.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.923+0000 7fd904500700 1 --2- 172.21.15.173:0/1539783622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7000 0x55cee9f8c580 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x55ceeaa71ef0 tx=0x55cee9dab920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:48.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.923+0000 7fd9014fa700 1 -- 172.21.15.173:0/1539783622 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cee9d4b600 con 0x55cee9ca7000 2024-09-13T23:58:48.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.923+0000 7fd9014fa700 1 -- 172.21.15.173:0/1539783622 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cee9d6bc80 con 0x55cee9ca7000 2024-09-13T23:58:48.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.923+0000 7fd905d47f40 1 -- 172.21.15.173:0/1539783622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cee9cb9860 con 0x55cee9ca7000 2024-09-13T23:58:48.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.923+0000 7fd9014fa700 1 -- 172.21.15.173:0/1539783622 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cee9d4b8c0 con 0x55cee9ca7000 2024-09-13T23:58:48.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.923+0000 7fd905d47f40 1 -- 172.21.15.173:0/1539783622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cee9cb96c0 con 0x55cee9ca7000 2024-09-13T23:58:48.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.923+0000 7fd905d47f40 1 Processor -- start 2024-09-13T23:58:48.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.923+0000 7fd905d47f40 1 -- start start 2024-09-13T23:58:48.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.923+0000 7fd9014fa700 1 -- 172.21.15.173:0/1539783622 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55cee9da0b00 con 0x55cee9ca7000 2024-09-13T23:58:48.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.923+0000 7fd905d47f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7800 0x55cee9f8cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:48.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.923+0000 7fd905d47f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee9ccc640 con 0x55cee9ca7800 2024-09-13T23:58:48.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.923+0000 7fd9014fa700 1 --2- 172.21.15.173:0/1539783622 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ceea046000 0x55cee9f8d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:48.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.923+0000 7fd904d01700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7800 0x55cee9f8cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:48.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.923+0000 7fd904d01700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7800 0x55cee9f8cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50758/0 (socket says 172.21.15.173:50758) 2024-09-13T23:58:48.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.923+0000 7fd904d01700 1 -- 172.21.15.173:0/1074357533 learned_addr learned my addr 172.21.15.173:0/1074357533 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:48.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.923+0000 7fd9014fa700 1 -- 172.21.15.173:0/1539783622 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x55cee9d0d180 con 0x55cee9ca7000 2024-09-13T23:58:48.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.923+0000 7fd904500700 1 --2- 172.21.15.173:0/1539783622 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ceea046000 0x55cee9f8d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:48.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.927+0000 7fd904d01700 1 -- 172.21.15.173:0/1074357533 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cee9cb8000 con 0x55cee9ca7800 2024-09-13T23:58:48.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.927+0000 7fd904d01700 1 --2- 172.21.15.173:0/1074357533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7800 0x55cee9f8cb00 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x55ceeaa71fb0 tx=0x55ceea00af60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37cef3d108cc80e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:48.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.927+0000 7fd904500700 1 --2- 172.21.15.173:0/1539783622 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ceea046000 0x55cee9f8d080 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55ceeab1cf60 tx=0x55ceea00b080 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:48.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.927+0000 7fd8fecf5700 1 -- 172.21.15.173:0/1074357533 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cee9d4b600 con 0x55cee9ca7800 2024-09-13T23:58:48.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.927+0000 7fd8fecf5700 1 -- 172.21.15.173:0/1074357533 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ceea04e000 con 0x55cee9ca7800 2024-09-13T23:58:48.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.927+0000 7fd8fecf5700 1 -- 172.21.15.173:0/1074357533 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cee9d4b8c0 con 0x55cee9ca7800 2024-09-13T23:58:48.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.927+0000 7fd905d47f40 1 -- 172.21.15.173:0/1074357533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7800 msgr2=0x55cee9f8cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:48.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.927+0000 7fd905d47f40 1 --2- 172.21.15.173:0/1074357533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7800 0x55cee9f8cb00 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x55ceeaa71fb0 tx=0x55ceea00af60 comp rx=0 tx=0).stop 2024-09-13T23:58:48.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.927+0000 7fd905d47f40 1 -- 172.21.15.173:0/1074357533 shutdown_connections 2024-09-13T23:58:48.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.927+0000 7fd905d47f40 1 --2- 172.21.15.173:0/1074357533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7800 0x55cee9f8cb00 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:48.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.927+0000 7fd905d47f40 1 -- 172.21.15.173:0/1074357533 >> 172.21.15.173:0/1074357533 conn(0x55cee9ca7400 msgr2=0x55cee9da7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:48.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.927+0000 7fd905d47f40 1 -- 172.21.15.173:0/1074357533 shutdown_connections 2024-09-13T23:58:48.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.927+0000 7fd905d47f40 1 -- 172.21.15.173:0/1074357533 wait complete. 2024-09-13T23:58:48.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.927+0000 7fd905d47f40 1 Processor -- start 2024-09-13T23:58:48.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.927+0000 7fd905d47f40 1 -- start start 2024-09-13T23:58:48.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.927+0000 7fd905d47f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7800 0x55cee9f8cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:48.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.927+0000 7fd905d47f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee9ccc8c0 con 0x55cee9ca7800 2024-09-13T23:58:48.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.931+0000 7fd904d01700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7800 0x55cee9f8cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:48.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.931+0000 7fd904d01700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7800 0x55cee9f8cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50762/0 (socket says 172.21.15.173:50762) 2024-09-13T23:58:48.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.931+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 learned_addr learned my addr 172.21.15.173:0/3405670241 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:48.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.931+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cee9cb8ea0 con 0x55cee9ca7800 2024-09-13T23:58:48.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.931+0000 7fd904d01700 1 --2- 172.21.15.173:0/3405670241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7800 0x55cee9f8cb00 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x55ceeab1c450 tx=0x55ceea00a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:48.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.931+0000 7fd8fd4f2700 1 -- 172.21.15.173:0/3405670241 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cee9d4b760 con 0x55cee9ca7800 2024-09-13T23:58:48.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.931+0000 7fd8fd4f2700 1 -- 172.21.15.173:0/3405670241 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ceea04e180 con 0x55cee9ca7800 2024-09-13T23:58:48.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.931+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cee9cb8820 con 0x55cee9ca7800 2024-09-13T23:58:48.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.931+0000 7fd8fd4f2700 1 -- 172.21.15.173:0/3405670241 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55cee9d4b600 con 0x55cee9ca7800 2024-09-13T23:58:48.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.931+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cee9cb89c0 con 0x55cee9ca7800 2024-09-13T23:58:48.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.931+0000 7fd905d47f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:48.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.931+0000 7fd8fd4f2700 1 -- 172.21.15.173:0/3405670241 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55cee9da1080 con 0x55cee9ca7800 2024-09-13T23:58:48.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.931+0000 7fd8fd4f2700 1 --2- 172.21.15.173:0/3405670241 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ceea046c00 0x55cee9f8d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:48.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.931+0000 7fd8fd4f2700 1 -- 172.21.15.173:0/3405670241 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x55cee9d0d340 con 0x55cee9ca7800 2024-09-13T23:58:48.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.931+0000 7fd905d47f40 1 --2- 172.21.15.173:0/3405670241 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55ceea047000 0x55cee9f8db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:48.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.931+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047400 con 0x55ceea047000 2024-09-13T23:58:48.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.931+0000 7fd903cff700 1 --2- 172.21.15.173:0/3405670241 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ceea046c00 0x55cee9f8d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:48.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd904d01700 1 --2- 172.21.15.173:0/3405670241 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55ceea047000 0x55cee9f8db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:48.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd904d01700 1 --2- 172.21.15.173:0/3405670241 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55ceea047000 0x55cee9f8db80 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:48.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd903cff700 1 --2- 172.21.15.173:0/3405670241 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ceea046c00 0x55cee9f8d600 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55ceeaa70030 tx=0x55ceea0ee900 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:48.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea047000 2024-09-13T23:58:48.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd905d47f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:48.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd905d47f40 20 realm 2024-09-13T23:58:48.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd905d47f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:48.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047000 2024-09-13T23:58:48.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea047000 2024-09-13T23:58:48.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd905d47f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:48.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd905d47f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:58:48.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd905d47f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:48.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047c00 con 0x55ceea047000 2024-09-13T23:58:48.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea047000 2024-09-13T23:58:48.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd905d47f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:48.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd905d47f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:48.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd905d47f40 1 --2- 172.21.15.173:0/3405670241 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55ceea047400 0x55cee9f8e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:48.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047400 2024-09-13T23:58:48.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd904500700 1 --2- 172.21.15.173:0/3405670241 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55ceea047400 0x55cee9f8e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:48.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd904500700 1 --2- 172.21.15.173:0/3405670241 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55ceea047400 0x55cee9f8e100 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:48.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55ceea0cf200 con 0x55ceea047400 2024-09-13T23:58:48.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd905d47f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:48.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd905d47f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:48.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd905d47f40 1 --2- 172.21.15.173:0/3405670241 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55ceea047c00 0x55cee9f8e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:48.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea110000 con 0x55ceea047c00 2024-09-13T23:58:48.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.935+0000 7fd903cff700 1 --2- 172.21.15.173:0/3405670241 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55ceea047c00 0x55cee9f8e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:48.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.939+0000 7fd903cff700 1 --2- 172.21.15.173:0/3405670241 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55ceea047c00 0x55cee9f8e680 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:48.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.939+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55ceea0cf440 con 0x55ceea047c00 2024-09-13T23:58:48.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.939+0000 7fd905d47f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:58:48.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.939+0000 7fd905d47f40 20 searching for the correct realm 2024-09-13T23:58:48.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.939+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea110400 con 0x55ceea047c00 2024-09-13T23:58:48.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.939+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55ceea0cf440 con 0x55ceea047c00 2024-09-13T23:58:48.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.939+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea110000 con 0x55ceea047400 2024-09-13T23:58:48.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.939+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0cf200 con 0x55ceea047400 2024-09-13T23:58:48.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.939+0000 7fd904500700 1 --2- 172.21.15.173:0/3405670241 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55ceea110000 0x55cee9f8ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:48.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.939+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea110000 2024-09-13T23:58:48.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.939+0000 7fd904d01700 1 --2- 172.21.15.173:0/3405670241 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55ceea110000 0x55cee9f8ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:48.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.939+0000 7fd904d01700 1 --2- 172.21.15.173:0/3405670241 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55ceea110000 0x55cee9f8ec00 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:48.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.939+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea110000 2024-09-13T23:58:48.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.939+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea110000 2024-09-13T23:58:48.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.939+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 37 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea110000 2024-09-13T23:58:48.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.939+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047000 2024-09-13T23:58:48.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.943+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea047000 2024-09-13T23:58:48.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.943+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047c00 2024-09-13T23:58:48.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.943+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0cf440 con 0x55ceea047c00 2024-09-13T23:58:48.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.943+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047000 2024-09-13T23:58:48.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.943+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea047000 2024-09-13T23:58:48.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.943+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047400 2024-09-13T23:58:48.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.943+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0cf200 con 0x55ceea047400 2024-09-13T23:58:48.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.943+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047400 2024-09-13T23:58:48.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.943+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0cf200 con 0x55ceea047400 2024-09-13T23:58:48.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.943+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047000 2024-09-13T23:58:48.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.943+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea047000 2024-09-13T23:58:48.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.943+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea110000 2024-09-13T23:58:48.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.943+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea110000 2024-09-13T23:58:48.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.943+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047000 2024-09-13T23:58:48.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.947+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea047000 2024-09-13T23:58:48.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.947+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea110000 2024-09-13T23:58:48.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.947+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea110000 2024-09-13T23:58:48.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.947+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047400 2024-09-13T23:58:48.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.947+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0cf200 con 0x55ceea047400 2024-09-13T23:58:48.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.947+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047c00 2024-09-13T23:58:48.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.947+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0cf440 con 0x55ceea047c00 2024-09-13T23:58:48.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.947+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047000 2024-09-13T23:58:48.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.947+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea047000 2024-09-13T23:58:48.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.947+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047400 2024-09-13T23:58:48.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.947+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0cf200 con 0x55ceea047400 2024-09-13T23:58:48.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.947+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047c00 2024-09-13T23:58:48.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.947+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0cf440 con 0x55ceea047c00 2024-09-13T23:58:48.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.947+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047000 2024-09-13T23:58:48.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.951+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea047000 2024-09-13T23:58:48.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.951+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047000 2024-09-13T23:58:48.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.951+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea047000 2024-09-13T23:58:48.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.951+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047000 2024-09-13T23:58:48.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.951+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea047000 2024-09-13T23:58:48.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.951+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047c00 2024-09-13T23:58:48.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.951+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0cf440 con 0x55ceea047c00 2024-09-13T23:58:48.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.951+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea110000 2024-09-13T23:58:48.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.951+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea110000 2024-09-13T23:58:48.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.951+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047000 2024-09-13T23:58:48.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.951+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea047000 2024-09-13T23:58:48.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.951+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea110000 2024-09-13T23:58:48.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.951+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea110000 2024-09-13T23:58:48.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.951+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047c00 2024-09-13T23:58:48.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.951+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0cf440 con 0x55ceea047c00 2024-09-13T23:58:48.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.951+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea110000 2024-09-13T23:58:48.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.955+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea110000 2024-09-13T23:58:48.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.955+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047400 2024-09-13T23:58:48.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.955+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0cf200 con 0x55ceea047400 2024-09-13T23:58:48.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.955+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047400 2024-09-13T23:58:48.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.955+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0cf200 con 0x55ceea047400 2024-09-13T23:58:48.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.955+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047c00 2024-09-13T23:58:48.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.955+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0cf440 con 0x55ceea047c00 2024-09-13T23:58:48.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.955+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047400 2024-09-13T23:58:48.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.955+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55ceea0cf200 con 0x55ceea047400 2024-09-13T23:58:48.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.955+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea047400 2024-09-13T23:58:48.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55ceea0cf200 con 0x55ceea047400 2024-09-13T23:58:48.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd905d47f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:58:48.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd905d47f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:58:48.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd905d47f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:58:48.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd905d47f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:58:48.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd905d47f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:48.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea110800 con 0x55ceea047000 2024-09-13T23:58:48.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea047000 2024-09-13T23:58:48.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd905d47f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:48.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd905d47f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:48.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea110c00 con 0x55ceea047400 2024-09-13T23:58:48.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55ceea0cf200 con 0x55ceea047400 2024-09-13T23:58:48.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd905d47f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:48.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd905d47f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:48.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea111000 con 0x55ceea110000 2024-09-13T23:58:48.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea110000 2024-09-13T23:58:48.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd905d47f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:58:48.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd905d47f40 20 zone default found 2024-09-13T23:58:48.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd905d47f40 4 Realm: () 2024-09-13T23:58:48.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd905d47f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:58:48.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd905d47f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:58:48.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd905d47f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:58:48.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd905d47f40 20 zonegroup default 2024-09-13T23:58:48.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd905d47f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:48.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea111400 con 0x55ceea110000 2024-09-13T23:58:48.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea110000 2024-09-13T23:58:48.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd905d47f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:48.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd905d47f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:48.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea111800 con 0x55ceea047c00 2024-09-13T23:58:48.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.959+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55ceea0cf440 con 0x55ceea047c00 2024-09-13T23:58:48.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.963+0000 7fd905d47f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:48.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.963+0000 7fd905d47f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:48.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.963+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea111c00 con 0x55ceea047c00 2024-09-13T23:58:48.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.963+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55ceea0cf440 con 0x55ceea047c00 2024-09-13T23:58:48.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.963+0000 7fd905d47f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:48.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.963+0000 7fd905d47f40 20 started sync module instance, tier type = 2024-09-13T23:58:48.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.963+0000 7fd905d47f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:58:48.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.963+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea116000 con 0x55ceea047400 2024-09-13T23:58:48.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.963+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v37'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0cf200 con 0x55ceea047400 2024-09-13T23:58:48.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.967+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94347176983296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea116400 con 0x55ceea047400 2024-09-13T23:58:48.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.967+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea116800 con 0x55ceea047000 2024-09-13T23:58:48.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.967+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v37'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea047000 2024-09-13T23:58:48.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.967+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94347176984448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea116c00 con 0x55ceea047000 2024-09-13T23:58:48.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.967+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea117000 con 0x55ceea047400 2024-09-13T23:58:48.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.967+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94347176983296] v37'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0cf200 con 0x55ceea047400 2024-09-13T23:58:48.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.971+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94347176984448] v37'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea047000 2024-09-13T23:58:48.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.971+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v37'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0cf200 con 0x55ceea047400 2024-09-13T23:58:48.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.971+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94347176985600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea117400 con 0x55ceea047400 2024-09-13T23:58:48.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.971+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea117800 con 0x55ceea110000 2024-09-13T23:58:48.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.975+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v37'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea110000 2024-09-13T23:58:48.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.975+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94347176986752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea117c00 con 0x55ceea110000 2024-09-13T23:58:48.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.975+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea116800 con 0x55ceea047400 2024-09-13T23:58:48.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.975+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94347176985600] v37'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0cf200 con 0x55ceea047400 2024-09-13T23:58:48.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.975+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94347176986752] v37'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea110000 2024-09-13T23:58:48.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.975+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v37'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0cf200 con 0x55ceea047400 2024-09-13T23:58:48.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.975+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94347176987904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea116000 con 0x55ceea047400 2024-09-13T23:58:48.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.975+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea110800 con 0x55ceea047c00 2024-09-13T23:58:48.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.979+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v37'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0cf440 con 0x55ceea047c00 2024-09-13T23:58:48.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.979+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94347176989056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea111000 con 0x55ceea047c00 2024-09-13T23:58:48.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.979+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea111400 con 0x55ceea047c00 2024-09-13T23:58:48.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.979+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94347176987904] v37'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0cf200 con 0x55ceea047400 2024-09-13T23:58:48.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.979+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v37'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0cf440 con 0x55ceea047c00 2024-09-13T23:58:48.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.979+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94347176990208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea110c00 con 0x55ceea047c00 2024-09-13T23:58:48.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.979+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea047800 con 0x55ceea110000 2024-09-13T23:58:48.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.979+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94347176989056] v37'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0cf440 con 0x55ceea047c00 2024-09-13T23:58:48.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.983+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94347176990208] v37'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0cf440 con 0x55ceea047c00 2024-09-13T23:58:48.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.983+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v37'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea110000 2024-09-13T23:58:48.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.983+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94347176991360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea116400 con 0x55ceea110000 2024-09-13T23:58:48.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.983+0000 7fd905d47f40 20 add_watcher() i=0 2024-09-13T23:58:48.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.983+0000 7fd905d47f40 20 add_watcher() i=1 2024-09-13T23:58:48.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.983+0000 7fd905d47f40 20 add_watcher() i=2 2024-09-13T23:58:48.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.983+0000 7fd905d47f40 20 add_watcher() i=3 2024-09-13T23:58:48.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.983+0000 7fd905d47f40 20 add_watcher() i=4 2024-09-13T23:58:48.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.983+0000 7fd905d47f40 20 add_watcher() i=5 2024-09-13T23:58:48.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.983+0000 7fd905d47f40 20 add_watcher() i=6 2024-09-13T23:58:48.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.983+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94347176991360] v37'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea110000 2024-09-13T23:58:48.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.983+0000 7fd905d47f40 20 add_watcher() i=7 2024-09-13T23:58:48.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.983+0000 7fd905d47f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:58:48.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.983+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea117000 con 0x55ceea047000 2024-09-13T23:58:48.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.987+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea047000 2024-09-13T23:58:48.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.987+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94347178655744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea117400 con 0x55ceea047000 2024-09-13T23:58:48.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.987+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94347178655744] v37'228 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea047000 2024-09-13T23:58:48.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.987+0000 7fd8eb4ce700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:48.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.987+0000 7fd905d47f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:58:48.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.987+0000 7fd905d47f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:58:48.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.991+0000 7fd905d47f40 1 Processor -- start 2024-09-13T23:58:48.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.991+0000 7fd905d47f40 1 -- start start 2024-09-13T23:58:48.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.991+0000 7fd905d47f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ceea110400 0x55cee9f8f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:48.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.991+0000 7fd905d47f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee9d343c0 con 0x55ceea110400 2024-09-13T23:58:48.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.991+0000 7fd903cff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ceea110400 0x55cee9f8f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:48.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.991+0000 7fd903cff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ceea110400 0x55cee9f8f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50770/0 (socket says 172.21.15.173:50770) 2024-09-13T23:58:48.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.991+0000 7fd903cff700 1 -- 172.21.15.173:0/1542795576 learned_addr learned my addr 172.21.15.173:0/1542795576 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:48.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.991+0000 7fd903cff700 1 -- 172.21.15.173:0/1542795576 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cee9cb8b60 con 0x55ceea110400 2024-09-13T23:58:48.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.991+0000 7fd903cff700 1 --2- 172.21.15.173:0/1542795576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ceea110400 0x55cee9f8f180 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x55ceea1260c0 tx=0x55ceea0ee8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ed7b3f6ab771df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:48.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.991+0000 7fd8eaccd700 1 -- 172.21.15.173:0/1542795576 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ceea12e000 con 0x55ceea110400 2024-09-13T23:58:48.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.991+0000 7fd8eaccd700 1 -- 172.21.15.173:0/1542795576 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ceea04e600 con 0x55ceea110400 2024-09-13T23:58:48.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.991+0000 7fd8eaccd700 1 -- 172.21.15.173:0/1542795576 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ceea12e160 con 0x55ceea110400 2024-09-13T23:58:48.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.991+0000 7fd905d47f40 1 -- 172.21.15.173:0/1542795576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ceea110400 msgr2=0x55cee9f8f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:48.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.991+0000 7fd905d47f40 1 --2- 172.21.15.173:0/1542795576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ceea110400 0x55cee9f8f180 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x55ceea1260c0 tx=0x55ceea0ee8a0 comp rx=0 tx=0).stop 2024-09-13T23:58:48.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.991+0000 7fd905d47f40 1 -- 172.21.15.173:0/1542795576 shutdown_connections 2024-09-13T23:58:48.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.991+0000 7fd905d47f40 1 --2- 172.21.15.173:0/1542795576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ceea110400 0x55cee9f8f180 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:48.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.991+0000 7fd905d47f40 1 -- 172.21.15.173:0/1542795576 >> 172.21.15.173:0/1542795576 conn(0x55ceea116800 msgr2=0x55cee9da8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:48.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.991+0000 7fd905d47f40 1 -- 172.21.15.173:0/1542795576 shutdown_connections 2024-09-13T23:58:48.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.991+0000 7fd905d47f40 1 -- 172.21.15.173:0/1542795576 wait complete. 2024-09-13T23:58:48.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.991+0000 7fd905d47f40 1 Processor -- start 2024-09-13T23:58:48.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.991+0000 7fd905d47f40 1 -- start start 2024-09-13T23:58:48.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.995+0000 7fd905d47f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ceea110400 0x55cee9f8f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:48.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.995+0000 7fd905d47f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee9d34500 con 0x55ceea110400 2024-09-13T23:58:48.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.995+0000 7fd903cff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ceea110400 0x55cee9f8f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:48.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.995+0000 7fd903cff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ceea110400 0x55cee9f8f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50772/0 (socket says 172.21.15.173:50772) 2024-09-13T23:58:48.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.995+0000 7fd903cff700 1 -- 172.21.15.173:0/2066633046 learned_addr learned my addr 172.21.15.173:0/2066633046 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:48.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.995+0000 7fd903cff700 1 -- 172.21.15.173:0/2066633046 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cee9cb8d00 con 0x55ceea110400 2024-09-13T23:58:48.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.995+0000 7fd903cff700 1 --2- 172.21.15.173:0/2066633046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ceea110400 0x55cee9f8f180 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x55ceea1262d0 tx=0x55ceea0eea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:48.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.995+0000 7fd8e94ca700 1 -- 172.21.15.173:0/2066633046 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ceea12e2c0 con 0x55ceea110400 2024-09-13T23:58:49.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.995+0000 7fd8e94ca700 1 -- 172.21.15.173:0/2066633046 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ceea04e300 con 0x55ceea110400 2024-09-13T23:58:49.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.995+0000 7fd905d47f40 1 -- 172.21.15.173:0/2066633046 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cee9cb8340 con 0x55ceea110400 2024-09-13T23:58:49.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.995+0000 7fd8e94ca700 1 -- 172.21.15.173:0/2066633046 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ceea12e000 con 0x55ceea110400 2024-09-13T23:58:49.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.995+0000 7fd905d47f40 1 -- 172.21.15.173:0/2066633046 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cee9cb8b60 con 0x55ceea110400 2024-09-13T23:58:49.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.995+0000 7fd8e94ca700 1 -- 172.21.15.173:0/2066633046 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55cee9da1b80 con 0x55ceea110400 2024-09-13T23:58:49.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.995+0000 7fd8e94ca700 1 --2- 172.21.15.173:0/2066633046 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ceea047800 0x55ceea1ac000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.995+0000 7fd8e94ca700 1 -- 172.21.15.173:0/2066633046 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x55cee9d0d500 con 0x55ceea110400 2024-09-13T23:58:49.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.999+0000 7fd905d47f40 5 note: GC not initialized 2024-09-13T23:58:49.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.999+0000 7fd904d01700 1 --2- 172.21.15.173:0/2066633046 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ceea047800 0x55ceea1ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.999+0000 7fd904d01700 1 --2- 172.21.15.173:0/2066633046 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ceea047800 0x55ceea1ac000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55ceea0ab740 tx=0x55ceea1c0000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.999+0000 7fd8e6cc5700 20 reqs_thread_entry: start 2024-09-13T23:58:49.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.999+0000 7fd905d47f40 20 init_complete bucket index max shards: 11 2024-09-13T23:58:49.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.999+0000 7fd905d47f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:58:49.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.999+0000 7fd8e4cc1700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:59:19 2024 2024-09-13T23:58:49.004 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:58:49.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.999+0000 7fd905d47f40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:58:49.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.999+0000 7fd905d47f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.999+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea110800 con 0x55ceea047000 2024-09-13T23:58:49.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.999+0000 7fd8e449f700 20 reqs_thread_entry: start 2024-09-13T23:58:49.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.999+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv18 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea047000 2024-09-13T23:58:49.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.999+0000 7fd905d47f40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:58:49.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.999+0000 7fd905d47f40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:58:49.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.999+0000 7fd905d47f40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:58:49.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.999+0000 7fd905d47f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:58:49.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:48.999+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea116c00 con 0x55ceea047c00 2024-09-13T23:58:49.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.003+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(63 usage.10 [call] v37'32 uv32 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0cf440 con 0x55ceea047c00 2024-09-13T23:58:49.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.003+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea117800 con 0x55ceea047c00 2024-09-13T23:58:49.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.003+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(64 usage.10 [call] v37'33 uv32 ondisk = -61 ((61) No data available)) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0cf440 con 0x55ceea047c00 2024-09-13T23:58:49.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.007+0000 7fd8eb4ce700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:49.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.007+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94347178655744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea117c00 con 0x55ceea047000 2024-09-13T23:58:49.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.011+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94347178655744] v37'229 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea047000 2024-09-13T23:58:49.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.011+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94347176983296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea116400 con 0x55ceea047400 2024-09-13T23:58:49.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.011+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94347176983296] v37'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0cf200 con 0x55ceea047400 2024-09-13T23:58:49.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.011+0000 7fd905d47f40 20 remove_watcher() i=0 2024-09-13T23:58:49.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.011+0000 7fd905d47f40 2 removed watcher, disabling cache 2024-09-13T23:58:49.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.011+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94347176984448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea06e000 con 0x55ceea047000 2024-09-13T23:58:49.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.015+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94347176984448] v37'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea047000 2024-09-13T23:58:49.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.015+0000 7fd905d47f40 20 remove_watcher() i=1 2024-09-13T23:58:49.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.015+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94347176985600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea06e400 con 0x55ceea047400 2024-09-13T23:58:49.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.019+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94347176985600] v37'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0cf200 con 0x55ceea047400 2024-09-13T23:58:49.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.019+0000 7fd905d47f40 20 remove_watcher() i=2 2024-09-13T23:58:49.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.019+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94347176986752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea06e800 con 0x55ceea110000 2024-09-13T23:58:49.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.019+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94347176986752] v37'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea110000 2024-09-13T23:58:49.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.019+0000 7fd905d47f40 20 remove_watcher() i=3 2024-09-13T23:58:49.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.019+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94347176987904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea06ec00 con 0x55ceea047400 2024-09-13T23:58:49.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.023+0000 7fd904500700 1 -- 172.21.15.173:0/3405670241 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94347176987904] v37'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0cf200 con 0x55ceea047400 2024-09-13T23:58:49.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.023+0000 7fd905d47f40 20 remove_watcher() i=4 2024-09-13T23:58:49.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.023+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94347176989056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea06f000 con 0x55ceea047c00 2024-09-13T23:58:49.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.023+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94347176989056] v37'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0cf440 con 0x55ceea047c00 2024-09-13T23:58:49.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.023+0000 7fd905d47f40 20 remove_watcher() i=5 2024-09-13T23:58:49.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.023+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94347176990208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea06f400 con 0x55ceea047c00 2024-09-13T23:58:49.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.027+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94347176990208] v37'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0cf440 con 0x55ceea047c00 2024-09-13T23:58:49.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.027+0000 7fd905d47f40 20 remove_watcher() i=6 2024-09-13T23:58:49.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.027+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94347176991360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ceea06f800 con 0x55ceea110000 2024-09-13T23:58:49.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.027+0000 7fd904d01700 1 -- 172.21.15.173:0/3405670241 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94347176991360] v37'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55ceea0ceb40 con 0x55ceea110000 2024-09-13T23:58:49.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.027+0000 7fd905d47f40 20 remove_watcher() i=7 2024-09-13T23:58:49.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.027+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55ceea047400 msgr2=0x55cee9f8e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.027+0000 7fd905d47f40 1 --2- 172.21.15.173:0/3405670241 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55ceea047400 0x55cee9f8e100 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.027+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55ceea047000 msgr2=0x55cee9f8db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.027+0000 7fd905d47f40 1 --2- 172.21.15.173:0/3405670241 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55ceea047000 0x55cee9f8db80 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.027+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55ceea110000 msgr2=0x55cee9f8ec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.027+0000 7fd905d47f40 1 --2- 172.21.15.173:0/3405670241 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55ceea110000 0x55cee9f8ec00 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.027+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55ceea047c00 msgr2=0x55cee9f8e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.027+0000 7fd905d47f40 1 --2- 172.21.15.173:0/3405670241 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55ceea047c00 0x55cee9f8e680 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ceea046c00 msgr2=0x55cee9f8d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 --2- 172.21.15.173:0/3405670241 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ceea046c00 0x55cee9f8d600 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55ceeaa70030 tx=0x55ceea0ee900 comp rx=0 tx=0).stop 2024-09-13T23:58:49.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7800 msgr2=0x55cee9f8cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 --2- 172.21.15.173:0/3405670241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7800 0x55cee9f8cb00 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x55ceeab1c450 tx=0x55ceea00a5a0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 reap_dead start 2024-09-13T23:58:49.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd903cff700 1 -- 172.21.15.173:0/3405670241 reap_dead start 2024-09-13T23:58:49.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 shutdown_connections 2024-09-13T23:58:49.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 >> 172.21.15.173:0/3405670241 conn(0x55cee9ca7400 msgr2=0x55cee9da7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 shutdown_connections 2024-09-13T23:58:49.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 -- 172.21.15.173:0/3405670241 wait complete. 2024-09-13T23:58:49.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 -- 172.21.15.173:0/2066633046 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ceea047800 msgr2=0x55ceea1ac000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 --2- 172.21.15.173:0/2066633046 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ceea047800 0x55ceea1ac000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55ceea0ab740 tx=0x55ceea1c0000 comp rx=0 tx=0).stop 2024-09-13T23:58:49.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 -- 172.21.15.173:0/2066633046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ceea110400 msgr2=0x55cee9f8f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 --2- 172.21.15.173:0/2066633046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ceea110400 0x55cee9f8f180 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x55ceea1262d0 tx=0x55ceea0eea20 comp rx=0 tx=0).stop 2024-09-13T23:58:49.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 -- 172.21.15.173:0/2066633046 shutdown_connections 2024-09-13T23:58:49.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 --2- 172.21.15.173:0/2066633046 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ceea047800 0x55ceea1ac000 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 --2- 172.21.15.173:0/2066633046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ceea110400 0x55cee9f8f180 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 -- 172.21.15.173:0/2066633046 >> 172.21.15.173:0/2066633046 conn(0x55ceea116800 msgr2=0x55cee9da8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 -- 172.21.15.173:0/2066633046 shutdown_connections 2024-09-13T23:58:49.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 -- 172.21.15.173:0/2066633046 wait complete. 2024-09-13T23:58:49.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 -- 172.21.15.173:0/1539783622 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ceea046000 msgr2=0x55cee9f8d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 --2- 172.21.15.173:0/1539783622 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ceea046000 0x55cee9f8d080 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55ceeab1cf60 tx=0x55ceea00b080 comp rx=0 tx=0).stop 2024-09-13T23:58:49.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 -- 172.21.15.173:0/1539783622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7000 msgr2=0x55cee9f8c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 --2- 172.21.15.173:0/1539783622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7000 0x55cee9f8c580 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x55ceeaa71ef0 tx=0x55cee9dab920 comp rx=0 tx=0).stop 2024-09-13T23:58:49.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 -- 172.21.15.173:0/1539783622 shutdown_connections 2024-09-13T23:58:49.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 --2- 172.21.15.173:0/1539783622 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ceea046000 0x55cee9f8d080 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 --2- 172.21.15.173:0/1539783622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55cee9ca7000 0x55cee9f8c580 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 -- 172.21.15.173:0/1539783622 >> 172.21.15.173:0/1539783622 conn(0x55cee9ca6c00 msgr2=0x55cee9da7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 -- 172.21.15.173:0/1539783622 shutdown_connections 2024-09-13T23:58:49.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.031+0000 7fd905d47f40 1 -- 172.21.15.173:0/1539783622 wait complete. 2024-09-13T23:58:49.042 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-13T23:58:49.042 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-13T23:58:49.042 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-13T23:58:49.125 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:58:49.126 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:58:49.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.123+0000 7ff15b07cf40 1 Processor -- start 2024-09-13T23:58:49.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.123+0000 7ff15b07cf40 1 -- start start 2024-09-13T23:58:49.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.123+0000 7ff15b07cf40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55e3427b9400 0x55e342a9e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.123+0000 7ff15b07cf40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e34287d500 con 0x55e3427b9000 2024-09-13T23:58:49.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.123+0000 7ff15b07cf40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e342846a00 con 0x55e3427b9400 2024-09-13T23:58:49.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.123+0000 7ff159034700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55e3427b9400 0x55e342a9e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.123+0000 7ff159835700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55e3427b9000 0x55e3428b8800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:53574/0 (socket says 172.21.15.173:53574) 2024-09-13T23:58:49.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.123+0000 7ff159835700 1 -- 172.21.15.173:0/1972902237 learned_addr learned my addr 172.21.15.173:0/1972902237 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:58:49.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.123+0000 7ff159034700 1 -- 172.21.15.173:0/1972902237 >> v1:172.21.15.87:6789/0 conn(0x55e3427b9000 legacy=0x55e3428b8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.123+0000 7ff159034700 1 -- 172.21.15.173:0/1972902237 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3427cbd40 con 0x55e3427b9400 2024-09-13T23:58:49.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.123+0000 7ff159034700 1 --2- 172.21.15.173:0/1972902237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9400 0x55e342a9e580 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x55e342a99920 tx=0x55e3428bd920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5945822f5fb75266 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.123+0000 7ff158833700 1 -- 172.21.15.173:0/1972902237 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e34285d4a0 con 0x55e3427b9400 2024-09-13T23:58:49.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.123+0000 7ff158833700 1 -- 172.21.15.173:0/1972902237 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e34287d800 con 0x55e3427b9400 2024-09-13T23:58:49.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.123+0000 7ff158833700 1 -- 172.21.15.173:0/1972902237 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e34285d600 con 0x55e3427b9400 2024-09-13T23:58:49.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.127+0000 7ff15b07cf40 1 -- 172.21.15.173:0/1972902237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9400 msgr2=0x55e342a9e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.127+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/1972902237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9400 0x55e342a9e580 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x55e342a99920 tx=0x55e3428bd920 comp rx=0 tx=0).stop 2024-09-13T23:58:49.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.127+0000 7ff15b07cf40 1 -- 172.21.15.173:0/1972902237 shutdown_connections 2024-09-13T23:58:49.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.127+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/1972902237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9400 0x55e342a9e580 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.127+0000 7ff15b07cf40 1 -- 172.21.15.173:0/1972902237 >> 172.21.15.173:0/1972902237 conn(0x55e3427b8c00 msgr2=0x55e3428b8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.127+0000 7ff15b07cf40 1 -- 172.21.15.173:0/1972902237 shutdown_connections 2024-09-13T23:58:49.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.127+0000 7ff15b07cf40 1 -- 172.21.15.173:0/1972902237 wait complete. 2024-09-13T23:58:49.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.127+0000 7ff15b07cf40 1 Processor -- start 2024-09-13T23:58:49.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.127+0000 7ff15b07cf40 1 -- start start 2024-09-13T23:58:49.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.127+0000 7ff15b07cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9000 0x55e342a9e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.127+0000 7ff15b07cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e342846500 con 0x55e3427b9000 2024-09-13T23:58:49.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.127+0000 7ff159835700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9000 0x55e342a9e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.127+0000 7ff159835700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9000 0x55e342a9e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50792/0 (socket says 172.21.15.173:50792) 2024-09-13T23:58:49.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.127+0000 7ff159835700 1 -- 172.21.15.173:0/2439602118 learned_addr learned my addr 172.21.15.173:0/2439602118 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.127+0000 7ff159835700 1 -- 172.21.15.173:0/2439602118 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3427cbba0 con 0x55e3427b9000 2024-09-13T23:58:49.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.127+0000 7ff159835700 1 --2- 172.21.15.173:0/2439602118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9000 0x55e342a9e580 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x55e342915e00 tx=0x55e3428bdb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91dbb6f818262cd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.127+0000 7ff158032700 1 -- 172.21.15.173:0/2439602118 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e34285d4a0 con 0x55e3427b9000 2024-09-13T23:58:49.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.127+0000 7ff158032700 1 -- 172.21.15.173:0/2439602118 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e34287db00 con 0x55e3427b9000 2024-09-13T23:58:49.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.127+0000 7ff158032700 1 -- 172.21.15.173:0/2439602118 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e34285d600 con 0x55e3427b9000 2024-09-13T23:58:49.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.127+0000 7ff15b07cf40 1 -- 172.21.15.173:0/2439602118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9000 msgr2=0x55e342a9e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.127+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/2439602118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9000 0x55e342a9e580 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x55e342915e00 tx=0x55e3428bdb60 comp rx=0 tx=0).stop 2024-09-13T23:58:49.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.127+0000 7ff15b07cf40 1 -- 172.21.15.173:0/2439602118 shutdown_connections 2024-09-13T23:58:49.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.127+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/2439602118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9000 0x55e342a9e580 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.127+0000 7ff15b07cf40 1 -- 172.21.15.173:0/2439602118 >> 172.21.15.173:0/2439602118 conn(0x55e3427b8c00 msgr2=0x55e3428b9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.131+0000 7ff15b07cf40 1 -- 172.21.15.173:0/2439602118 shutdown_connections 2024-09-13T23:58:49.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.131+0000 7ff15b07cf40 1 -- 172.21.15.173:0/2439602118 wait complete. 2024-09-13T23:58:49.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.131+0000 7ff15b07cf40 1 Processor -- start 2024-09-13T23:58:49.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.131+0000 7ff15b07cf40 1 -- start start 2024-09-13T23:58:49.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.131+0000 7ff15b07cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9000 0x55e342a9e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.131+0000 7ff15b07cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3428463c0 con 0x55e3427b9000 2024-09-13T23:58:49.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.131+0000 7ff159835700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9000 0x55e342a9e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.131+0000 7ff159835700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9000 0x55e342a9e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50798/0 (socket says 172.21.15.173:50798) 2024-09-13T23:58:49.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.131+0000 7ff159835700 1 -- 172.21.15.173:0/235875775 learned_addr learned my addr 172.21.15.173:0/235875775 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.131+0000 7ff159835700 1 -- 172.21.15.173:0/235875775 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3427cba00 con 0x55e3427b9000 2024-09-13T23:58:49.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.131+0000 7ff159835700 1 --2- 172.21.15.173:0/235875775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9000 0x55e342a9e580 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x55e342915ef0 tx=0x55e3428bda40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.131+0000 7ff15682f700 1 -- 172.21.15.173:0/235875775 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e34285d8c0 con 0x55e3427b9000 2024-09-13T23:58:49.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.131+0000 7ff15682f700 1 -- 172.21.15.173:0/235875775 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e34287dc80 con 0x55e3427b9000 2024-09-13T23:58:49.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.131+0000 7ff15b07cf40 1 -- 172.21.15.173:0/235875775 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e3427cb860 con 0x55e3427b9000 2024-09-13T23:58:49.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.131+0000 7ff15682f700 1 -- 172.21.15.173:0/235875775 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e34285d4a0 con 0x55e3427b9000 2024-09-13T23:58:49.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.131+0000 7ff15b07cf40 1 -- 172.21.15.173:0/235875775 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3427cb6c0 con 0x55e3427b9000 2024-09-13T23:58:49.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.131+0000 7ff15b07cf40 1 Processor -- start 2024-09-13T23:58:49.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15b07cf40 1 -- start start 2024-09-13T23:58:49.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15b07cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9800 0x55e342a9eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15b07cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e342846000 con 0x55e3427b9800 2024-09-13T23:58:49.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15682f700 1 -- 172.21.15.173:0/235875775 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55e3428b2b00 con 0x55e3427b9000 2024-09-13T23:58:49.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15682f700 1 --2- 172.21.15.173:0/235875775 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e342b62000 0x55e342a9f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15682f700 1 -- 172.21.15.173:0/235875775 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x55e34281f180 con 0x55e3427b9000 2024-09-13T23:58:49.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15a036700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9800 0x55e342a9eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff159835700 1 --2- 172.21.15.173:0/235875775 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e342b62000 0x55e342a9f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15a036700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9800 0x55e342a9eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50814/0 (socket says 172.21.15.173:50814) 2024-09-13T23:58:49.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15a036700 1 -- 172.21.15.173:0/158798690 learned_addr learned my addr 172.21.15.173:0/158798690 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15a036700 1 -- 172.21.15.173:0/158798690 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3427ca000 con 0x55e3427b9800 2024-09-13T23:58:49.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff159835700 1 --2- 172.21.15.173:0/235875775 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e342b62000 0x55e342a9f080 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55e343631590 tx=0x55e342b18240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15a036700 1 --2- 172.21.15.173:0/158798690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9800 0x55e342a9eb00 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x55e343630420 tx=0x55e342b19500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac137933b4a92115 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15402a700 1 -- 172.21.15.173:0/158798690 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e34285d8c0 con 0x55e3427b9800 2024-09-13T23:58:49.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15402a700 1 -- 172.21.15.173:0/158798690 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e342b74000 con 0x55e3427b9800 2024-09-13T23:58:49.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15402a700 1 -- 172.21.15.173:0/158798690 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e34285d4a0 con 0x55e3427b9800 2024-09-13T23:58:49.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15b07cf40 1 -- 172.21.15.173:0/158798690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9800 msgr2=0x55e342a9eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/158798690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9800 0x55e342a9eb00 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x55e343630420 tx=0x55e342b19500 comp rx=0 tx=0).stop 2024-09-13T23:58:49.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15b07cf40 1 -- 172.21.15.173:0/158798690 shutdown_connections 2024-09-13T23:58:49.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/158798690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9800 0x55e342a9eb00 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15b07cf40 1 -- 172.21.15.173:0/158798690 >> 172.21.15.173:0/158798690 conn(0x55e3427b9400 msgr2=0x55e3428b9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15b07cf40 1 -- 172.21.15.173:0/158798690 shutdown_connections 2024-09-13T23:58:49.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15b07cf40 1 -- 172.21.15.173:0/158798690 wait complete. 2024-09-13T23:58:49.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15b07cf40 1 Processor -- start 2024-09-13T23:58:49.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15b07cf40 1 -- start start 2024-09-13T23:58:49.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15b07cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9800 0x55e342a9eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.135+0000 7ff15b07cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3427de640 con 0x55e3427b9800 2024-09-13T23:58:49.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.139+0000 7ff15a036700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9800 0x55e342a9eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.139+0000 7ff15a036700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9800 0x55e342a9eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50824/0 (socket says 172.21.15.173:50824) 2024-09-13T23:58:49.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.139+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 learned_addr learned my addr 172.21.15.173:0/3314796902 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.139+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3427caea0 con 0x55e3427b9800 2024-09-13T23:58:49.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.139+0000 7ff15a036700 1 --2- 172.21.15.173:0/3314796902 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9800 0x55e342a9eb00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x55e343630270 tx=0x55e342b190e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.139+0000 7ff152827700 1 -- 172.21.15.173:0/3314796902 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e34285db80 con 0x55e3427b9800 2024-09-13T23:58:49.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.139+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e3427ca820 con 0x55e3427b9800 2024-09-13T23:58:49.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.139+0000 7ff152827700 1 -- 172.21.15.173:0/3314796902 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e342b74180 con 0x55e3427b9800 2024-09-13T23:58:49.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.139+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3427ca9c0 con 0x55e3427b9800 2024-09-13T23:58:49.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.139+0000 7ff152827700 1 -- 172.21.15.173:0/3314796902 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e34285d8c0 con 0x55e3427b9800 2024-09-13T23:58:49.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.139+0000 7ff15b07cf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.139+0000 7ff152827700 1 -- 172.21.15.173:0/3314796902 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55e3428b2dc0 con 0x55e3427b9800 2024-09-13T23:58:49.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.139+0000 7ff152827700 1 --2- 172.21.15.173:0/3314796902 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e342b62c00 0x55e342a9f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.139+0000 7ff152827700 1 -- 172.21.15.173:0/3314796902 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x55e34281f340 con 0x55e3427b9800 2024-09-13T23:58:49.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.143+0000 7ff159034700 1 --2- 172.21.15.173:0/3314796902 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e342b62c00 0x55e342a9f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.143+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/3314796902 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55e342b63000 0x55e342a9fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.143+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63400 con 0x55e342b63000 2024-09-13T23:58:49.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.143+0000 7ff15a036700 1 --2- 172.21.15.173:0/3314796902 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55e342b63000 0x55e342a9fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.143+0000 7ff159034700 1 --2- 172.21.15.173:0/3314796902 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e342b62c00 0x55e342a9f600 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55e342a99920 tx=0x55e3428bd800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.143+0000 7ff15a036700 1 --2- 172.21.15.173:0/3314796902 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55e342b63000 0x55e342a9fb80 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.143+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342b63000 2024-09-13T23:58:49.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.143+0000 7ff15b07cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:49.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.143+0000 7ff15b07cf40 20 realm 2024-09-13T23:58:49.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.143+0000 7ff15b07cf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.143+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63000 2024-09-13T23:58:49.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.143+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342b63000 2024-09-13T23:58:49.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.143+0000 7ff15b07cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:49.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.143+0000 7ff15b07cf40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:58:49.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.143+0000 7ff15b07cf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.143+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63c00 con 0x55e342b63000 2024-09-13T23:58:49.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.143+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342b63000 2024-09-13T23:58:49.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.143+0000 7ff15b07cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:49.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.143+0000 7ff15b07cf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.143+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/3314796902 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55e342b63400 0x55e342aa0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.143+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63400 2024-09-13T23:58:49.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.143+0000 7ff159835700 1 --2- 172.21.15.173:0/3314796902 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55e342b63400 0x55e342aa0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.143+0000 7ff159835700 1 --2- 172.21.15.173:0/3314796902 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55e342b63400 0x55e342aa0100 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.147+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55e342bf7200 con 0x55e342b63400 2024-09-13T23:58:49.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.147+0000 7ff15b07cf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:49.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.147+0000 7ff15b07cf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.147+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/3314796902 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55e342b63c00 0x55e342aa0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.147+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342c22000 con 0x55e342b63c00 2024-09-13T23:58:49.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.147+0000 7ff159034700 1 --2- 172.21.15.173:0/3314796902 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55e342b63c00 0x55e342aa0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.147+0000 7ff159034700 1 --2- 172.21.15.173:0/3314796902 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55e342b63c00 0x55e342aa0680 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.147+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55e342bf7440 con 0x55e342b63c00 2024-09-13T23:58:49.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.147+0000 7ff15b07cf40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:58:49.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.147+0000 7ff15b07cf40 20 searching for the correct realm 2024-09-13T23:58:49.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.147+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342c22400 con 0x55e342b63c00 2024-09-13T23:58:49.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.147+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55e342bf7440 con 0x55e342b63c00 2024-09-13T23:58:49.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.147+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342c22000 con 0x55e342b63400 2024-09-13T23:58:49.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.147+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf7200 con 0x55e342b63400 2024-09-13T23:58:49.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.147+0000 7ff159835700 1 --2- 172.21.15.173:0/3314796902 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55e342c22000 0x55e342aa0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.147+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342c22000 2024-09-13T23:58:49.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.147+0000 7ff15a036700 1 --2- 172.21.15.173:0/3314796902 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55e342c22000 0x55e342aa0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.147+0000 7ff15a036700 1 --2- 172.21.15.173:0/3314796902 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55e342c22000 0x55e342aa0c00 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.151+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342c22000 2024-09-13T23:58:49.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.151+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342c22000 2024-09-13T23:58:49.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.151+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 37 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342c22000 2024-09-13T23:58:49.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.151+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63000 2024-09-13T23:58:49.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.151+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342b63000 2024-09-13T23:58:49.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.151+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63c00 2024-09-13T23:58:49.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.151+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf7440 con 0x55e342b63c00 2024-09-13T23:58:49.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.151+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63000 2024-09-13T23:58:49.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.151+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342b63000 2024-09-13T23:58:49.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.151+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63400 2024-09-13T23:58:49.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.151+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf7200 con 0x55e342b63400 2024-09-13T23:58:49.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.151+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63400 2024-09-13T23:58:49.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.155+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf7200 con 0x55e342b63400 2024-09-13T23:58:49.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.155+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63000 2024-09-13T23:58:49.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.155+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342b63000 2024-09-13T23:58:49.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.155+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342c22000 2024-09-13T23:58:49.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.155+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342c22000 2024-09-13T23:58:49.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.155+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63000 2024-09-13T23:58:49.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.155+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342b63000 2024-09-13T23:58:49.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.155+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342c22000 2024-09-13T23:58:49.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.155+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342c22000 2024-09-13T23:58:49.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.155+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63400 2024-09-13T23:58:49.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.155+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf7200 con 0x55e342b63400 2024-09-13T23:58:49.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.155+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63c00 2024-09-13T23:58:49.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.155+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf7440 con 0x55e342b63c00 2024-09-13T23:58:49.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.155+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63000 2024-09-13T23:58:49.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.159+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342b63000 2024-09-13T23:58:49.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.159+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63400 2024-09-13T23:58:49.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.159+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf7200 con 0x55e342b63400 2024-09-13T23:58:49.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.159+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63c00 2024-09-13T23:58:49.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.159+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf7440 con 0x55e342b63c00 2024-09-13T23:58:49.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.159+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63000 2024-09-13T23:58:49.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.159+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342b63000 2024-09-13T23:58:49.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.159+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63000 2024-09-13T23:58:49.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.159+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342b63000 2024-09-13T23:58:49.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.159+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63000 2024-09-13T23:58:49.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.159+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342b63000 2024-09-13T23:58:49.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.159+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63c00 2024-09-13T23:58:49.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.159+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf7440 con 0x55e342b63c00 2024-09-13T23:58:49.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.159+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342c22000 2024-09-13T23:58:49.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.163+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342c22000 2024-09-13T23:58:49.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.163+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63000 2024-09-13T23:58:49.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.163+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342b63000 2024-09-13T23:58:49.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.163+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342c22000 2024-09-13T23:58:49.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.163+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342c22000 2024-09-13T23:58:49.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.163+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63c00 2024-09-13T23:58:49.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.163+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf7440 con 0x55e342b63c00 2024-09-13T23:58:49.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.163+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342c22000 2024-09-13T23:58:49.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.163+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342c22000 2024-09-13T23:58:49.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.163+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63400 2024-09-13T23:58:49.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.163+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf7200 con 0x55e342b63400 2024-09-13T23:58:49.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.163+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63400 2024-09-13T23:58:49.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.167+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf7200 con 0x55e342b63400 2024-09-13T23:58:49.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.167+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63c00 2024-09-13T23:58:49.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.167+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf7440 con 0x55e342b63c00 2024-09-13T23:58:49.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.167+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63400 2024-09-13T23:58:49.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.167+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55e342bf7200 con 0x55e342b63400 2024-09-13T23:58:49.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.167+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342b63400 2024-09-13T23:58:49.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.167+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e342bf7200 con 0x55e342b63400 2024-09-13T23:58:49.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.167+0000 7ff15b07cf40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:58:49.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.167+0000 7ff15b07cf40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:58:49.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.167+0000 7ff15b07cf40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:58:49.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.167+0000 7ff15b07cf40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:58:49.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.167+0000 7ff15b07cf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.167+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342c22800 con 0x55e342b63000 2024-09-13T23:58:49.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.167+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342b63000 2024-09-13T23:58:49.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.167+0000 7ff15b07cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:49.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.167+0000 7ff15b07cf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.167+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342c22c00 con 0x55e342b63400 2024-09-13T23:58:49.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.167+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55e342bf7200 con 0x55e342b63400 2024-09-13T23:58:49.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.167+0000 7ff15b07cf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:49.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff15b07cf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342c23000 con 0x55e342c22000 2024-09-13T23:58:49.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342c22000 2024-09-13T23:58:49.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff15b07cf40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:58:49.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff15b07cf40 20 zone default found 2024-09-13T23:58:49.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff15b07cf40 4 Realm: () 2024-09-13T23:58:49.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff15b07cf40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:58:49.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff15b07cf40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:58:49.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff15b07cf40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:58:49.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff15b07cf40 20 zonegroup default 2024-09-13T23:58:49.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff15b07cf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342c23400 con 0x55e342c22000 2024-09-13T23:58:49.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342c22000 2024-09-13T23:58:49.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff15b07cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:49.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff15b07cf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342c23800 con 0x55e342b63c00 2024-09-13T23:58:49.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55e342bf7440 con 0x55e342b63c00 2024-09-13T23:58:49.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff15b07cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:49.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff15b07cf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342c23c00 con 0x55e342b63c00 2024-09-13T23:58:49.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55e342bf7440 con 0x55e342b63c00 2024-09-13T23:58:49.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff15b07cf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:49.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff15b07cf40 20 started sync module instance, tier type = 2024-09-13T23:58:49.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff15b07cf40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:58:49.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.171+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b00000 con 0x55e342b63400 2024-09-13T23:58:49.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.175+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v37'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e342bf7200 con 0x55e342b63400 2024-09-13T23:58:49.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.175+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94434564332288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b00400 con 0x55e342b63400 2024-09-13T23:58:49.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.175+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b00800 con 0x55e342b63000 2024-09-13T23:58:49.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.179+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v37'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342b63000 2024-09-13T23:58:49.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.179+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94434564332288] v37'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e342bf7200 con 0x55e342b63400 2024-09-13T23:58:49.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.179+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94434564333440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b00c00 con 0x55e342b63000 2024-09-13T23:58:49.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.179+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b01000 con 0x55e342b63400 2024-09-13T23:58:49.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.179+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94434564333440] v37'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342b63000 2024-09-13T23:58:49.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.179+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v37'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e342bf7200 con 0x55e342b63400 2024-09-13T23:58:49.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.179+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94434564334592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b01400 con 0x55e342b63400 2024-09-13T23:58:49.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.179+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b01800 con 0x55e342c22000 2024-09-13T23:58:49.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.183+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v37'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342c22000 2024-09-13T23:58:49.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.183+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94434564335744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b01c00 con 0x55e342c22000 2024-09-13T23:58:49.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.183+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b00800 con 0x55e342b63400 2024-09-13T23:58:49.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.183+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94434564334592] v37'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e342bf7200 con 0x55e342b63400 2024-09-13T23:58:49.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.187+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94434564335744] v37'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342c22000 2024-09-13T23:58:49.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.187+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v37'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e342bf7200 con 0x55e342b63400 2024-09-13T23:58:49.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.187+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94434564336896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b00000 con 0x55e342b63400 2024-09-13T23:58:49.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.187+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342c22800 con 0x55e342b63c00 2024-09-13T23:58:49.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.187+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v37'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e342bf7440 con 0x55e342b63c00 2024-09-13T23:58:49.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.187+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94434564338048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342c23000 con 0x55e342b63c00 2024-09-13T23:58:49.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.187+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342c23400 con 0x55e342b63c00 2024-09-13T23:58:49.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.187+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94434564336896] v37'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e342bf7200 con 0x55e342b63400 2024-09-13T23:58:49.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.191+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94434564338048] v37'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e342bf7440 con 0x55e342b63c00 2024-09-13T23:58:49.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.191+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(56 notify.6 [create] v37'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e342bf7440 con 0x55e342b63c00 2024-09-13T23:58:49.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.191+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94434564339200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342c22c00 con 0x55e342b63c00 2024-09-13T23:58:49.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.191+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b63800 con 0x55e342c22000 2024-09-13T23:58:49.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.191+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v37'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342c22000 2024-09-13T23:58:49.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.191+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94434564340352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b00400 con 0x55e342c22000 2024-09-13T23:58:49.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.191+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94434564339200] v37'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e342bf7440 con 0x55e342b63c00 2024-09-13T23:58:49.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.191+0000 7ff15b07cf40 20 add_watcher() i=0 2024-09-13T23:58:49.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.191+0000 7ff15b07cf40 20 add_watcher() i=1 2024-09-13T23:58:49.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.191+0000 7ff15b07cf40 20 add_watcher() i=2 2024-09-13T23:58:49.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.191+0000 7ff15b07cf40 20 add_watcher() i=3 2024-09-13T23:58:49.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.191+0000 7ff15b07cf40 20 add_watcher() i=4 2024-09-13T23:58:49.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.191+0000 7ff15b07cf40 20 add_watcher() i=5 2024-09-13T23:58:49.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.191+0000 7ff15b07cf40 20 add_watcher() i=6 2024-09-13T23:58:49.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.195+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94434564340352] v37'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342c22000 2024-09-13T23:58:49.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.195+0000 7ff15b07cf40 20 add_watcher() i=7 2024-09-13T23:58:49.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.195+0000 7ff15b07cf40 2 all 8 watchers are set, enabling cache 2024-09-13T23:58:49.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.195+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b01000 con 0x55e342b63000 2024-09-13T23:58:49.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.195+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342b63000 2024-09-13T23:58:49.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.195+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94434566029312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b01400 con 0x55e342b63000 2024-09-13T23:58:49.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.199+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94434566029312] v37'230 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342b63000 2024-09-13T23:58:49.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.199+0000 7ff140803700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:49.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.199+0000 7ff15b07cf40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:58:49.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.199+0000 7ff15b07cf40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:58:49.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.199+0000 7ff15b07cf40 1 Processor -- start 2024-09-13T23:58:49.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.199+0000 7ff15b07cf40 1 -- start start 2024-09-13T23:58:49.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.199+0000 7ff15b07cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e342c22400 0x55e342aa1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.199+0000 7ff15b07cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3427de780 con 0x55e342c22400 2024-09-13T23:58:49.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.199+0000 7ff159034700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e342c22400 0x55e342aa1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.199+0000 7ff159034700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e342c22400 0x55e342aa1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50828/0 (socket says 172.21.15.173:50828) 2024-09-13T23:58:49.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.199+0000 7ff159034700 1 -- 172.21.15.173:0/1841619124 learned_addr learned my addr 172.21.15.173:0/1841619124 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.199+0000 7ff159034700 1 -- 172.21.15.173:0/1841619124 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3427cab60 con 0x55e342c22400 2024-09-13T23:58:49.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.199+0000 7ff159034700 1 --2- 172.21.15.173:0/1841619124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e342c22400 0x55e342aa1180 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x55e342c3e0f0 tx=0x55e3428bd980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e0d9fd4a8c7a72 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.199+0000 7ff140002700 1 -- 172.21.15.173:0/1841619124 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e34285d760 con 0x55e342c22400 2024-09-13T23:58:49.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.199+0000 7ff140002700 1 -- 172.21.15.173:0/1841619124 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e342b74600 con 0x55e342c22400 2024-09-13T23:58:49.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.199+0000 7ff140002700 1 -- 172.21.15.173:0/1841619124 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e342c40000 con 0x55e342c22400 2024-09-13T23:58:49.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.203+0000 7ff15b07cf40 1 -- 172.21.15.173:0/1841619124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e342c22400 msgr2=0x55e342aa1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.203+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/1841619124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e342c22400 0x55e342aa1180 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x55e342c3e0f0 tx=0x55e3428bd980 comp rx=0 tx=0).stop 2024-09-13T23:58:49.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.203+0000 7ff15b07cf40 1 -- 172.21.15.173:0/1841619124 shutdown_connections 2024-09-13T23:58:49.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.203+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/1841619124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e342c22400 0x55e342aa1180 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.203+0000 7ff15b07cf40 1 -- 172.21.15.173:0/1841619124 >> 172.21.15.173:0/1841619124 conn(0x55e342b00800 msgr2=0x55e3428ba000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.203+0000 7ff15b07cf40 1 -- 172.21.15.173:0/1841619124 shutdown_connections 2024-09-13T23:58:49.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.203+0000 7ff15b07cf40 1 -- 172.21.15.173:0/1841619124 wait complete. 2024-09-13T23:58:49.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.203+0000 7ff15b07cf40 1 Processor -- start 2024-09-13T23:58:49.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.203+0000 7ff15b07cf40 1 -- start start 2024-09-13T23:58:49.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.203+0000 7ff15b07cf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e342c22400 0x55e342aa1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.203+0000 7ff15b07cf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e342846000 con 0x55e342c22400 2024-09-13T23:58:49.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.203+0000 7ff159034700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e342c22400 0x55e342aa1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.203+0000 7ff159034700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e342c22400 0x55e342aa1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50838/0 (socket says 172.21.15.173:50838) 2024-09-13T23:58:49.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.203+0000 7ff159034700 1 -- 172.21.15.173:0/736630966 learned_addr learned my addr 172.21.15.173:0/736630966 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.203+0000 7ff159034700 1 -- 172.21.15.173:0/736630966 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3427cad00 con 0x55e342c22400 2024-09-13T23:58:49.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.203+0000 7ff159034700 1 --2- 172.21.15.173:0/736630966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e342c22400 0x55e342aa1180 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x55e342c3e300 tx=0x55e342bdcc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.203+0000 7ff13e7ff700 1 -- 172.21.15.173:0/736630966 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e342c40160 con 0x55e342c22400 2024-09-13T23:58:49.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.203+0000 7ff13e7ff700 1 -- 172.21.15.173:0/736630966 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e342b74300 con 0x55e342c22400 2024-09-13T23:58:49.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.203+0000 7ff13e7ff700 1 -- 172.21.15.173:0/736630966 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55e342c402c0 con 0x55e342c22400 2024-09-13T23:58:49.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.203+0000 7ff15b07cf40 1 -- 172.21.15.173:0/736630966 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e3427ca340 con 0x55e342c22400 2024-09-13T23:58:49.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.203+0000 7ff15b07cf40 1 -- 172.21.15.173:0/736630966 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3427cbd40 con 0x55e342c22400 2024-09-13T23:58:49.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.207+0000 7ff13e7ff700 1 -- 172.21.15.173:0/736630966 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55e3428b3b80 con 0x55e342c22400 2024-09-13T23:58:49.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.207+0000 7ff13e7ff700 1 --2- 172.21.15.173:0/736630966 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e342b63800 0x55e342cbc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.207+0000 7ff13e7ff700 1 -- 172.21.15.173:0/736630966 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x55e34281f500 con 0x55e342c22400 2024-09-13T23:58:49.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.207+0000 7ff15b07cf40 5 note: GC not initialized 2024-09-13T23:58:49.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.207+0000 7ff15a036700 1 --2- 172.21.15.173:0/736630966 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e342b63800 0x55e342cbc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.207+0000 7ff15a036700 1 --2- 172.21.15.173:0/736630966 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e342b63800 0x55e342cbc000 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55e342bcb770 tx=0x55e342cce000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.207+0000 7ff15b07cf40 20 init_complete bucket index max shards: 11 2024-09-13T23:58:49.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.207+0000 7ff13bffa700 20 reqs_thread_entry: start 2024-09-13T23:58:49.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.207+0000 7ff15b07cf40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:58:49.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.207+0000 7ff139ff6700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:59:19 2024 2024-09-13T23:58:49.213 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:58:49.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.207+0000 7ff1397d4700 20 reqs_thread_entry: start 2024-09-13T23:58:49.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.207+0000 7ff15b07cf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.207+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342c22800 con 0x55e342b63000 2024-09-13T23:58:49.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.211+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv18 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342b63000 2024-09-13T23:58:49.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.211+0000 7ff15b07cf40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:58:49.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.211+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b00c00 con 0x55e342b63c00 2024-09-13T23:58:49.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.211+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 152+0+15 (crc 0 0 0) 0x55e342bf7440 con 0x55e342b63c00 2024-09-13T23:58:49.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.211+0000 7ff140803700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:49.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.211+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94434566029312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b01800 con 0x55e342b63000 2024-09-13T23:58:49.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.215+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94434566029312] v37'231 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342b63000 2024-09-13T23:58:49.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.215+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94434564332288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b01c00 con 0x55e342b63400 2024-09-13T23:58:49.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.219+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94434564332288] v37'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e342bf7200 con 0x55e342b63400 2024-09-13T23:58:49.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.219+0000 7ff15b07cf40 20 remove_watcher() i=0 2024-09-13T23:58:49.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.219+0000 7ff15b07cf40 2 removed watcher, disabling cache 2024-09-13T23:58:49.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.219+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94434564333440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b00400 con 0x55e342b63000 2024-09-13T23:58:49.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.219+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94434564333440] v37'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342b63000 2024-09-13T23:58:49.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.219+0000 7ff15b07cf40 20 remove_watcher() i=1 2024-09-13T23:58:49.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.219+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94434564334592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b8c000 con 0x55e342b63400 2024-09-13T23:58:49.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.223+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94434564334592] v37'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e342bf7200 con 0x55e342b63400 2024-09-13T23:58:49.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.223+0000 7ff15b07cf40 20 remove_watcher() i=2 2024-09-13T23:58:49.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.223+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94434564335744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b8c400 con 0x55e342c22000 2024-09-13T23:58:49.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.227+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94434564335744] v37'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342c22000 2024-09-13T23:58:49.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.227+0000 7ff15b07cf40 20 remove_watcher() i=3 2024-09-13T23:58:49.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.227+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94434564336896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b8c800 con 0x55e342b63400 2024-09-13T23:58:49.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.227+0000 7ff159835700 1 -- 172.21.15.173:0/3314796902 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94434564336896] v37'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e342bf7200 con 0x55e342b63400 2024-09-13T23:58:49.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.227+0000 7ff15b07cf40 20 remove_watcher() i=4 2024-09-13T23:58:49.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.227+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94434564338048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b8cc00 con 0x55e342b63c00 2024-09-13T23:58:49.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.231+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94434564338048] v37'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e342bf7440 con 0x55e342b63c00 2024-09-13T23:58:49.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.231+0000 7ff15b07cf40 20 remove_watcher() i=5 2024-09-13T23:58:49.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.231+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94434564339200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b8d000 con 0x55e342b63c00 2024-09-13T23:58:49.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.235+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94434564339200] v37'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e342bf7440 con 0x55e342b63c00 2024-09-13T23:58:49.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.235+0000 7ff15b07cf40 20 remove_watcher() i=6 2024-09-13T23:58:49.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.235+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94434564340352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55e342b8d400 con 0x55e342c22000 2024-09-13T23:58:49.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.235+0000 7ff15a036700 1 -- 172.21.15.173:0/3314796902 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94434564340352] v37'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55e342bf6b40 con 0x55e342c22000 2024-09-13T23:58:49.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.235+0000 7ff15b07cf40 20 remove_watcher() i=7 2024-09-13T23:58:49.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.235+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55e342b63400 msgr2=0x55e342aa0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.235+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/3314796902 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55e342b63400 0x55e342aa0100 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.235+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55e342b63000 msgr2=0x55e342a9fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.235+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/3314796902 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55e342b63000 0x55e342a9fb80 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.235+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55e342c22000 msgr2=0x55e342aa0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.235+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/3314796902 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55e342c22000 0x55e342aa0c00 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.235+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55e342b63c00 msgr2=0x55e342aa0680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.235+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/3314796902 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55e342b63c00 0x55e342aa0680 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.235+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e342b62c00 msgr2=0x55e342a9f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.235+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/3314796902 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e342b62c00 0x55e342a9f600 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55e342a99920 tx=0x55e3428bd800 comp rx=0 tx=0).stop 2024-09-13T23:58:49.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.235+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9800 msgr2=0x55e342a9eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.235+0000 7ff159034700 1 -- 172.21.15.173:0/3314796902 reap_dead start 2024-09-13T23:58:49.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.235+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/3314796902 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9800 0x55e342a9eb00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x55e343630270 tx=0x55e342b190e0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.235+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 shutdown_connections 2024-09-13T23:58:49.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.235+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/3314796902 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9800 0x55e342a9eb00 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.235+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 >> 172.21.15.173:0/3314796902 conn(0x55e3427b9400 msgr2=0x55e3428b9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.235+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 shutdown_connections 2024-09-13T23:58:49.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.235+0000 7ff15b07cf40 1 -- 172.21.15.173:0/3314796902 wait complete. 2024-09-13T23:58:49.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.239+0000 7ff15b07cf40 1 -- 172.21.15.173:0/736630966 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e342b63800 msgr2=0x55e342cbc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.239+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/736630966 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e342b63800 0x55e342cbc000 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55e342bcb770 tx=0x55e342cce000 comp rx=0 tx=0).stop 2024-09-13T23:58:49.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.239+0000 7ff15b07cf40 1 -- 172.21.15.173:0/736630966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e342c22400 msgr2=0x55e342aa1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.239+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/736630966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e342c22400 0x55e342aa1180 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x55e342c3e300 tx=0x55e342bdcc00 comp rx=0 tx=0).stop 2024-09-13T23:58:49.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.239+0000 7ff15b07cf40 1 -- 172.21.15.173:0/736630966 shutdown_connections 2024-09-13T23:58:49.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.239+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/736630966 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e342b63800 0x55e342cbc000 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.239+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/736630966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e342c22400 0x55e342aa1180 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.239+0000 7ff15b07cf40 1 -- 172.21.15.173:0/736630966 >> 172.21.15.173:0/736630966 conn(0x55e342b00800 msgr2=0x55e3428ba000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.239+0000 7ff15b07cf40 1 -- 172.21.15.173:0/736630966 shutdown_connections 2024-09-13T23:58:49.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.239+0000 7ff15b07cf40 1 -- 172.21.15.173:0/736630966 wait complete. 2024-09-13T23:58:49.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.239+0000 7ff15b07cf40 1 -- 172.21.15.173:0/235875775 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e342b62000 msgr2=0x55e342a9f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.239+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/235875775 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e342b62000 0x55e342a9f080 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55e343631590 tx=0x55e342b18240 comp rx=0 tx=0).stop 2024-09-13T23:58:49.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.239+0000 7ff15b07cf40 1 -- 172.21.15.173:0/235875775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9000 msgr2=0x55e342a9e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.239+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/235875775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9000 0x55e342a9e580 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x55e342915ef0 tx=0x55e3428bda40 comp rx=0 tx=0).stop 2024-09-13T23:58:49.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.239+0000 7ff15b07cf40 1 -- 172.21.15.173:0/235875775 shutdown_connections 2024-09-13T23:58:49.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.239+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/235875775 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55e342b62000 0x55e342a9f080 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.239+0000 7ff15b07cf40 1 --2- 172.21.15.173:0/235875775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e3427b9000 0x55e342a9e580 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.239+0000 7ff15b07cf40 1 -- 172.21.15.173:0/235875775 >> 172.21.15.173:0/235875775 conn(0x55e3427b8c00 msgr2=0x55e3428b9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.239+0000 7ff15b07cf40 1 -- 172.21.15.173:0/235875775 shutdown_connections 2024-09-13T23:58:49.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.239+0000 7ff15b07cf40 1 -- 172.21.15.173:0/235875775 wait complete. 2024-09-13T23:58:49.246 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:58:49.246 INFO:teuthology.orchestra.run.smithi173.stdout: "entries": [], 2024-09-13T23:58:49.246 INFO:teuthology.orchestra.run.smithi173.stdout: "summary": [] 2024-09-13T23:58:49.246 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:58:49.248 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-13T23:58:49.248 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-13T23:58:49.248 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-13T23:58:49.248 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-13T23:58:49.290 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:58:49.290 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:58:49.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.287+0000 7ff820106f40 1 Processor -- start 2024-09-13T23:58:49.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.287+0000 7ff820106f40 1 -- start start 2024-09-13T23:58:49.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.287+0000 7ff820106f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55eeb4bad000 0x55eeb4e92580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.287+0000 7ff820106f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55eeb4c71500 con 0x55eeb4bad400 2024-09-13T23:58:49.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.287+0000 7ff820106f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55eeb4c3aa00 con 0x55eeb4bad000 2024-09-13T23:58:49.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.287+0000 7ff81e8bf700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55eeb4bad000 0x55eeb4e92580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.287+0000 7ff81e0be700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55eeb4bad400 0x55eeb4cac800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:53578/0 (socket says 172.21.15.173:53578) 2024-09-13T23:58:49.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.287+0000 7ff81e8bf700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55eeb4bad000 0x55eeb4e92580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50850/0 (socket says 172.21.15.173:50850) 2024-09-13T23:58:49.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.287+0000 7ff81e0be700 1 -- 172.21.15.173:0/2693080752 learned_addr learned my addr 172.21.15.173:0/2693080752 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:58:49.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.287+0000 7ff81e8bf700 1 -- 172.21.15.173:0/2693080752 >> v1:172.21.15.87:6789/0 conn(0x55eeb4bad400 legacy=0x55eeb4cac800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.287+0000 7ff81e8bf700 1 -- 172.21.15.173:0/2693080752 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eeb4bbfd40 con 0x55eeb4bad000 2024-09-13T23:58:49.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.287+0000 7ff81e8bf700 1 --2- 172.21.15.173:0/2693080752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad000 0x55eeb4e92580 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x55eeb4e8da70 tx=0x55eeb4cb1920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4ba91eef6c8f52 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.287+0000 7ff81d8bd700 1 -- 172.21.15.173:0/2693080752 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55eeb4c514a0 con 0x55eeb4bad000 2024-09-13T23:58:49.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.287+0000 7ff81d8bd700 1 -- 172.21.15.173:0/2693080752 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55eeb4c71800 con 0x55eeb4bad000 2024-09-13T23:58:49.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.287+0000 7ff81d8bd700 1 -- 172.21.15.173:0/2693080752 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55eeb4c51600 con 0x55eeb4bad000 2024-09-13T23:58:49.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.291+0000 7ff820106f40 1 -- 172.21.15.173:0/2693080752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad000 msgr2=0x55eeb4e92580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.291+0000 7ff820106f40 1 --2- 172.21.15.173:0/2693080752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad000 0x55eeb4e92580 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x55eeb4e8da70 tx=0x55eeb4cb1920 comp rx=0 tx=0).stop 2024-09-13T23:58:49.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.291+0000 7ff820106f40 1 -- 172.21.15.173:0/2693080752 shutdown_connections 2024-09-13T23:58:49.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.291+0000 7ff820106f40 1 --2- 172.21.15.173:0/2693080752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad000 0x55eeb4e92580 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.291+0000 7ff820106f40 1 -- 172.21.15.173:0/2693080752 >> 172.21.15.173:0/2693080752 conn(0x55eeb4bacc00 msgr2=0x55eeb4cac000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.291+0000 7ff820106f40 1 -- 172.21.15.173:0/2693080752 shutdown_connections 2024-09-13T23:58:49.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.291+0000 7ff820106f40 1 -- 172.21.15.173:0/2693080752 wait complete. 2024-09-13T23:58:49.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.291+0000 7ff820106f40 1 Processor -- start 2024-09-13T23:58:49.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.291+0000 7ff820106f40 1 -- start start 2024-09-13T23:58:49.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.291+0000 7ff820106f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad000 0x55eeb4e92580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.291+0000 7ff820106f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeb4c3a500 con 0x55eeb4bad000 2024-09-13T23:58:49.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.291+0000 7ff81e8bf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad000 0x55eeb4e92580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.291+0000 7ff81e8bf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad000 0x55eeb4e92580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50854/0 (socket says 172.21.15.173:50854) 2024-09-13T23:58:49.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.291+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1096263798 learned_addr learned my addr 172.21.15.173:0/1096263798 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.291+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1096263798 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eeb4bbfba0 con 0x55eeb4bad000 2024-09-13T23:58:49.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.291+0000 7ff81e8bf700 1 --2- 172.21.15.173:0/1096263798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad000 0x55eeb4e92580 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x55eeb4d09d40 tx=0x55eeb4cb1800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568a1701adb4193 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.291+0000 7ff81d0bc700 1 -- 172.21.15.173:0/1096263798 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55eeb4c51760 con 0x55eeb4bad000 2024-09-13T23:58:49.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.291+0000 7ff81d0bc700 1 -- 172.21.15.173:0/1096263798 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55eeb4c71b00 con 0x55eeb4bad000 2024-09-13T23:58:49.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.291+0000 7ff81d0bc700 1 -- 172.21.15.173:0/1096263798 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55eeb4c511e0 con 0x55eeb4bad000 2024-09-13T23:58:49.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.295+0000 7ff820106f40 1 -- 172.21.15.173:0/1096263798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad000 msgr2=0x55eeb4e92580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.295+0000 7ff820106f40 1 --2- 172.21.15.173:0/1096263798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad000 0x55eeb4e92580 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x55eeb4d09d40 tx=0x55eeb4cb1800 comp rx=0 tx=0).stop 2024-09-13T23:58:49.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.295+0000 7ff820106f40 1 -- 172.21.15.173:0/1096263798 shutdown_connections 2024-09-13T23:58:49.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.295+0000 7ff820106f40 1 --2- 172.21.15.173:0/1096263798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad000 0x55eeb4e92580 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.295+0000 7ff820106f40 1 -- 172.21.15.173:0/1096263798 >> 172.21.15.173:0/1096263798 conn(0x55eeb4bacc00 msgr2=0x55eeb4cad000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.295+0000 7ff820106f40 1 -- 172.21.15.173:0/1096263798 shutdown_connections 2024-09-13T23:58:49.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.295+0000 7ff820106f40 1 -- 172.21.15.173:0/1096263798 wait complete. 2024-09-13T23:58:49.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.295+0000 7ff820106f40 1 Processor -- start 2024-09-13T23:58:49.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.295+0000 7ff820106f40 1 -- start start 2024-09-13T23:58:49.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.295+0000 7ff820106f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad000 0x55eeb4e92580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.295+0000 7ff820106f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeb4c3a3c0 con 0x55eeb4bad000 2024-09-13T23:58:49.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.295+0000 7ff81e8bf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad000 0x55eeb4e92580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.295+0000 7ff81e8bf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad000 0x55eeb4e92580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50868/0 (socket says 172.21.15.173:50868) 2024-09-13T23:58:49.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.295+0000 7ff81e8bf700 1 -- 172.21.15.173:0/2526082406 learned_addr learned my addr 172.21.15.173:0/2526082406 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.295+0000 7ff81e8bf700 1 -- 172.21.15.173:0/2526082406 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eeb4bbfa00 con 0x55eeb4bad000 2024-09-13T23:58:49.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.295+0000 7ff81e8bf700 1 --2- 172.21.15.173:0/2526082406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad000 0x55eeb4e92580 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x55eeb4d096b0 tx=0x55eeb4cb1920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.295+0000 7ff81b8b9700 1 -- 172.21.15.173:0/2526082406 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55eeb4c514a0 con 0x55eeb4bad000 2024-09-13T23:58:49.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.295+0000 7ff81b8b9700 1 -- 172.21.15.173:0/2526082406 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55eeb4c71c80 con 0x55eeb4bad000 2024-09-13T23:58:49.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.295+0000 7ff820106f40 1 -- 172.21.15.173:0/2526082406 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55eeb4bbf860 con 0x55eeb4bad000 2024-09-13T23:58:49.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.295+0000 7ff81b8b9700 1 -- 172.21.15.173:0/2526082406 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55eeb4c51600 con 0x55eeb4bad000 2024-09-13T23:58:49.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.295+0000 7ff820106f40 1 -- 172.21.15.173:0/2526082406 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eeb4bbf6c0 con 0x55eeb4bad000 2024-09-13T23:58:49.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.299+0000 7ff81b8b9700 1 -- 172.21.15.173:0/2526082406 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55eeb4ca6b00 con 0x55eeb4bad000 2024-09-13T23:58:49.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.299+0000 7ff820106f40 1 Processor -- start 2024-09-13T23:58:49.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.299+0000 7ff820106f40 1 -- start start 2024-09-13T23:58:49.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.299+0000 7ff81b8b9700 1 --2- 172.21.15.173:0/2526082406 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55eeb4f54000 0x55eeb4e93080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.299+0000 7ff820106f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad800 0x55eeb4e92b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.299+0000 7ff820106f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeb4bd2640 con 0x55eeb4bad800 2024-09-13T23:58:49.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.299+0000 7ff81b8b9700 1 -- 172.21.15.173:0/2526082406 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x55eeb4c13180 con 0x55eeb4bad000 2024-09-13T23:58:49.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.299+0000 7ff81f0c0700 1 --2- 172.21.15.173:0/2526082406 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55eeb4f54000 0x55eeb4e93080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.299+0000 7ff81e8bf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad800 0x55eeb4e92b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.299+0000 7ff81e8bf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad800 0x55eeb4e92b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50878/0 (socket says 172.21.15.173:50878) 2024-09-13T23:58:49.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.299+0000 7ff81e8bf700 1 -- 172.21.15.173:0/3695350164 learned_addr learned my addr 172.21.15.173:0/3695350164 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.299+0000 7ff81f0c0700 1 --2- 172.21.15.173:0/2526082406 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55eeb4f54000 0x55eeb4e93080 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55eeb4d09e90 tx=0x55eeb4f1af60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.299+0000 7ff81e8bf700 1 -- 172.21.15.173:0/3695350164 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eeb4bbe000 con 0x55eeb4bad800 2024-09-13T23:58:49.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.299+0000 7ff81e8bf700 1 --2- 172.21.15.173:0/3695350164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad800 0x55eeb4e92b00 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x55eeb4edaf60 tx=0x55eeb4f1b080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7bfb09cd4d1e2c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.299+0000 7ff8190b4700 1 -- 172.21.15.173:0/3695350164 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55eeb4c514a0 con 0x55eeb4bad800 2024-09-13T23:58:49.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.299+0000 7ff8190b4700 1 -- 172.21.15.173:0/3695350164 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55eeb4c71c80 con 0x55eeb4bad800 2024-09-13T23:58:49.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.299+0000 7ff8190b4700 1 -- 172.21.15.173:0/3695350164 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55eeb4c51600 con 0x55eeb4bad800 2024-09-13T23:58:49.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.303+0000 7ff820106f40 1 -- 172.21.15.173:0/3695350164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad800 msgr2=0x55eeb4e92b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.303+0000 7ff820106f40 1 --2- 172.21.15.173:0/3695350164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad800 0x55eeb4e92b00 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x55eeb4edaf60 tx=0x55eeb4f1b080 comp rx=0 tx=0).stop 2024-09-13T23:58:49.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.303+0000 7ff820106f40 1 -- 172.21.15.173:0/3695350164 shutdown_connections 2024-09-13T23:58:49.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.303+0000 7ff820106f40 1 --2- 172.21.15.173:0/3695350164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad800 0x55eeb4e92b00 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.303+0000 7ff820106f40 1 -- 172.21.15.173:0/3695350164 >> 172.21.15.173:0/3695350164 conn(0x55eeb4bad400 msgr2=0x55eeb4cad800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.303+0000 7ff820106f40 1 -- 172.21.15.173:0/3695350164 shutdown_connections 2024-09-13T23:58:49.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.303+0000 7ff820106f40 1 -- 172.21.15.173:0/3695350164 wait complete. 2024-09-13T23:58:49.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.303+0000 7ff820106f40 1 Processor -- start 2024-09-13T23:58:49.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.303+0000 7ff820106f40 1 -- start start 2024-09-13T23:58:49.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.303+0000 7ff820106f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad800 0x55eeb4e92b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.303+0000 7ff820106f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeb4bd28c0 con 0x55eeb4bad800 2024-09-13T23:58:49.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.303+0000 7ff81e8bf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad800 0x55eeb4e92b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.303+0000 7ff81e8bf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad800 0x55eeb4e92b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50880/0 (socket says 172.21.15.173:50880) 2024-09-13T23:58:49.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.303+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 learned_addr learned my addr 172.21.15.173:0/1173781832 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.303+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eeb4bbeea0 con 0x55eeb4bad800 2024-09-13T23:58:49.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.303+0000 7ff81e8bf700 1 --2- 172.21.15.173:0/1173781832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad800 0x55eeb4e92b00 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x55eeb4eda180 tx=0x55eeb4f1b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.303+0000 7ff8178b1700 1 -- 172.21.15.173:0/1173781832 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55eeb4c51760 con 0x55eeb4bad800 2024-09-13T23:58:49.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.303+0000 7ff8178b1700 1 -- 172.21.15.173:0/1173781832 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55eeb4f7c000 con 0x55eeb4bad800 2024-09-13T23:58:49.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.303+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55eeb4bbe820 con 0x55eeb4bad800 2024-09-13T23:58:49.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.303+0000 7ff8178b1700 1 -- 172.21.15.173:0/1173781832 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55eeb4c511e0 con 0x55eeb4bad800 2024-09-13T23:58:49.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.303+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eeb4bbe9c0 con 0x55eeb4bad800 2024-09-13T23:58:49.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.307+0000 7ff8178b1700 1 -- 172.21.15.173:0/1173781832 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55eeb4ca6dc0 con 0x55eeb4bad800 2024-09-13T23:58:49.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.307+0000 7ff820106f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.307+0000 7ff8178b1700 1 --2- 172.21.15.173:0/1173781832 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55eeb4f55000 0x55eeb4e93600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.307+0000 7ff8178b1700 1 -- 172.21.15.173:0/1173781832 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x55eeb4c13340 con 0x55eeb4bad800 2024-09-13T23:58:49.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.307+0000 7ff81e0be700 1 --2- 172.21.15.173:0/1173781832 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55eeb4f55000 0x55eeb4e93600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.307+0000 7ff820106f40 1 --2- 172.21.15.173:0/1173781832 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55eeb4f55400 0x55eeb4e93b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.307+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4f55800 con 0x55eeb4f55400 2024-09-13T23:58:49.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.307+0000 7ff81f0c0700 1 --2- 172.21.15.173:0/1173781832 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55eeb4f55400 0x55eeb4e93b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.307+0000 7ff81e0be700 1 --2- 172.21.15.173:0/1173781832 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55eeb4f55000 0x55eeb4e93600 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55eeb4f57e90 tx=0x55eeb4fce540 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.307+0000 7ff81f0c0700 1 --2- 172.21.15.173:0/1173781832 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55eeb4f55400 0x55eeb4e93b80 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.307+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.307+0000 7ff820106f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:49.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.307+0000 7ff820106f40 20 realm 2024-09-13T23:58:49.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.307+0000 7ff820106f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.307+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4f55c00 con 0x55eeb4f55400 2024-09-13T23:58:49.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.307+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.307+0000 7ff820106f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:49.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.307+0000 7ff820106f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:58:49.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.307+0000 7ff820106f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.307+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4f55800 con 0x55eeb4f55400 2024-09-13T23:58:49.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.311+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.311+0000 7ff820106f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:49.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.311+0000 7ff820106f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.311+0000 7ff820106f40 1 --2- 172.21.15.173:0/1173781832 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55eeb4f55c00 0x55eeb4e94100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.311+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4f55c00 2024-09-13T23:58:49.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.311+0000 7ff81e8bf700 1 --2- 172.21.15.173:0/1173781832 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55eeb4f55c00 0x55eeb4e94100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.311+0000 7ff81e8bf700 1 --2- 172.21.15.173:0/1173781832 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55eeb4f55c00 0x55eeb4e94100 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.311+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.311+0000 7ff820106f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:49.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.311+0000 7ff820106f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.311+0000 7ff820106f40 1 --2- 172.21.15.173:0/1173781832 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55eeb4ff6400 0x55eeb4e94680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.311+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6800 con 0x55eeb4ff6400 2024-09-13T23:58:49.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.311+0000 7ff81e0be700 1 --2- 172.21.15.173:0/1173781832 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55eeb4ff6400 0x55eeb4e94680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.311+0000 7ff81e0be700 1 --2- 172.21.15.173:0/1173781832 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55eeb4ff6400 0x55eeb4e94680 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.311+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.311+0000 7ff820106f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:58:49.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.311+0000 7ff820106f40 20 searching for the correct realm 2024-09-13T23:58:49.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.311+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6c00 con 0x55eeb4ff6400 2024-09-13T23:58:49.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.311+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.311+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6800 con 0x55eeb4f55c00 2024-09-13T23:58:49.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.315+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.315+0000 7ff81e8bf700 1 --2- 172.21.15.173:0/1173781832 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55eeb4ff6800 0x55eeb4e94c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.315+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4ff6800 2024-09-13T23:58:49.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.315+0000 7ff81f0c0700 1 --2- 172.21.15.173:0/1173781832 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55eeb4ff6800 0x55eeb4e94c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.315+0000 7ff81f0c0700 1 --2- 172.21.15.173:0/1173781832 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55eeb4ff6800 0x55eeb4e94c00 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.315+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.315+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4ff6800 2024-09-13T23:58:49.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.315+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 37 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.315+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4f55400 2024-09-13T23:58:49.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.315+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.315+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4ff6400 2024-09-13T23:58:49.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.315+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.315+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4f55400 2024-09-13T23:58:49.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.315+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.315+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4f55c00 2024-09-13T23:58:49.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.319+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.319+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4f55c00 2024-09-13T23:58:49.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.319+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.319+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4f55400 2024-09-13T23:58:49.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.319+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.319+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4ff6800 2024-09-13T23:58:49.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.319+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.319+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4f55400 2024-09-13T23:58:49.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.319+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.319+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4ff6800 2024-09-13T23:58:49.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.319+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.319+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4f55c00 2024-09-13T23:58:49.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.323+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.323+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4ff6400 2024-09-13T23:58:49.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.323+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.323+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4f55400 2024-09-13T23:58:49.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.323+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.323+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4f55c00 2024-09-13T23:58:49.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.323+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.323+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4ff6400 2024-09-13T23:58:49.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.323+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.323+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4f55400 2024-09-13T23:58:49.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.323+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.323+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4f55400 2024-09-13T23:58:49.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.327+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.327+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4f55400 2024-09-13T23:58:49.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.327+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.327+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4ff6400 2024-09-13T23:58:49.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.327+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.327+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4ff6800 2024-09-13T23:58:49.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.327+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.327+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4f55400 2024-09-13T23:58:49.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.327+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.327+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4ff6800 2024-09-13T23:58:49.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.327+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.327+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4ff6400 2024-09-13T23:58:49.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.327+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.327+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4ff6800 2024-09-13T23:58:49.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.327+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.327+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4f55c00 2024-09-13T23:58:49.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.331+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.331+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4f55c00 2024-09-13T23:58:49.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.331+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.331+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4ff6400 2024-09-13T23:58:49.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.331+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.331+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4f55c00 2024-09-13T23:58:49.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.331+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.331+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4f55c00 2024-09-13T23:58:49.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.331+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.331+0000 7ff820106f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:58:49.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.331+0000 7ff820106f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:58:49.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.331+0000 7ff820106f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:58:49.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.331+0000 7ff820106f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:58:49.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.331+0000 7ff820106f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.331+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff7000 con 0x55eeb4f55400 2024-09-13T23:58:49.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:49.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff7400 con 0x55eeb4f55c00 2024-09-13T23:58:49.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:49.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff7800 con 0x55eeb4ff6800 2024-09-13T23:58:49.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:58:49.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 20 zone default found 2024-09-13T23:58:49.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 4 Realm: () 2024-09-13T23:58:49.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:58:49.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:58:49.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:58:49.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 20 zonegroup default 2024-09-13T23:58:49.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff7c00 con 0x55eeb4ff6800 2024-09-13T23:58:49.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:49.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff7000 con 0x55eeb4ff6400 2024-09-13T23:58:49.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:49.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff7800 con 0x55eeb4ff6400 2024-09-13T23:58:49.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:49.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 20 started sync module instance, tier type = 2024-09-13T23:58:49.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:58:49.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.335+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4f55800 con 0x55eeb4f55c00 2024-09-13T23:58:49.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.339+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v37'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.339+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94483725720320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4f54800 con 0x55eeb4f55c00 2024-09-13T23:58:49.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.339+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4f55800 con 0x55eeb4f55400 2024-09-13T23:58:49.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.343+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v37'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.343+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94483725721472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4f55400 2024-09-13T23:58:49.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.343+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94483725720320] v37'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.343+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff7400 con 0x55eeb4f55c00 2024-09-13T23:58:49.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.347+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94483725721472] v37'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.347+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v37'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.347+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94483725722624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffa000 con 0x55eeb4f55c00 2024-09-13T23:58:49.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.347+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffa400 con 0x55eeb4ff6800 2024-09-13T23:58:49.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.347+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v37'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.347+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94483725723776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffa800 con 0x55eeb4ff6800 2024-09-13T23:58:49.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.347+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffac00 con 0x55eeb4f55c00 2024-09-13T23:58:49.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.347+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94483725722624] v37'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.351+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94483725723776] v37'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.351+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v37'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.351+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94483725724928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffb000 con 0x55eeb4f55c00 2024-09-13T23:58:49.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.351+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffb400 con 0x55eeb4ff6400 2024-09-13T23:58:49.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.355+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v37'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.355+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94483725726080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffb800 con 0x55eeb4ff6400 2024-09-13T23:58:49.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.355+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffbc00 con 0x55eeb4ff6400 2024-09-13T23:58:49.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.355+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94483725724928] v37'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.355+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v37'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.355+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94483725727232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffb400 con 0x55eeb4ff6400 2024-09-13T23:58:49.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.355+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffa000 con 0x55eeb4ff6800 2024-09-13T23:58:49.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.355+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94483725726080] v37'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.359+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v37'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.359+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94483725728384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffac00 con 0x55eeb4ff6800 2024-09-13T23:58:49.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.359+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94483725727232] v37'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.359+0000 7ff820106f40 20 add_watcher() i=0 2024-09-13T23:58:49.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.359+0000 7ff820106f40 20 add_watcher() i=1 2024-09-13T23:58:49.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.359+0000 7ff820106f40 20 add_watcher() i=2 2024-09-13T23:58:49.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.359+0000 7ff820106f40 20 add_watcher() i=3 2024-09-13T23:58:49.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.359+0000 7ff820106f40 20 add_watcher() i=4 2024-09-13T23:58:49.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.359+0000 7ff820106f40 20 add_watcher() i=5 2024-09-13T23:58:49.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.359+0000 7ff820106f40 20 add_watcher() i=6 2024-09-13T23:58:49.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.359+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94483725728384] v37'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.359+0000 7ff820106f40 20 add_watcher() i=7 2024-09-13T23:58:49.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.359+0000 7ff820106f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:58:49.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.359+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6c00 con 0x55eeb4f55400 2024-09-13T23:58:49.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.359+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.359+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94483727261696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff7000 con 0x55eeb4f55400 2024-09-13T23:58:49.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.363+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94483727261696] v37'232 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.363+0000 7ff820106f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:58:49.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.363+0000 7ff820106f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:58:49.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.363+0000 7ff820106f40 1 Processor -- start 2024-09-13T23:58:49.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.363+0000 7ff80588d700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:49.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.363+0000 7ff820106f40 1 -- start start 2024-09-13T23:58:49.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.363+0000 7ff820106f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4ff7400 0x55eeb4e95180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.363+0000 7ff820106f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeb4c3a3c0 con 0x55eeb4ff7400 2024-09-13T23:58:49.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.363+0000 7ff81e0be700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4ff7400 0x55eeb4e95180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.363+0000 7ff81e0be700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4ff7400 0x55eeb4e95180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50894/0 (socket says 172.21.15.173:50894) 2024-09-13T23:58:49.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.363+0000 7ff81e0be700 1 -- 172.21.15.173:0/2463919240 learned_addr learned my addr 172.21.15.173:0/2463919240 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.363+0000 7ff81e0be700 1 -- 172.21.15.173:0/2463919240 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eeb4bbeb60 con 0x55eeb4ff7400 2024-09-13T23:58:49.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.363+0000 7ff81e0be700 1 --2- 172.21.15.173:0/2463919240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4ff7400 0x55eeb4e95180 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x55eeb500a690 tx=0x55eeb4fce4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b415def2bf6b9128 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.367+0000 7ff80508c700 1 -- 172.21.15.173:0/2463919240 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55eeb5012000 con 0x55eeb4ff7400 2024-09-13T23:58:49.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.367+0000 7ff80508c700 1 -- 172.21.15.173:0/2463919240 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55eeb4f7ca80 con 0x55eeb4ff7400 2024-09-13T23:58:49.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.367+0000 7ff80508c700 1 -- 172.21.15.173:0/2463919240 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55eeb5012160 con 0x55eeb4ff7400 2024-09-13T23:58:49.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.367+0000 7ff820106f40 1 -- 172.21.15.173:0/2463919240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4ff7400 msgr2=0x55eeb4e95180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.367+0000 7ff820106f40 1 --2- 172.21.15.173:0/2463919240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4ff7400 0x55eeb4e95180 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x55eeb500a690 tx=0x55eeb4fce4e0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.367+0000 7ff820106f40 1 -- 172.21.15.173:0/2463919240 shutdown_connections 2024-09-13T23:58:49.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.367+0000 7ff820106f40 1 --2- 172.21.15.173:0/2463919240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4ff7400 0x55eeb4e95180 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.367+0000 7ff820106f40 1 -- 172.21.15.173:0/2463919240 >> 172.21.15.173:0/2463919240 conn(0x55eeb4ff7800 msgr2=0x55eeb4cae000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.367+0000 7ff820106f40 1 -- 172.21.15.173:0/2463919240 shutdown_connections 2024-09-13T23:58:49.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.367+0000 7ff820106f40 1 -- 172.21.15.173:0/2463919240 wait complete. 2024-09-13T23:58:49.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.367+0000 7ff820106f40 1 Processor -- start 2024-09-13T23:58:49.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.367+0000 7ff820106f40 1 -- start start 2024-09-13T23:58:49.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.367+0000 7ff820106f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4ff7400 0x55eeb4e95180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.367+0000 7ff820106f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeb4c3a500 con 0x55eeb4ff7400 2024-09-13T23:58:49.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.367+0000 7ff81e0be700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4ff7400 0x55eeb4e95180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.367+0000 7ff81e0be700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4ff7400 0x55eeb4e95180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50906/0 (socket says 172.21.15.173:50906) 2024-09-13T23:58:49.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.367+0000 7ff81e0be700 1 -- 172.21.15.173:0/1084239009 learned_addr learned my addr 172.21.15.173:0/1084239009 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.367+0000 7ff81e0be700 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eeb4bbed00 con 0x55eeb4ff7400 2024-09-13T23:58:49.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.367+0000 7ff81e0be700 1 --2- 172.21.15.173:0/1084239009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4ff7400 0x55eeb4e95180 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x55eeb500a8a0 tx=0x55eeb4fce660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.367+0000 7ff803889700 1 -- 172.21.15.173:0/1084239009 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55eeb50122c0 con 0x55eeb4ff7400 2024-09-13T23:58:49.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.371+0000 7ff803889700 1 -- 172.21.15.173:0/1084239009 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55eeb4f7c780 con 0x55eeb4ff7400 2024-09-13T23:58:49.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.371+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55eeb4bbe340 con 0x55eeb4ff7400 2024-09-13T23:58:49.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.371+0000 7ff803889700 1 -- 172.21.15.173:0/1084239009 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55eeb5012000 con 0x55eeb4ff7400 2024-09-13T23:58:49.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.371+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eeb4bbeb60 con 0x55eeb4ff7400 2024-09-13T23:58:49.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.371+0000 7ff803889700 1 -- 172.21.15.173:0/1084239009 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55eeb4ca7b80 con 0x55eeb4ff7400 2024-09-13T23:58:49.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.371+0000 7ff803889700 1 --2- 172.21.15.173:0/1084239009 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55eeb4ff6c00 0x55eeb5096000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.371+0000 7ff803889700 1 -- 172.21.15.173:0/1084239009 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x55eeb4c136c0 con 0x55eeb4ff7400 2024-09-13T23:58:49.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.371+0000 7ff81f0c0700 1 --2- 172.21.15.173:0/1084239009 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55eeb4ff6c00 0x55eeb5096000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.371+0000 7ff820106f40 1 --2- 172.21.15.173:0/1084239009 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55eeb4ff7c00 0x55eeb4e95700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.371+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4ff7c00 2024-09-13T23:58:49.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.371+0000 7ff81e8bf700 1 --2- 172.21.15.173:0/1084239009 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55eeb4ff7c00 0x55eeb4e95700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.371+0000 7ff81f0c0700 1 --2- 172.21.15.173:0/1084239009 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55eeb4ff6c00 0x55eeb5096000 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55eeb4f8fd10 tx=0x55eeb4cb1ce0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.371+0000 7ff81e8bf700 1 --2- 172.21.15.173:0/1084239009 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55eeb4ff7c00 0x55eeb4e95700 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.375+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v37'37 uv30 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ff7c00 2024-09-13T23:58:49.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.375+0000 7ff820106f40 1 --2- 172.21.15.173:0/1084239009 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55eeb4f54800 0x55eeb5096580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.375+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4f55800 con 0x55eeb4f54800 2024-09-13T23:58:49.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.375+0000 7ff81e0be700 1 --2- 172.21.15.173:0/1084239009 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55eeb4f54800 0x55eeb5096580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.375+0000 7ff81e0be700 1 --2- 172.21.15.173:0/1084239009 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55eeb4f54800 0x55eeb5096580 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.379+0000 7ff81e0be700 1 -- 172.21.15.173:0/1084239009 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v37'31 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4f54800 2024-09-13T23:58:49.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.379+0000 7ff820106f40 1 --2- 172.21.15.173:0/1084239009 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55eeb4ffa800 0x55eeb5096b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.379+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffa000 con 0x55eeb4ffa800 2024-09-13T23:58:49.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.379+0000 7ff81f0c0700 1 --2- 172.21.15.173:0/1084239009 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55eeb4ffa800 0x55eeb5096b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.379+0000 7ff81f0c0700 1 --2- 172.21.15.173:0/1084239009 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55eeb4ffa800 0x55eeb5096b00 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.379+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1084239009 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v37'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ffa800 2024-09-13T23:58:49.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.379+0000 7ff820106f40 1 --2- 172.21.15.173:0/1084239009 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55eeb4ffac00 0x55eeb5097080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.379+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffb000 con 0x55eeb4ffac00 2024-09-13T23:58:49.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.379+0000 7ff81e8bf700 1 --2- 172.21.15.173:0/1084239009 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55eeb4ffac00 0x55eeb5097080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.383+0000 7ff81e8bf700 1 --2- 172.21.15.173:0/1084239009 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55eeb4ffac00 0x55eeb5097080 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.383+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v37'233 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ffac00 2024-09-13T23:58:49.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.383+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffa400 con 0x55eeb4ff7c00 2024-09-13T23:58:49.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.387+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v37'74 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ff7c00 2024-09-13T23:58:49.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.387+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff7000 con 0x55eeb4ffa800 2024-09-13T23:58:49.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.391+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1084239009 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v37'49 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ffa800 2024-09-13T23:58:49.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.391+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8000 con 0x55eeb4ff7c00 2024-09-13T23:58:49.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.391+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v37'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ff7c00 2024-09-13T23:58:49.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.391+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8400 con 0x55eeb4ffac00 2024-09-13T23:58:49.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.395+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v37'52 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ffac00 2024-09-13T23:58:49.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.395+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8800 con 0x55eeb4ff7c00 2024-09-13T23:58:49.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.395+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v37'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ff7c00 2024-09-13T23:58:49.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.399+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8c00 con 0x55eeb4ff7c00 2024-09-13T23:58:49.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.399+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v37'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ff7c00 2024-09-13T23:58:49.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.399+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9000 con 0x55eeb4ff7c00 2024-09-13T23:58:49.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.403+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v37'75 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ff7c00 2024-09-13T23:58:49.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.403+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9400 con 0x55eeb4ffa800 2024-09-13T23:58:49.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.407+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1084239009 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v37'34 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ffa800 2024-09-13T23:58:49.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.407+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9800 con 0x55eeb4ff7c00 2024-09-13T23:58:49.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.407+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v37'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ff7c00 2024-09-13T23:58:49.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.407+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9c00 con 0x55eeb4ffac00 2024-09-13T23:58:49.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.411+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v37'55 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ffac00 2024-09-13T23:58:49.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.411+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8000 con 0x55eeb4ffac00 2024-09-13T23:58:49.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.415+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v37'234 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ffac00 2024-09-13T23:58:49.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.415+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8400 con 0x55eeb4ff7c00 2024-09-13T23:58:49.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.415+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v37'68 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ff7c00 2024-09-13T23:58:49.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.415+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8800 con 0x55eeb4ff7c00 2024-09-13T23:58:49.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.419+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v37'76 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ff7c00 2024-09-13T23:58:49.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.419+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffb000 con 0x55eeb4ffa800 2024-09-13T23:58:49.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.423+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1084239009 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v37'32 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ffa800 2024-09-13T23:58:49.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.423+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffa400 con 0x55eeb4ff7c00 2024-09-13T23:58:49.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.427+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v37'36 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ff7c00 2024-09-13T23:58:49.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.427+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4ffac00 2024-09-13T23:58:49.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.427+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v37'235 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ffac00 2024-09-13T23:58:49.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.427+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8c00 con 0x55eeb4ff7c00 2024-09-13T23:58:49.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.431+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v37'69 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ff7c00 2024-09-13T23:58:49.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.431+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9000 con 0x55eeb4ff7c00 2024-09-13T23:58:49.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.435+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v37'38 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ff7c00 2024-09-13T23:58:49.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.435+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9800 con 0x55eeb4ffa800 2024-09-13T23:58:49.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.435+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1084239009 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v37'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ffa800 2024-09-13T23:58:49.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.435+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9c00 con 0x55eeb4ff7c00 2024-09-13T23:58:49.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.439+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v37'35 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ff7c00 2024-09-13T23:58:49.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.439+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8000 con 0x55eeb4ffa800 2024-09-13T23:58:49.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.443+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1084239009 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v37'24 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ffa800 2024-09-13T23:58:49.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.443+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8400 con 0x55eeb4ffa800 2024-09-13T23:58:49.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.443+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1084239009 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v37'50 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ffa800 2024-09-13T23:58:49.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.443+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8800 con 0x55eeb4ffa800 2024-09-13T23:58:49.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.447+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1084239009 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v37'36 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ffa800 2024-09-13T23:58:49.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.447+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9400 con 0x55eeb4ff7c00 2024-09-13T23:58:49.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.451+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v37'34 uv26 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ff7c00 2024-09-13T23:58:49.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.451+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8000 con 0x55eeb4ffac00 2024-09-13T23:58:49.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.451+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v37'53 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ffac00 2024-09-13T23:58:49.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.451+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8400 con 0x55eeb4ff7c00 2024-09-13T23:58:49.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.455+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v37'70 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ff7c00 2024-09-13T23:58:49.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.455+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9800 con 0x55eeb4ffac00 2024-09-13T23:58:49.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.459+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v37'56 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ffac00 2024-09-13T23:58:49.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.459+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffa000 con 0x55eeb4f54800 2024-09-13T23:58:49.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.463+0000 7ff81e0be700 1 -- 172.21.15.173:0/1084239009 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v37'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4f54800 2024-09-13T23:58:49.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.463+0000 7ff801084700 20 reqs_thread_entry: start 2024-09-13T23:58:49.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.463+0000 7ff820106f40 20 init_complete bucket index max shards: 11 2024-09-13T23:58:49.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.463+0000 7ff820106f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:58:49.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.463+0000 7ff7ff080700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:59:19 2024 2024-09-13T23:58:49.470 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:58:49.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.463+0000 7ff7fe85e700 20 reqs_thread_entry: start 2024-09-13T23:58:49.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.467+0000 7ff820106f40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:58:49.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.467+0000 7ff820106f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.467+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8c00 con 0x55eeb4f55400 2024-09-13T23:58:49.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.467+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv18 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.467+0000 7ff820106f40 20 rados_obj.operate() r=0 bl.length=357 2024-09-13T23:58:49.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.467+0000 7ff820106f40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:58:49.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.467+0000 7ff820106f40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:58:49.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.467+0000 7ff820106f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:58:49.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.467+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9000 con 0x55eeb4ff6800 2024-09-13T23:58:49.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.467+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.467+0000 7ff820106f40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6 : miss 2024-09-13T23:58:49.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.467+0000 7ff820106f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.467+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:64 8.e 8:731f280a:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.6:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9c00 con 0x55eeb4ff6800 2024-09-13T23:58:49.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.467+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(64 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.467+0000 7ff820106f40 20 rados_obj.operate() r=0 bl.length=352 2024-09-13T23:58:49.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.467+0000 7ff820106f40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6 info.flags=0x17 2024-09-13T23:58:49.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.467+0000 7ff820106f40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6 to cache LRU end 2024-09-13T23:58:49.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.467+0000 7ff820106f40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:58:49.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.467+0000 7ff820106f40 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:58:49.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.467+0000 7ff820106f40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6 2024-09-13T23:58:49.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.467+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 4.31 4:8c82a818:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9400 con 0x55eeb4f55c00 2024-09-13T23:58:49.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.471+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(65 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.471+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 4.d 4:b1b0e942:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8000 con 0x55eeb4f55c00 2024-09-13T23:58:49.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.471+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(66 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.1 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.471+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:67 4.19 4:9838fba5:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8400 con 0x55eeb4ff6400 2024-09-13T23:58:49.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.471+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(67 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.2 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.471+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:68 4.21 4:84db7e82:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4ff6800 2024-09-13T23:58:49.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.471+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 16 ==== osd_op_reply(68 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.471+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:69 4.3c 4:3e6b750d:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffa400 con 0x55eeb4f55400 2024-09-13T23:58:49.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.475+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(69 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.4 [call out=425b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.475+0000 7ff820106f40 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-13T23:58:49.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.475+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:70 4.21 4:879f2c76:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8400 con 0x55eeb4ff6800 2024-09-13T23:58:49.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.475+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 17 ==== osd_op_reply(70 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.5 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.475+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 4.1f 4:f9db8e05:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffb800 con 0x55eeb4f55c00 2024-09-13T23:58:49.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.475+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(71 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.6 [call out=85b] v0'0 uv15 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.475+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:72 4.13 4:c83ba87b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffbc00 con 0x55eeb4ff6800 2024-09-13T23:58:49.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.475+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 18 ==== osd_op_reply(72 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.475+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:73 4.1c 4:3a3b579b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffa000 con 0x55eeb4ff6800 2024-09-13T23:58:49.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.479+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 19 ==== osd_op_reply(73 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.479+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:74 4.19 4:9a1d0212:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4f55800 con 0x55eeb4ff6400 2024-09-13T23:58:49.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.479+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(74 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.9 [call out=85b] v0'0 uv10 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.479+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:75 4.15 4:aafe7a70:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8800 con 0x55eeb4ff6400 2024-09-13T23:58:49.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.479+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 17 ==== osd_op_reply(75 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.10 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.479+0000 7ff820106f40 20 get_obj_state: rctx=0x55eeb4c3d8f0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55eeb51421e8 s->prefetch_data=0 2024-09-13T23:58:49.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.479+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:76 3.37s0 3:eec79fe0:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8c00 con 0x55eeb4f55400 2024-09-13T23:58:49.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.479+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(76 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.479+0000 7ff820106f40 10 manifest: total_size = 6 2024-09-13T23:58:49.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.479+0000 7ff820106f40 20 get_obj_state: setting s->obj_tag to d342d0db-d035-4a54-bae7-2e0f76db6818.4232.6372698530068424044 2024-09-13T23:58:49.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.479+0000 7ff820106f40 20 get_obj_state: rctx=0x55eeb4c3d8f0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55eeb51421e8 s->prefetch_data=0 2024-09-13T23:58:49.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.479+0000 7ff820106f40 20 prepare_atomic_modification: state is not atomic. state=0x55eeb51421e8 2024-09-13T23:58:49.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.479+0000 7ff820106f40 20 bucket index object: default.rgw.buckets.index:.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.4 2024-09-13T23:58:49.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.479+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:77 4.3c 4:3e6b750d:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9000 con 0x55eeb4f55400 2024-09-13T23:58:49.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.483+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(77 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.4 [stat,call,call] v37'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.483+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:78 3.37s0 3:eec79fe0:::d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9c00 con 0x55eeb4f55400 2024-09-13T23:58:49.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.487+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(78 d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6_15f6f8dc036519d7fe15b39338f6e5db [call] v37'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.487+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:79 4.3c 4:3e6b750d:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffa400 con 0x55eeb4f55400 2024-09-13T23:58:49.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.487+0000 7ff820106f40 20 list_objects_ordered: starting attempt 1 2024-09-13T23:58:49.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.487+0000 7ff820106f40 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T23:58:49.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.487+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:80 4.31 4:8c82a818:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4f55c00 2024-09-13T23:58:49.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.487+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:81 4.d 4:b1b0e942:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5148000 con 0x55eeb4f55c00 2024-09-13T23:58:49.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.487+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:82 4.19 4:9838fba5:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5148400 con 0x55eeb4ff6400 2024-09-13T23:58:49.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.487+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:83 4.21 4:84db7e82:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5148800 con 0x55eeb4ff6800 2024-09-13T23:58:49.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.487+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:84 4.3c 4:3e6b750d:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5148c00 con 0x55eeb4f55400 2024-09-13T23:58:49.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.487+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:85 4.21 4:879f2c76:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5149000 con 0x55eeb4ff6800 2024-09-13T23:58:49.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.487+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:86 4.1f 4:f9db8e05:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5149400 con 0x55eeb4f55c00 2024-09-13T23:58:49.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.487+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:87 4.13 4:c83ba87b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5149800 con 0x55eeb4ff6800 2024-09-13T23:58:49.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.487+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 18 ==== osd_op_reply(82 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.2 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.487+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== osd_op_reply(80 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.487+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== osd_op_reply(81 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.1 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.487+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:88 4.1c 4:3a3b579b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5149c00 con 0x55eeb4ff6800 2024-09-13T23:58:49.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.487+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(86 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.6 [call out=85b] v0'0 uv15 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.487+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:89 4.19 4:9a1d0212:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5148800 con 0x55eeb4ff6400 2024-09-13T23:58:49.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.487+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:90 4.15 4:aafe7a70:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5148c00 con 0x55eeb4ff6400 2024-09-13T23:58:49.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.491+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 20 ==== osd_op_reply(83 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.491+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 21 ==== osd_op_reply(87 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.491+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 22 ==== osd_op_reply(85 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.5 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.491+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 23 ==== osd_op_reply(88 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.491+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 19 ==== osd_op_reply(89 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.9 [call out=85b] v0'0 uv10 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.491+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 20 ==== osd_op_reply(90 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.10 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.491+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(79 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.4 [stat,call,call] v37'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.491+0000 7ff8188b3700 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-13T23:58:49.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.491+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 24 ==== osd_op_reply(84 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.4 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.491+0000 7ff820106f40 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T23:58:49.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.491+0000 7ff820106f40 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T23:58:49.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.491+0000 7ff820106f40 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T23:58:49.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.491+0000 7ff820106f40 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T23:58:49.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.491+0000 7ff820106f40 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6])"; uploads.size()=0; is_truncated=0 2024-09-13T23:58:49.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.491+0000 7ff820106f40 10 lifecycle: RGWRados::convert_old_bucket_info(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6]) 2024-09-13T23:58:49.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.491+0000 7ff820106f40 10 lifecycle: cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:58:49.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.491+0000 7ff820106f40 20 lifecycle: rados->read ofs=0 len=0 2024-09-13T23:58:49.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.491+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:91 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffbc00 con 0x55eeb4ff6800 2024-09-13T23:58:49.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.491+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 24 ==== osd_op_reply(91 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv39 ondisk = 0) v8 ==== 275+0+304 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.491+0000 7ff820106f40 20 lifecycle: rados_obj.operate() r=0 bl.length=165 2024-09-13T23:58:49.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.491+0000 7ff820106f40 10 lifecycle: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T23:58:49.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.491+0000 7ff820106f40 10 lifecycle: adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:58:49.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.491+0000 7ff820106f40 10 lifecycle: updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:58:49.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.491+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:92 8.e 8:731f280a:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.6:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffa400 con 0x55eeb4ff6800 2024-09-13T23:58:49.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.495+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 25 ==== osd_op_reply(92 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6 [delete,create,call,call,writefull 0~352,setxattr (123)] v37'9 uv9 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.495+0000 7ff820106f40 10 lifecycle: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6 info.flags=0x17 2024-09-13T23:58:49.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.495+0000 7ff820106f40 10 lifecycle: moving default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6 to cache LRU end 2024-09-13T23:58:49.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.495+0000 7ff820106f40 10 lifecycle: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:58:49.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.495+0000 7ff820106f40 10 lifecycle: distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6, ofs0, ns] 2024-09-13T23:58:49.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.495+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:93 7.15 7:a93a5511:::notify.2:head [notify cookie 94483727265152 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9000 con 0x55eeb4f55c00 2024-09-13T23:58:49.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.495+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== watch-notify(notify (1) cookie 94483725722624 notify 158913789995 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x55eeb4ed8b60 con 0x55eeb4f55c00 2024-09-13T23:58:49.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.495+0000 7ff8188b3700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789995 cookie 94483725722624 notifier 4862 bl.length()=725 2024-09-13T23:58:49.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.495+0000 7ff8188b3700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6 info.flags=0x17 2024-09-13T23:58:49.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.495+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== osd_op_reply(93 notify.2 [notify cookie 94483727265152 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.495+0000 7ff8188b3700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6 to cache LRU end 2024-09-13T23:58:49.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.495+0000 7ff8188b3700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:58:49.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.495+0000 7ff8188b3700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:94 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8400 con 0x55eeb4f55c00 2024-09-13T23:58:49.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.495+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== osd_op_reply(94 notify.2 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.495+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 27 ==== watch-notify(notify_complete (2) cookie 94483727265152 notify 158913789995 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55eeb4f52ea0 con 0x55eeb4f55c00 2024-09-13T23:58:49.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.495+0000 7ff820106f40 20 lifecycle: handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6]): orig_sources= new_sources= 2024-09-13T23:58:49.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.495+0000 7ff820106f40 20 lifecycle: handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6]): potential sources added=[] removed=[] 2024-09-13T23:58:49.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.495+0000 7ff820106f40 20 lifecycle: handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6]): orig_dests= new_dests= 2024-09-13T23:58:49.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.495+0000 7ff820106f40 20 lifecycle: handle_bi_update(): bucket=:myfoo[d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6]): potential dests added=[] removed=[] 2024-09-13T23:58:49.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.495+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:33 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=65b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9c00 con 0x55eeb4ffac00 2024-09-13T23:58:49.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.499+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(33 lc.16 [call] v37'15 uv15 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ffac00 2024-09-13T23:58:49.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.499+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:34 6.1 6:8386e9da:lc::lc.16:head [call rgw.lc_rm_entry in=92b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9800 con 0x55eeb4ffac00 2024-09-13T23:58:49.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.499+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(34 lc.16 [call] v37'16 uv16 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ffac00 2024-09-13T23:58:49.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.499+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:35 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=49b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9400 con 0x55eeb4ffac00 2024-09-13T23:58:49.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.503+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(35 lc.16 [call] v37'17 uv17 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4ffac00 2024-09-13T23:58:49.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.503+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:95 4.31 4:8c82a818:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8000 con 0x55eeb4f55c00 2024-09-13T23:58:49.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.503+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:96 4.d 4:b1b0e942:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9000 con 0x55eeb4f55c00 2024-09-13T23:58:49.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.503+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:97 4.19 4:9838fba5:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8400 con 0x55eeb4ff6400 2024-09-13T23:58:49.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.503+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:98 4.21 4:84db7e82:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5148000 con 0x55eeb4ff6800 2024-09-13T23:58:49.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.503+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:99 4.3c 4:3e6b750d:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5149400 con 0x55eeb4f55400 2024-09-13T23:58:49.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.503+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:100 4.21 4:879f2c76:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4ff6800 2024-09-13T23:58:49.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.503+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:101 4.1f 4:f9db8e05:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffb800 con 0x55eeb4f55c00 2024-09-13T23:58:49.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.503+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:102 4.13 4:c83ba87b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8c00 con 0x55eeb4ff6800 2024-09-13T23:58:49.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.503+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 26 ==== osd_op_reply(98 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.503+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 21 ==== osd_op_reply(97 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.2 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.503+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:103 4.1c 4:3a3b579b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8800 con 0x55eeb4ff6800 2024-09-13T23:58:49.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.503+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 27 ==== osd_op_reply(100 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.5 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.503+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:104 4.19 4:9a1d0212:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8400 con 0x55eeb4ff6400 2024-09-13T23:58:49.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.503+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 25 ==== osd_op_reply(99 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.4 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.503+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:105 4.15 4:aafe7a70:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4f55800 con 0x55eeb4ff6400 2024-09-13T23:58:49.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.503+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 28 ==== osd_op_reply(102 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.503+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 28 ==== osd_op_reply(101 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.6 [call out=85b] v0'0 uv15 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.503+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 29 ==== osd_op_reply(95 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.503+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 30 ==== osd_op_reply(96 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.1 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.503+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 29 ==== osd_op_reply(103 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.503+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 22 ==== osd_op_reply(104 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.9 [call out=85b] v0'0 uv10 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.503+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 23 ==== osd_op_reply(105 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.10 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.503+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:106 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffbc00 con 0x55eeb4ff6800 2024-09-13T23:58:49.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.507+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 30 ==== osd_op_reply(106 foo.buckets [call] v37'44 uv44 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.507+0000 7ff820106f40 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x17) 2024-09-13T23:58:49.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.507+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:107 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffa000 con 0x55eeb4ff6800 2024-09-13T23:58:49.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.507+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 31 ==== osd_op_reply(107 myfoo [call,call,delete] v37'45 uv45 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.507+0000 7ff820106f40 10 removing default.rgw.meta+root+myfoo from cache 2024-09-13T23:58:49.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.507+0000 7ff820106f40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T23:58:49.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.507+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94483727265152 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffa400 con 0x55eeb4ff6400 2024-09-13T23:58:49.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.507+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 24 ==== watch-notify(notify (1) cookie 94483725727232 notify 158913789992 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x55eeb505ab60 con 0x55eeb4ff6400 2024-09-13T23:58:49.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.507+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 25 ==== osd_op_reply(108 notify.6 [notify cookie 94483727265152 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.507+0000 7ff8190b4700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789992 cookie 94483725727232 notifier 4862 bl.length()=149 2024-09-13T23:58:49.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.507+0000 7ff8190b4700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5148000 con 0x55eeb4ff6400 2024-09-13T23:58:49.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.511+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 26 ==== watch-notify(notify_complete (2) cookie 94483727265152 notify 158913789992 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55eeb505ad00 con 0x55eeb4ff6400 2024-09-13T23:58:49.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.511+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 27 ==== osd_op_reply(109 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.511+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:110 8.e 8:731f280a:root::.bucket.meta.myfoo%3ad342d0db-d035-4a54-bae7-2e0f76db6818.4234.6:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5148800 con 0x55eeb4ff6800 2024-09-13T23:58:49.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.511+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 32 ==== osd_op_reply(110 .bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6 [call,call,delete] v37'10 uv10 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.511+0000 7ff820106f40 10 removing default.rgw.meta+root+.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6 from cache 2024-09-13T23:58:49.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.511+0000 7ff820106f40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6, ofs0, ns] 2024-09-13T23:58:49.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.511+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:111 7.15 7:a93a5511:::notify.2:head [notify cookie 94483727265152 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5148c00 con 0x55eeb4f55c00 2024-09-13T23:58:49.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.511+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 31 ==== watch-notify(notify (1) cookie 94483725722624 notify 158913789996 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x55eeb4f52ea0 con 0x55eeb4f55c00 2024-09-13T23:58:49.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.511+0000 7ff8190b4700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789996 cookie 94483725722624 notifier 4862 bl.length()=206 2024-09-13T23:58:49.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.511+0000 7ff8190b4700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5148400 con 0x55eeb4f55c00 2024-09-13T23:58:49.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.511+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 32 ==== osd_op_reply(111 notify.2 [notify cookie 94483727265152 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.515+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 33 ==== osd_op_reply(112 notify.2 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.515+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 34 ==== watch-notify(notify_complete (2) cookie 94483727265152 notify 158913789996 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55eeb4f53040 con 0x55eeb4f55c00 2024-09-13T23:58:49.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.515+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:113 4.31 4:8c82a818:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5149000 con 0x55eeb4f55c00 2024-09-13T23:58:49.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.515+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:114 4.d 4:b1b0e942:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5149400 con 0x55eeb4f55c00 2024-09-13T23:58:49.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.515+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:115 4.19 4:9838fba5:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5149800 con 0x55eeb4ff6400 2024-09-13T23:58:49.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.515+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:116 4.21 4:84db7e82:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5149c00 con 0x55eeb4ff6800 2024-09-13T23:58:49.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.515+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:117 4.3c 4:3e6b750d:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5148c00 con 0x55eeb4f55400 2024-09-13T23:58:49.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.515+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:118 4.21 4:879f2c76:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5148400 con 0x55eeb4ff6800 2024-09-13T23:58:49.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.515+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:119 4.1f 4:f9db8e05:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5149000 con 0x55eeb4f55c00 2024-09-13T23:58:49.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.515+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:120 4.13 4:c83ba87b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5149400 con 0x55eeb4ff6800 2024-09-13T23:58:49.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.515+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:121 4.1c 4:3a3b579b:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffb800 con 0x55eeb4ff6800 2024-09-13T23:58:49.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.515+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:122 4.19 4:9a1d0212:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9c00 con 0x55eeb4ff6400 2024-09-13T23:58:49.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.515+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:123 4.15 4:aafe7a70:::.dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9800 con 0x55eeb4ff6400 2024-09-13T23:58:49.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.515+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 33 ==== osd_op_reply(116 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.3 [delete] v37'3 uv3 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.515+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 35 ==== osd_op_reply(113 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.0 [delete] v37'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.519+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 34 ==== osd_op_reply(120 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.7 [delete] v37'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.519+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 28 ==== osd_op_reply(123 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.10 [delete] v37'8 uv8 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.519+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 29 ==== osd_op_reply(115 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.2 [delete] v37'11 uv11 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.519+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 36 ==== osd_op_reply(119 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.6 [delete] v37'16 uv16 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.519+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 37 ==== osd_op_reply(114 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.1 [delete] v37'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.519+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 30 ==== osd_op_reply(122 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.9 [delete] v37'12 uv12 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.519+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 26 ==== osd_op_reply(117 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.4 [delete] v37'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.519+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 35 ==== osd_op_reply(121 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.8 [delete] v37'12 uv12 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.523+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 36 ==== osd_op_reply(118 .dir.d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6.5 [delete] v37'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.523+0000 7ff820106f40 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6 : miss 2024-09-13T23:58:49.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.523+0000 7ff820106f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.523+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:124 6.e 6:7082aa77:::pubsub..bucket.myfoo%2fd342d0db-d035-4a54-bae7-2e0f76db6818.4234.6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9400 con 0x55eeb4f55c00 2024-09-13T23:58:49.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.523+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 38 ==== osd_op_reply(124 pubsub..bucket.myfoo/d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.523+0000 7ff820106f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:49.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.523+0000 7ff820106f40 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6 info.flags=0x0 2024-09-13T23:58:49.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.523+0000 7ff820106f40 10 adding default.rgw.log++pubsub..bucket.myfoo/d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6 to cache LRU end 2024-09-13T23:58:49.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.523+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:125 6.e 6:7082aa77:::pubsub..bucket.myfoo%2fd342d0db-d035-4a54-bae7-2e0f76db6818.4234.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8000 con 0x55eeb4f55c00 2024-09-13T23:58:49.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.523+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 39 ==== osd_op_reply(125 pubsub..bucket.myfoo/d342d0db-d035-4a54-bae7-2e0f76db6818.4234.6 [delete] v37'31 uv23 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.523+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:126 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9000 con 0x55eeb4ff6800 2024-09-13T23:58:49.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.527+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 37 ==== osd_op_reply(126 foo.buckets [call] v37'46 uv46 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.527+0000 7ff820106f40 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-13T23:58:49.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.527+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:127 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5148000 con 0x55eeb4f55400 2024-09-13T23:58:49.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.531+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 27 ==== osd_op_reply(127 9te6NH5mcdcq0Tc5i8i1 [delete] v37'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.531+0000 7ff820106f40 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-13T23:58:49.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.531+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:128 7.e 7:7759931f:::notify.3:head [notify cookie 94483727265152 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5149800 con 0x55eeb4ff6800 2024-09-13T23:58:49.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.531+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 38 ==== watch-notify(notify (1) cookie 94483725723776 notify 158913789970 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x55eeb505ab60 con 0x55eeb4ff6800 2024-09-13T23:58:49.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.531+0000 7ff8188b3700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789970 cookie 94483725723776 notifier 4862 bl.length()=170 2024-09-13T23:58:49.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.531+0000 7ff8188b3700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:129 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5162000 con 0x55eeb4ff6800 2024-09-13T23:58:49.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.531+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 39 ==== osd_op_reply(128 notify.3 [notify cookie 94483727265152 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.531+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 40 ==== osd_op_reply(129 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.531+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 41 ==== watch-notify(notify_complete (2) cookie 94483727265152 notify 158913789970 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55eeb4f52ea0 con 0x55eeb4ff6800 2024-09-13T23:58:49.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.531+0000 7ff820106f40 10 removing email index: foo@foo.com 2024-09-13T23:58:49.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.531+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:130 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5148800 con 0x55eeb4f55400 2024-09-13T23:58:49.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.531+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 28 ==== osd_op_reply(130 foo@foo.com [delete] v37'2 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.531+0000 7ff820106f40 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-13T23:58:49.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.531+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:131 7.e 7:7759931f:::notify.3:head [notify cookie 94483727265152 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5149c00 con 0x55eeb4ff6800 2024-09-13T23:58:49.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.535+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 42 ==== watch-notify(notify (1) cookie 94483725723776 notify 158913789971 ret 0) v3 ==== 204+0+0 (crc 0 0 0) 0x55eeb4f52ea0 con 0x55eeb4ff6800 2024-09-13T23:58:49.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.535+0000 7ff8190b4700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789971 cookie 94483725723776 notifier 4862 bl.length()=162 2024-09-13T23:58:49.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.535+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 43 ==== osd_op_reply(131 notify.3 [notify cookie 94483727265152 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.535+0000 7ff8190b4700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:132 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5162400 con 0x55eeb4ff6800 2024-09-13T23:58:49.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.535+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 44 ==== osd_op_reply(132 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.535+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 45 ==== watch-notify(notify_complete (2) cookie 94483727265152 notify 158913789971 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55eeb505ab60 con 0x55eeb4ff6800 2024-09-13T23:58:49.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.535+0000 7ff820106f40 10 removing user buckets index 2024-09-13T23:58:49.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.535+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:133 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5148c00 con 0x55eeb4ff6800 2024-09-13T23:58:49.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.535+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 46 ==== osd_op_reply(133 foo.buckets [delete] v37'47 uv47 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.535+0000 7ff820106f40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-13T23:58:49.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.535+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:134 7.3 7:c609908c:::notify.5:head [notify cookie 94483727265152 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5148400 con 0x55eeb4ff6400 2024-09-13T23:58:49.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.535+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 31 ==== watch-notify(notify (1) cookie 94483725726080 notify 158913789993 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x55eeb505ad00 con 0x55eeb4ff6400 2024-09-13T23:58:49.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.539+0000 7ff8190b4700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789993 cookie 94483725726080 notifier 4862 bl.length()=160 2024-09-13T23:58:49.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.539+0000 7ff8190b4700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:135 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5162800 con 0x55eeb4ff6400 2024-09-13T23:58:49.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.539+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 32 ==== osd_op_reply(134 notify.5 [notify cookie 94483727265152 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.539+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 33 ==== watch-notify(notify_complete (2) cookie 94483727265152 notify 158913789993 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55eeb505aea0 con 0x55eeb4ff6400 2024-09-13T23:58:49.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.539+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 34 ==== osd_op_reply(135 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.539+0000 7ff820106f40 10 removing user index: foo 2024-09-13T23:58:49.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.539+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:136 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5149400 con 0x55eeb4f55400 2024-09-13T23:58:49.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.539+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 29 ==== osd_op_reply(136 foo [call,call,delete] v37'23 uv23 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.539+0000 7ff820106f40 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-13T23:58:49.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.539+0000 7ff820106f40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:58:49.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.539+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:137 7.d 7:b4812045:::notify.4:head [notify cookie 94483727265152 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffa400 con 0x55eeb4f55c00 2024-09-13T23:58:49.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.543+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 40 ==== watch-notify(notify (1) cookie 94483725724928 notify 158913789997 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x55eeb4f53040 con 0x55eeb4f55c00 2024-09-13T23:58:49.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.543+0000 7ff8188b3700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789997 cookie 94483725724928 notifier 4862 bl.length()=152 2024-09-13T23:58:49.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.543+0000 7ff8188b3700 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:138 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb5163000 con 0x55eeb4f55c00 2024-09-13T23:58:49.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.543+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 41 ==== osd_op_reply(137 notify.4 [notify cookie 94483727265152 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.543+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 42 ==== osd_op_reply(138 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.543+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 43 ==== watch-notify(notify_complete (2) cookie 94483727265152 notify 158913789997 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55eeb4f531e0 con 0x55eeb4f55c00 2024-09-13T23:58:49.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.543+0000 7ff80588d700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:49.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.543+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:139 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94483727261696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffbc00 con 0x55eeb4f55400 2024-09-13T23:58:49.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.547+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 30 ==== osd_op_reply(139 data_loggenerations_metadata [watch unwatch cookie 94483727261696] v37'236 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.547+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:140 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94483725720320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ffa000 con 0x55eeb4f55c00 2024-09-13T23:58:49.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.551+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 44 ==== osd_op_reply(140 notify.0 [watch unwatch cookie 94483725720320] v37'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.551+0000 7ff820106f40 20 remove_watcher() i=0 2024-09-13T23:58:49.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.551+0000 7ff820106f40 2 removed watcher, disabling cache 2024-09-13T23:58:49.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.551+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:141 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94483725721472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8400 con 0x55eeb4f55400 2024-09-13T23:58:49.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.551+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.1 v2:172.21.15.173:6808/3256211813 31 ==== osd_op_reply(141 notify.1 [watch unwatch cookie 94483725721472] v37'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4f55400 2024-09-13T23:58:49.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.551+0000 7ff820106f40 20 remove_watcher() i=1 2024-09-13T23:58:49.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.551+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:142 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94483725722624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9c00 con 0x55eeb4f55c00 2024-09-13T23:58:49.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.555+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 45 ==== osd_op_reply(142 notify.2 [watch unwatch cookie 94483725722624] v37'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.555+0000 7ff820106f40 20 remove_watcher() i=2 2024-09-13T23:58:49.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.555+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:143 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94483725723776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c9800 con 0x55eeb4ff6800 2024-09-13T23:58:49.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.559+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 47 ==== osd_op_reply(143 notify.3 [watch unwatch cookie 94483725723776] v37'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.559+0000 7ff820106f40 20 remove_watcher() i=3 2024-09-13T23:58:49.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.559+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:144 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94483725724928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8c00 con 0x55eeb4f55c00 2024-09-13T23:58:49.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.559+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1173781832 <== osd.0 v2:172.21.15.87:6800/3507919120 46 ==== osd_op_reply(144 notify.4 [watch unwatch cookie 94483725724928] v37'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd7200 con 0x55eeb4f55c00 2024-09-13T23:58:49.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.559+0000 7ff820106f40 20 remove_watcher() i=4 2024-09-13T23:58:49.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.559+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:145 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94483725726080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb50c8800 con 0x55eeb4ff6400 2024-09-13T23:58:49.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.563+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 35 ==== osd_op_reply(145 notify.5 [watch unwatch cookie 94483725726080] v37'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.563+0000 7ff820106f40 20 remove_watcher() i=5 2024-09-13T23:58:49.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.563+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:146 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94483725727232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4ff6000 con 0x55eeb4ff6400 2024-09-13T23:58:49.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.567+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 <== osd.3 v2:172.21.15.173:6800/4020038786 36 ==== osd_op_reply(146 notify.6 [watch unwatch cookie 94483725727232] v37'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd7440 con 0x55eeb4ff6400 2024-09-13T23:58:49.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.567+0000 7ff820106f40 20 remove_watcher() i=6 2024-09-13T23:58:49.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.567+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:147 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94483725728384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55eeb4f55800 con 0x55eeb4ff6800 2024-09-13T23:58:49.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.567+0000 7ff81f0c0700 1 -- 172.21.15.173:0/1173781832 <== osd.2 v2:172.21.15.173:6809/889985573 48 ==== osd_op_reply(147 notify.7 [watch unwatch cookie 94483725728384] v37'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55eeb4fd6b40 con 0x55eeb4ff6800 2024-09-13T23:58:49.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.567+0000 7ff820106f40 20 remove_watcher() i=7 2024-09-13T23:58:49.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55eeb4f55c00 msgr2=0x55eeb4e94100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 --2- 172.21.15.173:0/1173781832 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55eeb4f55c00 0x55eeb4e94100 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55eeb4f55400 msgr2=0x55eeb4e93b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 --2- 172.21.15.173:0/1173781832 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55eeb4f55400 0x55eeb4e93b80 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55eeb4ff6800 msgr2=0x55eeb4e94c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 --2- 172.21.15.173:0/1173781832 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55eeb4ff6800 0x55eeb4e94c00 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55eeb4ff6400 msgr2=0x55eeb4e94680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 --2- 172.21.15.173:0/1173781832 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55eeb4ff6400 0x55eeb4e94680 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55eeb4f55000 msgr2=0x55eeb4e93600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 --2- 172.21.15.173:0/1173781832 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55eeb4f55000 0x55eeb4e93600 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55eeb4f57e90 tx=0x55eeb4fce540 comp rx=0 tx=0).stop 2024-09-13T23:58:49.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad800 msgr2=0x55eeb4e92b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 --2- 172.21.15.173:0/1173781832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad800 0x55eeb4e92b00 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x55eeb4eda180 tx=0x55eeb4f1b260 comp rx=0 tx=0).stop 2024-09-13T23:58:49.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 reap_dead start 2024-09-13T23:58:49.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 shutdown_connections 2024-09-13T23:58:49.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff81e0be700 1 -- 172.21.15.173:0/1173781832 reap_dead start 2024-09-13T23:58:49.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 >> 172.21.15.173:0/1173781832 conn(0x55eeb4bad400 msgr2=0x55eeb4cad800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 shutdown_connections 2024-09-13T23:58:49.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/1173781832 wait complete. 2024-09-13T23:58:49.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55eeb4ff7c00 msgr2=0x55eeb4e95700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 --2- 172.21.15.173:0/1084239009 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55eeb4ff7c00 0x55eeb4e95700 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55eeb4ffac00 msgr2=0x55eeb5097080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 --2- 172.21.15.173:0/1084239009 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55eeb4ffac00 0x55eeb5097080 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55eeb4f54800 msgr2=0x55eeb5096580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 --2- 172.21.15.173:0/1084239009 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55eeb4f54800 0x55eeb5096580 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55eeb4ffa800 msgr2=0x55eeb5096b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 --2- 172.21.15.173:0/1084239009 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55eeb4ffa800 0x55eeb5096b00 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55eeb4ff6c00 msgr2=0x55eeb5096000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 --2- 172.21.15.173:0/1084239009 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55eeb4ff6c00 0x55eeb5096000 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55eeb4f8fd10 tx=0x55eeb4cb1ce0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4ff7400 msgr2=0x55eeb4e95180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff81e8bf700 1 -- 172.21.15.173:0/1084239009 reap_dead start 2024-09-13T23:58:49.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 --2- 172.21.15.173:0/1084239009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4ff7400 0x55eeb4e95180 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x55eeb500a8a0 tx=0x55eeb4fce660 comp rx=0 tx=0).stop 2024-09-13T23:58:49.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 shutdown_connections 2024-09-13T23:58:49.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 --2- 172.21.15.173:0/1084239009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4ff7400 0x55eeb4e95180 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 >> 172.21.15.173:0/1084239009 conn(0x55eeb4ff7800 msgr2=0x55eeb4cae000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 shutdown_connections 2024-09-13T23:58:49.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/1084239009 wait complete. 2024-09-13T23:58:49.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/2526082406 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55eeb4f54000 msgr2=0x55eeb4e93080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 --2- 172.21.15.173:0/2526082406 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55eeb4f54000 0x55eeb4e93080 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55eeb4d09e90 tx=0x55eeb4f1af60 comp rx=0 tx=0).stop 2024-09-13T23:58:49.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/2526082406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad000 msgr2=0x55eeb4e92580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 --2- 172.21.15.173:0/2526082406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad000 0x55eeb4e92580 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x55eeb4d096b0 tx=0x55eeb4cb1920 comp rx=0 tx=0).stop 2024-09-13T23:58:49.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/2526082406 shutdown_connections 2024-09-13T23:58:49.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 --2- 172.21.15.173:0/2526082406 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55eeb4f54000 0x55eeb4e93080 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 --2- 172.21.15.173:0/2526082406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eeb4bad000 0x55eeb4e92580 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/2526082406 >> 172.21.15.173:0/2526082406 conn(0x55eeb4bacc00 msgr2=0x55eeb4cad000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/2526082406 shutdown_connections 2024-09-13T23:58:49.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.571+0000 7ff820106f40 1 -- 172.21.15.173:0/2526082406 wait complete. 2024-09-13T23:58:49.581 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:58:49.582 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:58:49.582 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:58:49.624 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:58:49.624 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:58:49.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.619+0000 7f9649453f40 1 Processor -- start 2024-09-13T23:58:49.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.619+0000 7f9649453f40 1 -- start start 2024-09-13T23:58:49.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.619+0000 7f9649453f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55abcea0d400 0x55abcecf2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.619+0000 7f9649453f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55abcead1500 con 0x55abcea0d000 2024-09-13T23:58:49.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.619+0000 7f9649453f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55abcea9aa00 con 0x55abcea0d400 2024-09-13T23:58:49.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.623+0000 7f964740b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55abcea0d400 0x55abcecf2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.623+0000 7f9647c0c700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55abcea0d000 0x55abceb0c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:53580/0 (socket says 172.21.15.173:53580) 2024-09-13T23:58:49.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.623+0000 7f9647c0c700 1 -- 172.21.15.173:0/4079964878 learned_addr learned my addr 172.21.15.173:0/4079964878 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:58:49.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.623+0000 7f964740b700 1 -- 172.21.15.173:0/4079964878 >> v1:172.21.15.87:6789/0 conn(0x55abcea0d000 legacy=0x55abceb0c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.623+0000 7f964740b700 1 -- 172.21.15.173:0/4079964878 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abcea1fd40 con 0x55abcea0d400 2024-09-13T23:58:49.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.623+0000 7f964740b700 1 --2- 172.21.15.173:0/4079964878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0d400 0x55abcecf2580 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x55abceced920 tx=0x55abceb11920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323de03bafa1fa88 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.623+0000 7f9646c0a700 1 -- 172.21.15.173:0/4079964878 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55abceab14a0 con 0x55abcea0d400 2024-09-13T23:58:49.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.623+0000 7f9646c0a700 1 -- 172.21.15.173:0/4079964878 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55abcead1800 con 0x55abcea0d400 2024-09-13T23:58:49.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.623+0000 7f9646c0a700 1 -- 172.21.15.173:0/4079964878 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55abceab1600 con 0x55abcea0d400 2024-09-13T23:58:49.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.623+0000 7f9649453f40 1 -- 172.21.15.173:0/4079964878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0d400 msgr2=0x55abcecf2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.623+0000 7f9649453f40 1 --2- 172.21.15.173:0/4079964878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0d400 0x55abcecf2580 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x55abceced920 tx=0x55abceb11920 comp rx=0 tx=0).stop 2024-09-13T23:58:49.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.623+0000 7f9649453f40 1 -- 172.21.15.173:0/4079964878 shutdown_connections 2024-09-13T23:58:49.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.623+0000 7f9649453f40 1 --2- 172.21.15.173:0/4079964878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0d400 0x55abcecf2580 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.623+0000 7f9649453f40 1 -- 172.21.15.173:0/4079964878 >> 172.21.15.173:0/4079964878 conn(0x55abcea0cc00 msgr2=0x55abceb0c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.623+0000 7f9649453f40 1 -- 172.21.15.173:0/4079964878 shutdown_connections 2024-09-13T23:58:49.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.623+0000 7f9649453f40 1 -- 172.21.15.173:0/4079964878 wait complete. 2024-09-13T23:58:49.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.623+0000 7f9649453f40 1 Processor -- start 2024-09-13T23:58:49.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.623+0000 7f9649453f40 1 -- start start 2024-09-13T23:58:49.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.623+0000 7f9649453f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0d000 0x55abcecf2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.623+0000 7f9649453f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abcea9a500 con 0x55abcea0d000 2024-09-13T23:58:49.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.623+0000 7f9647c0c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0d000 0x55abcecf2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.623+0000 7f9647c0c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0d000 0x55abcecf2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50924/0 (socket says 172.21.15.173:50924) 2024-09-13T23:58:49.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.623+0000 7f9647c0c700 1 -- 172.21.15.173:0/350443872 learned_addr learned my addr 172.21.15.173:0/350443872 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.627+0000 7f9647c0c700 1 -- 172.21.15.173:0/350443872 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abcea1fba0 con 0x55abcea0d000 2024-09-13T23:58:49.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.627+0000 7f9647c0c700 1 --2- 172.21.15.173:0/350443872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0d000 0x55abcecf2580 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x55abcf7d7e60 tx=0x55abceb11b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f016fbe9a9911667 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.627+0000 7f9646409700 1 -- 172.21.15.173:0/350443872 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55abceab14a0 con 0x55abcea0d000 2024-09-13T23:58:49.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.627+0000 7f9646409700 1 -- 172.21.15.173:0/350443872 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55abcead1b00 con 0x55abcea0d000 2024-09-13T23:58:49.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.627+0000 7f9646409700 1 -- 172.21.15.173:0/350443872 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55abceab1600 con 0x55abcea0d000 2024-09-13T23:58:49.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.627+0000 7f9649453f40 1 -- 172.21.15.173:0/350443872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0d000 msgr2=0x55abcecf2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.627+0000 7f9649453f40 1 --2- 172.21.15.173:0/350443872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0d000 0x55abcecf2580 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x55abcf7d7e60 tx=0x55abceb11b60 comp rx=0 tx=0).stop 2024-09-13T23:58:49.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.627+0000 7f9649453f40 1 -- 172.21.15.173:0/350443872 shutdown_connections 2024-09-13T23:58:49.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.627+0000 7f9649453f40 1 --2- 172.21.15.173:0/350443872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0d000 0x55abcecf2580 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.627+0000 7f9649453f40 1 -- 172.21.15.173:0/350443872 >> 172.21.15.173:0/350443872 conn(0x55abcea0cc00 msgr2=0x55abceb0d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.627+0000 7f9649453f40 1 -- 172.21.15.173:0/350443872 shutdown_connections 2024-09-13T23:58:49.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.627+0000 7f9649453f40 1 -- 172.21.15.173:0/350443872 wait complete. 2024-09-13T23:58:49.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.627+0000 7f9649453f40 1 Processor -- start 2024-09-13T23:58:49.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.627+0000 7f9649453f40 1 -- start start 2024-09-13T23:58:49.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.627+0000 7f9649453f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0d400 0x55abcecf2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.627+0000 7f9649453f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abcea9a3c0 con 0x55abcea0d400 2024-09-13T23:58:49.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.627+0000 7f9647c0c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0d400 0x55abcecf2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.627+0000 7f9647c0c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0d400 0x55abcecf2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50938/0 (socket says 172.21.15.173:50938) 2024-09-13T23:58:49.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.627+0000 7f9647c0c700 1 -- 172.21.15.173:0/2191929272 learned_addr learned my addr 172.21.15.173:0/2191929272 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.627+0000 7f9647c0c700 1 -- 172.21.15.173:0/2191929272 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abcea1fa00 con 0x55abcea0d400 2024-09-13T23:58:49.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.627+0000 7f9647c0c700 1 --2- 172.21.15.173:0/2191929272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0d400 0x55abcecf2b00 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x55abcf7d7ef0 tx=0x55abceb11a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.631+0000 7f9644c06700 1 -- 172.21.15.173:0/2191929272 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55abceab18c0 con 0x55abcea0d400 2024-09-13T23:58:49.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.631+0000 7f9644c06700 1 -- 172.21.15.173:0/2191929272 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55abcead1c80 con 0x55abcea0d400 2024-09-13T23:58:49.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.631+0000 7f9649453f40 1 -- 172.21.15.173:0/2191929272 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55abcea1f860 con 0x55abcea0d400 2024-09-13T23:58:49.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.631+0000 7f9644c06700 1 -- 172.21.15.173:0/2191929272 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55abceab14a0 con 0x55abcea0d400 2024-09-13T23:58:49.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.631+0000 7f9649453f40 1 -- 172.21.15.173:0/2191929272 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55abcea1f6c0 con 0x55abcea0d400 2024-09-13T23:58:49.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.631+0000 7f9649453f40 1 Processor -- start 2024-09-13T23:58:49.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.631+0000 7f9649453f40 1 -- start start 2024-09-13T23:58:49.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.631+0000 7f9644c06700 1 -- 172.21.15.173:0/2191929272 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55abceb06b00 con 0x55abcea0d400 2024-09-13T23:58:49.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.631+0000 7f9649453f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0dc00 0x55abcecf3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.631+0000 7f9649453f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abcea9a000 con 0x55abcea0dc00 2024-09-13T23:58:49.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.631+0000 7f9644c06700 1 --2- 172.21.15.173:0/2191929272 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55abcedb8000 0x55abcecf4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.631+0000 7f964840d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0dc00 0x55abcecf3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.631+0000 7f9644c06700 1 -- 172.21.15.173:0/2191929272 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x55abcea73180 con 0x55abcea0d400 2024-09-13T23:58:49.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.631+0000 7f964840d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0dc00 0x55abcecf3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50942/0 (socket says 172.21.15.173:50942) 2024-09-13T23:58:49.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.631+0000 7f964840d700 1 -- 172.21.15.173:0/568337335 learned_addr learned my addr 172.21.15.173:0/568337335 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.631+0000 7f9647c0c700 1 --2- 172.21.15.173:0/2191929272 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55abcedb8000 0x55abcecf4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.631+0000 7f964840d700 1 -- 172.21.15.173:0/568337335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abcea1e000 con 0x55abcea0dc00 2024-09-13T23:58:49.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.631+0000 7f964840d700 1 --2- 172.21.15.173:0/568337335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0dc00 0x55abcecf3080 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x55abcf7d7fb0 tx=0x55abced6d200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987ae432f6742b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.631+0000 7f9647c0c700 1 --2- 172.21.15.173:0/2191929272 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55abcedb8000 0x55abcecf4100 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55abced24f30 tx=0x55abced6c240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.635+0000 7f9642401700 1 -- 172.21.15.173:0/568337335 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55abceab18c0 con 0x55abcea0dc00 2024-09-13T23:58:49.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.635+0000 7f9642401700 1 -- 172.21.15.173:0/568337335 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55abcedc4000 con 0x55abcea0dc00 2024-09-13T23:58:49.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.635+0000 7f9642401700 1 -- 172.21.15.173:0/568337335 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55abceab14a0 con 0x55abcea0dc00 2024-09-13T23:58:49.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.635+0000 7f9649453f40 1 -- 172.21.15.173:0/568337335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0dc00 msgr2=0x55abcecf3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.635+0000 7f9649453f40 1 --2- 172.21.15.173:0/568337335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0dc00 0x55abcecf3080 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x55abcf7d7fb0 tx=0x55abced6d200 comp rx=0 tx=0).stop 2024-09-13T23:58:49.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.635+0000 7f9649453f40 1 -- 172.21.15.173:0/568337335 shutdown_connections 2024-09-13T23:58:49.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.635+0000 7f9649453f40 1 --2- 172.21.15.173:0/568337335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0dc00 0x55abcecf3080 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.635+0000 7f9649453f40 1 -- 172.21.15.173:0/568337335 >> 172.21.15.173:0/568337335 conn(0x55abcea0d800 msgr2=0x55abceb0d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.635+0000 7f9649453f40 1 -- 172.21.15.173:0/568337335 shutdown_connections 2024-09-13T23:58:49.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.635+0000 7f9649453f40 1 -- 172.21.15.173:0/568337335 wait complete. 2024-09-13T23:58:49.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.635+0000 7f9649453f40 1 Processor -- start 2024-09-13T23:58:49.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.635+0000 7f9649453f40 1 -- start start 2024-09-13T23:58:49.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.635+0000 7f9649453f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0dc00 0x55abcecf3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.635+0000 7f9649453f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abcea32640 con 0x55abcea0dc00 2024-09-13T23:58:49.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.635+0000 7f964840d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0dc00 0x55abcecf3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.635+0000 7f964840d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0dc00 0x55abcecf3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50948/0 (socket says 172.21.15.173:50948) 2024-09-13T23:58:49.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.635+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 learned_addr learned my addr 172.21.15.173:0/3376033955 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.639+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abcea1eea0 con 0x55abcea0dc00 2024-09-13T23:58:49.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.639+0000 7f964840d700 1 --2- 172.21.15.173:0/3376033955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0dc00 0x55abcecf3080 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x55abcecede00 tx=0x55abceb11bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.639+0000 7f9640bfe700 1 -- 172.21.15.173:0/3376033955 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55abceab1b80 con 0x55abcea0dc00 2024-09-13T23:58:49.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.639+0000 7f9640bfe700 1 -- 172.21.15.173:0/3376033955 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55abcedc4180 con 0x55abcea0dc00 2024-09-13T23:58:49.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.639+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55abcea1e820 con 0x55abcea0dc00 2024-09-13T23:58:49.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.639+0000 7f9640bfe700 1 -- 172.21.15.173:0/3376033955 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55abceab18c0 con 0x55abcea0dc00 2024-09-13T23:58:49.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.639+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55abcea1e9c0 con 0x55abcea0dc00 2024-09-13T23:58:49.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.639+0000 7f9640bfe700 1 -- 172.21.15.173:0/3376033955 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55abceb06dc0 con 0x55abcea0dc00 2024-09-13T23:58:49.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.639+0000 7f9649453f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.639+0000 7f9640bfe700 1 --2- 172.21.15.173:0/3376033955 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55abcedb8c00 0x55abcecf4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.639+0000 7f9640bfe700 1 -- 172.21.15.173:0/3376033955 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x55abcea73340 con 0x55abcea0dc00 2024-09-13T23:58:49.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.643+0000 7f964740b700 1 --2- 172.21.15.173:0/3376033955 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55abcedb8c00 0x55abcecf4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.643+0000 7f9649453f40 1 --2- 172.21.15.173:0/3376033955 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55abcedb9000 0x55abcecf3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.643+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9400 con 0x55abcedb9000 2024-09-13T23:58:49.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.643+0000 7f964840d700 1 --2- 172.21.15.173:0/3376033955 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55abcedb9000 0x55abcecf3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.643+0000 7f964740b700 1 --2- 172.21.15.173:0/3376033955 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55abcedb8c00 0x55abcecf4680 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x55abceced920 tx=0x55abceb11800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.643+0000 7f964840d700 1 --2- 172.21.15.173:0/3376033955 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55abcedb9000 0x55abcecf3600 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.643+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55abcee62b40 con 0x55abcedb9000 2024-09-13T23:58:49.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.643+0000 7f9649453f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:49.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.643+0000 7f9649453f40 20 realm 2024-09-13T23:58:49.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.643+0000 7f9649453f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.643+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9000 2024-09-13T23:58:49.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.643+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55abcee62b40 con 0x55abcedb9000 2024-09-13T23:58:49.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.643+0000 7f9649453f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:49.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.643+0000 7f9649453f40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:58:49.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.643+0000 7f9649453f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.643+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9c00 con 0x55abcedb9000 2024-09-13T23:58:49.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.643+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55abcee62b40 con 0x55abcedb9000 2024-09-13T23:58:49.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.643+0000 7f9649453f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:49.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.643+0000 7f9649453f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.643+0000 7f9649453f40 1 --2- 172.21.15.173:0/3376033955 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55abcedb9400 0x55abcecf3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.643+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9400 2024-09-13T23:58:49.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.643+0000 7f9647c0c700 1 --2- 172.21.15.173:0/3376033955 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55abcedb9400 0x55abcecf3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.643+0000 7f9647c0c700 1 --2- 172.21.15.173:0/3376033955 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55abcedb9400 0x55abcecf3b80 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.647+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55abcee63200 con 0x55abcedb9400 2024-09-13T23:58:49.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.647+0000 7f9649453f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:49.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.647+0000 7f9649453f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.647+0000 7f9649453f40 1 --2- 172.21.15.173:0/3376033955 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55abcedb9c00 0x55abcecf4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.647+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee76000 con 0x55abcedb9c00 2024-09-13T23:58:49.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.647+0000 7f964740b700 1 --2- 172.21.15.173:0/3376033955 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55abcedb9c00 0x55abcecf4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.647+0000 7f964740b700 1 --2- 172.21.15.173:0/3376033955 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55abcedb9c00 0x55abcecf4c00 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.647+0000 7f964740b700 1 -- 172.21.15.173:0/3376033955 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x55abcee63440 con 0x55abcedb9c00 2024-09-13T23:58:49.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.647+0000 7f9649453f40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:58:49.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.647+0000 7f9649453f40 20 searching for the correct realm 2024-09-13T23:58:49.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.647+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee76400 con 0x55abcedb9c00 2024-09-13T23:58:49.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.647+0000 7f964740b700 1 -- 172.21.15.173:0/3376033955 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x55abcee63440 con 0x55abcedb9c00 2024-09-13T23:58:49.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.647+0000 7f964740b700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee76000 con 0x55abcedb9400 2024-09-13T23:58:49.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.647+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee63200 con 0x55abcedb9400 2024-09-13T23:58:49.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.647+0000 7f9647c0c700 1 --2- 172.21.15.173:0/3376033955 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55abcee76000 0x55abcecf2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.647+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcee76000 2024-09-13T23:58:49.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.647+0000 7f964840d700 1 --2- 172.21.15.173:0/3376033955 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55abcee76000 0x55abcecf2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.647+0000 7f964840d700 1 --2- 172.21.15.173:0/3376033955 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55abcee76000 0x55abcecf2580 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.647+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee62b40 con 0x55abcee76000 2024-09-13T23:58:49.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.647+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcee76000 2024-09-13T23:58:49.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.651+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 37 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x55abcee62b40 con 0x55abcee76000 2024-09-13T23:58:49.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.651+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9000 2024-09-13T23:58:49.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.651+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee62b40 con 0x55abcedb9000 2024-09-13T23:58:49.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.651+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9c00 2024-09-13T23:58:49.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.651+0000 7f964740b700 1 -- 172.21.15.173:0/3376033955 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee63440 con 0x55abcedb9c00 2024-09-13T23:58:49.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.651+0000 7f964740b700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9000 2024-09-13T23:58:49.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.651+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee62b40 con 0x55abcedb9000 2024-09-13T23:58:49.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.651+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9400 2024-09-13T23:58:49.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.651+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee63200 con 0x55abcedb9400 2024-09-13T23:58:49.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.651+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9400 2024-09-13T23:58:49.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.651+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee63200 con 0x55abcedb9400 2024-09-13T23:58:49.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.651+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9000 2024-09-13T23:58:49.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.651+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee62b40 con 0x55abcedb9000 2024-09-13T23:58:49.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.651+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcee76000 2024-09-13T23:58:49.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.651+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee62b40 con 0x55abcee76000 2024-09-13T23:58:49.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.651+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9000 2024-09-13T23:58:49.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.651+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee62b40 con 0x55abcedb9000 2024-09-13T23:58:49.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.651+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcee76000 2024-09-13T23:58:49.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.651+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee62b40 con 0x55abcee76000 2024-09-13T23:58:49.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.651+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9400 2024-09-13T23:58:49.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.655+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee63200 con 0x55abcedb9400 2024-09-13T23:58:49.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.655+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9c00 2024-09-13T23:58:49.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.655+0000 7f964740b700 1 -- 172.21.15.173:0/3376033955 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee63440 con 0x55abcedb9c00 2024-09-13T23:58:49.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.655+0000 7f964740b700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9000 2024-09-13T23:58:49.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.655+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee62b40 con 0x55abcedb9000 2024-09-13T23:58:49.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.655+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9400 2024-09-13T23:58:49.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.655+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee63200 con 0x55abcedb9400 2024-09-13T23:58:49.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.655+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9c00 2024-09-13T23:58:49.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.655+0000 7f964740b700 1 -- 172.21.15.173:0/3376033955 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee63440 con 0x55abcedb9c00 2024-09-13T23:58:49.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.655+0000 7f964740b700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9000 2024-09-13T23:58:49.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.655+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee62b40 con 0x55abcedb9000 2024-09-13T23:58:49.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.655+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9000 2024-09-13T23:58:49.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.655+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee62b40 con 0x55abcedb9000 2024-09-13T23:58:49.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.655+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9000 2024-09-13T23:58:49.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.655+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee62b40 con 0x55abcedb9000 2024-09-13T23:58:49.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.655+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9c00 2024-09-13T23:58:49.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.655+0000 7f964740b700 1 -- 172.21.15.173:0/3376033955 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee63440 con 0x55abcedb9c00 2024-09-13T23:58:49.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.655+0000 7f964740b700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcee76000 2024-09-13T23:58:49.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.659+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee62b40 con 0x55abcee76000 2024-09-13T23:58:49.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.659+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9000 2024-09-13T23:58:49.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.659+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee62b40 con 0x55abcedb9000 2024-09-13T23:58:49.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.659+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcee76000 2024-09-13T23:58:49.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.659+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee62b40 con 0x55abcee76000 2024-09-13T23:58:49.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.659+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9c00 2024-09-13T23:58:49.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.659+0000 7f964740b700 1 -- 172.21.15.173:0/3376033955 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee63440 con 0x55abcedb9c00 2024-09-13T23:58:49.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.659+0000 7f964740b700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcee76000 2024-09-13T23:58:49.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.659+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee62b40 con 0x55abcee76000 2024-09-13T23:58:49.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.659+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9400 2024-09-13T23:58:49.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.659+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee63200 con 0x55abcedb9400 2024-09-13T23:58:49.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.659+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9400 2024-09-13T23:58:49.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.659+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee63200 con 0x55abcedb9400 2024-09-13T23:58:49.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.659+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9c00 2024-09-13T23:58:49.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.659+0000 7f964740b700 1 -- 172.21.15.173:0/3376033955 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee63440 con 0x55abcedb9c00 2024-09-13T23:58:49.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.659+0000 7f964740b700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9400 2024-09-13T23:58:49.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.659+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x55abcee63200 con 0x55abcedb9400 2024-09-13T23:58:49.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.659+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9400 2024-09-13T23:58:49.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55abcee63200 con 0x55abcedb9400 2024-09-13T23:58:49.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:58:49.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:58:49.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:58:49.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:58:49.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee76800 con 0x55abcedb9000 2024-09-13T23:58:49.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55abcee62b40 con 0x55abcedb9000 2024-09-13T23:58:49.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:49.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee76c00 con 0x55abcedb9400 2024-09-13T23:58:49.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x55abcee63200 con 0x55abcedb9400 2024-09-13T23:58:49.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:49.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee77000 con 0x55abcee76000 2024-09-13T23:58:49.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x55abcee62b40 con 0x55abcee76000 2024-09-13T23:58:49.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:58:49.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 20 zone default found 2024-09-13T23:58:49.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 4 Realm: () 2024-09-13T23:58:49.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:58:49.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:58:49.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:58:49.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 20 zonegroup default 2024-09-13T23:58:49.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee77400 con 0x55abcee76000 2024-09-13T23:58:49.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x55abcee62b40 con 0x55abcee76000 2024-09-13T23:58:49.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:49.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee77800 con 0x55abcedb9c00 2024-09-13T23:58:49.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f964740b700 1 -- 172.21.15.173:0/3376033955 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55abcee63440 con 0x55abcedb9c00 2024-09-13T23:58:49.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:49.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee77c00 con 0x55abcedb9c00 2024-09-13T23:58:49.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.663+0000 7f964740b700 1 -- 172.21.15.173:0/3376033955 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x55abcee63440 con 0x55abcedb9c00 2024-09-13T23:58:49.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.667+0000 7f9649453f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:49.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.667+0000 7f9649453f40 20 started sync module instance, tier type = 2024-09-13T23:58:49.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.667+0000 7f9649453f40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:58:49.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.667+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee80000 con 0x55abcedb9400 2024-09-13T23:58:49.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.667+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v37'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55abcee63200 con 0x55abcedb9400 2024-09-13T23:58:49.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.667+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94196397415168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee80400 con 0x55abcedb9400 2024-09-13T23:58:49.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.667+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee80800 con 0x55abcedb9000 2024-09-13T23:58:49.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.671+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v37'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55abcee62b40 con 0x55abcedb9000 2024-09-13T23:58:49.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.671+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94196397416320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee80c00 con 0x55abcedb9000 2024-09-13T23:58:49.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.671+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 94196397415168] v37'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55abcee63200 con 0x55abcedb9400 2024-09-13T23:58:49.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.671+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee81000 con 0x55abcedb9400 2024-09-13T23:58:49.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.671+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 94196397416320] v37'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55abcee62b40 con 0x55abcedb9000 2024-09-13T23:58:49.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.671+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v37'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55abcee63200 con 0x55abcedb9400 2024-09-13T23:58:49.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.671+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94196397417472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee81400 con 0x55abcedb9400 2024-09-13T23:58:49.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.671+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee81800 con 0x55abcee76000 2024-09-13T23:58:49.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.675+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v37'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55abcee62b40 con 0x55abcee76000 2024-09-13T23:58:49.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.675+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94196397418624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee81c00 con 0x55abcee76000 2024-09-13T23:58:49.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.675+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee80800 con 0x55abcedb9400 2024-09-13T23:58:49.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.675+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94196397417472] v37'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55abcee63200 con 0x55abcedb9400 2024-09-13T23:58:49.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.675+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94196397418624] v37'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55abcee62b40 con 0x55abcee76000 2024-09-13T23:58:49.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.679+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v37'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55abcee63200 con 0x55abcedb9400 2024-09-13T23:58:49.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.679+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94196397419776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee80000 con 0x55abcedb9400 2024-09-13T23:58:49.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.679+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee80400 con 0x55abcedb9c00 2024-09-13T23:58:49.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.679+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 94196397419776] v37'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55abcee63200 con 0x55abcedb9400 2024-09-13T23:58:49.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.679+0000 7f964740b700 1 -- 172.21.15.173:0/3376033955 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v37'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55abcee63440 con 0x55abcedb9c00 2024-09-13T23:58:49.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.679+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94196397420928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee76800 con 0x55abcedb9c00 2024-09-13T23:58:49.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.679+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee77000 con 0x55abcedb9c00 2024-09-13T23:58:49.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.683+0000 7f964740b700 1 -- 172.21.15.173:0/3376033955 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v37'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55abcee63440 con 0x55abcedb9c00 2024-09-13T23:58:49.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.683+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94196397422080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee77400 con 0x55abcedb9c00 2024-09-13T23:58:49.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.683+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee76c00 con 0x55abcee76000 2024-09-13T23:58:49.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.683+0000 7f964740b700 1 -- 172.21.15.173:0/3376033955 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94196397420928] v37'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55abcee63440 con 0x55abcedb9c00 2024-09-13T23:58:49.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.683+0000 7f964740b700 1 -- 172.21.15.173:0/3376033955 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94196397422080] v37'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55abcee63440 con 0x55abcedb9c00 2024-09-13T23:58:49.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.683+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v37'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55abcee62b40 con 0x55abcee76000 2024-09-13T23:58:49.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.683+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94196397423232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcee76000 2024-09-13T23:58:49.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.683+0000 7f9649453f40 20 add_watcher() i=0 2024-09-13T23:58:49.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.683+0000 7f9649453f40 20 add_watcher() i=1 2024-09-13T23:58:49.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.683+0000 7f9649453f40 20 add_watcher() i=2 2024-09-13T23:58:49.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.683+0000 7f9649453f40 20 add_watcher() i=3 2024-09-13T23:58:49.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.683+0000 7f9649453f40 20 add_watcher() i=4 2024-09-13T23:58:49.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.683+0000 7f9649453f40 20 add_watcher() i=5 2024-09-13T23:58:49.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.683+0000 7f9649453f40 20 add_watcher() i=6 2024-09-13T23:58:49.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.687+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94196397423232] v37'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55abcee62b40 con 0x55abcee76000 2024-09-13T23:58:49.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.687+0000 7f9649453f40 20 add_watcher() i=7 2024-09-13T23:58:49.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.687+0000 7f9649453f40 2 all 8 watchers are set, enabling cache 2024-09-13T23:58:49.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.687+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee80c00 con 0x55abcedb9000 2024-09-13T23:58:49.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.687+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x55abcee62b40 con 0x55abcedb9000 2024-09-13T23:58:49.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.687+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94196399104000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee81800 con 0x55abcedb9000 2024-09-13T23:58:49.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.691+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94196399104000] v37'237 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55abcee62b40 con 0x55abcedb9000 2024-09-13T23:58:49.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.691+0000 7f962ebda700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:49.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.691+0000 7f9649453f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:58:49.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.691+0000 7f9649453f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:58:49.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.691+0000 7f9649453f40 1 Processor -- start 2024-09-13T23:58:49.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.691+0000 7f9649453f40 1 -- start start 2024-09-13T23:58:49.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.691+0000 7f9649453f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcee80400 0x55abcecf5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.691+0000 7f9649453f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abcea32780 con 0x55abcee80400 2024-09-13T23:58:49.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.691+0000 7f964740b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcee80400 0x55abcecf5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.691+0000 7f964740b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcee80400 0x55abcecf5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50954/0 (socket says 172.21.15.173:50954) 2024-09-13T23:58:49.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.691+0000 7f964740b700 1 -- 172.21.15.173:0/519440739 learned_addr learned my addr 172.21.15.173:0/519440739 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.691+0000 7f964740b700 1 -- 172.21.15.173:0/519440739 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abcea1eb60 con 0x55abcee80400 2024-09-13T23:58:49.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.691+0000 7f964740b700 1 --2- 172.21.15.173:0/519440739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcee80400 0x55abcecf5180 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x55abcee09230 tx=0x55abceb11980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb5ee149b6cf5be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.691+0000 7f962e3d9700 1 -- 172.21.15.173:0/519440739 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55abceab1760 con 0x55abcee80400 2024-09-13T23:58:49.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.691+0000 7f962e3d9700 1 -- 172.21.15.173:0/519440739 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55abcedc4600 con 0x55abcee80400 2024-09-13T23:58:49.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.691+0000 7f962e3d9700 1 -- 172.21.15.173:0/519440739 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55abcee96000 con 0x55abcee80400 2024-09-13T23:58:49.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.695+0000 7f9649453f40 1 -- 172.21.15.173:0/519440739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcee80400 msgr2=0x55abcecf5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.695+0000 7f9649453f40 1 --2- 172.21.15.173:0/519440739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcee80400 0x55abcecf5180 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x55abcee09230 tx=0x55abceb11980 comp rx=0 tx=0).stop 2024-09-13T23:58:49.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.695+0000 7f9649453f40 1 -- 172.21.15.173:0/519440739 shutdown_connections 2024-09-13T23:58:49.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.695+0000 7f9649453f40 1 --2- 172.21.15.173:0/519440739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcee80400 0x55abcecf5180 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.695+0000 7f9649453f40 1 -- 172.21.15.173:0/519440739 >> 172.21.15.173:0/519440739 conn(0x55abcee81c00 msgr2=0x55abceb0e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.695+0000 7f9649453f40 1 -- 172.21.15.173:0/519440739 shutdown_connections 2024-09-13T23:58:49.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.695+0000 7f9649453f40 1 -- 172.21.15.173:0/519440739 wait complete. 2024-09-13T23:58:49.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.695+0000 7f9649453f40 1 Processor -- start 2024-09-13T23:58:49.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.695+0000 7f9649453f40 1 -- start start 2024-09-13T23:58:49.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.695+0000 7f9649453f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcee80400 0x55abcecf5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.695+0000 7f9649453f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abcea9a000 con 0x55abcee80400 2024-09-13T23:58:49.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.695+0000 7f964740b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcee80400 0x55abcecf5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.695+0000 7f964740b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcee80400 0x55abcecf5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50964/0 (socket says 172.21.15.173:50964) 2024-09-13T23:58:49.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.695+0000 7f964740b700 1 -- 172.21.15.173:0/1830793042 learned_addr learned my addr 172.21.15.173:0/1830793042 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.695+0000 7f964740b700 1 -- 172.21.15.173:0/1830793042 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abcea1ed00 con 0x55abcee80400 2024-09-13T23:58:49.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.695+0000 7f964740b700 1 --2- 172.21.15.173:0/1830793042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcee80400 0x55abcecf5180 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x55abcee980c0 tx=0x55abcee20c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.695+0000 7f962cbd6700 1 -- 172.21.15.173:0/1830793042 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55abcee96160 con 0x55abcee80400 2024-09-13T23:58:49.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.695+0000 7f962cbd6700 1 -- 172.21.15.173:0/1830793042 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55abcedc4300 con 0x55abcee80400 2024-09-13T23:58:49.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.695+0000 7f962cbd6700 1 -- 172.21.15.173:0/1830793042 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55abcee962c0 con 0x55abcee80400 2024-09-13T23:58:49.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.695+0000 7f9649453f40 1 -- 172.21.15.173:0/1830793042 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55abcea1e340 con 0x55abcee80400 2024-09-13T23:58:49.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.695+0000 7f9649453f40 1 -- 172.21.15.173:0/1830793042 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55abcea1eb60 con 0x55abcee80400 2024-09-13T23:58:49.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.699+0000 7f962cbd6700 1 -- 172.21.15.173:0/1830793042 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55abceb07b80 con 0x55abcee80400 2024-09-13T23:58:49.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.699+0000 7f962cbd6700 1 --2- 172.21.15.173:0/1830793042 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55abcef10000 0x55abcef16000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.699+0000 7f962cbd6700 1 -- 172.21.15.173:0/1830793042 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x55abcea73500 con 0x55abcee80400 2024-09-13T23:58:49.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.699+0000 7f9649453f40 5 note: GC not initialized 2024-09-13T23:58:49.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.699+0000 7f964840d700 1 --2- 172.21.15.173:0/1830793042 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55abcef10000 0x55abcef16000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.699+0000 7f964840d700 1 --2- 172.21.15.173:0/1830793042 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55abcef10000 0x55abcef16000 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x55abcee09cb0 tx=0x55abcef28000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.703+0000 7f962a3d1700 20 reqs_thread_entry: start 2024-09-13T23:58:49.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.703+0000 7f9649453f40 20 init_complete bucket index max shards: 11 2024-09-13T23:58:49.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.703+0000 7f9649453f40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:58:49.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.703+0000 7f96283cd700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:59:19 2024 2024-09-13T23:58:49.706 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:58:49.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.703+0000 7f9649453f40 20 rados->read ofs=0 len=0 2024-09-13T23:58:49.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.703+0000 7f9627bab700 20 reqs_thread_entry: start 2024-09-13T23:58:49.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.703+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee77800 con 0x55abcedb9000 2024-09-13T23:58:49.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.703+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x55abcee62b40 con 0x55abcedb9000 2024-09-13T23:58:49.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.703+0000 7f9649453f40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:49.707 INFO:teuthology.orchestra.run.smithi173.stderr:could not fetch user info: no user info saved 2024-09-13T23:58:49.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.703+0000 7f962ebda700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:49.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.703+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94196399104000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcee77c00 con 0x55abcedb9000 2024-09-13T23:58:49.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.707+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94196399104000] v37'238 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x55abcee62b40 con 0x55abcedb9000 2024-09-13T23:58:49.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.707+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94196397415168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcedb9800 con 0x55abcedb9400 2024-09-13T23:58:49.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.707+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94196397415168] v37'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55abcee63200 con 0x55abcedb9400 2024-09-13T23:58:49.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.707+0000 7f9649453f40 20 remove_watcher() i=0 2024-09-13T23:58:49.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.707+0000 7f9649453f40 2 removed watcher, disabling cache 2024-09-13T23:58:49.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.707+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94196397416320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcef10400 con 0x55abcedb9000 2024-09-13T23:58:49.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.711+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94196397416320] v37'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55abcee62b40 con 0x55abcedb9000 2024-09-13T23:58:49.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.711+0000 7f9649453f40 20 remove_watcher() i=1 2024-09-13T23:58:49.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.711+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94196397417472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcef10800 con 0x55abcedb9400 2024-09-13T23:58:49.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.715+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94196397417472] v37'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55abcee63200 con 0x55abcedb9400 2024-09-13T23:58:49.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.715+0000 7f9649453f40 20 remove_watcher() i=2 2024-09-13T23:58:49.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.715+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94196397418624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcef10c00 con 0x55abcee76000 2024-09-13T23:58:49.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.715+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94196397418624] v37'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55abcee62b40 con 0x55abcee76000 2024-09-13T23:58:49.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.715+0000 7f9649453f40 20 remove_watcher() i=3 2024-09-13T23:58:49.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.715+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94196397419776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcef11000 con 0x55abcedb9400 2024-09-13T23:58:49.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.719+0000 7f9647c0c700 1 -- 172.21.15.173:0/3376033955 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94196397419776] v37'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55abcee63200 con 0x55abcedb9400 2024-09-13T23:58:49.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.719+0000 7f9649453f40 20 remove_watcher() i=4 2024-09-13T23:58:49.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.719+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94196397420928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcef11400 con 0x55abcedb9c00 2024-09-13T23:58:49.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.719+0000 7f964740b700 1 -- 172.21.15.173:0/3376033955 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94196397420928] v37'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55abcee63440 con 0x55abcedb9c00 2024-09-13T23:58:49.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.719+0000 7f9649453f40 20 remove_watcher() i=5 2024-09-13T23:58:49.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.719+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94196397422080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcef11800 con 0x55abcedb9c00 2024-09-13T23:58:49.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.723+0000 7f964740b700 1 -- 172.21.15.173:0/3376033955 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94196397422080] v37'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55abcee63440 con 0x55abcedb9c00 2024-09-13T23:58:49.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.723+0000 7f9649453f40 20 remove_watcher() i=6 2024-09-13T23:58:49.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.723+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94196397423232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55abcef11c00 con 0x55abcee76000 2024-09-13T23:58:49.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.723+0000 7f964840d700 1 -- 172.21.15.173:0/3376033955 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94196397423232] v37'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x55abcee62b40 con 0x55abcee76000 2024-09-13T23:58:49.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.723+0000 7f9649453f40 20 remove_watcher() i=7 2024-09-13T23:58:49.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.723+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55abcedb9400 msgr2=0x55abcecf3b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.723+0000 7f9649453f40 1 --2- 172.21.15.173:0/3376033955 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55abcedb9400 0x55abcecf3b80 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.723+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55abcedb9000 msgr2=0x55abcecf3600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.723+0000 7f9649453f40 1 --2- 172.21.15.173:0/3376033955 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55abcedb9000 0x55abcecf3600 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.723+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55abcee76000 msgr2=0x55abcecf2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.723+0000 7f9649453f40 1 --2- 172.21.15.173:0/3376033955 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x55abcee76000 0x55abcecf2580 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.723+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55abcedb9c00 msgr2=0x55abcecf4c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.723+0000 7f9649453f40 1 --2- 172.21.15.173:0/3376033955 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55abcedb9c00 0x55abcecf4c00 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.723+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55abcedb8c00 msgr2=0x55abcecf4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.723+0000 7f9649453f40 1 --2- 172.21.15.173:0/3376033955 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55abcedb8c00 0x55abcecf4680 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x55abceced920 tx=0x55abceb11800 comp rx=0 tx=0).stop 2024-09-13T23:58:49.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.723+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0dc00 msgr2=0x55abcecf3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.723+0000 7f9649453f40 1 --2- 172.21.15.173:0/3376033955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0dc00 0x55abcecf3080 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x55abcecede00 tx=0x55abceb11bc0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.723+0000 7f964740b700 1 -- 172.21.15.173:0/3376033955 reap_dead start 2024-09-13T23:58:49.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.723+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 shutdown_connections 2024-09-13T23:58:49.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.723+0000 7f9649453f40 1 --2- 172.21.15.173:0/3376033955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0dc00 0x55abcecf3080 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.723+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 >> 172.21.15.173:0/3376033955 conn(0x55abcea0d800 msgr2=0x55abceb0d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.723+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 shutdown_connections 2024-09-13T23:58:49.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.723+0000 7f9649453f40 1 -- 172.21.15.173:0/3376033955 wait complete. 2024-09-13T23:58:49.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.727+0000 7f9649453f40 1 -- 172.21.15.173:0/1830793042 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55abcef10000 msgr2=0x55abcef16000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.727+0000 7f9649453f40 1 --2- 172.21.15.173:0/1830793042 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55abcef10000 0x55abcef16000 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x55abcee09cb0 tx=0x55abcef28000 comp rx=0 tx=0).stop 2024-09-13T23:58:49.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.727+0000 7f9649453f40 1 -- 172.21.15.173:0/1830793042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcee80400 msgr2=0x55abcecf5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.727+0000 7f9649453f40 1 --2- 172.21.15.173:0/1830793042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcee80400 0x55abcecf5180 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x55abcee980c0 tx=0x55abcee20c00 comp rx=0 tx=0).stop 2024-09-13T23:58:49.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.727+0000 7f9649453f40 1 -- 172.21.15.173:0/1830793042 shutdown_connections 2024-09-13T23:58:49.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.727+0000 7f9649453f40 1 --2- 172.21.15.173:0/1830793042 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55abcef10000 0x55abcef16000 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.727+0000 7f9649453f40 1 --2- 172.21.15.173:0/1830793042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcee80400 0x55abcecf5180 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.727+0000 7f9649453f40 1 -- 172.21.15.173:0/1830793042 >> 172.21.15.173:0/1830793042 conn(0x55abcee81c00 msgr2=0x55abceb0e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.727+0000 7f9649453f40 1 -- 172.21.15.173:0/1830793042 shutdown_connections 2024-09-13T23:58:49.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.727+0000 7f9649453f40 1 -- 172.21.15.173:0/1830793042 wait complete. 2024-09-13T23:58:49.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.727+0000 7f9649453f40 1 -- 172.21.15.173:0/2191929272 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55abcedb8000 msgr2=0x55abcecf4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.727+0000 7f9649453f40 1 --2- 172.21.15.173:0/2191929272 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55abcedb8000 0x55abcecf4100 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55abced24f30 tx=0x55abced6c240 comp rx=0 tx=0).stop 2024-09-13T23:58:49.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.727+0000 7f9649453f40 1 -- 172.21.15.173:0/2191929272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0d400 msgr2=0x55abcecf2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.727+0000 7f9649453f40 1 --2- 172.21.15.173:0/2191929272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0d400 0x55abcecf2b00 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x55abcf7d7ef0 tx=0x55abceb11a40 comp rx=0 tx=0).stop 2024-09-13T23:58:49.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.727+0000 7f9649453f40 1 -- 172.21.15.173:0/2191929272 shutdown_connections 2024-09-13T23:58:49.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.727+0000 7f9649453f40 1 --2- 172.21.15.173:0/2191929272 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55abcedb8000 0x55abcecf4100 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.727+0000 7f9649453f40 1 --2- 172.21.15.173:0/2191929272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55abcea0d400 0x55abcecf2b00 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.727+0000 7f9649453f40 1 -- 172.21.15.173:0/2191929272 >> 172.21.15.173:0/2191929272 conn(0x55abcea0cc00 msgr2=0x55abceb0d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.727+0000 7f9649453f40 1 -- 172.21.15.173:0/2191929272 shutdown_connections 2024-09-13T23:58:49.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.727+0000 7f9649453f40 1 -- 172.21.15.173:0/2191929272 wait complete. 2024-09-13T23:58:49.735 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-13T23:58:49.736 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-13T23:58:49.736 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-13T23:58:49.736 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-13T23:58:49.818 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:58:49.819 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:58:49.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.815+0000 7faf64c45f40 1 Processor -- start 2024-09-13T23:58:49.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.815+0000 7faf64c45f40 1 -- start start 2024-09-13T23:58:49.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.815+0000 7faf64c45f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x558d01051400 0x558d01336580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.815+0000 7faf64c45f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558d01115500 con 0x558d01051000 2024-09-13T23:58:49.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.815+0000 7faf64c45f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x558d010dea00 con 0x558d01051400 2024-09-13T23:58:49.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.815+0000 7faf62bfd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x558d01051400 0x558d01336580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.815+0000 7faf633fe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x558d01051000 0x558d01150800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:53594/0 (socket says 172.21.15.173:53594) 2024-09-13T23:58:49.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.815+0000 7faf62bfd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x558d01051400 0x558d01336580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50968/0 (socket says 172.21.15.173:50968) 2024-09-13T23:58:49.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.815+0000 7faf62bfd700 1 -- 172.21.15.173:0/3977558639 learned_addr learned my addr 172.21.15.173:0/3977558639 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.815+0000 7faf62bfd700 1 -- 172.21.15.173:0/3977558639 >> v1:172.21.15.87:6789/0 conn(0x558d01051000 legacy=0x558d01150800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.815+0000 7faf62bfd700 1 -- 172.21.15.173:0/3977558639 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d01063d40 con 0x558d01051400 2024-09-13T23:58:49.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.819+0000 7faf62bfd700 1 --2- 172.21.15.173:0/3977558639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051400 0x558d01336580 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x558d01331920 tx=0x558d01155920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5747cdd6f917e546 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.819+0000 7faf623fc700 1 -- 172.21.15.173:0/3977558639 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558d010f54a0 con 0x558d01051400 2024-09-13T23:58:49.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.819+0000 7faf623fc700 1 -- 172.21.15.173:0/3977558639 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558d01115800 con 0x558d01051400 2024-09-13T23:58:49.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.819+0000 7faf623fc700 1 -- 172.21.15.173:0/3977558639 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558d010f5600 con 0x558d01051400 2024-09-13T23:58:49.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.819+0000 7faf64c45f40 1 -- 172.21.15.173:0/3977558639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051400 msgr2=0x558d01336580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.819+0000 7faf64c45f40 1 --2- 172.21.15.173:0/3977558639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051400 0x558d01336580 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x558d01331920 tx=0x558d01155920 comp rx=0 tx=0).stop 2024-09-13T23:58:49.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.819+0000 7faf64c45f40 1 -- 172.21.15.173:0/3977558639 shutdown_connections 2024-09-13T23:58:49.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.819+0000 7faf64c45f40 1 --2- 172.21.15.173:0/3977558639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051400 0x558d01336580 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.819+0000 7faf64c45f40 1 -- 172.21.15.173:0/3977558639 >> 172.21.15.173:0/3977558639 conn(0x558d01050c00 msgr2=0x558d01150000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.819+0000 7faf64c45f40 1 -- 172.21.15.173:0/3977558639 shutdown_connections 2024-09-13T23:58:49.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.819+0000 7faf64c45f40 1 -- 172.21.15.173:0/3977558639 wait complete. 2024-09-13T23:58:49.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.819+0000 7faf64c45f40 1 Processor -- start 2024-09-13T23:58:49.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.819+0000 7faf64c45f40 1 -- start start 2024-09-13T23:58:49.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.819+0000 7faf64c45f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051000 0x558d01336580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.819+0000 7faf64c45f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d010de500 con 0x558d01051000 2024-09-13T23:58:49.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.819+0000 7faf633fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051000 0x558d01336580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.819+0000 7faf633fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051000 0x558d01336580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50972/0 (socket says 172.21.15.173:50972) 2024-09-13T23:58:49.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.819+0000 7faf633fe700 1 -- 172.21.15.173:0/891591488 learned_addr learned my addr 172.21.15.173:0/891591488 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.819+0000 7faf633fe700 1 -- 172.21.15.173:0/891591488 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d01063ba0 con 0x558d01051000 2024-09-13T23:58:49.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.819+0000 7faf633fe700 1 --2- 172.21.15.173:0/891591488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051000 0x558d01336580 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x558d011ade90 tx=0x558d01155b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8d340dc275fe0d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.819+0000 7faf61bfb700 1 -- 172.21.15.173:0/891591488 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558d010f51e0 con 0x558d01051000 2024-09-13T23:58:49.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.823+0000 7faf61bfb700 1 -- 172.21.15.173:0/891591488 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558d01115b00 con 0x558d01051000 2024-09-13T23:58:49.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.823+0000 7faf61bfb700 1 -- 172.21.15.173:0/891591488 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558d010f54a0 con 0x558d01051000 2024-09-13T23:58:49.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.823+0000 7faf64c45f40 1 -- 172.21.15.173:0/891591488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051000 msgr2=0x558d01336580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.823+0000 7faf64c45f40 1 --2- 172.21.15.173:0/891591488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051000 0x558d01336580 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x558d011ade90 tx=0x558d01155b60 comp rx=0 tx=0).stop 2024-09-13T23:58:49.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.823+0000 7faf64c45f40 1 -- 172.21.15.173:0/891591488 shutdown_connections 2024-09-13T23:58:49.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.823+0000 7faf64c45f40 1 --2- 172.21.15.173:0/891591488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051000 0x558d01336580 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.823+0000 7faf64c45f40 1 -- 172.21.15.173:0/891591488 >> 172.21.15.173:0/891591488 conn(0x558d01050c00 msgr2=0x558d01151000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.823+0000 7faf64c45f40 1 -- 172.21.15.173:0/891591488 shutdown_connections 2024-09-13T23:58:49.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.823+0000 7faf64c45f40 1 -- 172.21.15.173:0/891591488 wait complete. 2024-09-13T23:58:49.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.823+0000 7faf64c45f40 1 Processor -- start 2024-09-13T23:58:49.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.823+0000 7faf64c45f40 1 -- start start 2024-09-13T23:58:49.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.823+0000 7faf64c45f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051000 0x558d01336580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.823+0000 7faf64c45f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d010de3c0 con 0x558d01051000 2024-09-13T23:58:49.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.823+0000 7faf633fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051000 0x558d01336580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.823+0000 7faf633fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051000 0x558d01336580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50974/0 (socket says 172.21.15.173:50974) 2024-09-13T23:58:49.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.823+0000 7faf633fe700 1 -- 172.21.15.173:0/1080665112 learned_addr learned my addr 172.21.15.173:0/1080665112 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.827+0000 7faf633fe700 1 -- 172.21.15.173:0/1080665112 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d01063a00 con 0x558d01051000 2024-09-13T23:58:49.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.827+0000 7faf633fe700 1 --2- 172.21.15.173:0/1080665112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051000 0x558d01336580 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x558d01ec40f0 tx=0x558d01155a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.827+0000 7faf603f8700 1 -- 172.21.15.173:0/1080665112 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558d010f5600 con 0x558d01051000 2024-09-13T23:58:49.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.827+0000 7faf603f8700 1 -- 172.21.15.173:0/1080665112 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558d01115c80 con 0x558d01051000 2024-09-13T23:58:49.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.827+0000 7faf64c45f40 1 -- 172.21.15.173:0/1080665112 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558d01063860 con 0x558d01051000 2024-09-13T23:58:49.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.827+0000 7faf603f8700 1 -- 172.21.15.173:0/1080665112 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558d010f51e0 con 0x558d01051000 2024-09-13T23:58:49.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.827+0000 7faf64c45f40 1 -- 172.21.15.173:0/1080665112 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d010636c0 con 0x558d01051000 2024-09-13T23:58:49.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.827+0000 7faf64c45f40 1 Processor -- start 2024-09-13T23:58:49.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.827+0000 7faf64c45f40 1 -- start start 2024-09-13T23:58:49.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.827+0000 7faf603f8700 1 -- 172.21.15.173:0/1080665112 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x558d0114ab00 con 0x558d01051000 2024-09-13T23:58:49.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.827+0000 7faf64c45f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051800 0x558d01336b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.827+0000 7faf64c45f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d010de000 con 0x558d01051800 2024-09-13T23:58:49.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.827+0000 7faf603f8700 1 --2- 172.21.15.173:0/1080665112 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558d01402000 0x558d01337080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.827+0000 7faf603f8700 1 -- 172.21.15.173:0/1080665112 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x558d010b7180 con 0x558d01051000 2024-09-13T23:58:49.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.827+0000 7faf63bff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051800 0x558d01336b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.827+0000 7faf633fe700 1 --2- 172.21.15.173:0/1080665112 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558d01402000 0x558d01337080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.827+0000 7faf63bff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051800 0x558d01336b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:50990/0 (socket says 172.21.15.173:50990) 2024-09-13T23:58:49.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.827+0000 7faf63bff700 1 -- 172.21.15.173:0/3348393362 learned_addr learned my addr 172.21.15.173:0/3348393362 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.827+0000 7faf63bff700 1 -- 172.21.15.173:0/3348393362 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d01062000 con 0x558d01051800 2024-09-13T23:58:49.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.831+0000 7faf633fe700 1 --2- 172.21.15.173:0/1080665112 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558d01402000 0x558d01337080 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x558d01ec43f0 tx=0x558d013ba240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.831+0000 7faf63bff700 1 --2- 172.21.15.173:0/3348393362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051800 0x558d01336b00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x558d01ec4930 tx=0x558d013bb500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd05701f0bf8bc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.831+0000 7faf5dbf3700 1 -- 172.21.15.173:0/3348393362 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558d010f5600 con 0x558d01051800 2024-09-13T23:58:49.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.831+0000 7faf5dbf3700 1 -- 172.21.15.173:0/3348393362 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558d01416000 con 0x558d01051800 2024-09-13T23:58:49.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.831+0000 7faf5dbf3700 1 -- 172.21.15.173:0/3348393362 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558d010f51e0 con 0x558d01051800 2024-09-13T23:58:49.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.831+0000 7faf64c45f40 1 -- 172.21.15.173:0/3348393362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051800 msgr2=0x558d01336b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.831+0000 7faf64c45f40 1 --2- 172.21.15.173:0/3348393362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051800 0x558d01336b00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x558d01ec4930 tx=0x558d013bb500 comp rx=0 tx=0).stop 2024-09-13T23:58:49.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.831+0000 7faf64c45f40 1 -- 172.21.15.173:0/3348393362 shutdown_connections 2024-09-13T23:58:49.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.831+0000 7faf64c45f40 1 --2- 172.21.15.173:0/3348393362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051800 0x558d01336b00 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.831+0000 7faf64c45f40 1 -- 172.21.15.173:0/3348393362 >> 172.21.15.173:0/3348393362 conn(0x558d01051400 msgr2=0x558d01151800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.831+0000 7faf64c45f40 1 -- 172.21.15.173:0/3348393362 shutdown_connections 2024-09-13T23:58:49.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.831+0000 7faf64c45f40 1 -- 172.21.15.173:0/3348393362 wait complete. 2024-09-13T23:58:49.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.831+0000 7faf64c45f40 1 Processor -- start 2024-09-13T23:58:49.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.831+0000 7faf64c45f40 1 -- start start 2024-09-13T23:58:49.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.831+0000 7faf64c45f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051800 0x558d01336b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.831+0000 7faf64c45f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d01076640 con 0x558d01051800 2024-09-13T23:58:49.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.831+0000 7faf63bff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051800 0x558d01336b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.831+0000 7faf63bff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051800 0x558d01336b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51002/0 (socket says 172.21.15.173:51002) 2024-09-13T23:58:49.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.831+0000 7faf63bff700 1 -- 172.21.15.173:0/3331275460 learned_addr learned my addr 172.21.15.173:0/3331275460 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.831+0000 7faf63bff700 1 -- 172.21.15.173:0/3331275460 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d01062ea0 con 0x558d01051800 2024-09-13T23:58:49.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.831+0000 7faf63bff700 1 --2- 172.21.15.173:0/3331275460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051800 0x558d01336b00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x558d01ec45d0 tx=0x558d013bb0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.835+0000 7faf5c3f0700 1 -- 172.21.15.173:0/3331275460 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558d010f5a20 con 0x558d01051800 2024-09-13T23:58:49.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.835+0000 7faf64c45f40 1 -- 172.21.15.173:0/3331275460 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558d01062820 con 0x558d01051800 2024-09-13T23:58:49.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.835+0000 7faf5c3f0700 1 -- 172.21.15.173:0/3331275460 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558d01416180 con 0x558d01051800 2024-09-13T23:58:49.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.835+0000 7faf5c3f0700 1 -- 172.21.15.173:0/3331275460 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558d010f5600 con 0x558d01051800 2024-09-13T23:58:49.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.835+0000 7faf64c45f40 1 -- 172.21.15.173:0/3331275460 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d010629c0 con 0x558d01051800 2024-09-13T23:58:49.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.835+0000 7faf5c3f0700 1 -- 172.21.15.173:0/3331275460 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x558d0114adc0 con 0x558d01051800 2024-09-13T23:58:49.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.835+0000 7faf5c3f0700 1 --2- 172.21.15.173:0/3331275460 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558d01402c00 0x558d01337600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.835+0000 7faf5c3f0700 1 -- 172.21.15.173:0/3331275460 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x558d010b7340 con 0x558d01051800 2024-09-13T23:58:49.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.835+0000 7faf62bfd700 1 --2- 172.21.15.173:0/3331275460 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558d01402c00 0x558d01337600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.835+0000 7faf64c45f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:58:49.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.835+0000 7faf64c45f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:58:49.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.835+0000 7faf64c45f40 1 Processor -- start 2024-09-13T23:58:49.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.835+0000 7faf62bfd700 1 --2- 172.21.15.173:0/3331275460 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558d01402c00 0x558d01337600 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x558d01331920 tx=0x558d01155800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.835+0000 7faf64c45f40 1 -- start start 2024-09-13T23:58:49.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.835+0000 7faf64c45f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01403400 0x558d01337b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.835+0000 7faf64c45f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d010768c0 con 0x558d01403400 2024-09-13T23:58:49.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.839+0000 7faf633fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01403400 0x558d01337b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.839+0000 7faf633fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01403400 0x558d01337b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51010/0 (socket says 172.21.15.173:51010) 2024-09-13T23:58:49.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.839+0000 7faf633fe700 1 -- 172.21.15.173:0/2477729199 learned_addr learned my addr 172.21.15.173:0/2477729199 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.839+0000 7faf633fe700 1 -- 172.21.15.173:0/2477729199 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d01062b60 con 0x558d01403400 2024-09-13T23:58:49.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.839+0000 7faf633fe700 1 --2- 172.21.15.173:0/2477729199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01403400 0x558d01337b80 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x558d01ec4240 tx=0x558d013bb3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6fc07667ccb1c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.839+0000 7faf4a3cc700 1 -- 172.21.15.173:0/2477729199 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558d010f54a0 con 0x558d01403400 2024-09-13T23:58:49.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.839+0000 7faf4a3cc700 1 -- 172.21.15.173:0/2477729199 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558d01416600 con 0x558d01403400 2024-09-13T23:58:49.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.839+0000 7faf4a3cc700 1 -- 172.21.15.173:0/2477729199 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558d010f58c0 con 0x558d01403400 2024-09-13T23:58:49.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.839+0000 7faf64c45f40 1 -- 172.21.15.173:0/2477729199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01403400 msgr2=0x558d01337b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.839+0000 7faf64c45f40 1 --2- 172.21.15.173:0/2477729199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01403400 0x558d01337b80 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x558d01ec4240 tx=0x558d013bb3e0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.839+0000 7faf64c45f40 1 -- 172.21.15.173:0/2477729199 shutdown_connections 2024-09-13T23:58:49.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.839+0000 7faf64c45f40 1 --2- 172.21.15.173:0/2477729199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01403400 0x558d01337b80 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.839+0000 7faf64c45f40 1 -- 172.21.15.173:0/2477729199 >> 172.21.15.173:0/2477729199 conn(0x558d01403000 msgr2=0x558d01152000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.839+0000 7faf64c45f40 1 -- 172.21.15.173:0/2477729199 shutdown_connections 2024-09-13T23:58:49.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.839+0000 7faf64c45f40 1 -- 172.21.15.173:0/2477729199 wait complete. 2024-09-13T23:58:49.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.839+0000 7faf64c45f40 1 Processor -- start 2024-09-13T23:58:49.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.839+0000 7faf64c45f40 1 -- start start 2024-09-13T23:58:49.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.839+0000 7faf64c45f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01403400 0x558d01337b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.839+0000 7faf64c45f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d01076f00 con 0x558d01403400 2024-09-13T23:58:49.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.839+0000 7faf633fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01403400 0x558d01337b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.839+0000 7faf633fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01403400 0x558d01337b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51024/0 (socket says 172.21.15.173:51024) 2024-09-13T23:58:49.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.839+0000 7faf633fe700 1 -- 172.21.15.173:0/2601087935 learned_addr learned my addr 172.21.15.173:0/2601087935 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.843+0000 7faf633fe700 1 -- 172.21.15.173:0/2601087935 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d01062d00 con 0x558d01403400 2024-09-13T23:58:49.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.843+0000 7faf633fe700 1 --2- 172.21.15.173:0/2601087935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01403400 0x558d01337b80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x558d013e52c0 tx=0x558d013ba1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.843+0000 7faf48bc9700 1 -- 172.21.15.173:0/2601087935 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558d010f54a0 con 0x558d01403400 2024-09-13T23:58:49.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.843+0000 7faf48bc9700 1 -- 172.21.15.173:0/2601087935 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558d01416300 con 0x558d01403400 2024-09-13T23:58:49.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.843+0000 7faf64c45f40 1 -- 172.21.15.173:0/2601087935 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558d01062340 con 0x558d01403400 2024-09-13T23:58:49.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.843+0000 7faf48bc9700 1 -- 172.21.15.173:0/2601087935 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x558d010f58c0 con 0x558d01403400 2024-09-13T23:58:49.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.843+0000 7faf64c45f40 1 -- 172.21.15.173:0/2601087935 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d014c4000 con 0x558d01403400 2024-09-13T23:58:49.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.843+0000 7faf48bc9700 1 -- 172.21.15.173:0/2601087935 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x558d0114bb80 con 0x558d01403400 2024-09-13T23:58:49.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.843+0000 7faf48bc9700 1 --2- 172.21.15.173:0/2601087935 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558d014c3c00 0x558d01338c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.843+0000 7faf48bc9700 1 -- 172.21.15.173:0/2601087935 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x558d010b7500 con 0x558d01403400 2024-09-13T23:58:49.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.843+0000 7faf62bfd700 1 --2- 172.21.15.173:0/2601087935 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558d014c3c00 0x558d01338c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.843+0000 7faf64c45f40 1 --2- 172.21.15.173:0/1080665112 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558d014c2800 0x558d01338100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.843+0000 7faf46bc5700 20 reqs_thread_entry: start 2024-09-13T23:58:49.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.843+0000 7faf64c45f40 1 -- 172.21.15.173:0/1080665112 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x558d014c2c00 con 0x558d014c2800 2024-09-13T23:58:49.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.843+0000 7faf62bfd700 1 --2- 172.21.15.173:0/2601087935 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558d014c3c00 0x558d01338c00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x558d01330de0 tx=0x558d01155860 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.847+0000 7faf63bff700 1 --2- 172.21.15.173:0/1080665112 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558d014c2800 0x558d01338100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.847+0000 7faf63bff700 1 --2- 172.21.15.173:0/1080665112 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558d014c2800 0x558d01338100 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.847+0000 7faf63bff700 1 -- 172.21.15.173:0/1080665112 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x558d0152c240 con 0x558d014c2800 2024-09-13T23:58:49.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.847+0000 7faf64c45f40 1 --2- 172.21.15.173:0/1080665112 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558d014c3000 0x558d01338680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.847+0000 7faf64c45f40 1 -- 172.21.15.173:0/1080665112 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:2 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x558d014c3400 con 0x558d014c3000 2024-09-13T23:58:49.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.847+0000 7faf633fe700 1 --2- 172.21.15.173:0/1080665112 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558d014c3000 0x558d01338680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.847+0000 7faf633fe700 1 --2- 172.21.15.173:0/1080665112 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558d014c3000 0x558d01338680 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.847+0000 7faf633fe700 1 -- 172.21.15.173:0/1080665112 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(2 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x558d0152c480 con 0x558d014c3000 2024-09-13T23:58:49.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 -- 172.21.15.173:0/3331275460 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558d01402c00 msgr2=0x558d01337600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 --2- 172.21.15.173:0/3331275460 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558d01402c00 0x558d01337600 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x558d01331920 tx=0x558d01155800 comp rx=0 tx=0).stop 2024-09-13T23:58:49.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 -- 172.21.15.173:0/3331275460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051800 msgr2=0x558d01336b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 --2- 172.21.15.173:0/3331275460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051800 0x558d01336b00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x558d01ec45d0 tx=0x558d013bb0e0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 -- 172.21.15.173:0/3331275460 shutdown_connections 2024-09-13T23:58:49.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 --2- 172.21.15.173:0/3331275460 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558d01402c00 0x558d01337600 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 --2- 172.21.15.173:0/3331275460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051800 0x558d01336b00 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 -- 172.21.15.173:0/3331275460 >> 172.21.15.173:0/3331275460 conn(0x558d01051400 msgr2=0x558d01151800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 -- 172.21.15.173:0/3331275460 shutdown_connections 2024-09-13T23:58:49.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 -- 172.21.15.173:0/3331275460 wait complete. 2024-09-13T23:58:49.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 -- 172.21.15.173:0/2601087935 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558d014c3c00 msgr2=0x558d01338c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 --2- 172.21.15.173:0/2601087935 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558d014c3c00 0x558d01338c00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x558d01330de0 tx=0x558d01155860 comp rx=0 tx=0).stop 2024-09-13T23:58:49.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 -- 172.21.15.173:0/2601087935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01403400 msgr2=0x558d01337b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 --2- 172.21.15.173:0/2601087935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01403400 0x558d01337b80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x558d013e52c0 tx=0x558d013ba1e0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 -- 172.21.15.173:0/2601087935 shutdown_connections 2024-09-13T23:58:49.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 --2- 172.21.15.173:0/2601087935 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558d014c3c00 0x558d01338c00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 --2- 172.21.15.173:0/2601087935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01403400 0x558d01337b80 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 -- 172.21.15.173:0/2601087935 >> 172.21.15.173:0/2601087935 conn(0x558d01403000 msgr2=0x558d01152000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 -- 172.21.15.173:0/2601087935 shutdown_connections 2024-09-13T23:58:49.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 -- 172.21.15.173:0/2601087935 wait complete. 2024-09-13T23:58:49.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 -- 172.21.15.173:0/1080665112 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558d014c2800 msgr2=0x558d01338100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 --2- 172.21.15.173:0/1080665112 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558d014c2800 0x558d01338100 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 -- 172.21.15.173:0/1080665112 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558d014c3000 msgr2=0x558d01338680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 --2- 172.21.15.173:0/1080665112 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558d014c3000 0x558d01338680 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 -- 172.21.15.173:0/1080665112 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558d01402000 msgr2=0x558d01337080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 --2- 172.21.15.173:0/1080665112 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558d01402000 0x558d01337080 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x558d01ec43f0 tx=0x558d013ba240 comp rx=0 tx=0).stop 2024-09-13T23:58:49.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 -- 172.21.15.173:0/1080665112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051000 msgr2=0x558d01336580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 --2- 172.21.15.173:0/1080665112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051000 0x558d01336580 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x558d01ec40f0 tx=0x558d01155a40 comp rx=0 tx=0).stop 2024-09-13T23:58:49.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 -- 172.21.15.173:0/1080665112 shutdown_connections 2024-09-13T23:58:49.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 --2- 172.21.15.173:0/1080665112 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x558d014c3000 0x558d01338680 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 --2- 172.21.15.173:0/1080665112 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x558d014c2800 0x558d01338100 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 --2- 172.21.15.173:0/1080665112 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x558d01402000 0x558d01337080 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 --2- 172.21.15.173:0/1080665112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x558d01051000 0x558d01336580 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 -- 172.21.15.173:0/1080665112 >> 172.21.15.173:0/1080665112 conn(0x558d01050c00 msgr2=0x558d01151000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 -- 172.21.15.173:0/1080665112 shutdown_connections 2024-09-13T23:58:49.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.851+0000 7faf64c45f40 1 -- 172.21.15.173:0/1080665112 wait complete. 2024-09-13T23:58:49.859 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:58:49.859 INFO:teuthology.orchestra.run.smithi173.stdout: "id": "d342d0db-d035-4a54-bae7-2e0f76db6818", 2024-09-13T23:58:49.859 INFO:teuthology.orchestra.run.smithi173.stdout: "name": "default", 2024-09-13T23:58:49.859 INFO:teuthology.orchestra.run.smithi173.stdout: "domain_root": "default.rgw.meta:root", 2024-09-13T23:58:49.859 INFO:teuthology.orchestra.run.smithi173.stdout: "control_pool": "default.rgw.control", 2024-09-13T23:58:49.859 INFO:teuthology.orchestra.run.smithi173.stdout: "gc_pool": "default.rgw.log:gc", 2024-09-13T23:58:49.859 INFO:teuthology.orchestra.run.smithi173.stdout: "lc_pool": "default.rgw.log:lc", 2024-09-13T23:58:49.859 INFO:teuthology.orchestra.run.smithi173.stdout: "log_pool": "default.rgw.log", 2024-09-13T23:58:49.860 INFO:teuthology.orchestra.run.smithi173.stdout: "intent_log_pool": "default.rgw.log:intent", 2024-09-13T23:58:49.860 INFO:teuthology.orchestra.run.smithi173.stdout: "usage_log_pool": "default.rgw.log:usage", 2024-09-13T23:58:49.860 INFO:teuthology.orchestra.run.smithi173.stdout: "roles_pool": "default.rgw.meta:roles", 2024-09-13T23:58:49.860 INFO:teuthology.orchestra.run.smithi173.stdout: "reshard_pool": "default.rgw.log:reshard", 2024-09-13T23:58:49.860 INFO:teuthology.orchestra.run.smithi173.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2024-09-13T23:58:49.860 INFO:teuthology.orchestra.run.smithi173.stdout: "user_email_pool": "default.rgw.meta:users.email", 2024-09-13T23:58:49.860 INFO:teuthology.orchestra.run.smithi173.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2024-09-13T23:58:49.860 INFO:teuthology.orchestra.run.smithi173.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2024-09-13T23:58:49.860 INFO:teuthology.orchestra.run.smithi173.stdout: "otp_pool": "default.rgw.otp", 2024-09-13T23:58:49.860 INFO:teuthology.orchestra.run.smithi173.stdout: "system_key": { 2024-09-13T23:58:49.860 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "", 2024-09-13T23:58:49.860 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "" 2024-09-13T23:58:49.860 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:49.861 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_pools": [ 2024-09-13T23:58:49.861 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:49.861 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "default-placement", 2024-09-13T23:58:49.861 INFO:teuthology.orchestra.run.smithi173.stdout: "val": { 2024-09-13T23:58:49.861 INFO:teuthology.orchestra.run.smithi173.stdout: "index_pool": "default.rgw.buckets.index", 2024-09-13T23:58:49.861 INFO:teuthology.orchestra.run.smithi173.stdout: "storage_classes": { 2024-09-13T23:58:49.861 INFO:teuthology.orchestra.run.smithi173.stdout: "STANDARD": { 2024-09-13T23:58:49.861 INFO:teuthology.orchestra.run.smithi173.stdout: "data_pool": "default.rgw.buckets.data" 2024-09-13T23:58:49.861 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:49.861 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:49.861 INFO:teuthology.orchestra.run.smithi173.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2024-09-13T23:58:49.861 INFO:teuthology.orchestra.run.smithi173.stdout: "index_type": 0, 2024-09-13T23:58:49.861 INFO:teuthology.orchestra.run.smithi173.stdout: "inline_data": true 2024-09-13T23:58:49.861 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:49.862 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:49.862 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:49.862 INFO:teuthology.orchestra.run.smithi173.stdout: "realm_id": "", 2024-09-13T23:58:49.862 INFO:teuthology.orchestra.run.smithi173.stdout: "notif_pool": "default.rgw.log:notif" 2024-09-13T23:58:49.862 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:58:49.863 DEBUG:tasks.util.rgw: json result: {'id': 'd342d0db-d035-4a54-bae7-2e0f76db6818', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-09-13T23:58:49.863 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-13T23:58:49.863 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-13T23:58:49.863 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-13T23:58:49.902 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:58:49.902 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:58:49.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.899+0000 7f2fabc0df40 1 Processor -- start 2024-09-13T23:58:49.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.899+0000 7f2fabc0df40 1 -- start start 2024-09-13T23:58:49.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.899+0000 7f2fabc0df40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x563928147400 0x56392842c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.899+0000 7f2fabc0df40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56392820b500 con 0x563928147000 2024-09-13T23:58:49.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.899+0000 7f2fabc0df40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x5639281d4a00 con 0x563928147400 2024-09-13T23:58:49.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.899+0000 7f2fa9bc5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x563928147400 0x56392842c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.899+0000 7f2fa9bc5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x563928147400 0x56392842c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51028/0 (socket says 172.21.15.173:51028) 2024-09-13T23:58:49.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.899+0000 7f2fa9bc5700 1 -- 172.21.15.173:0/699781780 learned_addr learned my addr 172.21.15.173:0/699781780 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.899+0000 7f2faa3c6700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x563928147000 0x563928246800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:53608/0 (socket says 172.21.15.173:53608) 2024-09-13T23:58:49.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.899+0000 7f2fa9bc5700 1 -- 172.21.15.173:0/699781780 >> v1:172.21.15.87:6789/0 conn(0x563928147000 legacy=0x563928246800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.899+0000 7f2fa9bc5700 1 -- 172.21.15.173:0/699781780 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563928159d40 con 0x563928147400 2024-09-13T23:58:49.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.899+0000 7f2fa9bc5700 1 --2- 172.21.15.173:0/699781780 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147400 0x56392842c580 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x563928427920 tx=0x56392824b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b92b1b60958e523 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.899+0000 7f2fa93c4700 1 -- 172.21.15.173:0/699781780 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5639281eb4a0 con 0x563928147400 2024-09-13T23:58:49.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.899+0000 7f2fa93c4700 1 -- 172.21.15.173:0/699781780 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56392820b800 con 0x563928147400 2024-09-13T23:58:49.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.903+0000 7f2fa93c4700 1 -- 172.21.15.173:0/699781780 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5639281eb600 con 0x563928147400 2024-09-13T23:58:49.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.903+0000 7f2fabc0df40 1 -- 172.21.15.173:0/699781780 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147400 msgr2=0x56392842c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.903+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/699781780 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147400 0x56392842c580 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x563928427920 tx=0x56392824b920 comp rx=0 tx=0).stop 2024-09-13T23:58:49.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.903+0000 7f2fabc0df40 1 -- 172.21.15.173:0/699781780 shutdown_connections 2024-09-13T23:58:49.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.903+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/699781780 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147400 0x56392842c580 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.903+0000 7f2fabc0df40 1 -- 172.21.15.173:0/699781780 >> 172.21.15.173:0/699781780 conn(0x563928146c00 msgr2=0x563928246000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.903+0000 7f2fabc0df40 1 -- 172.21.15.173:0/699781780 shutdown_connections 2024-09-13T23:58:49.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.903+0000 7f2fabc0df40 1 -- 172.21.15.173:0/699781780 wait complete. 2024-09-13T23:58:49.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.903+0000 7f2fabc0df40 1 Processor -- start 2024-09-13T23:58:49.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.903+0000 7f2fabc0df40 1 -- start start 2024-09-13T23:58:49.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.903+0000 7f2fabc0df40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147000 0x56392842c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.903+0000 7f2fabc0df40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639281d4500 con 0x563928147000 2024-09-13T23:58:49.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.903+0000 7f2faa3c6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147000 0x56392842c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.903+0000 7f2faa3c6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147000 0x56392842c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51032/0 (socket says 172.21.15.173:51032) 2024-09-13T23:58:49.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.903+0000 7f2faa3c6700 1 -- 172.21.15.173:0/3409148633 learned_addr learned my addr 172.21.15.173:0/3409148633 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.903+0000 7f2faa3c6700 1 -- 172.21.15.173:0/3409148633 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563928159ba0 con 0x563928147000 2024-09-13T23:58:49.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.903+0000 7f2faa3c6700 1 --2- 172.21.15.173:0/3409148633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147000 0x56392842c580 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x5639282a3e90 tx=0x56392824bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe89603be02df52 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.903+0000 7f2fa8bc3700 1 -- 172.21.15.173:0/3409148633 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5639281eb1e0 con 0x563928147000 2024-09-13T23:58:49.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.903+0000 7f2fa8bc3700 1 -- 172.21.15.173:0/3409148633 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56392820bb00 con 0x563928147000 2024-09-13T23:58:49.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.903+0000 7f2fa8bc3700 1 -- 172.21.15.173:0/3409148633 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5639281eb4a0 con 0x563928147000 2024-09-13T23:58:49.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.907+0000 7f2fabc0df40 1 -- 172.21.15.173:0/3409148633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147000 msgr2=0x56392842c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.907+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/3409148633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147000 0x56392842c580 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x5639282a3e90 tx=0x56392824bb60 comp rx=0 tx=0).stop 2024-09-13T23:58:49.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.907+0000 7f2fabc0df40 1 -- 172.21.15.173:0/3409148633 shutdown_connections 2024-09-13T23:58:49.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.907+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/3409148633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147000 0x56392842c580 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.907+0000 7f2fabc0df40 1 -- 172.21.15.173:0/3409148633 >> 172.21.15.173:0/3409148633 conn(0x563928146c00 msgr2=0x563928247000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.907+0000 7f2fabc0df40 1 -- 172.21.15.173:0/3409148633 shutdown_connections 2024-09-13T23:58:49.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.907+0000 7f2fabc0df40 1 -- 172.21.15.173:0/3409148633 wait complete. 2024-09-13T23:58:49.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.907+0000 7f2fabc0df40 1 Processor -- start 2024-09-13T23:58:49.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.907+0000 7f2fabc0df40 1 -- start start 2024-09-13T23:58:49.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.907+0000 7f2fabc0df40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147000 0x56392842c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.907+0000 7f2fabc0df40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639281d43c0 con 0x563928147000 2024-09-13T23:58:49.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.907+0000 7f2faa3c6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147000 0x56392842c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.907+0000 7f2faa3c6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147000 0x56392842c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51046/0 (socket says 172.21.15.173:51046) 2024-09-13T23:58:49.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.907+0000 7f2faa3c6700 1 -- 172.21.15.173:0/2012328642 learned_addr learned my addr 172.21.15.173:0/2012328642 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.907+0000 7f2faa3c6700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563928159a00 con 0x563928147000 2024-09-13T23:58:49.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.907+0000 7f2faa3c6700 1 --2- 172.21.15.173:0/2012328642 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147000 0x56392842c580 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x5639282a3fb0 tx=0x56392824ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.907+0000 7f2fa73c0700 1 -- 172.21.15.173:0/2012328642 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5639281eb600 con 0x563928147000 2024-09-13T23:58:49.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.907+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563928159860 con 0x563928147000 2024-09-13T23:58:49.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.907+0000 7f2fa73c0700 1 -- 172.21.15.173:0/2012328642 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56392820bc80 con 0x563928147000 2024-09-13T23:58:49.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.907+0000 7f2fa73c0700 1 -- 172.21.15.173:0/2012328642 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5639281eb1e0 con 0x563928147000 2024-09-13T23:58:49.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.907+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5639281596c0 con 0x563928147000 2024-09-13T23:58:49.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.911+0000 7f2fabc0df40 1 Processor -- start 2024-09-13T23:58:49.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.911+0000 7f2fabc0df40 1 -- start start 2024-09-13T23:58:49.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.911+0000 7f2fa73c0700 1 -- 172.21.15.173:0/2012328642 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x563928240b00 con 0x563928147000 2024-09-13T23:58:49.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.911+0000 7f2fabc0df40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147800 0x56392842cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.911+0000 7f2fabc0df40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639281d4000 con 0x563928147800 2024-09-13T23:58:49.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.911+0000 7f2fa73c0700 1 --2- 172.21.15.173:0/2012328642 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5639284f8000 0x56392842d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.911+0000 7f2fa73c0700 1 -- 172.21.15.173:0/2012328642 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x5639281ad180 con 0x563928147000 2024-09-13T23:58:49.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.911+0000 7f2faa3c6700 1 --2- 172.21.15.173:0/2012328642 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5639284f8000 0x56392842d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.911+0000 7f2faabc7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147800 0x56392842cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.911+0000 7f2faabc7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147800 0x56392842cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51060/0 (socket says 172.21.15.173:51060) 2024-09-13T23:58:49.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.911+0000 7f2faabc7700 1 -- 172.21.15.173:0/2887614865 learned_addr learned my addr 172.21.15.173:0/2887614865 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.911+0000 7f2faabc7700 1 -- 172.21.15.173:0/2887614865 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563928158000 con 0x563928147800 2024-09-13T23:58:49.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.911+0000 7f2faabc7700 1 --2- 172.21.15.173:0/2887614865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147800 0x56392842cb00 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x563928466330 tx=0x5639284b1500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca656f60697c365 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.911+0000 7f2faa3c6700 1 --2- 172.21.15.173:0/2012328642 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5639284f8000 0x56392842d080 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x5639284666c0 tx=0x5639284b0240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.911+0000 7f2fa4bbb700 1 -- 172.21.15.173:0/2887614865 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5639281eb600 con 0x563928147800 2024-09-13T23:58:49.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.911+0000 7f2fa4bbb700 1 -- 172.21.15.173:0/2887614865 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56392850a000 con 0x563928147800 2024-09-13T23:58:49.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.911+0000 7f2fa4bbb700 1 -- 172.21.15.173:0/2887614865 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5639281eb1e0 con 0x563928147800 2024-09-13T23:58:49.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.911+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2887614865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147800 msgr2=0x56392842cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.911+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/2887614865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147800 0x56392842cb00 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x563928466330 tx=0x5639284b1500 comp rx=0 tx=0).stop 2024-09-13T23:58:49.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.915+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2887614865 shutdown_connections 2024-09-13T23:58:49.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.915+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/2887614865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147800 0x56392842cb00 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.915+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2887614865 >> 172.21.15.173:0/2887614865 conn(0x563928147400 msgr2=0x563928247800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.915+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2887614865 shutdown_connections 2024-09-13T23:58:49.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.915+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2887614865 wait complete. 2024-09-13T23:58:49.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.915+0000 7f2fabc0df40 1 Processor -- start 2024-09-13T23:58:49.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.915+0000 7f2fabc0df40 1 -- start start 2024-09-13T23:58:49.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.915+0000 7f2fabc0df40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147800 0x56392842cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.915+0000 7f2fabc0df40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56392816c640 con 0x563928147800 2024-09-13T23:58:49.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.915+0000 7f2faabc7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147800 0x56392842cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.915+0000 7f2faabc7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147800 0x56392842cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51062/0 (socket says 172.21.15.173:51062) 2024-09-13T23:58:49.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.915+0000 7f2faabc7700 1 -- 172.21.15.173:0/4053244729 learned_addr learned my addr 172.21.15.173:0/4053244729 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.915+0000 7f2faabc7700 1 -- 172.21.15.173:0/4053244729 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563928158ea0 con 0x563928147800 2024-09-13T23:58:49.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.915+0000 7f2faabc7700 1 --2- 172.21.15.173:0/4053244729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147800 0x56392842cb00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x563928466960 tx=0x5639284b10e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.915+0000 7f2fa33b8700 1 -- 172.21.15.173:0/4053244729 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5639281eba20 con 0x563928147800 2024-09-13T23:58:49.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.915+0000 7f2fa33b8700 1 -- 172.21.15.173:0/4053244729 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56392850a180 con 0x563928147800 2024-09-13T23:58:49.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.915+0000 7f2fabc0df40 1 -- 172.21.15.173:0/4053244729 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563928158820 con 0x563928147800 2024-09-13T23:58:49.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.915+0000 7f2fa33b8700 1 -- 172.21.15.173:0/4053244729 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5639281eb600 con 0x563928147800 2024-09-13T23:58:49.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.915+0000 7f2fabc0df40 1 -- 172.21.15.173:0/4053244729 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5639281589c0 con 0x563928147800 2024-09-13T23:58:49.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.919+0000 7f2fa33b8700 1 -- 172.21.15.173:0/4053244729 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x563928240dc0 con 0x563928147800 2024-09-13T23:58:49.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.919+0000 7f2fa33b8700 1 --2- 172.21.15.173:0/4053244729 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5639284f8c00 0x56392842d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.919+0000 7f2fa33b8700 1 -- 172.21.15.173:0/4053244729 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x5639281ad340 con 0x563928147800 2024-09-13T23:58:49.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.919+0000 7f2fa9bc5700 1 --2- 172.21.15.173:0/4053244729 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5639284f8c00 0x56392842d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.919+0000 7f2fabc0df40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:58:49.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.919+0000 7f2fabc0df40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:58:49.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.919+0000 7f2fabc0df40 1 Processor -- start 2024-09-13T23:58:49.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.919+0000 7f2fa9bc5700 1 --2- 172.21.15.173:0/4053244729 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5639284f8c00 0x56392842d600 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x563928427920 tx=0x56392824b800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.919+0000 7f2fabc0df40 1 -- start start 2024-09-13T23:58:49.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.919+0000 7f2fabc0df40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5639284f9400 0x56392842db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.919+0000 7f2fabc0df40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56392816c8c0 con 0x5639284f9400 2024-09-13T23:58:49.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.919+0000 7f2faa3c6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5639284f9400 0x56392842db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.919+0000 7f2faa3c6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5639284f9400 0x56392842db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51064/0 (socket says 172.21.15.173:51064) 2024-09-13T23:58:49.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.919+0000 7f2faa3c6700 1 -- 172.21.15.173:0/2318652268 learned_addr learned my addr 172.21.15.173:0/2318652268 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.919+0000 7f2faa3c6700 1 -- 172.21.15.173:0/2318652268 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563928158b60 con 0x5639284f9400 2024-09-13T23:58:49.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.919+0000 7f2faa3c6700 1 --2- 172.21.15.173:0/2318652268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5639284f9400 0x56392842db80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x563928466540 tx=0x5639284b13e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60f965cda7679f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.923+0000 7f2f91394700 1 -- 172.21.15.173:0/2318652268 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5639281eb4a0 con 0x5639284f9400 2024-09-13T23:58:49.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.923+0000 7f2f91394700 1 -- 172.21.15.173:0/2318652268 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56392850a600 con 0x5639284f9400 2024-09-13T23:58:49.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.923+0000 7f2f91394700 1 -- 172.21.15.173:0/2318652268 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5639281eb8c0 con 0x5639284f9400 2024-09-13T23:58:49.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.923+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2318652268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5639284f9400 msgr2=0x56392842db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.923+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/2318652268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5639284f9400 0x56392842db80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x563928466540 tx=0x5639284b13e0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.923+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2318652268 shutdown_connections 2024-09-13T23:58:49.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.923+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/2318652268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5639284f9400 0x56392842db80 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.923+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2318652268 >> 172.21.15.173:0/2318652268 conn(0x5639284f9000 msgr2=0x563928248000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.923+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2318652268 shutdown_connections 2024-09-13T23:58:49.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.923+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2318652268 wait complete. 2024-09-13T23:58:49.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.923+0000 7f2fabc0df40 1 Processor -- start 2024-09-13T23:58:49.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.923+0000 7f2fabc0df40 1 -- start start 2024-09-13T23:58:49.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.923+0000 7f2fabc0df40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5639284f9400 0x56392842db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.923+0000 7f2fabc0df40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56392816cf00 con 0x5639284f9400 2024-09-13T23:58:49.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.923+0000 7f2faa3c6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5639284f9400 0x56392842db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.923+0000 7f2faa3c6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5639284f9400 0x56392842db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51076/0 (socket says 172.21.15.173:51076) 2024-09-13T23:58:49.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.923+0000 7f2faa3c6700 1 -- 172.21.15.173:0/4043881993 learned_addr learned my addr 172.21.15.173:0/4043881993 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:49.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.923+0000 7f2faa3c6700 1 -- 172.21.15.173:0/4043881993 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563928158d00 con 0x5639284f9400 2024-09-13T23:58:49.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.923+0000 7f2faa3c6700 1 --2- 172.21.15.173:0/4043881993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5639284f9400 0x56392842db80 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x56392854fda0 tx=0x5639284b01e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.923+0000 7f2f8fb91700 1 -- 172.21.15.173:0/4043881993 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5639281eb4a0 con 0x5639284f9400 2024-09-13T23:58:49.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.923+0000 7f2f8fb91700 1 -- 172.21.15.173:0/4043881993 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56392850a300 con 0x5639284f9400 2024-09-13T23:58:49.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.923+0000 7f2fabc0df40 1 -- 172.21.15.173:0/4043881993 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563928158340 con 0x5639284f9400 2024-09-13T23:58:49.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.923+0000 7f2f8fb91700 1 -- 172.21.15.173:0/4043881993 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5639281eb8c0 con 0x5639284f9400 2024-09-13T23:58:49.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.923+0000 7f2fabc0df40 1 -- 172.21.15.173:0/4043881993 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5639285b8000 con 0x5639284f9400 2024-09-13T23:58:49.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.927+0000 7f2f8fb91700 1 -- 172.21.15.173:0/4043881993 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x563928241b80 con 0x5639284f9400 2024-09-13T23:58:49.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.927+0000 7f2f8fb91700 1 --2- 172.21.15.173:0/4043881993 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5639285b7c00 0x56392842ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.927+0000 7f2f8fb91700 1 -- 172.21.15.173:0/4043881993 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x5639281ad500 con 0x5639284f9400 2024-09-13T23:58:49.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.927+0000 7f2fa9bc5700 1 --2- 172.21.15.173:0/4043881993 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5639285b7c00 0x56392842ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.927+0000 7f2f8db8d700 20 reqs_thread_entry: start 2024-09-13T23:58:49.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.927+0000 7f2fa9bc5700 1 --2- 172.21.15.173:0/4043881993 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5639285b7c00 0x56392842ec00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x5639282a21b0 tx=0x56392824b860 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.927+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/2012328642 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5639285b6800 0x56392842e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.927+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5639285b6c00 con 0x5639285b6800 2024-09-13T23:58:49.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.927+0000 7f2faabc7700 1 --2- 172.21.15.173:0/2012328642 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5639285b6800 0x56392842e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.927+0000 7f2faabc7700 1 --2- 172.21.15.173:0/2012328642 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5639285b6800 0x56392842e100 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.931+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563928624240 con 0x5639285b6800 2024-09-13T23:58:49.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.931+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/2012328642 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5639285b7000 0x56392842e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.931+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5639285b7400 con 0x5639285b7000 2024-09-13T23:58:49.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.931+0000 7f2faa3c6700 1 --2- 172.21.15.173:0/2012328642 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5639285b7000 0x56392842e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.931+0000 7f2faa3c6700 1 --2- 172.21.15.173:0/2012328642 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5639285b7000 0x56392842e680 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.931+0000 7f2faa3c6700 1 -- 172.21.15.173:0/2012328642 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x563928624900 con 0x5639285b7000 2024-09-13T23:58:49.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.931+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/2012328642 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5639285b7800 0x56392842f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.931+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:3 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642000 con 0x5639285b7800 2024-09-13T23:58:49.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.931+0000 7f2fa9bc5700 1 --2- 172.21.15.173:0/2012328642 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5639285b7800 0x56392842f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.931+0000 7f2fa9bc5700 1 --2- 172.21.15.173:0/2012328642 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5639285b7800 0x56392842f180 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.931+0000 7f2fa9bc5700 1 -- 172.21.15.173:0/2012328642 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(3 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x563928624b40 con 0x5639285b7800 2024-09-13T23:58:49.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.935+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x5639285b6800 2024-09-13T23:58:49.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.935+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x563928624240 con 0x5639285b6800 2024-09-13T23:58:49.938 INFO:teuthology.orchestra.run.smithi173.stderr:NOTICE: set zone's realm_id= 2024-09-13T23:58:49.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.935+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642800 con 0x5639285b7800 2024-09-13T23:58:49.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.935+0000 7f2fa9bc5700 1 -- 172.21.15.173:0/2012328642 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(5 [pgnls start_epoch 37 out=107b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x563928624b40 con 0x5639285b7800 2024-09-13T23:58:49.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.935+0000 7f2fa9bc5700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642000 con 0x5639285b7000 2024-09-13T23:58:49.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.935+0000 7f2faa3c6700 1 -- 172.21.15.173:0/2012328642 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624900 con 0x5639285b7000 2024-09-13T23:58:49.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.935+0000 7f2faa3c6700 1 --2- 172.21.15.173:0/2012328642 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563928642000 0x56392864c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:49.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.935+0000 7f2faa3c6700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x5639285b7400 con 0x563928642000 2024-09-13T23:58:49.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.935+0000 7f2faabc7700 1 --2- 172.21.15.173:0/2012328642 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563928642000 0x56392864c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:49.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.935+0000 7f2faabc7700 1 --2- 172.21.15.173:0/2012328642 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563928642000 0x56392864c000 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:49.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.935+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624240 con 0x563928642000 2024-09-13T23:58:49.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.935+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x563928642000 2024-09-13T23:58:49.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.935+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x563928624240 con 0x563928642000 2024-09-13T23:58:49.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.935+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x5639285b6800 2024-09-13T23:58:49.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.939+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624240 con 0x5639285b6800 2024-09-13T23:58:49.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.939+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x5639285b7800 2024-09-13T23:58:49.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.939+0000 7f2fa9bc5700 1 -- 172.21.15.173:0/2012328642 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624b40 con 0x5639285b7800 2024-09-13T23:58:49.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.939+0000 7f2fa9bc5700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x5639285b6800 2024-09-13T23:58:49.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.939+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624240 con 0x5639285b6800 2024-09-13T23:58:49.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.939+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x5639285b7000 2024-09-13T23:58:49.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.939+0000 7f2faa3c6700 1 -- 172.21.15.173:0/2012328642 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624900 con 0x5639285b7000 2024-09-13T23:58:49.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.939+0000 7f2faa3c6700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x5639285b7000 2024-09-13T23:58:49.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.939+0000 7f2faa3c6700 1 -- 172.21.15.173:0/2012328642 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624900 con 0x5639285b7000 2024-09-13T23:58:49.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.939+0000 7f2faa3c6700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x5639285b6800 2024-09-13T23:58:49.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.939+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624240 con 0x5639285b6800 2024-09-13T23:58:49.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.939+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x563928642000 2024-09-13T23:58:49.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.939+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624240 con 0x563928642000 2024-09-13T23:58:49.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.939+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x5639285b6800 2024-09-13T23:58:49.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.943+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624240 con 0x5639285b6800 2024-09-13T23:58:49.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.943+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x563928642000 2024-09-13T23:58:49.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.943+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624240 con 0x563928642000 2024-09-13T23:58:49.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.943+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x5639285b7000 2024-09-13T23:58:49.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.943+0000 7f2faa3c6700 1 -- 172.21.15.173:0/2012328642 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(18 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624900 con 0x5639285b7000 2024-09-13T23:58:49.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.943+0000 7f2faa3c6700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x5639285b7800 2024-09-13T23:58:49.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.943+0000 7f2fa9bc5700 1 -- 172.21.15.173:0/2012328642 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624b40 con 0x5639285b7800 2024-09-13T23:58:49.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.943+0000 7f2fa9bc5700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x5639285b6800 2024-09-13T23:58:49.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.943+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624240 con 0x5639285b6800 2024-09-13T23:58:49.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.943+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x5639285b7000 2024-09-13T23:58:49.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.943+0000 7f2faa3c6700 1 -- 172.21.15.173:0/2012328642 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624900 con 0x5639285b7000 2024-09-13T23:58:49.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.943+0000 7f2faa3c6700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x5639285b7800 2024-09-13T23:58:49.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.943+0000 7f2fa9bc5700 1 -- 172.21.15.173:0/2012328642 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624b40 con 0x5639285b7800 2024-09-13T23:58:49.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.943+0000 7f2fa9bc5700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x5639285b6800 2024-09-13T23:58:49.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.947+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624240 con 0x5639285b6800 2024-09-13T23:58:49.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.947+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x5639285b6800 2024-09-13T23:58:49.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.947+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624240 con 0x5639285b6800 2024-09-13T23:58:49.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.947+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x5639285b6800 2024-09-13T23:58:49.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.947+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624240 con 0x5639285b6800 2024-09-13T23:58:49.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.947+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x5639285b7800 2024-09-13T23:58:49.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.947+0000 7f2fa9bc5700 1 -- 172.21.15.173:0/2012328642 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624b40 con 0x5639285b7800 2024-09-13T23:58:49.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.947+0000 7f2fa9bc5700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x563928642000 2024-09-13T23:58:49.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.947+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624240 con 0x563928642000 2024-09-13T23:58:49.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.947+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x5639285b6800 2024-09-13T23:58:49.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.947+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624240 con 0x5639285b6800 2024-09-13T23:58:49.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.947+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x563928642000 2024-09-13T23:58:49.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.947+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624240 con 0x563928642000 2024-09-13T23:58:49.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.947+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x5639285b7800 2024-09-13T23:58:49.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.947+0000 7f2fa9bc5700 1 -- 172.21.15.173:0/2012328642 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624b40 con 0x5639285b7800 2024-09-13T23:58:49.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.951+0000 7f2fa9bc5700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x563928642000 2024-09-13T23:58:49.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.951+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624240 con 0x563928642000 2024-09-13T23:58:49.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.951+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x5639285b7000 2024-09-13T23:58:49.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.951+0000 7f2faa3c6700 1 -- 172.21.15.173:0/2012328642 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624900 con 0x5639285b7000 2024-09-13T23:58:49.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.951+0000 7f2faa3c6700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x5639285b7000 2024-09-13T23:58:49.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.951+0000 7f2faa3c6700 1 -- 172.21.15.173:0/2012328642 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624900 con 0x5639285b7000 2024-09-13T23:58:49.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.951+0000 7f2faa3c6700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x5639285b7800 2024-09-13T23:58:49.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.951+0000 7f2fa9bc5700 1 -- 172.21.15.173:0/2012328642 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624b40 con 0x5639285b7800 2024-09-13T23:58:49.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.951+0000 7f2fa9bc5700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x5639285b7000 2024-09-13T23:58:49.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.951+0000 7f2faa3c6700 1 -- 172.21.15.173:0/2012328642 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(35 [pgnls start_epoch 37 out=115b] v26'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x563928624900 con 0x5639285b7000 2024-09-13T23:58:49.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.951+0000 7f2faa3c6700 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642400 con 0x5639285b7000 2024-09-13T23:58:49.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.955+0000 7f2faa3c6700 1 -- 172.21.15.173:0/2012328642 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(36 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563928624900 con 0x5639285b7000 2024-09-13T23:58:49.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.955+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928642c00 con 0x5639285b7000 2024-09-13T23:58:49.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.955+0000 7f2faa3c6700 1 -- 172.21.15.173:0/2012328642 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x563928624900 con 0x5639285b7000 2024-09-13T23:58:49.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.955+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:38 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928643000 con 0x5639285b7800 2024-09-13T23:58:49.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.955+0000 7f2fa9bc5700 1 -- 172.21.15.173:0/2012328642 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(38 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x563928624b40 con 0x5639285b7800 2024-09-13T23:58:49.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.955+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:39 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [create,call version.set in=58b,writefull 0~1036 in=1036b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928643400 con 0x5639285b7800 2024-09-13T23:58:49.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.959+0000 7f2fa9bc5700 1 -- 172.21.15.173:0/2012328642 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(39 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [create,call,writefull 0~1036] v37'3 uv3 ondisk = 0) v8 ==== 274+0+0 (crc 0 0 0) 0x563928624b40 con 0x5639285b7800 2024-09-13T23:58:49.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.959+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928643800 con 0x5639285b7000 2024-09-13T23:58:49.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.959+0000 7f2faa3c6700 1 -- 172.21.15.173:0/2012328642 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v37'3 uv3 ondisk = 0) v8 ==== 246+0+0 (crc 0 0 0) 0x563928624900 con 0x5639285b7000 2024-09-13T23:58:49.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.959+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2012328642 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x563928643c00 con 0x5639285b6800 2024-09-13T23:58:49.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.963+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v37'1 uv1 ondisk = 0) v8 ==== 199+0+0 (crc 0 0 0) 0x563928624240 con 0x5639285b6800 2024-09-13T23:58:49.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 -- 172.21.15.173:0/4053244729 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5639284f8c00 msgr2=0x56392842d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/4053244729 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5639284f8c00 0x56392842d600 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x563928427920 tx=0x56392824b800 comp rx=0 tx=0).stop 2024-09-13T23:58:49.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 -- 172.21.15.173:0/4053244729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147800 msgr2=0x56392842cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/4053244729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147800 0x56392842cb00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x563928466960 tx=0x5639284b10e0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 -- 172.21.15.173:0/4053244729 shutdown_connections 2024-09-13T23:58:49.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/4053244729 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5639284f8c00 0x56392842d600 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/4053244729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147800 0x56392842cb00 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 -- 172.21.15.173:0/4053244729 >> 172.21.15.173:0/4053244729 conn(0x563928147400 msgr2=0x563928247800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 -- 172.21.15.173:0/4053244729 shutdown_connections 2024-09-13T23:58:49.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 -- 172.21.15.173:0/4053244729 wait complete. 2024-09-13T23:58:49.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 -- 172.21.15.173:0/4043881993 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5639285b7c00 msgr2=0x56392842ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/4043881993 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5639285b7c00 0x56392842ec00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x5639282a21b0 tx=0x56392824b860 comp rx=0 tx=0).stop 2024-09-13T23:58:49.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 -- 172.21.15.173:0/4043881993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5639284f9400 msgr2=0x56392842db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/4043881993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5639284f9400 0x56392842db80 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x56392854fda0 tx=0x5639284b01e0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 -- 172.21.15.173:0/4043881993 shutdown_connections 2024-09-13T23:58:49.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/4043881993 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5639285b7c00 0x56392842ec00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/4043881993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5639284f9400 0x56392842db80 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 -- 172.21.15.173:0/4043881993 >> 172.21.15.173:0/4043881993 conn(0x5639284f9000 msgr2=0x563928248000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 -- 172.21.15.173:0/4043881993 shutdown_connections 2024-09-13T23:58:49.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 -- 172.21.15.173:0/4043881993 wait complete. 2024-09-13T23:58:49.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2012328642 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5639285b7000 msgr2=0x56392842e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/2012328642 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5639285b7000 0x56392842e680 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2012328642 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5639285b6800 msgr2=0x56392842e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/2012328642 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5639285b6800 0x56392842e100 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2012328642 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563928642000 msgr2=0x56392864c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/2012328642 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x563928642000 0x56392864c000 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2012328642 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5639285b7800 msgr2=0x56392842f180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/2012328642 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x5639285b7800 0x56392842f180 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2012328642 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5639284f8000 msgr2=0x56392842d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/2012328642 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5639284f8000 0x56392842d080 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x5639284666c0 tx=0x5639284b0240 comp rx=0 tx=0).stop 2024-09-13T23:58:49.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2012328642 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147000 msgr2=0x56392842c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:49.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2faabc7700 1 -- 172.21.15.173:0/2012328642 reap_dead start 2024-09-13T23:58:49.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/2012328642 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147000 0x56392842c580 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x5639282a3fb0 tx=0x56392824ba40 comp rx=0 tx=0).stop 2024-09-13T23:58:49.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2012328642 shutdown_connections 2024-09-13T23:58:49.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 --2- 172.21.15.173:0/2012328642 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563928147000 0x56392842c580 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:49.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2012328642 >> 172.21.15.173:0/2012328642 conn(0x563928146c00 msgr2=0x563928247000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:49.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2012328642 shutdown_connections 2024-09-13T23:58:49.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:49.967+0000 7f2fabc0df40 1 -- 172.21.15.173:0/2012328642 wait complete. 2024-09-13T23:58:49.975 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:58:49.975 INFO:teuthology.orchestra.run.smithi173.stdout: "id": "d342d0db-d035-4a54-bae7-2e0f76db6818", 2024-09-13T23:58:49.975 INFO:teuthology.orchestra.run.smithi173.stdout: "name": "default", 2024-09-13T23:58:49.975 INFO:teuthology.orchestra.run.smithi173.stdout: "domain_root": "default.rgw.meta:root", 2024-09-13T23:58:49.975 INFO:teuthology.orchestra.run.smithi173.stdout: "control_pool": "default.rgw.control", 2024-09-13T23:58:49.975 INFO:teuthology.orchestra.run.smithi173.stdout: "gc_pool": "default.rgw.log:gc", 2024-09-13T23:58:49.975 INFO:teuthology.orchestra.run.smithi173.stdout: "lc_pool": "default.rgw.log:lc", 2024-09-13T23:58:49.975 INFO:teuthology.orchestra.run.smithi173.stdout: "log_pool": "default.rgw.log", 2024-09-13T23:58:49.975 INFO:teuthology.orchestra.run.smithi173.stdout: "intent_log_pool": "default.rgw.log:intent", 2024-09-13T23:58:49.976 INFO:teuthology.orchestra.run.smithi173.stdout: "usage_log_pool": "default.rgw.log:usage", 2024-09-13T23:58:49.976 INFO:teuthology.orchestra.run.smithi173.stdout: "roles_pool": "default.rgw.meta:roles", 2024-09-13T23:58:49.976 INFO:teuthology.orchestra.run.smithi173.stdout: "reshard_pool": "default.rgw.log:reshard", 2024-09-13T23:58:49.976 INFO:teuthology.orchestra.run.smithi173.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2024-09-13T23:58:49.976 INFO:teuthology.orchestra.run.smithi173.stdout: "user_email_pool": "default.rgw.meta:users.email", 2024-09-13T23:58:49.976 INFO:teuthology.orchestra.run.smithi173.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2024-09-13T23:58:49.976 INFO:teuthology.orchestra.run.smithi173.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2024-09-13T23:58:49.976 INFO:teuthology.orchestra.run.smithi173.stdout: "otp_pool": "default.rgw.otp", 2024-09-13T23:58:49.976 INFO:teuthology.orchestra.run.smithi173.stdout: "system_key": { 2024-09-13T23:58:49.976 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "", 2024-09-13T23:58:49.976 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "" 2024-09-13T23:58:49.976 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:49.976 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_pools": [ 2024-09-13T23:58:49.977 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:49.977 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "default-placement", 2024-09-13T23:58:49.977 INFO:teuthology.orchestra.run.smithi173.stdout: "val": { 2024-09-13T23:58:49.977 INFO:teuthology.orchestra.run.smithi173.stdout: "index_pool": "default.rgw.buckets.index", 2024-09-13T23:58:49.977 INFO:teuthology.orchestra.run.smithi173.stdout: "storage_classes": { 2024-09-13T23:58:49.977 INFO:teuthology.orchestra.run.smithi173.stdout: "STANDARD": { 2024-09-13T23:58:49.977 INFO:teuthology.orchestra.run.smithi173.stdout: "data_pool": "default.rgw.buckets.data" 2024-09-13T23:58:49.977 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:49.977 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:49.977 INFO:teuthology.orchestra.run.smithi173.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2024-09-13T23:58:49.977 INFO:teuthology.orchestra.run.smithi173.stdout: "index_type": 0, 2024-09-13T23:58:49.977 INFO:teuthology.orchestra.run.smithi173.stdout: "inline_data": true 2024-09-13T23:58:49.977 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:49.977 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:49.978 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:49.978 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "new-placement", 2024-09-13T23:58:49.978 INFO:teuthology.orchestra.run.smithi173.stdout: "val": { 2024-09-13T23:58:49.978 INFO:teuthology.orchestra.run.smithi173.stdout: "index_pool": ".rgw.buckets.index.2", 2024-09-13T23:58:49.978 INFO:teuthology.orchestra.run.smithi173.stdout: "storage_classes": { 2024-09-13T23:58:49.978 INFO:teuthology.orchestra.run.smithi173.stdout: "STANDARD": { 2024-09-13T23:58:49.978 INFO:teuthology.orchestra.run.smithi173.stdout: "data_pool": ".rgw.buckets.2" 2024-09-13T23:58:49.978 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:49.978 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:49.978 INFO:teuthology.orchestra.run.smithi173.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2024-09-13T23:58:49.978 INFO:teuthology.orchestra.run.smithi173.stdout: "index_type": 0, 2024-09-13T23:58:49.978 INFO:teuthology.orchestra.run.smithi173.stdout: "inline_data": false 2024-09-13T23:58:49.978 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:49.978 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:49.979 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:49.979 INFO:teuthology.orchestra.run.smithi173.stdout: "realm_id": "", 2024-09-13T23:58:49.979 INFO:teuthology.orchestra.run.smithi173.stdout: "notif_pool": "default.rgw.log:notif" 2024-09-13T23:58:49.979 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:58:49.980 DEBUG:tasks.util.rgw: json result: {'id': 'd342d0db-d035-4a54-bae7-2e0f76db6818', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-09-13T23:58:49.980 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-13T23:58:49.980 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-13T23:58:49.980 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-13T23:58:50.017 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:58:50.017 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:58:50.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.015+0000 7fecd6c6ff40 1 Processor -- start 2024-09-13T23:58:50.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.015+0000 7fecd6c6ff40 1 -- start start 2024-09-13T23:58:50.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.015+0000 7fecd6c6ff40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55ed57313400 0x55ed575f8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.015+0000 7fecd6c6ff40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ed573d7500 con 0x55ed57313000 2024-09-13T23:58:50.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.015+0000 7fecd6c6ff40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ed573a0a00 con 0x55ed57313400 2024-09-13T23:58:50.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.015+0000 7fecd4c27700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55ed57313400 0x55ed575f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.015+0000 7fecd4c27700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55ed57313400 0x55ed575f8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51082/0 (socket says 172.21.15.173:51082) 2024-09-13T23:58:50.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.015+0000 7fecd5428700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x55ed57313000 0x55ed57412800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:53622/0 (socket says 172.21.15.173:53622) 2024-09-13T23:58:50.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.015+0000 7fecd4c27700 1 -- 172.21.15.173:0/2702290576 learned_addr learned my addr 172.21.15.173:0/2702290576 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.015+0000 7fecd4c27700 1 -- 172.21.15.173:0/2702290576 >> v1:172.21.15.87:6789/0 conn(0x55ed57313000 legacy=0x55ed57412800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.015+0000 7fecd4c27700 1 -- 172.21.15.173:0/2702290576 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed57325d40 con 0x55ed57313400 2024-09-13T23:58:50.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.015+0000 7fecd4426700 1 -- 172.21.15.173:0/2702290576 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4069793202 0 0) 0x55ed5746e000 con 0x55ed57313000 2024-09-13T23:58:50.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.015+0000 7fecd4c27700 1 --2- 172.21.15.173:0/2702290576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313400 0x55ed575f8580 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x55ed575f3920 tx=0x55ed57417920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef340842c584b74 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.015+0000 7fecd4426700 1 -- 172.21.15.173:0/2702290576 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ed573b74a0 con 0x55ed57313400 2024-09-13T23:58:50.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.015+0000 7fecd4426700 1 -- 172.21.15.173:0/2702290576 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ed573d7800 con 0x55ed57313400 2024-09-13T23:58:50.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.015+0000 7fecd4426700 1 -- 172.21.15.173:0/2702290576 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ed573b7600 con 0x55ed57313400 2024-09-13T23:58:50.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.015+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/2702290576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313400 msgr2=0x55ed575f8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.015+0000 7fecd6c6ff40 1 --2- 172.21.15.173:0/2702290576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313400 0x55ed575f8580 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x55ed575f3920 tx=0x55ed57417920 comp rx=0 tx=0).stop 2024-09-13T23:58:50.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.015+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/2702290576 shutdown_connections 2024-09-13T23:58:50.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.015+0000 7fecd6c6ff40 1 --2- 172.21.15.173:0/2702290576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313400 0x55ed575f8580 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.015+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/2702290576 >> 172.21.15.173:0/2702290576 conn(0x55ed57312c00 msgr2=0x55ed57412000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.015+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/2702290576 shutdown_connections 2024-09-13T23:58:50.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.015+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/2702290576 wait complete. 2024-09-13T23:58:50.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.019+0000 7fecd6c6ff40 1 Processor -- start 2024-09-13T23:58:50.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.019+0000 7fecd6c6ff40 1 -- start start 2024-09-13T23:58:50.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.019+0000 7fecd6c6ff40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313000 0x55ed575f8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.019+0000 7fecd6c6ff40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed573a0500 con 0x55ed57313000 2024-09-13T23:58:50.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.019+0000 7fecd5428700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313000 0x55ed575f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.019+0000 7fecd5428700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313000 0x55ed575f8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51098/0 (socket says 172.21.15.173:51098) 2024-09-13T23:58:50.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.019+0000 7fecd5428700 1 -- 172.21.15.173:0/4195868285 learned_addr learned my addr 172.21.15.173:0/4195868285 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.019+0000 7fecd5428700 1 -- 172.21.15.173:0/4195868285 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed57325ba0 con 0x55ed57313000 2024-09-13T23:58:50.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.019+0000 7fecd5428700 1 --2- 172.21.15.173:0/4195868285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313000 0x55ed575f8580 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x55ed58173ec0 tx=0x55ed57417b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f32af00f4368821 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.019+0000 7fecd3c25700 1 -- 172.21.15.173:0/4195868285 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ed573b74a0 con 0x55ed57313000 2024-09-13T23:58:50.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.019+0000 7fecd3c25700 1 -- 172.21.15.173:0/4195868285 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ed573d7b00 con 0x55ed57313000 2024-09-13T23:58:50.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.019+0000 7fecd3c25700 1 -- 172.21.15.173:0/4195868285 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ed573b7600 con 0x55ed57313000 2024-09-13T23:58:50.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.019+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/4195868285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313000 msgr2=0x55ed575f8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.019+0000 7fecd6c6ff40 1 --2- 172.21.15.173:0/4195868285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313000 0x55ed575f8580 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x55ed58173ec0 tx=0x55ed57417b60 comp rx=0 tx=0).stop 2024-09-13T23:58:50.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.019+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/4195868285 shutdown_connections 2024-09-13T23:58:50.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.019+0000 7fecd6c6ff40 1 --2- 172.21.15.173:0/4195868285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313000 0x55ed575f8580 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.019+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/4195868285 >> 172.21.15.173:0/4195868285 conn(0x55ed57312c00 msgr2=0x55ed57413000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.023+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/4195868285 shutdown_connections 2024-09-13T23:58:50.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.023+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/4195868285 wait complete. 2024-09-13T23:58:50.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.023+0000 7fecd6c6ff40 1 Processor -- start 2024-09-13T23:58:50.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.023+0000 7fecd6c6ff40 1 -- start start 2024-09-13T23:58:50.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.023+0000 7fecd6c6ff40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313000 0x55ed575f8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.023+0000 7fecd6c6ff40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed573a03c0 con 0x55ed57313000 2024-09-13T23:58:50.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.023+0000 7fecd5428700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313000 0x55ed575f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.023+0000 7fecd5428700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313000 0x55ed575f8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51112/0 (socket says 172.21.15.173:51112) 2024-09-13T23:58:50.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.023+0000 7fecd5428700 1 -- 172.21.15.173:0/3010010227 learned_addr learned my addr 172.21.15.173:0/3010010227 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.023+0000 7fecd5428700 1 -- 172.21.15.173:0/3010010227 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed57325a00 con 0x55ed57313000 2024-09-13T23:58:50.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.023+0000 7fecd5428700 1 --2- 172.21.15.173:0/3010010227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313000 0x55ed575f8580 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x55ed58173f80 tx=0x55ed57417a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.023+0000 7fecd2422700 1 -- 172.21.15.173:0/3010010227 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ed573b78c0 con 0x55ed57313000 2024-09-13T23:58:50.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.023+0000 7fecd2422700 1 -- 172.21.15.173:0/3010010227 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ed573d7c80 con 0x55ed57313000 2024-09-13T23:58:50.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.023+0000 7fecd2422700 1 -- 172.21.15.173:0/3010010227 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ed573b74a0 con 0x55ed57313000 2024-09-13T23:58:50.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.023+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3010010227 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ed57325860 con 0x55ed57313000 2024-09-13T23:58:50.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.023+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3010010227 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ed573256c0 con 0x55ed57313000 2024-09-13T23:58:50.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7fecd6c6ff40 1 Processor -- start 2024-09-13T23:58:50.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7fecd6c6ff40 1 -- start start 2024-09-13T23:58:50.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7fecd6c6ff40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313800 0x55ed575f8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7fecd6c6ff40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed573a0000 con 0x55ed57313800 2024-09-13T23:58:50.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7fecd2422700 1 -- 172.21.15.173:0/3010010227 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55ed5740cb00 con 0x55ed57313000 2024-09-13T23:58:50.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7fecd5c29700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313800 0x55ed575f8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7fecd5c29700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313800 0x55ed575f8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51126/0 (socket says 172.21.15.173:51126) 2024-09-13T23:58:50.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7fecd5c29700 1 -- 172.21.15.173:0/3338341369 learned_addr learned my addr 172.21.15.173:0/3338341369 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7fecd2422700 1 --2- 172.21.15.173:0/3010010227 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ed576c0000 0x55ed575f9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7fecd2422700 1 -- 172.21.15.173:0/3010010227 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x55ed57379180 con 0x55ed57313000 2024-09-13T23:58:50.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7fecd5c29700 1 -- 172.21.15.173:0/3338341369 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed57324000 con 0x55ed57313800 2024-09-13T23:58:50.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7fecd5428700 1 --2- 172.21.15.173:0/3010010227 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ed576c0000 0x55ed575f9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7fecd5c29700 1 --2- 172.21.15.173:0/3338341369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313800 0x55ed575f8b00 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x55ed5818bb30 tx=0x55ed57417f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ab072192189a46 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7feccfc1d700 1 -- 172.21.15.173:0/3338341369 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ed573b78c0 con 0x55ed57313800 2024-09-13T23:58:50.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7feccfc1d700 1 -- 172.21.15.173:0/3338341369 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ed576b2000 con 0x55ed57313800 2024-09-13T23:58:50.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7feccfc1d700 1 -- 172.21.15.173:0/3338341369 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ed573b74a0 con 0x55ed57313800 2024-09-13T23:58:50.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3338341369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313800 msgr2=0x55ed575f8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7fecd5428700 1 --2- 172.21.15.173:0/3010010227 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ed576c0000 0x55ed575f9080 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x55ed5818b170 tx=0x55ed57676240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7fecd6c6ff40 1 --2- 172.21.15.173:0/3338341369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313800 0x55ed575f8b00 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x55ed5818bb30 tx=0x55ed57417f20 comp rx=0 tx=0).stop 2024-09-13T23:58:50.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3338341369 shutdown_connections 2024-09-13T23:58:50.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7fecd6c6ff40 1 --2- 172.21.15.173:0/3338341369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313800 0x55ed575f8b00 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3338341369 >> 172.21.15.173:0/3338341369 conn(0x55ed57313400 msgr2=0x55ed57413800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3338341369 shutdown_connections 2024-09-13T23:58:50.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3338341369 wait complete. 2024-09-13T23:58:50.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.027+0000 7fecd6c6ff40 1 Processor -- start 2024-09-13T23:58:50.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.031+0000 7fecd6c6ff40 1 -- start start 2024-09-13T23:58:50.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.031+0000 7fecd6c6ff40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313800 0x55ed575f8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.031+0000 7fecd6c6ff40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed57338640 con 0x55ed57313800 2024-09-13T23:58:50.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.031+0000 7fecd5c29700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313800 0x55ed575f8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.031+0000 7fecd5c29700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313800 0x55ed575f8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51128/0 (socket says 172.21.15.173:51128) 2024-09-13T23:58:50.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.031+0000 7fecd5c29700 1 -- 172.21.15.173:0/3024934233 learned_addr learned my addr 172.21.15.173:0/3024934233 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.031+0000 7fecd5c29700 1 -- 172.21.15.173:0/3024934233 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed57324ea0 con 0x55ed57313800 2024-09-13T23:58:50.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.031+0000 7fecd5c29700 1 --2- 172.21.15.173:0/3024934233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313800 0x55ed575f8b00 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x55ed5818a9f0 tx=0x55ed57417e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.031+0000 7fecce41a700 1 -- 172.21.15.173:0/3024934233 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ed573b7b80 con 0x55ed57313800 2024-09-13T23:58:50.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.031+0000 7fecce41a700 1 -- 172.21.15.173:0/3024934233 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ed576b2180 con 0x55ed57313800 2024-09-13T23:58:50.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.031+0000 7fecce41a700 1 -- 172.21.15.173:0/3024934233 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ed573b78c0 con 0x55ed57313800 2024-09-13T23:58:50.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.031+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3024934233 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ed57324820 con 0x55ed57313800 2024-09-13T23:58:50.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.031+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3024934233 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ed573249c0 con 0x55ed57313800 2024-09-13T23:58:50.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecce41a700 1 -- 172.21.15.173:0/3024934233 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55ed5740cdc0 con 0x55ed57313800 2024-09-13T23:58:50.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecd6c6ff40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:58:50.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecd6c6ff40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:58:50.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecce41a700 1 --2- 172.21.15.173:0/3024934233 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ed576c0c00 0x55ed575f9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecce41a700 1 -- 172.21.15.173:0/3024934233 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x55ed57379340 con 0x55ed57313800 2024-09-13T23:58:50.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecd6c6ff40 1 Processor -- start 2024-09-13T23:58:50.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecd6c6ff40 1 -- start start 2024-09-13T23:58:50.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecd4c27700 1 --2- 172.21.15.173:0/3024934233 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ed576c0c00 0x55ed575f9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecd6c6ff40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed576c1400 0x55ed575f9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecd6c6ff40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed573388c0 con 0x55ed576c1400 2024-09-13T23:58:50.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecd4c27700 1 --2- 172.21.15.173:0/3024934233 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ed576c0c00 0x55ed575f9600 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55ed575f3920 tx=0x55ed57417800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecd5428700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed576c1400 0x55ed575f9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecd5428700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed576c1400 0x55ed575f9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51134/0 (socket says 172.21.15.173:51134) 2024-09-13T23:58:50.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecd5428700 1 -- 172.21.15.173:0/3077542001 learned_addr learned my addr 172.21.15.173:0/3077542001 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecd5428700 1 -- 172.21.15.173:0/3077542001 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed57324b60 con 0x55ed576c1400 2024-09-13T23:58:50.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecd5428700 1 --2- 172.21.15.173:0/3077542001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed576c1400 0x55ed575f9b80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x55ed5818b2f0 tx=0x55ed57677500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69aa6a033f83e27f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecbc3f6700 1 -- 172.21.15.173:0/3077542001 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ed573b7600 con 0x55ed576c1400 2024-09-13T23:58:50.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecbc3f6700 1 -- 172.21.15.173:0/3077542001 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ed576b2600 con 0x55ed576c1400 2024-09-13T23:58:50.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecbc3f6700 1 -- 172.21.15.173:0/3077542001 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ed573b7a20 con 0x55ed576c1400 2024-09-13T23:58:50.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3077542001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed576c1400 msgr2=0x55ed575f9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecd6c6ff40 1 --2- 172.21.15.173:0/3077542001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed576c1400 0x55ed575f9b80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x55ed5818b2f0 tx=0x55ed57677500 comp rx=0 tx=0).stop 2024-09-13T23:58:50.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3077542001 shutdown_connections 2024-09-13T23:58:50.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecd6c6ff40 1 --2- 172.21.15.173:0/3077542001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed576c1400 0x55ed575f9b80 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3077542001 >> 172.21.15.173:0/3077542001 conn(0x55ed576c1000 msgr2=0x55ed57414000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3077542001 shutdown_connections 2024-09-13T23:58:50.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.035+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3077542001 wait complete. 2024-09-13T23:58:50.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.039+0000 7fecd6c6ff40 1 Processor -- start 2024-09-13T23:58:50.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.039+0000 7fecd6c6ff40 1 -- start start 2024-09-13T23:58:50.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.039+0000 7fecd6c6ff40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed576c1400 0x55ed575f9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.039+0000 7fecd6c6ff40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed57338f00 con 0x55ed576c1400 2024-09-13T23:58:50.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.039+0000 7fecd5428700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed576c1400 0x55ed575f9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.039+0000 7fecd5428700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed576c1400 0x55ed575f9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51148/0 (socket says 172.21.15.173:51148) 2024-09-13T23:58:50.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.039+0000 7fecd5428700 1 -- 172.21.15.173:0/2029619053 learned_addr learned my addr 172.21.15.173:0/2029619053 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.039+0000 7fecd5428700 1 -- 172.21.15.173:0/2029619053 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed57324d00 con 0x55ed576c1400 2024-09-13T23:58:50.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.039+0000 7fecd5428700 1 --2- 172.21.15.173:0/2029619053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed576c1400 0x55ed575f9b80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x55ed576ab9e0 tx=0x55ed576761e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.039+0000 7fecbabf3700 1 -- 172.21.15.173:0/2029619053 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ed573b7600 con 0x55ed576c1400 2024-09-13T23:58:50.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.039+0000 7fecbabf3700 1 -- 172.21.15.173:0/2029619053 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ed576b2300 con 0x55ed576c1400 2024-09-13T23:58:50.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.039+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/2029619053 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ed57324340 con 0x55ed576c1400 2024-09-13T23:58:50.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.039+0000 7fecbabf3700 1 -- 172.21.15.173:0/2029619053 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ed573b7a20 con 0x55ed576c1400 2024-09-13T23:58:50.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.039+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/2029619053 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ed57784000 con 0x55ed576c1400 2024-09-13T23:58:50.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.039+0000 7fecbabf3700 1 -- 172.21.15.173:0/2029619053 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55ed5740db80 con 0x55ed576c1400 2024-09-13T23:58:50.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.043+0000 7fecbabf3700 1 --2- 172.21.15.173:0/2029619053 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ed5777dc00 0x55ed575fac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.043+0000 7fecbabf3700 1 -- 172.21.15.173:0/2029619053 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x55ed57379500 con 0x55ed576c1400 2024-09-13T23:58:50.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.043+0000 7fecd4c27700 1 --2- 172.21.15.173:0/2029619053 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ed5777dc00 0x55ed575fac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.043+0000 7fecb8bef700 20 reqs_thread_entry: start 2024-09-13T23:58:50.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.043+0000 7fecd6c6ff40 1 --2- 172.21.15.173:0/3010010227 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55ed5777c800 0x55ed575fa100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.043+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3010010227 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ed5777cc00 con 0x55ed5777c800 2024-09-13T23:58:50.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.043+0000 7fecd5c29700 1 --2- 172.21.15.173:0/3010010227 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55ed5777c800 0x55ed575fa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.043+0000 7fecd4c27700 1 --2- 172.21.15.173:0/2029619053 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ed5777dc00 0x55ed575fac00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55ed575f3f50 tx=0x55ed57417860 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.043+0000 7fecd5c29700 1 --2- 172.21.15.173:0/3010010227 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55ed5777c800 0x55ed575fa100 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.043+0000 7fecd5c29700 1 -- 172.21.15.173:0/3010010227 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x55ed577e8240 con 0x55ed5777c800 2024-09-13T23:58:50.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.043+0000 7fecd6c6ff40 1 --2- 172.21.15.173:0/3010010227 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55ed5777d000 0x55ed575fa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.043+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3010010227 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ed5777d400 con 0x55ed5777d000 2024-09-13T23:58:50.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.043+0000 7fecd5428700 1 --2- 172.21.15.173:0/3010010227 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55ed5777d000 0x55ed575fa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.043+0000 7fecd5428700 1 --2- 172.21.15.173:0/3010010227 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55ed5777d000 0x55ed575fa680 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.047+0000 7fecd5428700 1 -- 172.21.15.173:0/3010010227 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55ed577e8900 con 0x55ed5777d000 2024-09-13T23:58:50.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.047+0000 7fecd6c6ff40 1 --2- 172.21.15.173:0/3010010227 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55ed5777d800 0x55ed575fb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.047+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3010010227 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:3 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ed57800000 con 0x55ed5777d800 2024-09-13T23:58:50.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.047+0000 7fecd4c27700 1 --2- 172.21.15.173:0/3010010227 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55ed5777d800 0x55ed575fb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.047+0000 7fecd4c27700 1 --2- 172.21.15.173:0/3010010227 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55ed5777d800 0x55ed575fb180 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.047+0000 7fecd4c27700 1 -- 172.21.15.173:0/3010010227 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(3 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [call out=48b,read 0~1036 out=1036b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+1084 (crc 0 0 0) 0x55ed577e8b40 con 0x55ed5777d800 2024-09-13T23:58:50.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.047+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3024934233 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ed576c0c00 msgr2=0x55ed575f9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.047+0000 7fecd6c6ff40 1 --2- 172.21.15.173:0/3024934233 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ed576c0c00 0x55ed575f9600 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55ed575f3920 tx=0x55ed57417800 comp rx=0 tx=0).stop 2024-09-13T23:58:50.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.047+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3024934233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313800 msgr2=0x55ed575f8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.047+0000 7fecd6c6ff40 1 --2- 172.21.15.173:0/3024934233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313800 0x55ed575f8b00 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x55ed5818a9f0 tx=0x55ed57417e00 comp rx=0 tx=0).stop 2024-09-13T23:58:50.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.047+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3024934233 shutdown_connections 2024-09-13T23:58:50.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.047+0000 7fecd6c6ff40 1 --2- 172.21.15.173:0/3024934233 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ed576c0c00 0x55ed575f9600 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.047+0000 7fecd6c6ff40 1 --2- 172.21.15.173:0/3024934233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313800 0x55ed575f8b00 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.047+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3024934233 >> 172.21.15.173:0/3024934233 conn(0x55ed57313400 msgr2=0x55ed57413800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.047+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3024934233 shutdown_connections 2024-09-13T23:58:50.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.047+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3024934233 wait complete. 2024-09-13T23:58:50.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/2029619053 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ed5777dc00 msgr2=0x55ed575fac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd6c6ff40 1 --2- 172.21.15.173:0/2029619053 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ed5777dc00 0x55ed575fac00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55ed575f3f50 tx=0x55ed57417860 comp rx=0 tx=0).stop 2024-09-13T23:58:50.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/2029619053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed576c1400 msgr2=0x55ed575f9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd6c6ff40 1 --2- 172.21.15.173:0/2029619053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed576c1400 0x55ed575f9b80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x55ed576ab9e0 tx=0x55ed576761e0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/2029619053 shutdown_connections 2024-09-13T23:58:50.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd6c6ff40 1 --2- 172.21.15.173:0/2029619053 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ed5777dc00 0x55ed575fac00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd6c6ff40 1 --2- 172.21.15.173:0/2029619053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed576c1400 0x55ed575f9b80 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/2029619053 >> 172.21.15.173:0/2029619053 conn(0x55ed576c1000 msgr2=0x55ed57414000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/2029619053 shutdown_connections 2024-09-13T23:58:50.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/2029619053 wait complete. 2024-09-13T23:58:50.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3010010227 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55ed5777d000 msgr2=0x55ed575fa680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd6c6ff40 1 --2- 172.21.15.173:0/3010010227 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55ed5777d000 0x55ed575fa680 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3010010227 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55ed5777c800 msgr2=0x55ed575fa100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd6c6ff40 1 --2- 172.21.15.173:0/3010010227 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x55ed5777c800 0x55ed575fa100 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3010010227 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55ed5777d800 msgr2=0x55ed575fb180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd6c6ff40 1 --2- 172.21.15.173:0/3010010227 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55ed5777d800 0x55ed575fb180 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3010010227 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ed576c0000 msgr2=0x55ed575f9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd6c6ff40 1 --2- 172.21.15.173:0/3010010227 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ed576c0000 0x55ed575f9080 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x55ed5818b170 tx=0x55ed57676240 comp rx=0 tx=0).stop 2024-09-13T23:58:50.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3010010227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313000 msgr2=0x55ed575f8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd6c6ff40 1 --2- 172.21.15.173:0/3010010227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ed57313000 0x55ed575f8580 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x55ed58173f80 tx=0x55ed57417a40 comp rx=0 tx=0).stop 2024-09-13T23:58:50.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd5c29700 1 -- 172.21.15.173:0/3010010227 reap_dead start 2024-09-13T23:58:50.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3010010227 shutdown_connections 2024-09-13T23:58:50.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3010010227 >> 172.21.15.173:0/3010010227 conn(0x55ed57312c00 msgr2=0x55ed57413000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3010010227 shutdown_connections 2024-09-13T23:58:50.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.051+0000 7fecd6c6ff40 1 -- 172.21.15.173:0/3010010227 wait complete. 2024-09-13T23:58:50.058 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:58:50.058 INFO:teuthology.orchestra.run.smithi173.stdout: "id": "d342d0db-d035-4a54-bae7-2e0f76db6818", 2024-09-13T23:58:50.058 INFO:teuthology.orchestra.run.smithi173.stdout: "name": "default", 2024-09-13T23:58:50.058 INFO:teuthology.orchestra.run.smithi173.stdout: "domain_root": "default.rgw.meta:root", 2024-09-13T23:58:50.058 INFO:teuthology.orchestra.run.smithi173.stdout: "control_pool": "default.rgw.control", 2024-09-13T23:58:50.058 INFO:teuthology.orchestra.run.smithi173.stdout: "gc_pool": "default.rgw.log:gc", 2024-09-13T23:58:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: "lc_pool": "default.rgw.log:lc", 2024-09-13T23:58:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: "log_pool": "default.rgw.log", 2024-09-13T23:58:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: "intent_log_pool": "default.rgw.log:intent", 2024-09-13T23:58:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: "usage_log_pool": "default.rgw.log:usage", 2024-09-13T23:58:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: "roles_pool": "default.rgw.meta:roles", 2024-09-13T23:58:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: "reshard_pool": "default.rgw.log:reshard", 2024-09-13T23:58:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2024-09-13T23:58:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: "user_email_pool": "default.rgw.meta:users.email", 2024-09-13T23:58:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2024-09-13T23:58:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2024-09-13T23:58:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: "otp_pool": "default.rgw.otp", 2024-09-13T23:58:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: "system_key": { 2024-09-13T23:58:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "", 2024-09-13T23:58:50.059 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "" 2024-09-13T23:58:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_pools": [ 2024-09-13T23:58:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "default-placement", 2024-09-13T23:58:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: "val": { 2024-09-13T23:58:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: "index_pool": "default.rgw.buckets.index", 2024-09-13T23:58:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: "storage_classes": { 2024-09-13T23:58:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: "STANDARD": { 2024-09-13T23:58:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: "data_pool": "default.rgw.buckets.data" 2024-09-13T23:58:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2024-09-13T23:58:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: "index_type": 0, 2024-09-13T23:58:50.060 INFO:teuthology.orchestra.run.smithi173.stdout: "inline_data": true 2024-09-13T23:58:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "new-placement", 2024-09-13T23:58:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: "val": { 2024-09-13T23:58:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: "index_pool": ".rgw.buckets.index.2", 2024-09-13T23:58:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: "storage_classes": { 2024-09-13T23:58:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: "STANDARD": { 2024-09-13T23:58:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: "data_pool": ".rgw.buckets.2" 2024-09-13T23:58:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2024-09-13T23:58:50.061 INFO:teuthology.orchestra.run.smithi173.stdout: "index_type": 0, 2024-09-13T23:58:50.062 INFO:teuthology.orchestra.run.smithi173.stdout: "inline_data": false 2024-09-13T23:58:50.062 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:50.062 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:50.062 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:50.062 INFO:teuthology.orchestra.run.smithi173.stdout: "realm_id": "", 2024-09-13T23:58:50.062 INFO:teuthology.orchestra.run.smithi173.stdout: "notif_pool": "default.rgw.log:notif" 2024-09-13T23:58:50.062 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:58:50.063 DEBUG:tasks.util.rgw: json result: {'id': 'd342d0db-d035-4a54-bae7-2e0f76db6818', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-09-13T23:58:50.063 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T23:58:50.063 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T23:58:50.063 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-13T23:58:50.147 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:58:50.147 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:58:50.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.143+0000 7f2ebb772f40 1 Processor -- start 2024-09-13T23:58:50.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.143+0000 7f2ebb772f40 1 -- start start 2024-09-13T23:58:50.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.143+0000 7f2ebb772f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55ab5ea8d000 0x55ab5ed72580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.143+0000 7f2ebb772f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ab5eb51500 con 0x55ab5ea8d400 2024-09-13T23:58:50.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.143+0000 7f2ebb772f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ab5eb1aa00 con 0x55ab5ea8d000 2024-09-13T23:58:50.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.143+0000 7f2eb9f2b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55ab5ea8d000 0x55ab5ed72580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.143+0000 7f2eb9f2b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x55ab5ea8d000 0x55ab5ed72580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51150/0 (socket says 172.21.15.173:51150) 2024-09-13T23:58:50.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.143+0000 7f2eb9f2b700 1 -- 172.21.15.173:0/4065880143 learned_addr learned my addr 172.21.15.173:0/4065880143 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.143+0000 7f2eb972a700 1 --1- 172.21.15.173:0/4065880143 >> v1:172.21.15.87:6789/0 conn(0x55ab5ea8d400 0x55ab5eb8c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:53636/0 (socket says 172.21.15.173:53636) 2024-09-13T23:58:50.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.147+0000 7f2eb9f2b700 1 -- 172.21.15.173:0/4065880143 >> v1:172.21.15.87:6789/0 conn(0x55ab5ea8d400 legacy=0x55ab5eb8c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.147+0000 7f2eb9f2b700 1 -- 172.21.15.173:0/4065880143 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab5ea9fd40 con 0x55ab5ea8d000 2024-09-13T23:58:50.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.147+0000 7f2eb9f2b700 1 --2- 172.21.15.173:0/4065880143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8d000 0x55ab5ed72580 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x55ab5ed6da70 tx=0x55ab5eb91920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974705d49285d3a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.147+0000 7f2eb8f29700 1 -- 172.21.15.173:0/4065880143 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab5eb314a0 con 0x55ab5ea8d000 2024-09-13T23:58:50.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.147+0000 7f2eb8f29700 1 -- 172.21.15.173:0/4065880143 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ab5eb51800 con 0x55ab5ea8d000 2024-09-13T23:58:50.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.147+0000 7f2eb8f29700 1 -- 172.21.15.173:0/4065880143 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab5eb31600 con 0x55ab5ea8d000 2024-09-13T23:58:50.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.147+0000 7f2ebb772f40 1 -- 172.21.15.173:0/4065880143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8d000 msgr2=0x55ab5ed72580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.147+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/4065880143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8d000 0x55ab5ed72580 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x55ab5ed6da70 tx=0x55ab5eb91920 comp rx=0 tx=0).stop 2024-09-13T23:58:50.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.147+0000 7f2ebb772f40 1 -- 172.21.15.173:0/4065880143 shutdown_connections 2024-09-13T23:58:50.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.147+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/4065880143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8d000 0x55ab5ed72580 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.147+0000 7f2ebb772f40 1 -- 172.21.15.173:0/4065880143 >> 172.21.15.173:0/4065880143 conn(0x55ab5ea8cc00 msgr2=0x55ab5eb8c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.147+0000 7f2ebb772f40 1 -- 172.21.15.173:0/4065880143 shutdown_connections 2024-09-13T23:58:50.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.147+0000 7f2ebb772f40 1 -- 172.21.15.173:0/4065880143 wait complete. 2024-09-13T23:58:50.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.147+0000 7f2ebb772f40 1 Processor -- start 2024-09-13T23:58:50.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.147+0000 7f2ebb772f40 1 -- start start 2024-09-13T23:58:50.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.147+0000 7f2ebb772f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8d000 0x55ab5ed72580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.147+0000 7f2ebb772f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab5eb1a500 con 0x55ab5ea8d000 2024-09-13T23:58:50.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.147+0000 7f2eb9f2b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8d000 0x55ab5ed72580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.147+0000 7f2eb9f2b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8d000 0x55ab5ed72580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51162/0 (socket says 172.21.15.173:51162) 2024-09-13T23:58:50.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.147+0000 7f2eb9f2b700 1 -- 172.21.15.173:0/265907738 learned_addr learned my addr 172.21.15.173:0/265907738 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.151+0000 7f2eb9f2b700 1 -- 172.21.15.173:0/265907738 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab5ea9fba0 con 0x55ab5ea8d000 2024-09-13T23:58:50.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.151+0000 7f2eb9f2b700 1 --2- 172.21.15.173:0/265907738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8d000 0x55ab5ed72580 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x55ab5ebe81b0 tx=0x55ab5eb91800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=903a0177df87342c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.151+0000 7f2eb8728700 1 -- 172.21.15.173:0/265907738 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab5eb31760 con 0x55ab5ea8d000 2024-09-13T23:58:50.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.151+0000 7f2eb8728700 1 -- 172.21.15.173:0/265907738 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ab5eb51b00 con 0x55ab5ea8d000 2024-09-13T23:58:50.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.151+0000 7f2eb8728700 1 -- 172.21.15.173:0/265907738 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab5eb314a0 con 0x55ab5ea8d000 2024-09-13T23:58:50.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.151+0000 7f2ebb772f40 1 -- 172.21.15.173:0/265907738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8d000 msgr2=0x55ab5ed72580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.151+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/265907738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8d000 0x55ab5ed72580 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x55ab5ebe81b0 tx=0x55ab5eb91800 comp rx=0 tx=0).stop 2024-09-13T23:58:50.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.151+0000 7f2ebb772f40 1 -- 172.21.15.173:0/265907738 shutdown_connections 2024-09-13T23:58:50.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.151+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/265907738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8d000 0x55ab5ed72580 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.151+0000 7f2ebb772f40 1 -- 172.21.15.173:0/265907738 >> 172.21.15.173:0/265907738 conn(0x55ab5ea8cc00 msgr2=0x55ab5eb8d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.151+0000 7f2ebb772f40 1 -- 172.21.15.173:0/265907738 shutdown_connections 2024-09-13T23:58:50.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.151+0000 7f2ebb772f40 1 -- 172.21.15.173:0/265907738 wait complete. 2024-09-13T23:58:50.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.151+0000 7f2ebb772f40 1 Processor -- start 2024-09-13T23:58:50.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.151+0000 7f2ebb772f40 1 -- start start 2024-09-13T23:58:50.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.151+0000 7f2ebb772f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8d400 0x55ab5ed72b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.151+0000 7f2ebb772f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab5eb1a3c0 con 0x55ab5ea8d400 2024-09-13T23:58:50.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.151+0000 7f2eb9f2b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8d400 0x55ab5ed72b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.151+0000 7f2eb9f2b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8d400 0x55ab5ed72b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51168/0 (socket says 172.21.15.173:51168) 2024-09-13T23:58:50.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.151+0000 7f2eb9f2b700 1 -- 172.21.15.173:0/4112956068 learned_addr learned my addr 172.21.15.173:0/4112956068 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.151+0000 7f2eb9f2b700 1 -- 172.21.15.173:0/4112956068 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab5ea9fa00 con 0x55ab5ea8d400 2024-09-13T23:58:50.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.151+0000 7f2eb9f2b700 1 --2- 172.21.15.173:0/4112956068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8d400 0x55ab5ed72b00 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x55ab5ebe9f50 tx=0x55ab5eb91920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.151+0000 7f2eb6f25700 1 -- 172.21.15.173:0/4112956068 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab5eb31600 con 0x55ab5ea8d400 2024-09-13T23:58:50.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.151+0000 7f2ebb772f40 1 -- 172.21.15.173:0/4112956068 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ab5ea9f860 con 0x55ab5ea8d400 2024-09-13T23:58:50.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.151+0000 7f2eb6f25700 1 -- 172.21.15.173:0/4112956068 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ab5eb51c80 con 0x55ab5ea8d400 2024-09-13T23:58:50.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.155+0000 7f2eb6f25700 1 -- 172.21.15.173:0/4112956068 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab5eb318c0 con 0x55ab5ea8d400 2024-09-13T23:58:50.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.155+0000 7f2ebb772f40 1 -- 172.21.15.173:0/4112956068 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ab5ea9f6c0 con 0x55ab5ea8d400 2024-09-13T23:58:50.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.155+0000 7f2ebb772f40 1 Processor -- start 2024-09-13T23:58:50.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.155+0000 7f2ebb772f40 1 -- start start 2024-09-13T23:58:50.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.155+0000 7f2eb6f25700 1 -- 172.21.15.173:0/4112956068 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55ab5eb86b00 con 0x55ab5ea8d400 2024-09-13T23:58:50.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.155+0000 7f2ebb772f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8dc00 0x55ab5ed73080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.155+0000 7f2ebb772f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab5eb1a000 con 0x55ab5ea8dc00 2024-09-13T23:58:50.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.155+0000 7f2eb6f25700 1 --2- 172.21.15.173:0/4112956068 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ab5ee2c000 0x55ab5ed74100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.155+0000 7f2eba72c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8dc00 0x55ab5ed73080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.155+0000 7f2eba72c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8dc00 0x55ab5ed73080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51176/0 (socket says 172.21.15.173:51176) 2024-09-13T23:58:50.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.155+0000 7f2eb6f25700 1 -- 172.21.15.173:0/4112956068 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x55ab5eaf3180 con 0x55ab5ea8d400 2024-09-13T23:58:50.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.155+0000 7f2eba72c700 1 -- 172.21.15.173:0/4107568658 learned_addr learned my addr 172.21.15.173:0/4107568658 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.155+0000 7f2eb9f2b700 1 --2- 172.21.15.173:0/4112956068 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ab5ee2c000 0x55ab5ed74100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.155+0000 7f2eba72c700 1 -- 172.21.15.173:0/4107568658 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab5ea9e000 con 0x55ab5ea8dc00 2024-09-13T23:58:50.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.155+0000 7f2eb9f2b700 1 --2- 172.21.15.173:0/4112956068 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ab5ee2c000 0x55ab5ed74100 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x55ab5edb4e40 tx=0x55ab5edf0f60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.155+0000 7f2eba72c700 1 --2- 172.21.15.173:0/4107568658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8dc00 0x55ab5ed73080 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x55ab5ed6df50 tx=0x55ab5edf1260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460871a510999721 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.155+0000 7f2eb4720700 1 -- 172.21.15.173:0/4107568658 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab5eb31600 con 0x55ab5ea8dc00 2024-09-13T23:58:50.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.155+0000 7f2eb4720700 1 -- 172.21.15.173:0/4107568658 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ab5ee3a000 con 0x55ab5ea8dc00 2024-09-13T23:58:50.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.155+0000 7f2eb4720700 1 -- 172.21.15.173:0/4107568658 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab5eb318c0 con 0x55ab5ea8dc00 2024-09-13T23:58:50.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.159+0000 7f2ebb772f40 1 -- 172.21.15.173:0/4107568658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8dc00 msgr2=0x55ab5ed73080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.159+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/4107568658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8dc00 0x55ab5ed73080 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x55ab5ed6df50 tx=0x55ab5edf1260 comp rx=0 tx=0).stop 2024-09-13T23:58:50.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.159+0000 7f2ebb772f40 1 -- 172.21.15.173:0/4107568658 shutdown_connections 2024-09-13T23:58:50.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.159+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/4107568658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8dc00 0x55ab5ed73080 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.159+0000 7f2ebb772f40 1 -- 172.21.15.173:0/4107568658 >> 172.21.15.173:0/4107568658 conn(0x55ab5ea8d800 msgr2=0x55ab5eb8d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.159+0000 7f2ebb772f40 1 -- 172.21.15.173:0/4107568658 shutdown_connections 2024-09-13T23:58:50.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.159+0000 7f2ebb772f40 1 -- 172.21.15.173:0/4107568658 wait complete. 2024-09-13T23:58:50.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.159+0000 7f2ebb772f40 1 Processor -- start 2024-09-13T23:58:50.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.159+0000 7f2ebb772f40 1 -- start start 2024-09-13T23:58:50.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.159+0000 7f2ebb772f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8dc00 0x55ab5ed73080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.159+0000 7f2ebb772f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab5eab2640 con 0x55ab5ea8dc00 2024-09-13T23:58:50.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.159+0000 7f2eba72c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8dc00 0x55ab5ed73080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.159+0000 7f2eba72c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8dc00 0x55ab5ed73080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51182/0 (socket says 172.21.15.173:51182) 2024-09-13T23:58:50.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.159+0000 7f2eba72c700 1 -- 172.21.15.173:0/379299503 learned_addr learned my addr 172.21.15.173:0/379299503 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.159+0000 7f2eba72c700 1 -- 172.21.15.173:0/379299503 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab5ea9eea0 con 0x55ab5ea8dc00 2024-09-13T23:58:50.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.159+0000 7f2eba72c700 1 --2- 172.21.15.173:0/379299503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8dc00 0x55ab5ed73080 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x55ab5edb4810 tx=0x55ab5edf05a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.159+0000 7f2eb2f1d700 1 -- 172.21.15.173:0/379299503 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab5eb31760 con 0x55ab5ea8dc00 2024-09-13T23:58:50.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.159+0000 7f2eb2f1d700 1 -- 172.21.15.173:0/379299503 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ab5ee3a180 con 0x55ab5ea8dc00 2024-09-13T23:58:50.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.159+0000 7f2eb2f1d700 1 -- 172.21.15.173:0/379299503 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab5eb31600 con 0x55ab5ea8dc00 2024-09-13T23:58:50.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.159+0000 7f2ebb772f40 1 -- 172.21.15.173:0/379299503 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ab5ea9e820 con 0x55ab5ea8dc00 2024-09-13T23:58:50.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.159+0000 7f2ebb772f40 1 -- 172.21.15.173:0/379299503 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ab5ea9e9c0 con 0x55ab5ea8dc00 2024-09-13T23:58:50.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.163+0000 7f2eb2f1d700 1 -- 172.21.15.173:0/379299503 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55ab5eb87080 con 0x55ab5ea8dc00 2024-09-13T23:58:50.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.163+0000 7f2eb2f1d700 1 --2- 172.21.15.173:0/379299503 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ab5ee2cc00 0x55ab5ed74680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.163+0000 7f2eb2f1d700 1 -- 172.21.15.173:0/379299503 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x55ab5eaf3340 con 0x55ab5ea8dc00 2024-09-13T23:58:50.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.163+0000 7f2ebb772f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:58:50.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.163+0000 7f2ebb772f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:58:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.163+0000 7f2eb972a700 1 --2- 172.21.15.173:0/379299503 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ab5ee2cc00 0x55ab5ed74680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.163+0000 7f2ebb772f40 1 Processor -- start 2024-09-13T23:58:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.163+0000 7f2ebb772f40 1 -- start start 2024-09-13T23:58:50.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.163+0000 7f2ebb772f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ee2d400 0x55ab5ed73600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.163+0000 7f2ebb772f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab5eab28c0 con 0x55ab5ee2d400 2024-09-13T23:58:50.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.163+0000 7f2eb972a700 1 --2- 172.21.15.173:0/379299503 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ab5ee2cc00 0x55ab5ed74680 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x55ab5ed6df80 tx=0x55ab5eed4900 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.163+0000 7f2eb9f2b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ee2d400 0x55ab5ed73600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.163+0000 7f2eb9f2b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ee2d400 0x55ab5ed73600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51186/0 (socket says 172.21.15.173:51186) 2024-09-13T23:58:50.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.163+0000 7f2eb9f2b700 1 -- 172.21.15.173:0/1372454741 learned_addr learned my addr 172.21.15.173:0/1372454741 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.163+0000 7f2eb9f2b700 1 -- 172.21.15.173:0/1372454741 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab5ea9eb60 con 0x55ab5ee2d400 2024-09-13T23:58:50.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.163+0000 7f2eb9f2b700 1 --2- 172.21.15.173:0/1372454741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ee2d400 0x55ab5ed73600 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x55ab5ee15380 tx=0x55ab5edf10e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca78c2ea52c08a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.163+0000 7f2ea0ef9700 1 -- 172.21.15.173:0/1372454741 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab5eb31760 con 0x55ab5ee2d400 2024-09-13T23:58:50.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.163+0000 7f2ea0ef9700 1 -- 172.21.15.173:0/1372454741 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ab5ee3a600 con 0x55ab5ee2d400 2024-09-13T23:58:50.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.163+0000 7f2ea0ef9700 1 -- 172.21.15.173:0/1372454741 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab5eb31600 con 0x55ab5ee2d400 2024-09-13T23:58:50.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.163+0000 7f2ebb772f40 1 -- 172.21.15.173:0/1372454741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ee2d400 msgr2=0x55ab5ed73600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.167+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/1372454741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ee2d400 0x55ab5ed73600 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x55ab5ee15380 tx=0x55ab5edf10e0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.167+0000 7f2ebb772f40 1 -- 172.21.15.173:0/1372454741 shutdown_connections 2024-09-13T23:58:50.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.167+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/1372454741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ee2d400 0x55ab5ed73600 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.167+0000 7f2ebb772f40 1 -- 172.21.15.173:0/1372454741 >> 172.21.15.173:0/1372454741 conn(0x55ab5ee2d000 msgr2=0x55ab5eb8e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.167+0000 7f2ebb772f40 1 -- 172.21.15.173:0/1372454741 shutdown_connections 2024-09-13T23:58:50.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.167+0000 7f2ebb772f40 1 -- 172.21.15.173:0/1372454741 wait complete. 2024-09-13T23:58:50.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.167+0000 7f2ebb772f40 1 Processor -- start 2024-09-13T23:58:50.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.167+0000 7f2ebb772f40 1 -- start start 2024-09-13T23:58:50.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.167+0000 7f2ebb772f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ee2d400 0x55ab5ed73600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.167+0000 7f2ebb772f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab5eab2f00 con 0x55ab5ee2d400 2024-09-13T23:58:50.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.167+0000 7f2eb9f2b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ee2d400 0x55ab5ed73600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.167+0000 7f2eb9f2b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ee2d400 0x55ab5ed73600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51194/0 (socket says 172.21.15.173:51194) 2024-09-13T23:58:50.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.167+0000 7f2eb9f2b700 1 -- 172.21.15.173:0/1372673258 learned_addr learned my addr 172.21.15.173:0/1372673258 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.167+0000 7f2eb9f2b700 1 -- 172.21.15.173:0/1372673258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab5ea9ed00 con 0x55ab5ee2d400 2024-09-13T23:58:50.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.167+0000 7f2eb9f2b700 1 --2- 172.21.15.173:0/1372673258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ee2d400 0x55ab5ed73600 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x55ab5ee9bb60 tx=0x55ab5edf1200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.167+0000 7f2e9f6f6700 1 -- 172.21.15.173:0/1372673258 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab5eb31a20 con 0x55ab5ee2d400 2024-09-13T23:58:50.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.167+0000 7f2e9f6f6700 1 -- 172.21.15.173:0/1372673258 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ab5ee3a300 con 0x55ab5ee2d400 2024-09-13T23:58:50.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.167+0000 7f2ebb772f40 1 -- 172.21.15.173:0/1372673258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ab5ea9e340 con 0x55ab5ee2d400 2024-09-13T23:58:50.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.167+0000 7f2e9f6f6700 1 -- 172.21.15.173:0/1372673258 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x55ab5eb31b80 con 0x55ab5ee2d400 2024-09-13T23:58:50.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.167+0000 7f2ebb772f40 1 -- 172.21.15.173:0/1372673258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ab5eefc000 con 0x55ab5ee2d400 2024-09-13T23:58:50.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.171+0000 7f2e9f6f6700 1 -- 172.21.15.173:0/1372673258 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x55ab5eb86dc0 con 0x55ab5ee2d400 2024-09-13T23:58:50.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.171+0000 7f2e9f6f6700 1 --2- 172.21.15.173:0/1372673258 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ab5eef3c00 0x55ab5ed74c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.171+0000 7f2e9f6f6700 1 -- 172.21.15.173:0/1372673258 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x55ab5eaf3500 con 0x55ab5ee2d400 2024-09-13T23:58:50.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.171+0000 7f2eb972a700 1 --2- 172.21.15.173:0/1372673258 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ab5eef3c00 0x55ab5ed74c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.171+0000 7f2eb972a700 1 --2- 172.21.15.173:0/1372673258 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ab5eef3c00 0x55ab5ed74c00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x55ab5ef10750 tx=0x55ab5eed4840 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.171+0000 7f2e9d6f2700 20 reqs_thread_entry: start 2024-09-13T23:58:50.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.171+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/4112956068 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55ab5eef2400 0x55ab5ed73b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.171+0000 7f2ebb772f40 1 -- 172.21.15.173:0/4112956068 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ab5eef2800 con 0x55ab5eef2400 2024-09-13T23:58:50.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.171+0000 7f2eba72c700 1 --2- 172.21.15.173:0/4112956068 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55ab5eef2400 0x55ab5ed73b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.171+0000 7f2eba72c700 1 --2- 172.21.15.173:0/4112956068 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55ab5eef2400 0x55ab5ed73b80 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.175+0000 7f2eba72c700 1 -- 172.21.15.173:0/4112956068 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x55ab5ef62240 con 0x55ab5eef2400 2024-09-13T23:58:50.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.175+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/4112956068 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55ab5eef2c00 0x55ab5ed75180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.175+0000 7f2ebb772f40 1 -- 172.21.15.173:0/4112956068 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:2 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ab5eef3000 con 0x55ab5eef2c00 2024-09-13T23:58:50.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.175+0000 7f2eb9f2b700 1 --2- 172.21.15.173:0/4112956068 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55ab5eef2c00 0x55ab5ed75180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.175+0000 7f2eb9f2b700 1 --2- 172.21.15.173:0/4112956068 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55ab5eef2c00 0x55ab5ed75180 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.175+0000 7f2eb9f2b700 1 -- 172.21.15.173:0/4112956068 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(2 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [call out=48b,read 0~1036 out=1036b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+1084 (crc 0 0 0) 0x55ab5ef62480 con 0x55ab5eef2c00 2024-09-13T23:58:50.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.175+0000 7f2ebb772f40 1 -- 172.21.15.173:0/4112956068 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:3 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~874 in=874b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x55ab5eef3400 con 0x55ab5eef2c00 2024-09-13T23:58:50.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.175+0000 7f2eb9f2b700 1 -- 172.21.15.173:0/4112956068 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(3 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [stat,call,call,writefull 0~874] v37'4 uv4 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x55ab5ef62480 con 0x55ab5eef2c00 2024-09-13T23:58:50.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 -- 172.21.15.173:0/379299503 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ab5ee2cc00 msgr2=0x55ab5ed74680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/379299503 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ab5ee2cc00 0x55ab5ed74680 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x55ab5ed6df80 tx=0x55ab5eed4900 comp rx=0 tx=0).stop 2024-09-13T23:58:50.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 -- 172.21.15.173:0/379299503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8dc00 msgr2=0x55ab5ed73080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/379299503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8dc00 0x55ab5ed73080 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x55ab5edb4810 tx=0x55ab5edf05a0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 -- 172.21.15.173:0/379299503 shutdown_connections 2024-09-13T23:58:50.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/379299503 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ab5ee2cc00 0x55ab5ed74680 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/379299503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8dc00 0x55ab5ed73080 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 -- 172.21.15.173:0/379299503 >> 172.21.15.173:0/379299503 conn(0x55ab5ea8d800 msgr2=0x55ab5eb8d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 -- 172.21.15.173:0/379299503 shutdown_connections 2024-09-13T23:58:50.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 -- 172.21.15.173:0/379299503 wait complete. 2024-09-13T23:58:50.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 -- 172.21.15.173:0/1372673258 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ab5eef3c00 msgr2=0x55ab5ed74c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/1372673258 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ab5eef3c00 0x55ab5ed74c00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x55ab5ef10750 tx=0x55ab5eed4840 comp rx=0 tx=0).stop 2024-09-13T23:58:50.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 -- 172.21.15.173:0/1372673258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ee2d400 msgr2=0x55ab5ed73600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/1372673258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ee2d400 0x55ab5ed73600 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x55ab5ee9bb60 tx=0x55ab5edf1200 comp rx=0 tx=0).stop 2024-09-13T23:58:50.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 -- 172.21.15.173:0/1372673258 shutdown_connections 2024-09-13T23:58:50.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/1372673258 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ab5eef3c00 0x55ab5ed74c00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/1372673258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ee2d400 0x55ab5ed73600 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 -- 172.21.15.173:0/1372673258 >> 172.21.15.173:0/1372673258 conn(0x55ab5ee2d000 msgr2=0x55ab5eb8e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 -- 172.21.15.173:0/1372673258 shutdown_connections 2024-09-13T23:58:50.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 -- 172.21.15.173:0/1372673258 wait complete. 2024-09-13T23:58:50.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 -- 172.21.15.173:0/4112956068 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55ab5eef2400 msgr2=0x55ab5ed73b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/4112956068 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55ab5eef2400 0x55ab5ed73b80 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 -- 172.21.15.173:0/4112956068 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55ab5eef2c00 msgr2=0x55ab5ed75180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/4112956068 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55ab5eef2c00 0x55ab5ed75180 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 -- 172.21.15.173:0/4112956068 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ab5ee2c000 msgr2=0x55ab5ed74100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/4112956068 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ab5ee2c000 0x55ab5ed74100 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x55ab5edb4e40 tx=0x55ab5edf0f60 comp rx=0 tx=0).stop 2024-09-13T23:58:50.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 -- 172.21.15.173:0/4112956068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8d400 msgr2=0x55ab5ed72b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/4112956068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8d400 0x55ab5ed72b00 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x55ab5ebe9f50 tx=0x55ab5eb91920 comp rx=0 tx=0).stop 2024-09-13T23:58:50.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 -- 172.21.15.173:0/4112956068 shutdown_connections 2024-09-13T23:58:50.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/4112956068 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x55ab5eef2c00 0x55ab5ed75180 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/4112956068 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x55ab5eef2400 0x55ab5ed73b80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/4112956068 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x55ab5ee2c000 0x55ab5ed74100 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 --2- 172.21.15.173:0/4112956068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55ab5ea8d400 0x55ab5ed72b00 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 -- 172.21.15.173:0/4112956068 >> 172.21.15.173:0/4112956068 conn(0x55ab5ea8cc00 msgr2=0x55ab5eb8d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 -- 172.21.15.173:0/4112956068 shutdown_connections 2024-09-13T23:58:50.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.179+0000 7f2ebb772f40 1 -- 172.21.15.173:0/4112956068 wait complete. 2024-09-13T23:58:50.188 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:58:50.188 INFO:teuthology.orchestra.run.smithi173.stdout: "id": "d342d0db-d035-4a54-bae7-2e0f76db6818", 2024-09-13T23:58:50.188 INFO:teuthology.orchestra.run.smithi173.stdout: "name": "default", 2024-09-13T23:58:50.188 INFO:teuthology.orchestra.run.smithi173.stdout: "domain_root": "default.rgw.meta:root", 2024-09-13T23:58:50.188 INFO:teuthology.orchestra.run.smithi173.stdout: "control_pool": "default.rgw.control", 2024-09-13T23:58:50.188 INFO:teuthology.orchestra.run.smithi173.stdout: "gc_pool": "default.rgw.log:gc", 2024-09-13T23:58:50.188 INFO:teuthology.orchestra.run.smithi173.stdout: "lc_pool": "default.rgw.log:lc", 2024-09-13T23:58:50.188 INFO:teuthology.orchestra.run.smithi173.stdout: "log_pool": "default.rgw.log", 2024-09-13T23:58:50.188 INFO:teuthology.orchestra.run.smithi173.stdout: "intent_log_pool": "default.rgw.log:intent", 2024-09-13T23:58:50.188 INFO:teuthology.orchestra.run.smithi173.stdout: "usage_log_pool": "default.rgw.log:usage", 2024-09-13T23:58:50.188 INFO:teuthology.orchestra.run.smithi173.stdout: "roles_pool": "default.rgw.meta:roles", 2024-09-13T23:58:50.189 INFO:teuthology.orchestra.run.smithi173.stdout: "reshard_pool": "default.rgw.log:reshard", 2024-09-13T23:58:50.189 INFO:teuthology.orchestra.run.smithi173.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2024-09-13T23:58:50.189 INFO:teuthology.orchestra.run.smithi173.stdout: "user_email_pool": "default.rgw.meta:users.email", 2024-09-13T23:58:50.189 INFO:teuthology.orchestra.run.smithi173.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2024-09-13T23:58:50.189 INFO:teuthology.orchestra.run.smithi173.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2024-09-13T23:58:50.189 INFO:teuthology.orchestra.run.smithi173.stdout: "otp_pool": "default.rgw.otp", 2024-09-13T23:58:50.189 INFO:teuthology.orchestra.run.smithi173.stdout: "system_key": { 2024-09-13T23:58:50.189 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "", 2024-09-13T23:58:50.189 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "" 2024-09-13T23:58:50.189 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:50.189 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_pools": [ 2024-09-13T23:58:50.189 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:50.189 INFO:teuthology.orchestra.run.smithi173.stdout: "key": "default-placement", 2024-09-13T23:58:50.189 INFO:teuthology.orchestra.run.smithi173.stdout: "val": { 2024-09-13T23:58:50.190 INFO:teuthology.orchestra.run.smithi173.stdout: "index_pool": "default.rgw.buckets.index", 2024-09-13T23:58:50.190 INFO:teuthology.orchestra.run.smithi173.stdout: "storage_classes": { 2024-09-13T23:58:50.190 INFO:teuthology.orchestra.run.smithi173.stdout: "STANDARD": { 2024-09-13T23:58:50.190 INFO:teuthology.orchestra.run.smithi173.stdout: "data_pool": "default.rgw.buckets.data" 2024-09-13T23:58:50.190 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:50.190 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:50.190 INFO:teuthology.orchestra.run.smithi173.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2024-09-13T23:58:50.190 INFO:teuthology.orchestra.run.smithi173.stdout: "index_type": 0, 2024-09-13T23:58:50.190 INFO:teuthology.orchestra.run.smithi173.stdout: "inline_data": true 2024-09-13T23:58:50.190 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:50.190 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:50.190 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:50.190 INFO:teuthology.orchestra.run.smithi173.stdout: "realm_id": "", 2024-09-13T23:58:50.191 INFO:teuthology.orchestra.run.smithi173.stdout: "notif_pool": "default.rgw.log:notif" 2024-09-13T23:58:50.191 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:58:50.192 DEBUG:tasks.util.rgw: json result: {'id': 'd342d0db-d035-4a54-bae7-2e0f76db6818', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-09-13T23:58:50.192 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-13T23:58:50.192 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-13T23:58:50.192 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-13T23:58:50.231 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:58:50.231 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:58:50.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.227+0000 7f70e4c05f40 1 Processor -- start 2024-09-13T23:58:50.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.227+0000 7f70e4c05f40 1 -- start start 2024-09-13T23:58:50.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.227+0000 7f70e4c05f40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x5568c2637400 0x5568c291c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.227+0000 7f70e4c05f40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5568c26fb500 con 0x5568c2637000 2024-09-13T23:58:50.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.227+0000 7f70e4c05f40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x5568c26c4a00 con 0x5568c2637400 2024-09-13T23:58:50.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.227+0000 7f70e2bbd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x5568c2637400 0x5568c291c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.227+0000 7f70e2bbd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x5568c2637400 0x5568c291c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51204/0 (socket says 172.21.15.173:51204) 2024-09-13T23:58:50.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.227+0000 7f70e33be700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x5568c2637000 0x5568c2736800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:53640/0 (socket says 172.21.15.173:53640) 2024-09-13T23:58:50.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.227+0000 7f70e2bbd700 1 -- 172.21.15.173:0/4107541048 learned_addr learned my addr 172.21.15.173:0/4107541048 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.227+0000 7f70e2bbd700 1 -- 172.21.15.173:0/4107541048 >> v1:172.21.15.87:6789/0 conn(0x5568c2637000 legacy=0x5568c2736800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.227+0000 7f70e2bbd700 1 -- 172.21.15.173:0/4107541048 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568c2649d40 con 0x5568c2637400 2024-09-13T23:58:50.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.231+0000 7f70e2bbd700 1 --2- 172.21.15.173:0/4107541048 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637400 0x5568c291c580 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x5568c2917920 tx=0x5568c273b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ae7197809115ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.231+0000 7f70e23bc700 1 -- 172.21.15.173:0/4107541048 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c26db4a0 con 0x5568c2637400 2024-09-13T23:58:50.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.231+0000 7f70e23bc700 1 -- 172.21.15.173:0/4107541048 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5568c26fb800 con 0x5568c2637400 2024-09-13T23:58:50.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.231+0000 7f70e23bc700 1 -- 172.21.15.173:0/4107541048 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c26db600 con 0x5568c2637400 2024-09-13T23:58:50.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.231+0000 7f70e4c05f40 1 -- 172.21.15.173:0/4107541048 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637400 msgr2=0x5568c291c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.231+0000 7f70e4c05f40 1 --2- 172.21.15.173:0/4107541048 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637400 0x5568c291c580 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x5568c2917920 tx=0x5568c273b920 comp rx=0 tx=0).stop 2024-09-13T23:58:50.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.231+0000 7f70e4c05f40 1 -- 172.21.15.173:0/4107541048 shutdown_connections 2024-09-13T23:58:50.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.231+0000 7f70e4c05f40 1 --2- 172.21.15.173:0/4107541048 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637400 0x5568c291c580 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.231+0000 7f70e4c05f40 1 -- 172.21.15.173:0/4107541048 >> 172.21.15.173:0/4107541048 conn(0x5568c2636c00 msgr2=0x5568c2736000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.231+0000 7f70e4c05f40 1 -- 172.21.15.173:0/4107541048 shutdown_connections 2024-09-13T23:58:50.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.231+0000 7f70e4c05f40 1 -- 172.21.15.173:0/4107541048 wait complete. 2024-09-13T23:58:50.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.231+0000 7f70e4c05f40 1 Processor -- start 2024-09-13T23:58:50.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.231+0000 7f70e4c05f40 1 -- start start 2024-09-13T23:58:50.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.231+0000 7f70e4c05f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637000 0x5568c291c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.231+0000 7f70e4c05f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c26c4500 con 0x5568c2637000 2024-09-13T23:58:50.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.231+0000 7f70e33be700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637000 0x5568c291c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.231+0000 7f70e33be700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637000 0x5568c291c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51220/0 (socket says 172.21.15.173:51220) 2024-09-13T23:58:50.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.231+0000 7f70e33be700 1 -- 172.21.15.173:0/4157744333 learned_addr learned my addr 172.21.15.173:0/4157744333 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.231+0000 7f70e33be700 1 -- 172.21.15.173:0/4157744333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568c2649ba0 con 0x5568c2637000 2024-09-13T23:58:50.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e33be700 1 --2- 172.21.15.173:0/4157744333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637000 0x5568c291c580 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x5568c2793e90 tx=0x5568c273bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2690dfd548a8e91 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e1bbb700 1 -- 172.21.15.173:0/4157744333 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c26db4a0 con 0x5568c2637000 2024-09-13T23:58:50.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e1bbb700 1 -- 172.21.15.173:0/4157744333 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5568c26fbb00 con 0x5568c2637000 2024-09-13T23:58:50.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e1bbb700 1 -- 172.21.15.173:0/4157744333 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c26db600 con 0x5568c2637000 2024-09-13T23:58:50.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e4c05f40 1 -- 172.21.15.173:0/4157744333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637000 msgr2=0x5568c291c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e4c05f40 1 --2- 172.21.15.173:0/4157744333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637000 0x5568c291c580 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x5568c2793e90 tx=0x5568c273bb60 comp rx=0 tx=0).stop 2024-09-13T23:58:50.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e4c05f40 1 -- 172.21.15.173:0/4157744333 shutdown_connections 2024-09-13T23:58:50.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e4c05f40 1 --2- 172.21.15.173:0/4157744333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637000 0x5568c291c580 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e4c05f40 1 -- 172.21.15.173:0/4157744333 >> 172.21.15.173:0/4157744333 conn(0x5568c2636c00 msgr2=0x5568c2737000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e4c05f40 1 -- 172.21.15.173:0/4157744333 shutdown_connections 2024-09-13T23:58:50.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e4c05f40 1 -- 172.21.15.173:0/4157744333 wait complete. 2024-09-13T23:58:50.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e4c05f40 1 Processor -- start 2024-09-13T23:58:50.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e4c05f40 1 -- start start 2024-09-13T23:58:50.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e4c05f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637000 0x5568c291c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e4c05f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c26c43c0 con 0x5568c2637000 2024-09-13T23:58:50.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e33be700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637000 0x5568c291c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e33be700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637000 0x5568c291c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51236/0 (socket says 172.21.15.173:51236) 2024-09-13T23:58:50.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e33be700 1 -- 172.21.15.173:0/111242380 learned_addr learned my addr 172.21.15.173:0/111242380 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e33be700 1 -- 172.21.15.173:0/111242380 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568c2649a00 con 0x5568c2637000 2024-09-13T23:58:50.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e33be700 1 --2- 172.21.15.173:0/111242380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637000 0x5568c291c580 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x5568c34a00c0 tx=0x5568c273ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e03b8700 1 -- 172.21.15.173:0/111242380 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c26db8c0 con 0x5568c2637000 2024-09-13T23:58:50.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e03b8700 1 -- 172.21.15.173:0/111242380 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5568c26fbc80 con 0x5568c2637000 2024-09-13T23:58:50.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e4c05f40 1 -- 172.21.15.173:0/111242380 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5568c2649860 con 0x5568c2637000 2024-09-13T23:58:50.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e03b8700 1 -- 172.21.15.173:0/111242380 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c26db4a0 con 0x5568c2637000 2024-09-13T23:58:50.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.235+0000 7f70e4c05f40 1 -- 172.21.15.173:0/111242380 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568c26496c0 con 0x5568c2637000 2024-09-13T23:58:50.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.239+0000 7f70e4c05f40 1 Processor -- start 2024-09-13T23:58:50.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.239+0000 7f70e4c05f40 1 -- start start 2024-09-13T23:58:50.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.239+0000 7f70e03b8700 1 -- 172.21.15.173:0/111242380 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x5568c2730b00 con 0x5568c2637000 2024-09-13T23:58:50.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.239+0000 7f70e4c05f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637800 0x5568c291cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.239+0000 7f70e4c05f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c26c4000 con 0x5568c2637800 2024-09-13T23:58:50.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.239+0000 7f70e03b8700 1 --2- 172.21.15.173:0/111242380 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5568c29de000 0x5568c291d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.239+0000 7f70e03b8700 1 -- 172.21.15.173:0/111242380 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x5568c269d180 con 0x5568c2637000 2024-09-13T23:58:50.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.239+0000 7f70e3bbf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637800 0x5568c291cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.239+0000 7f70e3bbf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637800 0x5568c291cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51248/0 (socket says 172.21.15.173:51248) 2024-09-13T23:58:50.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.239+0000 7f70e3bbf700 1 -- 172.21.15.173:0/3609597062 learned_addr learned my addr 172.21.15.173:0/3609597062 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.239+0000 7f70e33be700 1 --2- 172.21.15.173:0/111242380 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5568c29de000 0x5568c291d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.239+0000 7f70e3bbf700 1 -- 172.21.15.173:0/3609597062 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568c2648000 con 0x5568c2637800 2024-09-13T23:58:50.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.239+0000 7f70e33be700 1 --2- 172.21.15.173:0/111242380 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5568c29de000 0x5568c291d080 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x5568c34a15f0 tx=0x5568c2996240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.239+0000 7f70e3bbf700 1 --2- 172.21.15.173:0/3609597062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637800 0x5568c291cb00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x5568c34a0ed0 tx=0x5568c2997500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4546b519351d71e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.239+0000 7f70ddbb3700 1 -- 172.21.15.173:0/3609597062 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c26db8c0 con 0x5568c2637800 2024-09-13T23:58:50.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.239+0000 7f70ddbb3700 1 -- 172.21.15.173:0/3609597062 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5568c29f0000 con 0x5568c2637800 2024-09-13T23:58:50.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.239+0000 7f70ddbb3700 1 -- 172.21.15.173:0/3609597062 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c26db4a0 con 0x5568c2637800 2024-09-13T23:58:50.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.243+0000 7f70e4c05f40 1 -- 172.21.15.173:0/3609597062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637800 msgr2=0x5568c291cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.243+0000 7f70e4c05f40 1 --2- 172.21.15.173:0/3609597062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637800 0x5568c291cb00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x5568c34a0ed0 tx=0x5568c2997500 comp rx=0 tx=0).stop 2024-09-13T23:58:50.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.243+0000 7f70e4c05f40 1 -- 172.21.15.173:0/3609597062 shutdown_connections 2024-09-13T23:58:50.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.243+0000 7f70e4c05f40 1 --2- 172.21.15.173:0/3609597062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637800 0x5568c291cb00 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.243+0000 7f70e4c05f40 1 -- 172.21.15.173:0/3609597062 >> 172.21.15.173:0/3609597062 conn(0x5568c2637400 msgr2=0x5568c2737800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.243+0000 7f70e4c05f40 1 -- 172.21.15.173:0/3609597062 shutdown_connections 2024-09-13T23:58:50.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.243+0000 7f70e4c05f40 1 -- 172.21.15.173:0/3609597062 wait complete. 2024-09-13T23:58:50.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.243+0000 7f70e4c05f40 1 Processor -- start 2024-09-13T23:58:50.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.243+0000 7f70e4c05f40 1 -- start start 2024-09-13T23:58:50.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.243+0000 7f70e4c05f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637800 0x5568c291cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.243+0000 7f70e4c05f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c265c640 con 0x5568c2637800 2024-09-13T23:58:50.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.243+0000 7f70e3bbf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637800 0x5568c291cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.243+0000 7f70e3bbf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637800 0x5568c291cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51254/0 (socket says 172.21.15.173:51254) 2024-09-13T23:58:50.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.243+0000 7f70e3bbf700 1 -- 172.21.15.173:0/3634992959 learned_addr learned my addr 172.21.15.173:0/3634992959 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.243+0000 7f70e3bbf700 1 -- 172.21.15.173:0/3634992959 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568c2648ea0 con 0x5568c2637800 2024-09-13T23:58:50.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.243+0000 7f70e3bbf700 1 --2- 172.21.15.173:0/3634992959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637800 0x5568c291cb00 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x5568c2793770 tx=0x5568c2996120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.243+0000 7f70dc3b0700 1 -- 172.21.15.173:0/3634992959 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c26dbb80 con 0x5568c2637800 2024-09-13T23:58:50.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.243+0000 7f70dc3b0700 1 -- 172.21.15.173:0/3634992959 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5568c29f0180 con 0x5568c2637800 2024-09-13T23:58:50.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.243+0000 7f70dc3b0700 1 -- 172.21.15.173:0/3634992959 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c26db8c0 con 0x5568c2637800 2024-09-13T23:58:50.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.243+0000 7f70e4c05f40 1 -- 172.21.15.173:0/3634992959 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5568c2648820 con 0x5568c2637800 2024-09-13T23:58:50.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.247+0000 7f70e4c05f40 1 -- 172.21.15.173:0/3634992959 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568c26489c0 con 0x5568c2637800 2024-09-13T23:58:50.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.247+0000 7f70e4c05f40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:58:50.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.247+0000 7f70e4c05f40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:58:50.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.247+0000 7f70e4c05f40 1 Processor -- start 2024-09-13T23:58:50.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.247+0000 7f70dc3b0700 1 -- 172.21.15.173:0/3634992959 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x5568c2730dc0 con 0x5568c2637800 2024-09-13T23:58:50.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.247+0000 7f70e4c05f40 1 -- start start 2024-09-13T23:58:50.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.247+0000 7f70dc3b0700 1 --2- 172.21.15.173:0/3634992959 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5568c29dfc00 0x5568c291d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.247+0000 7f70dc3b0700 1 -- 172.21.15.173:0/3634992959 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x5568c269d340 con 0x5568c2637800 2024-09-13T23:58:50.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.247+0000 7f70e4c05f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c29df000 0x5568c291db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.247+0000 7f70e4c05f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c265c8c0 con 0x5568c29df000 2024-09-13T23:58:50.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.247+0000 7f70e3bbf700 1 --2- 172.21.15.173:0/3634992959 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5568c29dfc00 0x5568c291d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.247+0000 7f70e33be700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c29df000 0x5568c291db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.247+0000 7f70e33be700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c29df000 0x5568c291db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51270/0 (socket says 172.21.15.173:51270) 2024-09-13T23:58:50.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.247+0000 7f70e33be700 1 -- 172.21.15.173:0/823340291 learned_addr learned my addr 172.21.15.173:0/823340291 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.247+0000 7f70e3bbf700 1 --2- 172.21.15.173:0/3634992959 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5568c29dfc00 0x5568c291d600 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x5568c2a26930 tx=0x5568c2997bc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.247+0000 7f70e33be700 1 -- 172.21.15.173:0/823340291 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568c2648b60 con 0x5568c29df000 2024-09-13T23:58:50.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.247+0000 7f70e33be700 1 --2- 172.21.15.173:0/823340291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c29df000 0x5568c291db80 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x5568c34a1770 tx=0x5568c29973e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae955a20e44db0cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.247+0000 7f70ca38c700 1 -- 172.21.15.173:0/823340291 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c26db600 con 0x5568c29df000 2024-09-13T23:58:50.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.247+0000 7f70ca38c700 1 -- 172.21.15.173:0/823340291 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5568c29f0600 con 0x5568c29df000 2024-09-13T23:58:50.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.247+0000 7f70ca38c700 1 -- 172.21.15.173:0/823340291 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c26dba20 con 0x5568c29df000 2024-09-13T23:58:50.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.251+0000 7f70e4c05f40 1 -- 172.21.15.173:0/823340291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c29df000 msgr2=0x5568c291db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.251+0000 7f70e4c05f40 1 --2- 172.21.15.173:0/823340291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c29df000 0x5568c291db80 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x5568c34a1770 tx=0x5568c29973e0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.251+0000 7f70e4c05f40 1 -- 172.21.15.173:0/823340291 shutdown_connections 2024-09-13T23:58:50.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.251+0000 7f70e4c05f40 1 --2- 172.21.15.173:0/823340291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c29df000 0x5568c291db80 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.251+0000 7f70e4c05f40 1 -- 172.21.15.173:0/823340291 >> 172.21.15.173:0/823340291 conn(0x5568c29dec00 msgr2=0x5568c2738000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.251+0000 7f70e4c05f40 1 -- 172.21.15.173:0/823340291 shutdown_connections 2024-09-13T23:58:50.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.251+0000 7f70e4c05f40 1 -- 172.21.15.173:0/823340291 wait complete. 2024-09-13T23:58:50.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.251+0000 7f70e4c05f40 1 Processor -- start 2024-09-13T23:58:50.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.251+0000 7f70e4c05f40 1 -- start start 2024-09-13T23:58:50.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.251+0000 7f70e4c05f40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c29df000 0x5568c291db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.251+0000 7f70e4c05f40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c265cf00 con 0x5568c29df000 2024-09-13T23:58:50.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.251+0000 7f70e33be700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c29df000 0x5568c291db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.251+0000 7f70e33be700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c29df000 0x5568c291db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51286/0 (socket says 172.21.15.173:51286) 2024-09-13T23:58:50.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.251+0000 7f70e33be700 1 -- 172.21.15.173:0/3192293600 learned_addr learned my addr 172.21.15.173:0/3192293600 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.251+0000 7f70e33be700 1 -- 172.21.15.173:0/3192293600 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568c2648d00 con 0x5568c29df000 2024-09-13T23:58:50.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.251+0000 7f70e33be700 1 --2- 172.21.15.173:0/3192293600 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c29df000 0x5568c291db80 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x5568c2a26630 tx=0x5568c29961e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.251+0000 7f70c8b89700 1 -- 172.21.15.173:0/3192293600 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c26db600 con 0x5568c29df000 2024-09-13T23:58:50.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.251+0000 7f70c8b89700 1 -- 172.21.15.173:0/3192293600 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5568c29f0300 con 0x5568c29df000 2024-09-13T23:58:50.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.251+0000 7f70e4c05f40 1 -- 172.21.15.173:0/3192293600 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5568c2648340 con 0x5568c29df000 2024-09-13T23:58:50.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.251+0000 7f70c8b89700 1 -- 172.21.15.173:0/3192293600 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x5568c26dba20 con 0x5568c29df000 2024-09-13T23:58:50.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.255+0000 7f70e4c05f40 1 -- 172.21.15.173:0/3192293600 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568c2aa2000 con 0x5568c29df000 2024-09-13T23:58:50.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.255+0000 7f70c8b89700 1 -- 172.21.15.173:0/3192293600 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x5568c2731b80 con 0x5568c29df000 2024-09-13T23:58:50.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.255+0000 7f70c8b89700 1 --2- 172.21.15.173:0/3192293600 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5568c2a9bc00 0x5568c291ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.255+0000 7f70c8b89700 1 -- 172.21.15.173:0/3192293600 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x5568c269d500 con 0x5568c29df000 2024-09-13T23:58:50.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.255+0000 7f70e2bbd700 1 --2- 172.21.15.173:0/3192293600 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5568c2a9bc00 0x5568c291ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.255+0000 7f70e2bbd700 1 --2- 172.21.15.173:0/3192293600 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5568c2a9bc00 0x5568c291ec00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x5568c2917920 tx=0x5568c273b800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.255+0000 7f70c6b85700 20 reqs_thread_entry: start 2024-09-13T23:58:50.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.255+0000 7f70e4c05f40 1 --2- 172.21.15.173:0/111242380 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5568c2a9a800 0x5568c291e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.255+0000 7f70e4c05f40 1 -- 172.21.15.173:0/111242380 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5568c2a9ac00 con 0x5568c2a9a800 2024-09-13T23:58:50.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.255+0000 7f70e3bbf700 1 --2- 172.21.15.173:0/111242380 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5568c2a9a800 0x5568c291e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.259+0000 7f70e3bbf700 1 --2- 172.21.15.173:0/111242380 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5568c2a9a800 0x5568c291e100 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.259+0000 7f70e3bbf700 1 -- 172.21.15.173:0/111242380 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x5568c2b00240 con 0x5568c2a9a800 2024-09-13T23:58:50.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.259+0000 7f70e4c05f40 1 --2- 172.21.15.173:0/111242380 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5568c2a9b000 0x5568c291e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.259+0000 7f70e4c05f40 1 -- 172.21.15.173:0/111242380 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5568c2a9b400 con 0x5568c2a9b000 2024-09-13T23:58:50.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.259+0000 7f70e33be700 1 --2- 172.21.15.173:0/111242380 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5568c2a9b000 0x5568c291e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.259+0000 7f70e33be700 1 --2- 172.21.15.173:0/111242380 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5568c2a9b000 0x5568c291e680 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.259+0000 7f70e33be700 1 -- 172.21.15.173:0/111242380 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x5568c2b00900 con 0x5568c2a9b000 2024-09-13T23:58:50.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.259+0000 7f70e4c05f40 1 --2- 172.21.15.173:0/111242380 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5568c2a9b800 0x5568c291f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.259+0000 7f70e4c05f40 1 -- 172.21.15.173:0/111242380 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:3 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x5568c2b20000 con 0x5568c2a9b800 2024-09-13T23:58:50.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.259+0000 7f70e2bbd700 1 --2- 172.21.15.173:0/111242380 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5568c2a9b800 0x5568c291f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.259+0000 7f70e2bbd700 1 --2- 172.21.15.173:0/111242380 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5568c2a9b800 0x5568c291f180 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.259+0000 7f70e2bbd700 1 -- 172.21.15.173:0/111242380 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(3 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [call out=24b,read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+444 (crc 0 0 0) 0x5568c2b00b40 con 0x5568c2a9b800 2024-09-13T23:58:50.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 -- 172.21.15.173:0/3634992959 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5568c29dfc00 msgr2=0x5568c291d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 --2- 172.21.15.173:0/3634992959 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5568c29dfc00 0x5568c291d600 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x5568c2a26930 tx=0x5568c2997bc0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 -- 172.21.15.173:0/3634992959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637800 msgr2=0x5568c291cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 --2- 172.21.15.173:0/3634992959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637800 0x5568c291cb00 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x5568c2793770 tx=0x5568c2996120 comp rx=0 tx=0).stop 2024-09-13T23:58:50.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 -- 172.21.15.173:0/3634992959 shutdown_connections 2024-09-13T23:58:50.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 --2- 172.21.15.173:0/3634992959 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5568c29dfc00 0x5568c291d600 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 --2- 172.21.15.173:0/3634992959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637800 0x5568c291cb00 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 -- 172.21.15.173:0/3634992959 >> 172.21.15.173:0/3634992959 conn(0x5568c2637400 msgr2=0x5568c2737800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 -- 172.21.15.173:0/3634992959 shutdown_connections 2024-09-13T23:58:50.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 -- 172.21.15.173:0/3634992959 wait complete. 2024-09-13T23:58:50.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 -- 172.21.15.173:0/3192293600 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5568c2a9bc00 msgr2=0x5568c291ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 --2- 172.21.15.173:0/3192293600 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5568c2a9bc00 0x5568c291ec00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x5568c2917920 tx=0x5568c273b800 comp rx=0 tx=0).stop 2024-09-13T23:58:50.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 -- 172.21.15.173:0/3192293600 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c29df000 msgr2=0x5568c291db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 --2- 172.21.15.173:0/3192293600 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c29df000 0x5568c291db80 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x5568c2a26630 tx=0x5568c29961e0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 -- 172.21.15.173:0/3192293600 shutdown_connections 2024-09-13T23:58:50.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 --2- 172.21.15.173:0/3192293600 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5568c2a9bc00 0x5568c291ec00 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 --2- 172.21.15.173:0/3192293600 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c29df000 0x5568c291db80 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 -- 172.21.15.173:0/3192293600 >> 172.21.15.173:0/3192293600 conn(0x5568c29dec00 msgr2=0x5568c2738000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 -- 172.21.15.173:0/3192293600 shutdown_connections 2024-09-13T23:58:50.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 -- 172.21.15.173:0/3192293600 wait complete. 2024-09-13T23:58:50.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 -- 172.21.15.173:0/111242380 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5568c2a9b000 msgr2=0x5568c291e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 --2- 172.21.15.173:0/111242380 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x5568c2a9b000 0x5568c291e680 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 -- 172.21.15.173:0/111242380 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5568c2a9a800 msgr2=0x5568c291e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 --2- 172.21.15.173:0/111242380 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x5568c2a9a800 0x5568c291e100 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 -- 172.21.15.173:0/111242380 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5568c2a9b800 msgr2=0x5568c291f180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 --2- 172.21.15.173:0/111242380 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x5568c2a9b800 0x5568c291f180 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 -- 172.21.15.173:0/111242380 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5568c29de000 msgr2=0x5568c291d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 --2- 172.21.15.173:0/111242380 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x5568c29de000 0x5568c291d080 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x5568c34a15f0 tx=0x5568c2996240 comp rx=0 tx=0).stop 2024-09-13T23:58:50.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 -- 172.21.15.173:0/111242380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637000 msgr2=0x5568c291c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 --2- 172.21.15.173:0/111242380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5568c2637000 0x5568c291c580 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x5568c34a00c0 tx=0x5568c273ba40 comp rx=0 tx=0).stop 2024-09-13T23:58:50.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e3bbf700 1 -- 172.21.15.173:0/111242380 reap_dead start 2024-09-13T23:58:50.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 -- 172.21.15.173:0/111242380 shutdown_connections 2024-09-13T23:58:50.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 -- 172.21.15.173:0/111242380 >> 172.21.15.173:0/111242380 conn(0x5568c2636c00 msgr2=0x5568c2737000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 -- 172.21.15.173:0/111242380 shutdown_connections 2024-09-13T23:58:50.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.263+0000 7f70e4c05f40 1 -- 172.21.15.173:0/111242380 wait complete. 2024-09-13T23:58:50.272 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:58:50.272 INFO:teuthology.orchestra.run.smithi173.stdout: "id": "45606a84-a024-4d59-86ac-9903db661675", 2024-09-13T23:58:50.272 INFO:teuthology.orchestra.run.smithi173.stdout: "name": "default", 2024-09-13T23:58:50.272 INFO:teuthology.orchestra.run.smithi173.stdout: "api_name": "default", 2024-09-13T23:58:50.272 INFO:teuthology.orchestra.run.smithi173.stdout: "is_master": true, 2024-09-13T23:58:50.272 INFO:teuthology.orchestra.run.smithi173.stdout: "endpoints": [], 2024-09-13T23:58:50.272 INFO:teuthology.orchestra.run.smithi173.stdout: "hostnames": [], 2024-09-13T23:58:50.272 INFO:teuthology.orchestra.run.smithi173.stdout: "hostnames_s3website": [], 2024-09-13T23:58:50.273 INFO:teuthology.orchestra.run.smithi173.stdout: "master_zone": "d342d0db-d035-4a54-bae7-2e0f76db6818", 2024-09-13T23:58:50.273 INFO:teuthology.orchestra.run.smithi173.stdout: "zones": [ 2024-09-13T23:58:50.273 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:50.273 INFO:teuthology.orchestra.run.smithi173.stdout: "id": "d342d0db-d035-4a54-bae7-2e0f76db6818", 2024-09-13T23:58:50.273 INFO:teuthology.orchestra.run.smithi173.stdout: "name": "default", 2024-09-13T23:58:50.273 INFO:teuthology.orchestra.run.smithi173.stdout: "endpoints": [], 2024-09-13T23:58:50.273 INFO:teuthology.orchestra.run.smithi173.stdout: "log_meta": false, 2024-09-13T23:58:50.273 INFO:teuthology.orchestra.run.smithi173.stdout: "log_data": false, 2024-09-13T23:58:50.273 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_index_max_shards": 11, 2024-09-13T23:58:50.273 INFO:teuthology.orchestra.run.smithi173.stdout: "read_only": false, 2024-09-13T23:58:50.273 INFO:teuthology.orchestra.run.smithi173.stdout: "tier_type": "", 2024-09-13T23:58:50.273 INFO:teuthology.orchestra.run.smithi173.stdout: "sync_from_all": true, 2024-09-13T23:58:50.274 INFO:teuthology.orchestra.run.smithi173.stdout: "sync_from": [], 2024-09-13T23:58:50.274 INFO:teuthology.orchestra.run.smithi173.stdout: "redirect_zone": "", 2024-09-13T23:58:50.274 INFO:teuthology.orchestra.run.smithi173.stdout: "supported_features": [ 2024-09-13T23:58:50.274 INFO:teuthology.orchestra.run.smithi173.stdout: "compress-encrypted", 2024-09-13T23:58:50.274 INFO:teuthology.orchestra.run.smithi173.stdout: "resharding" 2024-09-13T23:58:50.274 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:50.274 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:50.274 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:50.274 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_targets": [ 2024-09-13T23:58:50.274 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:50.274 INFO:teuthology.orchestra.run.smithi173.stdout: "name": "default-placement", 2024-09-13T23:58:50.274 INFO:teuthology.orchestra.run.smithi173.stdout: "tags": [], 2024-09-13T23:58:50.274 INFO:teuthology.orchestra.run.smithi173.stdout: "storage_classes": [ 2024-09-13T23:58:50.275 INFO:teuthology.orchestra.run.smithi173.stdout: "STANDARD" 2024-09-13T23:58:50.275 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:50.275 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:50.275 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:50.275 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "default-placement", 2024-09-13T23:58:50.275 INFO:teuthology.orchestra.run.smithi173.stdout: "realm_id": "", 2024-09-13T23:58:50.275 INFO:teuthology.orchestra.run.smithi173.stdout: "sync_policy": { 2024-09-13T23:58:50.275 INFO:teuthology.orchestra.run.smithi173.stdout: "groups": [] 2024-09-13T23:58:50.275 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:50.275 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled_features": [ 2024-09-13T23:58:50.275 INFO:teuthology.orchestra.run.smithi173.stdout: "resharding" 2024-09-13T23:58:50.275 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-13T23:58:50.275 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:58:50.276 DEBUG:tasks.util.rgw: json result: {'id': '45606a84-a024-4d59-86ac-9903db661675', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': 'd342d0db-d035-4a54-bae7-2e0f76db6818', 'zones': [{'id': 'd342d0db-d035-4a54-bae7-2e0f76db6818', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['compress-encrypted', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['resharding']} 2024-09-13T23:58:50.279 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-13T23:58:50.297 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-13T23:58:50.297 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-13T23:58:50.297 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-13T23:58:50.348 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:58:50.349 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:58:50.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.343+0000 7f380d4dcf40 1 Processor -- start 2024-09-13T23:58:50.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.347+0000 7f380d4dcf40 1 -- start start 2024-09-13T23:58:50.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.347+0000 7f380d4dcf40 1 --2- >> v2:172.21.15.87:3300/0 conn(0x556a1246f400 0x556a12754580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.347+0000 7f380d4dcf40 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556a12533500 con 0x556a1246f000 2024-09-13T23:58:50.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.347+0000 7f380d4dcf40 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x556a124fca00 con 0x556a1246f400 2024-09-13T23:58:50.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.347+0000 7f380b494700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x556a1246f400 0x556a12754580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.347+0000 7f380bc95700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x556a1246f000 0x556a1256e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.173:53656/0 (socket says 172.21.15.173:53656) 2024-09-13T23:58:50.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.347+0000 7f380bc95700 1 -- 172.21.15.173:0/4054567795 learned_addr learned my addr 172.21.15.173:0/4054567795 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-09-13T23:58:50.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.347+0000 7f380b494700 1 -- 172.21.15.173:0/4054567795 >> v1:172.21.15.87:6789/0 conn(0x556a1246f000 legacy=0x556a1256e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.347+0000 7f380ac93700 1 -- 172.21.15.173:0/4054567795 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1401893000 0 0) 0x556a125ca000 con 0x556a1246f000 2024-09-13T23:58:50.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.347+0000 7f380b494700 1 -- 172.21.15.173:0/4054567795 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a12481d40 con 0x556a1246f400 2024-09-13T23:58:50.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.347+0000 7f380b494700 1 --2- 172.21.15.173:0/4054567795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f400 0x556a12754580 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x556a1274f920 tx=0x556a12573920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbcf4192989b728 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.347+0000 7f380ac93700 1 -- 172.21.15.173:0/4054567795 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556a125134a0 con 0x556a1246f400 2024-09-13T23:58:50.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.347+0000 7f380ac93700 1 -- 172.21.15.173:0/4054567795 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556a12533800 con 0x556a1246f400 2024-09-13T23:58:50.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.347+0000 7f380ac93700 1 -- 172.21.15.173:0/4054567795 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556a12513600 con 0x556a1246f400 2024-09-13T23:58:50.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.347+0000 7f380d4dcf40 1 -- 172.21.15.173:0/4054567795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f400 msgr2=0x556a12754580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.347+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/4054567795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f400 0x556a12754580 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x556a1274f920 tx=0x556a12573920 comp rx=0 tx=0).stop 2024-09-13T23:58:50.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.347+0000 7f380d4dcf40 1 -- 172.21.15.173:0/4054567795 shutdown_connections 2024-09-13T23:58:50.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.347+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/4054567795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f400 0x556a12754580 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.347+0000 7f380d4dcf40 1 -- 172.21.15.173:0/4054567795 >> 172.21.15.173:0/4054567795 conn(0x556a1246ec00 msgr2=0x556a1256e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.347+0000 7f380d4dcf40 1 -- 172.21.15.173:0/4054567795 shutdown_connections 2024-09-13T23:58:50.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.347+0000 7f380d4dcf40 1 -- 172.21.15.173:0/4054567795 wait complete. 2024-09-13T23:58:50.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.347+0000 7f380d4dcf40 1 Processor -- start 2024-09-13T23:58:50.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.347+0000 7f380d4dcf40 1 -- start start 2024-09-13T23:58:50.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380d4dcf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f000 0x556a12754580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380d4dcf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a124fc500 con 0x556a1246f000 2024-09-13T23:58:50.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380bc95700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f000 0x556a12754580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380bc95700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f000 0x556a12754580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51300/0 (socket says 172.21.15.173:51300) 2024-09-13T23:58:50.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380bc95700 1 -- 172.21.15.173:0/3797826128 learned_addr learned my addr 172.21.15.173:0/3797826128 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380bc95700 1 -- 172.21.15.173:0/3797826128 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a12481ba0 con 0x556a1246f000 2024-09-13T23:58:50.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380bc95700 1 --2- 172.21.15.173:0/3797826128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f000 0x556a12754580 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x556a13239d70 tx=0x556a12573b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c525a50b43bf89 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380a492700 1 -- 172.21.15.173:0/3797826128 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556a125134a0 con 0x556a1246f000 2024-09-13T23:58:50.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380a492700 1 -- 172.21.15.173:0/3797826128 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556a12533b00 con 0x556a1246f000 2024-09-13T23:58:50.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380a492700 1 -- 172.21.15.173:0/3797826128 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556a12513600 con 0x556a1246f000 2024-09-13T23:58:50.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380d4dcf40 1 -- 172.21.15.173:0/3797826128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f000 msgr2=0x556a12754580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/3797826128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f000 0x556a12754580 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x556a13239d70 tx=0x556a12573b60 comp rx=0 tx=0).stop 2024-09-13T23:58:50.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380d4dcf40 1 -- 172.21.15.173:0/3797826128 shutdown_connections 2024-09-13T23:58:50.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/3797826128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f000 0x556a12754580 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380d4dcf40 1 -- 172.21.15.173:0/3797826128 >> 172.21.15.173:0/3797826128 conn(0x556a1246ec00 msgr2=0x556a1256f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380d4dcf40 1 -- 172.21.15.173:0/3797826128 shutdown_connections 2024-09-13T23:58:50.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380d4dcf40 1 -- 172.21.15.173:0/3797826128 wait complete. 2024-09-13T23:58:50.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380d4dcf40 1 Processor -- start 2024-09-13T23:58:50.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380d4dcf40 1 -- start start 2024-09-13T23:58:50.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380d4dcf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f000 0x556a12754580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380d4dcf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a124fc3c0 con 0x556a1246f000 2024-09-13T23:58:50.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380bc95700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f000 0x556a12754580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380bc95700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f000 0x556a12754580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51308/0 (socket says 172.21.15.173:51308) 2024-09-13T23:58:50.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380bc95700 1 -- 172.21.15.173:0/4280167961 learned_addr learned my addr 172.21.15.173:0/4280167961 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.351+0000 7f380bc95700 1 -- 172.21.15.173:0/4280167961 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a12481a00 con 0x556a1246f000 2024-09-13T23:58:50.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.355+0000 7f380bc95700 1 --2- 172.21.15.173:0/4280167961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f000 0x556a12754580 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x556a13239e00 tx=0x556a12573a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.355+0000 7f3808c8f700 1 -- 172.21.15.173:0/4280167961 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556a125138c0 con 0x556a1246f000 2024-09-13T23:58:50.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.355+0000 7f3808c8f700 1 -- 172.21.15.173:0/4280167961 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556a12533c80 con 0x556a1246f000 2024-09-13T23:58:50.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.355+0000 7f380d4dcf40 1 -- 172.21.15.173:0/4280167961 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556a12481860 con 0x556a1246f000 2024-09-13T23:58:50.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.355+0000 7f3808c8f700 1 -- 172.21.15.173:0/4280167961 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556a125134a0 con 0x556a1246f000 2024-09-13T23:58:50.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.355+0000 7f380d4dcf40 1 -- 172.21.15.173:0/4280167961 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a124816c0 con 0x556a1246f000 2024-09-13T23:58:50.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.355+0000 7f3808c8f700 1 -- 172.21.15.173:0/4280167961 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x556a12568b00 con 0x556a1246f000 2024-09-13T23:58:50.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.355+0000 7f380d4dcf40 1 Processor -- start 2024-09-13T23:58:50.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.355+0000 7f380d4dcf40 1 -- start start 2024-09-13T23:58:50.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.355+0000 7f380d4dcf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f800 0x556a12754b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.355+0000 7f380d4dcf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a12494640 con 0x556a1246f800 2024-09-13T23:58:50.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.355+0000 7f3808c8f700 1 --2- 172.21.15.173:0/4280167961 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556a1280c000 0x556a12755080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.355+0000 7f3808c8f700 1 -- 172.21.15.173:0/4280167961 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x556a124d5180 con 0x556a1246f000 2024-09-13T23:58:50.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.355+0000 7f380c496700 1 --2- 172.21.15.173:0/4280167961 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556a1280c000 0x556a12755080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.355+0000 7f380bc95700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f800 0x556a12754b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.355+0000 7f380bc95700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f800 0x556a12754b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51312/0 (socket says 172.21.15.173:51312) 2024-09-13T23:58:50.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.355+0000 7f380bc95700 1 -- 172.21.15.173:0/4194996453 learned_addr learned my addr 172.21.15.173:0/4194996453 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.355+0000 7f380c496700 1 --2- 172.21.15.173:0/4280167961 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556a1280c000 0x556a12755080 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x556a13239dd0 tx=0x556a127c7200 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.355+0000 7f380bc95700 1 -- 172.21.15.173:0/4194996453 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a12480000 con 0x556a1246f800 2024-09-13T23:58:50.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.355+0000 7f380bc95700 1 --2- 172.21.15.173:0/4194996453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f800 0x556a12754b00 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x556a12796390 tx=0x556a127c6240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef596ec8f38ea8c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.355+0000 7f380648a700 1 -- 172.21.15.173:0/4194996453 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556a12513600 con 0x556a1246f800 2024-09-13T23:58:50.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.359+0000 7f380648a700 1 -- 172.21.15.173:0/4194996453 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556a12533c80 con 0x556a1246f800 2024-09-13T23:58:50.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.359+0000 7f380648a700 1 -- 172.21.15.173:0/4194996453 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556a12513a20 con 0x556a1246f800 2024-09-13T23:58:50.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.359+0000 7f380d4dcf40 1 -- 172.21.15.173:0/4194996453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f800 msgr2=0x556a12754b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.359+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/4194996453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f800 0x556a12754b00 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x556a12796390 tx=0x556a127c6240 comp rx=0 tx=0).stop 2024-09-13T23:58:50.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.359+0000 7f380d4dcf40 1 -- 172.21.15.173:0/4194996453 shutdown_connections 2024-09-13T23:58:50.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.359+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/4194996453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f800 0x556a12754b00 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.359+0000 7f380d4dcf40 1 -- 172.21.15.173:0/4194996453 >> 172.21.15.173:0/4194996453 conn(0x556a1246f400 msgr2=0x556a1256f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.359+0000 7f380d4dcf40 1 -- 172.21.15.173:0/4194996453 shutdown_connections 2024-09-13T23:58:50.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.359+0000 7f380d4dcf40 1 -- 172.21.15.173:0/4194996453 wait complete. 2024-09-13T23:58:50.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.359+0000 7f380d4dcf40 1 Processor -- start 2024-09-13T23:58:50.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.359+0000 7f380d4dcf40 1 -- start start 2024-09-13T23:58:50.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.359+0000 7f380d4dcf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f800 0x556a12754b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.359+0000 7f380d4dcf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a124948c0 con 0x556a1246f800 2024-09-13T23:58:50.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.359+0000 7f380bc95700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f800 0x556a12754b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.359+0000 7f380bc95700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f800 0x556a12754b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51328/0 (socket says 172.21.15.173:51328) 2024-09-13T23:58:50.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.359+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 learned_addr learned my addr 172.21.15.173:0/926089420 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.359+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a12480ea0 con 0x556a1246f800 2024-09-13T23:58:50.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.359+0000 7f380bc95700 1 --2- 172.21.15.173:0/926089420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f800 0x556a12754b00 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x556a1280ee10 tx=0x556a127c73e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.359+0000 7f3804c87700 1 -- 172.21.15.173:0/926089420 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556a12513600 con 0x556a1246f800 2024-09-13T23:58:50.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.359+0000 7f3804c87700 1 -- 172.21.15.173:0/926089420 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556a12838000 con 0x556a1246f800 2024-09-13T23:58:50.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.359+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556a12480820 con 0x556a1246f800 2024-09-13T23:58:50.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.359+0000 7f3804c87700 1 -- 172.21.15.173:0/926089420 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556a12513a20 con 0x556a1246f800 2024-09-13T23:58:50.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.359+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a124809c0 con 0x556a1246f800 2024-09-13T23:58:50.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f380d4dcf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:50.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f3804c87700 1 -- 172.21.15.173:0/926089420 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x556a12568dc0 con 0x556a1246f800 2024-09-13T23:58:50.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f3804c87700 1 --2- 172.21.15.173:0/926089420 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556a1280d000 0x556a12755600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f3804c87700 1 -- 172.21.15.173:0/926089420 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x556a124d5340 con 0x556a1246f800 2024-09-13T23:58:50.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f380b494700 1 --2- 172.21.15.173:0/926089420 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556a1280d000 0x556a12755600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/926089420 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x556a1280d400 0x556a12755b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a1280d800 con 0x556a1280d400 2024-09-13T23:58:50.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f380c496700 1 --2- 172.21.15.173:0/926089420 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x556a1280d400 0x556a12755b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f380b494700 1 --2- 172.21.15.173:0/926089420 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556a1280d000 0x556a12755600 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x556a1274f920 tx=0x556a12573800 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f380c496700 1 --2- 172.21.15.173:0/926089420 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x556a1280d400 0x556a12755b80 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.1 v2:172.21.15.173:6808/3256211813 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x556a12854b40 con 0x556a1280d400 2024-09-13T23:58:50.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f380d4dcf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:50.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f380d4dcf40 20 realm 2024-09-13T23:58:50.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f380d4dcf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:50.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a1280dc00 con 0x556a1280d400 2024-09-13T23:58:50.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.1 v2:172.21.15.173:6808/3256211813 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x556a12854b40 con 0x556a1280d400 2024-09-13T23:58:50.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f380d4dcf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:50.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f380d4dcf40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:58:50.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f380d4dcf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:50.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a1280d800 con 0x556a1280d400 2024-09-13T23:58:50.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.1 v2:172.21.15.173:6808/3256211813 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x556a12854b40 con 0x556a1280d400 2024-09-13T23:58:50.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f380d4dcf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:50.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f380d4dcf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:50.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/926089420 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x556a1280dc00 0x556a12756100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.363+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a1280dc00 2024-09-13T23:58:50.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.367+0000 7f380bc95700 1 --2- 172.21.15.173:0/926089420 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x556a1280dc00 0x556a12756100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.367+0000 7f380bc95700 1 --2- 172.21.15.173:0/926089420 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x556a1280dc00 0x556a12756100 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.367+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x556a12855200 con 0x556a1280dc00 2024-09-13T23:58:50.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.367+0000 7f380d4dcf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:50.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.367+0000 7f380d4dcf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:50.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.367+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/926089420 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x556a128a6400 0x556a12756680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.367+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:5 5.0 5:012be80f:::zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6800 con 0x556a128a6400 2024-09-13T23:58:50.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.367+0000 7f380b494700 1 --2- 172.21.15.173:0/926089420 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x556a128a6400 0x556a12756680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.367+0000 7f380b494700 1 --2- 172.21.15.173:0/926089420 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x556a128a6400 0x556a12756680 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.367+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 <== osd.3 v2:172.21.15.173:6800/4020038786 1 ==== osd_op_reply(5 zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 [read 0~874 out=874b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x556a12855440 con 0x556a128a6400 2024-09-13T23:58:50.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.367+0000 7f380d4dcf40 20 rados_obj.operate() r=0 bl.length=874 2024-09-13T23:58:50.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.367+0000 7f380d4dcf40 20 searching for the correct realm 2024-09-13T23:58:50.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.367+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6c00 con 0x556a128a6400 2024-09-13T23:58:50.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.367+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 <== osd.3 v2:172.21.15.173:6800/4020038786 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x556a12855440 con 0x556a128a6400 2024-09-13T23:58:50.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.371+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6800 con 0x556a1280dc00 2024-09-13T23:58:50.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.371+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 2 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12855200 con 0x556a1280dc00 2024-09-13T23:58:50.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.371+0000 7f380bc95700 1 --2- 172.21.15.173:0/926089420 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x556a128a6800 0x556a12756c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.371+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a128a6800 2024-09-13T23:58:50.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.371+0000 7f380c496700 1 --2- 172.21.15.173:0/926089420 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x556a128a6800 0x556a12756c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.371+0000 7f380c496700 1 --2- 172.21.15.173:0/926089420 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x556a128a6800 0x556a12756c00 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.371+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.2 v2:172.21.15.173:6809/889985573 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12854b40 con 0x556a128a6800 2024-09-13T23:58:50.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.371+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a128a6800 2024-09-13T23:58:50.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.371+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.2 v2:172.21.15.173:6809/889985573 2 ==== osd_op_reply(9 [pgnls start_epoch 37 out=112b] v26'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x556a12854b40 con 0x556a128a6800 2024-09-13T23:58:50.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.371+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a1280d400 2024-09-13T23:58:50.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.371+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.1 v2:172.21.15.173:6808/3256211813 4 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12854b40 con 0x556a1280d400 2024-09-13T23:58:50.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.371+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a128a6400 2024-09-13T23:58:50.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.371+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 <== osd.3 v2:172.21.15.173:6800/4020038786 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12855440 con 0x556a128a6400 2024-09-13T23:58:50.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.371+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a1280d400 2024-09-13T23:58:50.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.375+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.1 v2:172.21.15.173:6808/3256211813 5 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12854b40 con 0x556a1280d400 2024-09-13T23:58:50.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.375+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a1280dc00 2024-09-13T23:58:50.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.375+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 3 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12855200 con 0x556a1280dc00 2024-09-13T23:58:50.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.375+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a1280dc00 2024-09-13T23:58:50.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.375+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 4 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12855200 con 0x556a1280dc00 2024-09-13T23:58:50.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.375+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a1280d400 2024-09-13T23:58:50.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.375+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.1 v2:172.21.15.173:6808/3256211813 6 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12854b40 con 0x556a1280d400 2024-09-13T23:58:50.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.375+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a128a6800 2024-09-13T23:58:50.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.375+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.2 v2:172.21.15.173:6809/889985573 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12854b40 con 0x556a128a6800 2024-09-13T23:58:50.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.375+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a1280d400 2024-09-13T23:58:50.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.375+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.1 v2:172.21.15.173:6808/3256211813 7 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12854b40 con 0x556a1280d400 2024-09-13T23:58:50.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.375+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a128a6800 2024-09-13T23:58:50.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.375+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.2 v2:172.21.15.173:6809/889985573 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12854b40 con 0x556a128a6800 2024-09-13T23:58:50.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.375+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a1280dc00 2024-09-13T23:58:50.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.379+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 5 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12855200 con 0x556a1280dc00 2024-09-13T23:58:50.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.379+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a128a6400 2024-09-13T23:58:50.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.379+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 <== osd.3 v2:172.21.15.173:6800/4020038786 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12855440 con 0x556a128a6400 2024-09-13T23:58:50.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.379+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a1280d400 2024-09-13T23:58:50.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.379+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.1 v2:172.21.15.173:6808/3256211813 8 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12854b40 con 0x556a1280d400 2024-09-13T23:58:50.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.379+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a1280dc00 2024-09-13T23:58:50.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.379+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12855200 con 0x556a1280dc00 2024-09-13T23:58:50.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.379+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a128a6400 2024-09-13T23:58:50.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.379+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 <== osd.3 v2:172.21.15.173:6800/4020038786 5 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12855440 con 0x556a128a6400 2024-09-13T23:58:50.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.379+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a1280d400 2024-09-13T23:58:50.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.379+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.1 v2:172.21.15.173:6808/3256211813 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12854b40 con 0x556a1280d400 2024-09-13T23:58:50.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.379+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a1280d400 2024-09-13T23:58:50.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.379+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.1 v2:172.21.15.173:6808/3256211813 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x556a12854b40 con 0x556a1280d400 2024-09-13T23:58:50.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.379+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a1280d400 2024-09-13T23:58:50.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.383+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.1 v2:172.21.15.173:6808/3256211813 11 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12854b40 con 0x556a1280d400 2024-09-13T23:58:50.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.383+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a128a6400 2024-09-13T23:58:50.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.383+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 <== osd.3 v2:172.21.15.173:6800/4020038786 6 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12855440 con 0x556a128a6400 2024-09-13T23:58:50.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.383+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a128a6800 2024-09-13T23:58:50.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.383+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.2 v2:172.21.15.173:6809/889985573 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12854b40 con 0x556a128a6800 2024-09-13T23:58:50.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.383+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a1280d400 2024-09-13T23:58:50.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.383+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.1 v2:172.21.15.173:6808/3256211813 12 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12854b40 con 0x556a1280d400 2024-09-13T23:58:50.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.383+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a128a6800 2024-09-13T23:58:50.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.383+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.2 v2:172.21.15.173:6809/889985573 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12854b40 con 0x556a128a6800 2024-09-13T23:58:50.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.383+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a128a6400 2024-09-13T23:58:50.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.383+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 <== osd.3 v2:172.21.15.173:6800/4020038786 7 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12855440 con 0x556a128a6400 2024-09-13T23:58:50.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.383+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a128a6800 2024-09-13T23:58:50.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.383+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.2 v2:172.21.15.173:6809/889985573 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12854b40 con 0x556a128a6800 2024-09-13T23:58:50.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.383+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a1280dc00 2024-09-13T23:58:50.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.383+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 7 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12855200 con 0x556a1280dc00 2024-09-13T23:58:50.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.383+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a1280dc00 2024-09-13T23:58:50.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.387+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 8 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12855200 con 0x556a1280dc00 2024-09-13T23:58:50.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.387+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a128a6400 2024-09-13T23:58:50.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.387+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 <== osd.3 v2:172.21.15.173:6800/4020038786 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12855440 con 0x556a128a6400 2024-09-13T23:58:50.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.387+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a1280dc00 2024-09-13T23:58:50.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.387+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 9 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x556a12855200 con 0x556a1280dc00 2024-09-13T23:58:50.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.387+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a1280dc00 2024-09-13T23:58:50.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.387+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 10 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x556a12855200 con 0x556a1280dc00 2024-09-13T23:58:50.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.387+0000 7f380d4dcf40 20 RGWRados::pool_iterate: got zone_info.d342d0db-d035-4a54-bae7-2e0f76db6818 2024-09-13T23:58:50.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.387+0000 7f380d4dcf40 20 RGWRados::pool_iterate: got zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 2024-09-13T23:58:50.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.387+0000 7f380d4dcf40 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:58:50.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.387+0000 7f380d4dcf40 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:58:50.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.387+0000 7f380d4dcf40 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:58:50.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.387+0000 7f380d4dcf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:50.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.387+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a7000 con 0x556a1280d400 2024-09-13T23:58:50.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.387+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.1 v2:172.21.15.173:6808/3256211813 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x556a12854b40 con 0x556a1280d400 2024-09-13T23:58:50.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.387+0000 7f380d4dcf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:50.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.387+0000 7f380d4dcf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:50.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.387+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a7400 con 0x556a1280dc00 2024-09-13T23:58:50.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x556a12855200 con 0x556a1280dc00 2024-09-13T23:58:50.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380d4dcf40 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:58:50.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380d4dcf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:50.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:40 5.18 5:1ec905e4:::zonegroup_info.45606a84-a024-4d59-86ac-9903db661675:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a7800 con 0x556a128a6800 2024-09-13T23:58:50.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.2 v2:172.21.15.173:6809/889985573 8 ==== osd_op_reply(40 zonegroup_info.45606a84-a024-4d59-86ac-9903db661675 [read 0~420 out=420b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+420 (crc 0 0 0) 0x556a12854b40 con 0x556a128a6800 2024-09-13T23:58:50.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380d4dcf40 20 rados_obj.operate() r=0 bl.length=420 2024-09-13T23:58:50.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380d4dcf40 20 zone default found 2024-09-13T23:58:50.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380d4dcf40 4 Realm: () 2024-09-13T23:58:50.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380d4dcf40 4 ZoneGroup: default (45606a84-a024-4d59-86ac-9903db661675) 2024-09-13T23:58:50.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380d4dcf40 4 Zone: default (d342d0db-d035-4a54-bae7-2e0f76db6818) 2024-09-13T23:58:50.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380d4dcf40 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:58:50.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380d4dcf40 20 zonegroup default 2024-09-13T23:58:50.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380d4dcf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:50.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a7c00 con 0x556a128a6800 2024-09-13T23:58:50.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.2 v2:172.21.15.173:6809/889985573 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x556a12854b40 con 0x556a128a6800 2024-09-13T23:58:50.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380d4dcf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:50.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380d4dcf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:50.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a7000 con 0x556a128a6400 2024-09-13T23:58:50.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 <== osd.3 v2:172.21.15.173:6800/4020038786 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x556a12855440 con 0x556a128a6400 2024-09-13T23:58:50.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380d4dcf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:50.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380d4dcf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:50.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a7800 con 0x556a128a6400 2024-09-13T23:58:50.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 <== osd.3 v2:172.21.15.173:6800/4020038786 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x556a12855440 con 0x556a128a6400 2024-09-13T23:58:50.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380d4dcf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:50.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380d4dcf40 20 started sync module instance, tier type = 2024-09-13T23:58:50.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380d4dcf40 20 started zone id=d342d0db-d035-4a54-bae7-2e0f76db6818 (name=default) with tier type = 2024-09-13T23:58:50.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.391+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a1280d800 con 0x556a1280dc00 2024-09-13T23:58:50.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.395+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 12 ==== osd_op_reply(44 notify.0 [create] v37'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12855200 con 0x556a1280dc00 2024-09-13T23:58:50.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.395+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93914064534272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a1280c800 con 0x556a1280dc00 2024-09-13T23:58:50.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.395+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a1280d800 con 0x556a1280d400 2024-09-13T23:58:50.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.399+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 13 ==== osd_op_reply(45 notify.0 [watch watch cookie 93914064534272] v37'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12855200 con 0x556a1280dc00 2024-09-13T23:58:50.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.399+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.1 v2:172.21.15.173:6808/3256211813 14 ==== osd_op_reply(46 notify.1 [create] v37'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12854b40 con 0x556a1280d400 2024-09-13T23:58:50.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.399+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93914064535424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6000 con 0x556a1280d400 2024-09-13T23:58:50.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.399+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a7400 con 0x556a1280dc00 2024-09-13T23:58:50.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.399+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.1 v2:172.21.15.173:6808/3256211813 15 ==== osd_op_reply(47 notify.1 [watch watch cookie 93914064535424] v37'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12854b40 con 0x556a1280d400 2024-09-13T23:58:50.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.399+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 14 ==== osd_op_reply(48 notify.2 [create] v37'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12855200 con 0x556a1280dc00 2024-09-13T23:58:50.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.403+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93914064536576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128b6000 con 0x556a1280dc00 2024-09-13T23:58:50.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.403+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128b6400 con 0x556a128a6800 2024-09-13T23:58:50.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.403+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93914064536576] v37'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12855200 con 0x556a1280dc00 2024-09-13T23:58:50.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.403+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.2 v2:172.21.15.173:6809/889985573 10 ==== osd_op_reply(50 notify.3 [create] v37'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12854b40 con 0x556a128a6800 2024-09-13T23:58:50.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.403+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93914064537728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128b6800 con 0x556a128a6800 2024-09-13T23:58:50.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.403+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128b6c00 con 0x556a1280dc00 2024-09-13T23:58:50.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.407+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.2 v2:172.21.15.173:6809/889985573 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93914064537728] v37'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12854b40 con 0x556a128a6800 2024-09-13T23:58:50.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.407+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 16 ==== osd_op_reply(52 notify.4 [create] v37'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12855200 con 0x556a1280dc00 2024-09-13T23:58:50.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.407+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93914064538880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128b7000 con 0x556a1280dc00 2024-09-13T23:58:50.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.407+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128b7400 con 0x556a128a6400 2024-09-13T23:58:50.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.407+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 <== osd.3 v2:172.21.15.173:6800/4020038786 11 ==== osd_op_reply(54 notify.5 [create] v37'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12855440 con 0x556a128a6400 2024-09-13T23:58:50.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.407+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93914064540032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128b7800 con 0x556a128a6400 2024-09-13T23:58:50.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.411+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128b7c00 con 0x556a128a6400 2024-09-13T23:58:50.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.407+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 17 ==== osd_op_reply(53 notify.4 [watch watch cookie 93914064538880] v37'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12855200 con 0x556a1280dc00 2024-09-13T23:58:50.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.411+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 <== osd.3 v2:172.21.15.173:6800/4020038786 12 ==== osd_op_reply(56 notify.6 [create] v37'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12855440 con 0x556a128a6400 2024-09-13T23:58:50.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.411+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93914064541184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128b7400 con 0x556a128a6400 2024-09-13T23:58:50.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.411+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128b6000 con 0x556a128a6800 2024-09-13T23:58:50.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.411+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 <== osd.3 v2:172.21.15.173:6800/4020038786 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93914064540032] v37'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12855440 con 0x556a128a6400 2024-09-13T23:58:50.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.415+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.2 v2:172.21.15.173:6809/889985573 12 ==== osd_op_reply(58 notify.7 [create] v37'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12854b40 con 0x556a128a6800 2024-09-13T23:58:50.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.415+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 <== osd.3 v2:172.21.15.173:6800/4020038786 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93914064541184] v37'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12855440 con 0x556a128a6400 2024-09-13T23:58:50.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.415+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93914064542336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128b6c00 con 0x556a128a6800 2024-09-13T23:58:50.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.415+0000 7f380d4dcf40 20 add_watcher() i=0 2024-09-13T23:58:50.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.415+0000 7f380d4dcf40 20 add_watcher() i=1 2024-09-13T23:58:50.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.415+0000 7f380d4dcf40 20 add_watcher() i=2 2024-09-13T23:58:50.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.415+0000 7f380d4dcf40 20 add_watcher() i=3 2024-09-13T23:58:50.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.415+0000 7f380d4dcf40 20 add_watcher() i=4 2024-09-13T23:58:50.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.415+0000 7f380d4dcf40 20 add_watcher() i=5 2024-09-13T23:58:50.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.415+0000 7f380d4dcf40 20 add_watcher() i=6 2024-09-13T23:58:50.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.415+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.2 v2:172.21.15.173:6809/889985573 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93914064542336] v37'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12854b40 con 0x556a128a6800 2024-09-13T23:58:50.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.415+0000 7f380d4dcf40 20 add_watcher() i=7 2024-09-13T23:58:50.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.415+0000 7f380d4dcf40 2 all 8 watchers are set, enabling cache 2024-09-13T23:58:50.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.415+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a6c00 con 0x556a1280d400 2024-09-13T23:58:50.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.415+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.1 v2:172.21.15.173:6808/3256211813 16 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x556a12854b40 con 0x556a1280d400 2024-09-13T23:58:50.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.415+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93914066042880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a7000 con 0x556a1280d400 2024-09-13T23:58:50.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.419+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.1 v2:172.21.15.173:6808/3256211813 17 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93914066042880] v37'239 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x556a12854b40 con 0x556a1280d400 2024-09-13T23:58:50.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.419+0000 7f37f2c63700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:50.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.419+0000 7f380d4dcf40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:58:50.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.419+0000 7f380d4dcf40 20 check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:58:50.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.419+0000 7f380d4dcf40 1 Processor -- start 2024-09-13T23:58:50.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.419+0000 7f380d4dcf40 1 -- start start 2024-09-13T23:58:50.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.419+0000 7f380d4dcf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a128a7400 0x556a12757180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.419+0000 7f380d4dcf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a124fc3c0 con 0x556a128a7400 2024-09-13T23:58:50.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.419+0000 7f380b494700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a128a7400 0x556a12757180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.419+0000 7f380b494700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a128a7400 0x556a12757180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51330/0 (socket says 172.21.15.173:51330) 2024-09-13T23:58:50.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.419+0000 7f380b494700 1 -- 172.21.15.173:0/2676691518 learned_addr learned my addr 172.21.15.173:0/2676691518 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.419+0000 7f380b494700 1 -- 172.21.15.173:0/2676691518 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a12480b60 con 0x556a128a7400 2024-09-13T23:58:50.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.419+0000 7f380b494700 1 --2- 172.21.15.173:0/2676691518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a128a7400 0x556a12757180 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x556a128c80c0 tx=0x556a12573980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9932e7c45552f4fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.419+0000 7f37f2462700 1 -- 172.21.15.173:0/2676691518 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556a12513760 con 0x556a128a7400 2024-09-13T23:58:50.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.419+0000 7f37f2462700 1 -- 172.21.15.173:0/2676691518 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556a12838900 con 0x556a128a7400 2024-09-13T23:58:50.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.419+0000 7f37f2462700 1 -- 172.21.15.173:0/2676691518 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556a128ba160 con 0x556a128a7400 2024-09-13T23:58:50.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.423+0000 7f380d4dcf40 1 -- 172.21.15.173:0/2676691518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a128a7400 msgr2=0x556a12757180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.423+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/2676691518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a128a7400 0x556a12757180 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x556a128c80c0 tx=0x556a12573980 comp rx=0 tx=0).stop 2024-09-13T23:58:50.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.423+0000 7f380d4dcf40 1 -- 172.21.15.173:0/2676691518 shutdown_connections 2024-09-13T23:58:50.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.423+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/2676691518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a128a7400 0x556a12757180 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.423+0000 7f380d4dcf40 1 -- 172.21.15.173:0/2676691518 >> 172.21.15.173:0/2676691518 conn(0x556a128a7800 msgr2=0x556a12570000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.423+0000 7f380d4dcf40 1 -- 172.21.15.173:0/2676691518 shutdown_connections 2024-09-13T23:58:50.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.423+0000 7f380d4dcf40 1 -- 172.21.15.173:0/2676691518 wait complete. 2024-09-13T23:58:50.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.423+0000 7f380d4dcf40 1 Processor -- start 2024-09-13T23:58:50.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.423+0000 7f380d4dcf40 1 -- start start 2024-09-13T23:58:50.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.423+0000 7f380d4dcf40 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a128a7400 0x556a12757180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.423+0000 7f380d4dcf40 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a124fc500 con 0x556a128a7400 2024-09-13T23:58:50.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.423+0000 7f380b494700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a128a7400 0x556a12757180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.423+0000 7f380b494700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a128a7400 0x556a12757180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.173:51346/0 (socket says 172.21.15.173:51346) 2024-09-13T23:58:50.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.423+0000 7f380b494700 1 -- 172.21.15.173:0/1258136219 learned_addr learned my addr 172.21.15.173:0/1258136219 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-13T23:58:50.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.423+0000 7f380b494700 1 -- 172.21.15.173:0/1258136219 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a12480d00 con 0x556a128a7400 2024-09-13T23:58:50.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.423+0000 7f380b494700 1 --2- 172.21.15.173:0/1258136219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a128a7400 0x556a12757180 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x556a128c82d0 tx=0x556a12864c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.423+0000 7f37f0c5f700 1 -- 172.21.15.173:0/1258136219 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556a128ba2c0 con 0x556a128a7400 2024-09-13T23:58:50.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.423+0000 7f37f0c5f700 1 -- 172.21.15.173:0/1258136219 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556a12838600 con 0x556a128a7400 2024-09-13T23:58:50.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.423+0000 7f380d4dcf40 1 -- 172.21.15.173:0/1258136219 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556a12480340 con 0x556a128a7400 2024-09-13T23:58:50.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.423+0000 7f37f0c5f700 1 -- 172.21.15.173:0/1258136219 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x556a128ba420 con 0x556a128a7400 2024-09-13T23:58:50.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.423+0000 7f380d4dcf40 1 -- 172.21.15.173:0/1258136219 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a12481d40 con 0x556a128a7400 2024-09-13T23:58:50.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.427+0000 7f37f0c5f700 1 -- 172.21.15.173:0/1258136219 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x556a12569b80 con 0x556a128a7400 2024-09-13T23:58:50.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.427+0000 7f37f0c5f700 1 --2- 172.21.15.173:0/1258136219 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556a128a6c00 0x556a1294c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:58:50.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.427+0000 7f37f0c5f700 1 -- 172.21.15.173:0/1258136219 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x556a124d56c0 con 0x556a128a7400 2024-09-13T23:58:50.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.427+0000 7f380d4dcf40 5 note: GC not initialized 2024-09-13T23:58:50.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.427+0000 7f380c496700 1 --2- 172.21.15.173:0/1258136219 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556a128a6c00 0x556a1294c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:58:50.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.427+0000 7f380c496700 1 --2- 172.21.15.173:0/1258136219 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556a128a6c00 0x556a1294c000 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x556a12850810 tx=0x556a12573e60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:58:50.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.427+0000 7f37ee45a700 20 reqs_thread_entry: start 2024-09-13T23:58:50.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.427+0000 7f380d4dcf40 20 init_complete bucket index max shards: 11 2024-09-13T23:58:50.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.427+0000 7f380d4dcf40 10 rgw notify: Started notification manager with: 1 workers 2024-09-13T23:58:50.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.427+0000 7f37ec456700 20 rgw notify: INFO: next queues processing will happen at: Fri Sep 13 23:59:20 2024 2024-09-13T23:58:50.434 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-13T23:58:50.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.427+0000 7f37ebc34700 20 reqs_thread_entry: start 2024-09-13T23:58:50.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.431+0000 7f380d4dcf40 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T23:58:50.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.431+0000 7f380d4dcf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:50.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.431+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a1280c800 con 0x556a1280d400 2024-09-13T23:58:50.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.431+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.1 v2:172.21.15.173:6808/3256211813 18 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x556a12854b40 con 0x556a1280d400 2024-09-13T23:58:50.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.431+0000 7f380d4dcf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:50.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.431+0000 7f380d4dcf40 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-13T23:58:50.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.431+0000 7f380d4dcf40 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:58:50.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.431+0000 7f380d4dcf40 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-13T23:58:50.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.431+0000 7f380d4dcf40 20 rados->read ofs=0 len=0 2024-09-13T23:58:50.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.431+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a1280d800 con 0x556a1280d400 2024-09-13T23:58:50.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.431+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.1 v2:172.21.15.173:6808/3256211813 19 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x556a12854b40 con 0x556a1280d400 2024-09-13T23:58:50.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.431+0000 7f380d4dcf40 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:58:50.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.431+0000 7f380d4dcf40 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-13T23:58:50.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.431+0000 7f380d4dcf40 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-13T23:58:50.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.431+0000 7f380d4dcf40 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-13T23:58:50.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.431+0000 7f380d4dcf40 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-13T23:58:50.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.431+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~439 in=439b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128b6800 con 0x556a1280d400 2024-09-13T23:58:50.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.431+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.1 v2:172.21.15.173:6808/3256211813 20 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~439] v37'3 uv3 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x556a12854b40 con 0x556a1280d400 2024-09-13T23:58:50.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.435+0000 7f380d4dcf40 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:58:50.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.435+0000 7f380d4dcf40 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:58:50.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.435+0000 7f380d4dcf40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T23:58:50.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.435+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93914066045184 in=627b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128b6000 con 0x556a1280dc00 2024-09-13T23:58:50.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.435+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 18 ==== watch-notify(notify (1) cookie 93914064538880 notify 158913789998 ret 0) v3 ==== 657+0+0 (crc 0 0 0) 0x556a12481860 con 0x556a1280dc00 2024-09-13T23:58:50.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.435+0000 7f380648a700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789998 cookie 93914064538880 notifier 4918 bl.length()=615 2024-09-13T23:58:50.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.435+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 19 ==== osd_op_reply(65 notify.4 [notify cookie 93914066045184 out=8b] v0'0 uv240 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x556a12855200 con 0x556a1280dc00 2024-09-13T23:58:50.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.435+0000 7f380648a700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:58:50.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.435+0000 7f380648a700 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:58:50.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.435+0000 7f380648a700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a129b2000 con 0x556a1280dc00 2024-09-13T23:58:50.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.435+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 20 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12855200 con 0x556a1280dc00 2024-09-13T23:58:50.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.435+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 21 ==== watch-notify(notify_complete (2) cookie 93914066045184 notify 158913789998 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556a12794000 con 0x556a1280dc00 2024-09-13T23:58:50.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.435+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128b6c00 con 0x556a1280d400 2024-09-13T23:58:50.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.439+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.1 v2:172.21.15.173:6808/3256211813 21 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v37'24 uv24 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x556a12854b40 con 0x556a1280d400 2024-09-13T23:58:50.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.439+0000 7f380d4dcf40 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-13T23:58:50.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.439+0000 7f380d4dcf40 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-13T23:58:50.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.439+0000 7f380d4dcf40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-13T23:58:50.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.439+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93914066045184 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128b7000 con 0x556a1280dc00 2024-09-13T23:58:50.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.439+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 22 ==== watch-notify(notify (1) cookie 93914064536576 notify 158913789999 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x556a12794000 con 0x556a1280dc00 2024-09-13T23:58:50.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.439+0000 7f380648a700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789999 cookie 93914064536576 notifier 4918 bl.length()=177 2024-09-13T23:58:50.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.439+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 23 ==== osd_op_reply(68 notify.2 [notify cookie 93914066045184 out=8b] v0'0 uv240 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x556a12855200 con 0x556a1280dc00 2024-09-13T23:58:50.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.439+0000 7f380648a700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-13T23:58:50.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.439+0000 7f380648a700 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-13T23:58:50.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.439+0000 7f380648a700 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a129b2400 con 0x556a1280dc00 2024-09-13T23:58:50.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.439+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 24 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12855200 con 0x556a1280dc00 2024-09-13T23:58:50.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.439+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 25 ==== watch-notify(notify_complete (2) cookie 93914066045184 notify 158913789999 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556a127941a0 con 0x556a1280dc00 2024-09-13T23:58:50.444 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-13T23:58:50.444 INFO:teuthology.orchestra.run.smithi173.stdout: "user_id": "ada", 2024-09-13T23:58:50.444 INFO:teuthology.orchestra.run.smithi173.stdout: "display_name": "Ms. Admin User", 2024-09-13T23:58:50.444 INFO:teuthology.orchestra.run.smithi173.stdout: "email": "", 2024-09-13T23:58:50.445 INFO:teuthology.orchestra.run.smithi173.stdout: "suspended": 0, 2024-09-13T23:58:50.445 INFO:teuthology.orchestra.run.smithi173.stdout: "max_buckets": 0, 2024-09-13T23:58:50.445 INFO:teuthology.orchestra.run.smithi173.stdout: "subusers": [], 2024-09-13T23:58:50.445 INFO:teuthology.orchestra.run.smithi173.stdout: "keys": [ 2024-09-13T23:58:50.445 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:50.445 INFO:teuthology.orchestra.run.smithi173.stdout: "user": "ada", 2024-09-13T23:58:50.445 INFO:teuthology.orchestra.run.smithi173.stdout: "access_key": "MH1WC2XQ1S8UISFDZC8W", 2024-09-13T23:58:50.445 INFO:teuthology.orchestra.run.smithi173.stdout: "secret_key": "dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG" 2024-09-13T23:58:50.445 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:50.445 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:50.445 INFO:teuthology.orchestra.run.smithi173.stdout: "swift_keys": [], 2024-09-13T23:58:50.445 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": [ 2024-09-13T23:58:50.446 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:50.446 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "buckets", 2024-09-13T23:58:50.446 INFO:teuthology.orchestra.run.smithi173.stdout: "perm": "*" 2024-09-13T23:58:50.446 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:50.446 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:50.446 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "info", 2024-09-13T23:58:50.446 INFO:teuthology.orchestra.run.smithi173.stdout: "perm": "read" 2024-09-13T23:58:50.446 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:50.446 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:50.446 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "ratelimit", 2024-09-13T23:58:50.446 INFO:teuthology.orchestra.run.smithi173.stdout: "perm": "*" 2024-09-13T23:58:50.446 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:50.446 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:50.446 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "usage", 2024-09-13T23:58:50.447 INFO:teuthology.orchestra.run.smithi173.stdout: "perm": "*" 2024-09-13T23:58:50.447 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:50.447 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:50.447 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "users", 2024-09-13T23:58:50.447 INFO:teuthology.orchestra.run.smithi173.stdout: "perm": "*" 2024-09-13T23:58:50.447 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:50.447 INFO:teuthology.orchestra.run.smithi173.stdout: { 2024-09-13T23:58:50.447 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "zone", 2024-09-13T23:58:50.447 INFO:teuthology.orchestra.run.smithi173.stdout: "perm": "*" 2024-09-13T23:58:50.447 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-13T23:58:50.447 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2024-09-13T23:58:50.447 INFO:teuthology.orchestra.run.smithi173.stdout: "op_mask": "read, write, delete", 2024-09-13T23:58:50.448 INFO:teuthology.orchestra.run.smithi173.stdout: "default_placement": "", 2024-09-13T23:58:50.448 INFO:teuthology.orchestra.run.smithi173.stdout: "default_storage_class": "", 2024-09-13T23:58:50.448 INFO:teuthology.orchestra.run.smithi173.stdout: "placement_tags": [], 2024-09-13T23:58:50.448 INFO:teuthology.orchestra.run.smithi173.stdout: "bucket_quota": { 2024-09-13T23:58:50.448 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:58:50.448 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:58:50.448 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:58:50.448 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:58:50.448 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:58:50.448 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:50.448 INFO:teuthology.orchestra.run.smithi173.stdout: "user_quota": { 2024-09-13T23:58:50.448 INFO:teuthology.orchestra.run.smithi173.stdout: "enabled": false, 2024-09-13T23:58:50.448 INFO:teuthology.orchestra.run.smithi173.stdout: "check_on_raw": false, 2024-09-13T23:58:50.449 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size": -1, 2024-09-13T23:58:50.449 INFO:teuthology.orchestra.run.smithi173.stdout: "max_size_kb": 0, 2024-09-13T23:58:50.449 INFO:teuthology.orchestra.run.smithi173.stdout: "max_objects": -1 2024-09-13T23:58:50.449 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-13T23:58:50.449 INFO:teuthology.orchestra.run.smithi173.stdout: "temp_url_keys": [], 2024-09-13T23:58:50.449 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "rgw", 2024-09-13T23:58:50.449 INFO:teuthology.orchestra.run.smithi173.stdout: "mfa_ids": [] 2024-09-13T23:58:50.449 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-13T23:58:50.449 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-13T23:58:50.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.443+0000 7f37f2c63700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:58:50.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.443+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93914066042880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128b6400 con 0x556a1280d400 2024-09-13T23:58:50.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.443+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.1 v2:172.21.15.173:6808/3256211813 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93914066042880] v37'240 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x556a12854b40 con 0x556a1280d400 2024-09-13T23:58:50.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.443+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93914064534272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a128a7000 con 0x556a1280dc00 2024-09-13T23:58:50.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.447+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 26 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93914064534272] v37'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12855200 con 0x556a1280dc00 2024-09-13T23:58:50.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.447+0000 7f380d4dcf40 20 remove_watcher() i=0 2024-09-13T23:58:50.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.447+0000 7f380d4dcf40 2 removed watcher, disabling cache 2024-09-13T23:58:50.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.447+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93914064535424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a129b2800 con 0x556a1280d400 2024-09-13T23:58:50.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.451+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.1 v2:172.21.15.173:6808/3256211813 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93914064535424] v37'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12854b40 con 0x556a1280d400 2024-09-13T23:58:50.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.451+0000 7f380d4dcf40 20 remove_watcher() i=1 2024-09-13T23:58:50.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.451+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93914064536576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a129b2c00 con 0x556a1280dc00 2024-09-13T23:58:50.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.451+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 27 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93914064536576] v37'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12855200 con 0x556a1280dc00 2024-09-13T23:58:50.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.451+0000 7f380d4dcf40 20 remove_watcher() i=2 2024-09-13T23:58:50.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.451+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93914064537728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a129b3000 con 0x556a128a6800 2024-09-13T23:58:50.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.455+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.2 v2:172.21.15.173:6809/889985573 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93914064537728] v37'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12854b40 con 0x556a128a6800 2024-09-13T23:58:50.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.455+0000 7f380d4dcf40 20 remove_watcher() i=3 2024-09-13T23:58:50.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.455+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93914064538880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a129b3400 con 0x556a1280dc00 2024-09-13T23:58:50.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.459+0000 7f380bc95700 1 -- 172.21.15.173:0/926089420 <== osd.0 v2:172.21.15.87:6800/3507919120 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93914064538880] v37'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12855200 con 0x556a1280dc00 2024-09-13T23:58:50.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.459+0000 7f380d4dcf40 20 remove_watcher() i=4 2024-09-13T23:58:50.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.459+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93914064540032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a129b3800 con 0x556a128a6400 2024-09-13T23:58:50.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.459+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 <== osd.3 v2:172.21.15.173:6800/4020038786 15 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93914064540032] v37'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12855440 con 0x556a128a6400 2024-09-13T23:58:50.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.459+0000 7f380d4dcf40 20 remove_watcher() i=5 2024-09-13T23:58:50.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.459+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93914064541184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a129b3c00 con 0x556a128a6400 2024-09-13T23:58:50.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.463+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 <== osd.3 v2:172.21.15.173:6800/4020038786 16 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93914064541184] v37'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12855440 con 0x556a128a6400 2024-09-13T23:58:50.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.463+0000 7f380d4dcf40 20 remove_watcher() i=6 2024-09-13T23:58:50.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.463+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 --> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93914064542336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) v8 -- 0x556a129b2000 con 0x556a128a6800 2024-09-13T23:58:50.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.463+0000 7f380c496700 1 -- 172.21.15.173:0/926089420 <== osd.2 v2:172.21.15.173:6809/889985573 15 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93914064542336] v37'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x556a12854b40 con 0x556a128a6800 2024-09-13T23:58:50.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.463+0000 7f380d4dcf40 20 remove_watcher() i=7 2024-09-13T23:58:50.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x556a1280dc00 msgr2=0x556a12756100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/926089420 >> [v2:172.21.15.87:6800/3507919120,v1:172.21.15.87:6801/3507919120] conn(0x556a1280dc00 0x556a12756100 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x556a1280d400 msgr2=0x556a12755b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/926089420 >> [v2:172.21.15.173:6808/3256211813,v1:172.21.15.173:6810/3256211813] conn(0x556a1280d400 0x556a12755b80 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x556a128a6800 msgr2=0x556a12756c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/926089420 >> [v2:172.21.15.173:6809/889985573,v1:172.21.15.173:6812/889985573] conn(0x556a128a6800 0x556a12756c00 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x556a128a6400 msgr2=0x556a12756680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/926089420 >> [v2:172.21.15.173:6800/4020038786,v1:172.21.15.173:6801/4020038786] conn(0x556a128a6400 0x556a12756680 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556a1280d000 msgr2=0x556a12755600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/926089420 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556a1280d000 0x556a12755600 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x556a1274f920 tx=0x556a12573800 comp rx=0 tx=0).stop 2024-09-13T23:58:50.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f800 msgr2=0x556a12754b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/926089420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f800 0x556a12754b00 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x556a1280ee10 tx=0x556a127c73e0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 reap_dead start 2024-09-13T23:58:50.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380b494700 1 -- 172.21.15.173:0/926089420 reap_dead start 2024-09-13T23:58:50.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 shutdown_connections 2024-09-13T23:58:50.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 >> 172.21.15.173:0/926089420 conn(0x556a1246f400 msgr2=0x556a1256f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 shutdown_connections 2024-09-13T23:58:50.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 -- 172.21.15.173:0/926089420 wait complete. 2024-09-13T23:58:50.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 -- 172.21.15.173:0/1258136219 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556a128a6c00 msgr2=0x556a1294c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/1258136219 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556a128a6c00 0x556a1294c000 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x556a12850810 tx=0x556a12573e60 comp rx=0 tx=0).stop 2024-09-13T23:58:50.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 -- 172.21.15.173:0/1258136219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a128a7400 msgr2=0x556a12757180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/1258136219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a128a7400 0x556a12757180 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x556a128c82d0 tx=0x556a12864c00 comp rx=0 tx=0).stop 2024-09-13T23:58:50.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 -- 172.21.15.173:0/1258136219 shutdown_connections 2024-09-13T23:58:50.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/1258136219 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556a128a6c00 0x556a1294c000 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/1258136219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a128a7400 0x556a12757180 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 -- 172.21.15.173:0/1258136219 >> 172.21.15.173:0/1258136219 conn(0x556a128a7800 msgr2=0x556a12570000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 -- 172.21.15.173:0/1258136219 shutdown_connections 2024-09-13T23:58:50.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 -- 172.21.15.173:0/1258136219 wait complete. 2024-09-13T23:58:50.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 -- 172.21.15.173:0/4280167961 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556a1280c000 msgr2=0x556a12755080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/4280167961 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556a1280c000 0x556a12755080 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x556a13239dd0 tx=0x556a127c7200 comp rx=0 tx=0).stop 2024-09-13T23:58:50.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 -- 172.21.15.173:0/4280167961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f000 msgr2=0x556a12754580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:58:50.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/4280167961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f000 0x556a12754580 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x556a13239e00 tx=0x556a12573a40 comp rx=0 tx=0).stop 2024-09-13T23:58:50.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 -- 172.21.15.173:0/4280167961 shutdown_connections 2024-09-13T23:58:50.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/4280167961 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x556a1280c000 0x556a12755080 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 --2- 172.21.15.173:0/4280167961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556a1246f000 0x556a12754580 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:58:50.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 -- 172.21.15.173:0/4280167961 >> 172.21.15.173:0/4280167961 conn(0x556a1246ec00 msgr2=0x556a1256f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:58:50.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 -- 172.21.15.173:0/4280167961 shutdown_connections 2024-09-13T23:58:50.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-13T23:58:50.467+0000 7f380d4dcf40 1 -- 172.21.15.173:0/4280167961 wait complete. 2024-09-13T23:58:50.478 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:58:50.479 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:58:50.479 ERROR:root:0 2024-09-13T23:58:50.480 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:58:50.496 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000005240dca5f7aa14f3-0066e4d1ba-1088-default', 'HostId': '1088-default-default'} 2024-09-13T23:58:50.496 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-13T23:58:50.525 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:58:50.526 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-13T23:58:50.562 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-13T23:58:50.563 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-13T23:58:50.598 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-13T23:58:50.599 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-13T23:58:50.622 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-13T23:58:50.622 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:58:50.635 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:58:50.635 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-13T23:58:50.649 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:58:50.649 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-13T23:58:50.669 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:58:50.669 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:58:50.682 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:58:50.682 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-13T23:58:50.701 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:58:50.701 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:58:50.714 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:58:50.714 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-13T23:58:50.738 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}] 2024-09-13T23:58:50.738 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:58:50.750 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:58:50.751 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-13T23:58:50.773 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:58:50.774 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:58:50.786 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:58:50.786 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-13T23:58:50.810 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-13T23:58:50.811 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:58:50.824 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:58:50.824 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-13T23:58:50.848 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-13T23:58:50.848 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:58:50.861 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:58:50.861 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-13T23:58:50.903 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:58:50.903 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:58:50.916 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:58:50.916 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-13T23:58:50.934 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:58:50.935 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:58:50.947 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:58:50.947 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-13T23:58:50.970 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:58:50.970 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:58:50.982 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:58:50.983 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-13T23:58:50.996 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-13T23:58:50.996 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-13T23:58:51.010 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-13T23:58:51.038 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-13T23:58:51.052 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-13T23:58:51.052 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-13T23:58:51.067 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '45606a84-a024-4d59-86ac-9903db661675', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.9', 'marker': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.9', 'index_type': 'Normal', 'versioned': False, 'versioning_enabled': False, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T23:58:51.030376Z', 'creation_time': '2024-09-13T23:58:51.023681Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T23:58:51.067 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-13T23:58:51.087 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '45606a84-a024-4d59-86ac-9903db661675', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.9', 'marker': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.9', 'index_type': 'Normal', 'versioned': False, 'versioning_enabled': False, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T23:58:51.030376Z', 'creation_time': '2024-09-13T23:58:51.023681Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-13T23:58:51.097 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-13T23:58:51.112 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '45606a84-a024-4d59-86ac-9903db661675', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.9', 'marker': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.9', 'index_type': 'Normal', 'versioned': False, 'versioning_enabled': False, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T23:58:51.030376Z', 'creation_time': '2024-09-13T23:58:51.023681Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T23:58:51.113 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-13T23:58:51.126 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx000005109c5d1ed0efe6c-0066e4d1bb-1088-default', 'HostId': '1088-default-default'} 2024-09-13T23:58:51.136 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-13T23:58:51.156 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:58:51.156 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-13T23:58:51.179 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:58:51.197 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.9'} 2024-09-13T23:58:51.222 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:58:51.269 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.9'} 2024-09-13T23:58:51.299 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:58:51.299 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-13T23:58:51.326 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:58:51.348 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-13T23:58:51.369 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:58:51.369 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-13T23:58:51.383 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '45606a84-a024-4d59-86ac-9903db661675', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.9', 'marker': 'd342d0db-d035-4a54-bae7-2e0f76db6818.4234.9', 'index_type': 'Normal', 'versioned': False, 'versioning_enabled': False, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T23:58:51.286618Z', 'creation_time': '2024-09-13T23:58:51.023681Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T23:59:51.485 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-13T23:59:51.529 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2024-09-13T23:59:51.530 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-13T23:59:51.566 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 231, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 231, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 231, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2024-09-13T23:59:51.567 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-13T23:59:51.580 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2024-09-13T23:59:51.581 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-13T23:59:51.595 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2024-09-13T23:59:51.595 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-13T23:59:51.609 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2024-09-13T23:59:51.610 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-13T23:59:51.622 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2024-09-13T23:59:51.623 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-13T23:59:51.637 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2024-09-13T23:59:51.637 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-13T23:59:51.652 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:59:51.653 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-13T23:59:51.665 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-13T23:59:51.666 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-13T23:59:51.688 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:59:51.700 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-13T23:59:51.725 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:59:52.003 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-13T23:59:52.016 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000c53a3c944fd89992-0066e4d1f8-1088-default', 'HostId': '1088-default-default'} 2024-09-13T23:59:52.180 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-13T23:59:52.194 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'email': '', 'permission': {'flags': 15}, 'name': 'Foo', 'group': 0, 'url_spec': ''}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-13T23:59:52.204 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-13T23:59:52.219 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'id': '', 'email': '', 'permission': {'flags': 1}, 'name': '', 'group': 1, 'url_spec': ''}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'email': '', 'permission': {'flags': 15}, 'name': 'Foo', 'group': 0, 'url_spec': ''}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-13T23:59:52.337 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-13T23:59:52.427 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:59:52.427 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-13T23:59:52.444 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-13T23:59:52.445 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-13T23:59:52.462 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-13T23:59:52.480 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-13T23:59:52.494 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000ce6ac2394c42f557-0066e4d1f8-1088-default', 'HostId': '1088-default-default'} 2024-09-13T23:59:52.507 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-13T23:59:52.591 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:59:52.591 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:59:52.605 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000002c045f52760b75cb-0066e4d1f8-1088-default', 'HostId': '1088-default-default'} 2024-09-13T23:59:52.605 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-13T23:59:52.618 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': '0b890e8e-a4ce-4e8b-9529-48a86f947d30'}]}} 2024-09-13T23:59:52.618 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-13T23:59:52.648 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:59:52.648 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-13T23:59:52.660 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-13T23:59:52.661 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-13T23:59:52.674 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000009d3dcb8b9307e74d-0066e4d1f8-1088-default', 'HostId': '1088-default-default'} 2024-09-13T23:59:52.674 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-13T23:59:52.686 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000a993255750a70b46-0066e4d1f8-1088-default', 'HostId': '1088-default-default'} 2024-09-13T23:59:52.707 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-13T23:59:52.719 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-13T23:59:52.720 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-13T23:59:52.732 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000087ca773adb8bbd3c-0066e4d1f8-1088-default', 'HostId': '1088-default-default'} 2024-09-13T23:59:52.733 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-13T23:59:52.745 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000013f3a226f0672a63-0066e4d1f8-1088-default', 'HostId': '1088-default-default'} 2024-09-13T23:59:52.745 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-13T23:59:52.759 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-13T23:59:52.759 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-13T23:59:52.771 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000a61ebc453f3c7287-0066e4d1f8-1088-default', 'HostId': '1088-default-default'} 2024-09-13T23:59:52.771 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-13T23:59:52.783 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000991bc882f9a56775-0066e4d1f8-1088-default', 'HostId': '1088-default-default'} 2024-09-13T23:59:52.783 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-13T23:59:52.795 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000014a4aaaabaef2d41-0066e4d1f8-1088-default', 'HostId': '1088-default-default'} 2024-09-13T23:59:52.796 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-13T23:59:52.807 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000727ff4551305dd42-0066e4d1f8-1088-default', 'HostId': '1088-default-default'} 2024-09-13T23:59:52.808 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-13T23:59:52.834 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:59:52.835 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-13T23:59:52.847 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-13T23:59:52.848 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-13T23:59:52.866 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:59:52.866 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-13T23:59:52.878 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-13T23:59:52.878 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-13T23:59:52.896 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:59:52.900 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-13T23:59:52.911 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-13T23:59:52.911 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T23:59:52.912 INFO:tasks.rgw.client.0.smithi173.stdout:2024-09-13T23:59:52.906+0000 7f898c58d700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 25582) UID: 0 2024-09-13T23:59:52.912 INFO:tasks.rgw.client.0.smithi173.stdout:2024-09-13T23:59:52.906+0000 7f898fdecf80 -1 shutting down 2024-09-13T23:59:56.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-13T23:59:59.012 INFO:tasks.rgw.client.0:Stopped 2024-09-13T23:59:59.013 DEBUG:teuthology.orchestra.run.smithi173:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-13T23:59:59.020 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f /etc/ceph/vault-root-token 2024-09-13T23:59:59.036 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-13T23:59:59.092 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T23:59:59.101 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T23:59:59.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.218+0000 7f238bfff700 1 Processor -- start 2024-09-13T23:59:59.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.218+0000 7f238bfff700 1 -- start start 2024-09-13T23:59:59.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.218+0000 7f238bfff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f238c099170 0x7f238c1300e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:59:59.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.218+0000 7f238bfff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f238c099dc0 con 0x7f238c097a10 2024-09-13T23:59:59.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.218+0000 7f238bfff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f238c09d120 con 0x7f238c099170 2024-09-13T23:59:59.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.218+0000 7f238affd700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f238c097a10 0x7f238c097df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44920/0 (socket says 172.21.15.87:44920) 2024-09-13T23:59:59.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.218+0000 7f238affd700 1 -- 172.21.15.87:0/3527310997 learned_addr learned my addr 172.21.15.87:0/3527310997 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T23:59:59.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.218+0000 7f238a7fc700 1 --2- 172.21.15.87:0/3527310997 >> v2:172.21.15.87:3300/0 conn(0x7f238c099170 0x7f238c1300e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:59:59.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.218+0000 7f2389ffb700 1 -- 172.21.15.87:0/3527310997 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446685472 0 0) 0x7f238c099dc0 con 0x7f238c097a10 2024-09-13T23:59:59.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.218+0000 7f2389ffb700 1 -- 172.21.15.87:0/3527310997 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23740035d0 con 0x7f238c097a10 2024-09-13T23:59:59.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.218+0000 7f238a7fc700 1 -- 172.21.15.87:0/3527310997 >> v1:172.21.15.87:6789/0 conn(0x7f238c097a10 legacy=0x7f238c097df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:59:59.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.218+0000 7f238a7fc700 1 -- 172.21.15.87:0/3527310997 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c071e10 con 0x7f238c099170 2024-09-13T23:59:59.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.218+0000 7f238a7fc700 1 --2- 172.21.15.87:0/3527310997 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f238c099170 0x7f238c1300e0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f23800097d0 tx=0x7f2380009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953cede8d15d64fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:59:59.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.218+0000 7f2389ffb700 1 -- 172.21.15.87:0/3527310997 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2380004160 con 0x7f238c099170 2024-09-13T23:59:59.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.218+0000 7f2389ffb700 1 -- 172.21.15.87:0/3527310997 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23800042c0 con 0x7f238c099170 2024-09-13T23:59:59.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.218+0000 7f2389ffb700 1 -- 172.21.15.87:0/3527310997 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23800045a0 con 0x7f238c099170 2024-09-13T23:59:59.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.218+0000 7f238bfff700 1 -- 172.21.15.87:0/3527310997 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f238c099170 msgr2=0x7f238c1300e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:59:59.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.218+0000 7f238bfff700 1 --2- 172.21.15.87:0/3527310997 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f238c099170 0x7f238c1300e0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f23800097d0 tx=0x7f2380009ae0 comp rx=0 tx=0).stop 2024-09-13T23:59:59.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.218+0000 7f238bfff700 1 -- 172.21.15.87:0/3527310997 shutdown_connections 2024-09-13T23:59:59.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.218+0000 7f238bfff700 1 --2- 172.21.15.87:0/3527310997 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f238c099170 0x7f238c1300e0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:59:59.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.218+0000 7f238bfff700 1 -- 172.21.15.87:0/3527310997 >> 172.21.15.87:0/3527310997 conn(0x7f238c09b5b0 msgr2=0x7f238c0714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:59:59.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.218+0000 7f238bfff700 1 -- 172.21.15.87:0/3527310997 shutdown_connections 2024-09-13T23:59:59.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.218+0000 7f238bfff700 1 -- 172.21.15.87:0/3527310997 wait complete. 2024-09-13T23:59:59.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.222+0000 7f238bfff700 1 Processor -- start 2024-09-13T23:59:59.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.222+0000 7f238bfff700 1 -- start start 2024-09-13T23:59:59.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.222+0000 7f238bfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f238c097a10 0x7f238c128950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:59:59.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.222+0000 7f238bfff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c12a060 con 0x7f238c097a10 2024-09-13T23:59:59.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.222+0000 7f238affd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f238c097a10 0x7f238c128950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:59:59.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.222+0000 7f238affd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f238c097a10 0x7f238c128950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52398/0 (socket says 172.21.15.87:52398) 2024-09-13T23:59:59.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.222+0000 7f238affd700 1 -- 172.21.15.87:0/2750032613 learned_addr learned my addr 172.21.15.87:0/2750032613 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T23:59:59.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.222+0000 7f238affd700 1 -- 172.21.15.87:0/2750032613 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23800094b0 con 0x7f238c097a10 2024-09-13T23:59:59.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.222+0000 7f238affd700 1 --2- 172.21.15.87:0/2750032613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f238c097a10 0x7f238c128950 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f237c00c680 tx=0x7f237c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:59:59.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.222+0000 7f23737fe700 1 -- 172.21.15.87:0/2750032613 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f237c005cc0 con 0x7f238c097a10 2024-09-13T23:59:59.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.222+0000 7f23737fe700 1 -- 172.21.15.87:0/2750032613 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237c005e20 con 0x7f238c097a10 2024-09-13T23:59:59.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.222+0000 7f238bfff700 1 -- 172.21.15.87:0/2750032613 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f238c098890 con 0x7f238c097a10 2024-09-13T23:59:59.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.222+0000 7f23737fe700 1 -- 172.21.15.87:0/2750032613 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f237c007220 con 0x7f238c097a10 2024-09-13T23:59:59.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.222+0000 7f238bfff700 1 -- 172.21.15.87:0/2750032613 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f238c11aad0 con 0x7f238c097a10 2024-09-13T23:59:59.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.222+0000 7f23737fe700 1 -- 172.21.15.87:0/2750032613 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f237c007380 con 0x7f238c097a10 2024-09-13T23:59:59.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.226+0000 7f238bfff700 1 -- 172.21.15.87:0/2750032613 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f238c11ba00 con 0x7f238c097a10 2024-09-13T23:59:59.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.226+0000 7f23737fe700 1 --2- 172.21.15.87:0/2750032613 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f23780354f0 0x7f23780379b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:59:59.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.226+0000 7f23737fe700 1 -- 172.21.15.87:0/2750032613 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6386+0+0 (secure 0 0 0) 0x7f237c047870 con 0x7f238c097a10 2024-09-13T23:59:59.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.226+0000 7f238a7fc700 1 --2- 172.21.15.87:0/2750032613 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f23780354f0 0x7f23780379b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:59:59.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.226+0000 7f238a7fc700 1 --2- 172.21.15.87:0/2750032613 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f23780354f0 0x7f23780379b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2380006ee0 tx=0x7f2380008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:59:59.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.234+0000 7f23737fe700 1 -- 172.21.15.87:0/2750032613 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f237c019d20 con 0x7f238c097a10 2024-09-13T23:59:59.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.406+0000 7f238bfff700 1 -- 172.21.15.87:0/2750032613 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f238c097df0 con 0x7f238c097a10 2024-09-13T23:59:59.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.410+0000 7f23737fe700 1 -- 172.21.15.87:0/2750032613 <== mon.0 v2:172.21.15.87:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f237c010e70 con 0x7f238c097a10 2024-09-13T23:59:59.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.410+0000 7f23737fe700 1 -- 172.21.15.87:0/2750032613 <== mon.0 v2:172.21.15.87:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) v1 ==== 123+0+0 (secure 0 0 0) 0x7f237c017020 con 0x7f238c097a10 2024-09-13T23:59:59.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.414+0000 7f238bfff700 1 -- 172.21.15.87:0/2750032613 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f23780354f0 msgr2=0x7f23780379b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:59:59.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.414+0000 7f238bfff700 1 --2- 172.21.15.87:0/2750032613 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f23780354f0 0x7f23780379b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2380006ee0 tx=0x7f2380008030 comp rx=0 tx=0).stop 2024-09-13T23:59:59.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.414+0000 7f238bfff700 1 -- 172.21.15.87:0/2750032613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f238c097a10 msgr2=0x7f238c128950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:59:59.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.414+0000 7f238bfff700 1 --2- 172.21.15.87:0/2750032613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f238c097a10 0x7f238c128950 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f237c00c680 tx=0x7f237c00ca40 comp rx=0 tx=0).stop 2024-09-13T23:59:59.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.414+0000 7f238bfff700 1 -- 172.21.15.87:0/2750032613 shutdown_connections 2024-09-13T23:59:59.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.414+0000 7f238bfff700 1 --2- 172.21.15.87:0/2750032613 >> [v2:172.21.15.173:6824/884576791,v1:172.21.15.173:6825/884576791] conn(0x7f23780354f0 0x7f23780379b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:59:59.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.414+0000 7f238bfff700 1 --2- 172.21.15.87:0/2750032613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f238c097a10 0x7f238c128950 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:59:59.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.414+0000 7f238bfff700 1 -- 172.21.15.87:0/2750032613 >> 172.21.15.87:0/2750032613 conn(0x7f238c09b5b0 msgr2=0x7f238c12a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:59:59.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.414+0000 7f238bfff700 1 -- 172.21.15.87:0/2750032613 shutdown_connections 2024-09-13T23:59:59.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T23:59:59.414+0000 7f238bfff700 1 -- 172.21.15.87:0/2750032613 wait complete. 2024-09-13T23:59:59.432 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T23:59:59.432 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T23:59:59.432 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T23:59:59.432 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T00:00:01.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-14T00:00:01.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-14T00:00:05.534 INFO:tasks.ceph.osd.0:Stopped 2024-09-14T00:00:05.535 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-14T00:00:05.535 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T00:00:05.632 INFO:tasks.ceph.osd.1:Stopped 2024-09-14T00:00:05.632 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-14T00:00:05.632 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T00:00:06.910 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-14T00:00:06.910 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-14T00:00:11.733 INFO:tasks.ceph.osd.2:Stopped 2024-09-14T00:00:11.734 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-14T00:00:11.734 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T00:00:11.824 INFO:tasks.ceph.osd.3:Stopped 2024-09-14T00:00:11.824 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-14T00:00:11.825 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-14T00:00:11.825 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T00:00:11.853 INFO:tasks.ceph.mgr.x:Stopped 2024-09-14T00:00:11.853 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-14T00:00:11.854 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-14T00:00:11.854 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T00:00:11.903 INFO:tasks.ceph.mon.a:Stopped 2024-09-14T00:00:11.904 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-14T00:00:11.904 DEBUG:teuthology.orchestra.run.smithi087:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-14T00:00:11.911 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-14T00:00:11.921 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi087.front.sepia.ceph.com 2024-09-14T00:00:11.921 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-14T00:00:12.275 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi173.front.sepia.ceph.com 2024-09-14T00:00:12.276 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-14T00:00:12.811 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi173.front.sepia.ceph.com 2024-09-14T00:00:12.811 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-14T00:00:13.215 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi173.front.sepia.ceph.com 2024-09-14T00:00:13.215 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-14T00:00:13.511 INFO:tasks.ceph:Archiving mon data... 2024-09-14T00:00:13.512 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-13_22:40:03-rgw-reef-distro-default-smithi/7904474/data/mon.a.tgz 2024-09-14T00:00:13.512 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-09-14T00:00:13.518 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.oxl52LA6Y4 2024-09-14T00:00:13.519 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.oxl52LA6Y4 2024-09-14T00:00:13.634 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.oxl52LA6Y4 2024-09-14T00:00:13.654 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.oxl52LA6Y4 is 237KB 2024-09-14T00:00:13.715 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.oxl52LA6Y4 2024-09-14T00:00:13.722 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-14T00:00:13.722 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T00:00:13.724 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T00:00:13.740 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-14T00:00:13.740 DEBUG:teuthology.orchestra.run.smithi087:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-14T00:00:13.743 DEBUG:teuthology.orchestra.run.smithi173:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-14T00:00:13.770 INFO:teuthology.orchestra.run.smithi173.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-14T00:00:13.772 INFO:teuthology.orchestra.run.smithi087.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-14T00:00:13.788 INFO:tasks.ceph:Archiving crash dumps... 2024-09-14T00:00:13.790 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_22:40:03-rgw-reef-distro-default-smithi/7904474/remote/smithi087/crash 2024-09-14T00:00:13.791 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T00:00:13.841 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_22:40:03-rgw-reef-distro-default-smithi/7904474/remote/smithi173/crash 2024-09-14T00:00:13.842 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T00:00:13.860 INFO:tasks.ceph:Compressing logs... 2024-09-14T00:00:13.861 DEBUG:teuthology.orchestra.run.smithi087:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T00:00:13.863 DEBUG:teuthology.orchestra.run.smithi173:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T00:00:16.566 INFO:tasks.ceph:Archiving logs... 2024-09-14T00:00:16.567 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_22:40:03-rgw-reef-distro-default-smithi/7904474/remote/smithi087/log 2024-09-14T00:00:16.567 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T00:00:16.787 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_22:40:03-rgw-reef-distro-default-smithi/7904474/remote/smithi173/log 2024-09-14T00:00:16.788 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T00:00:17.182 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-14T00:00:17.191 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-14T00:00:17.191 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T00:00:17.194 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T00:00:17.280 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-14T00:00:17.288 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-14T00:00:17.288 DEBUG:teuthology.orchestra.run.smithi087:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T00:00:17.291 DEBUG:teuthology.orchestra.run.smithi173:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T00:00:17.313 INFO:teuthology.orchestra.run.smithi087.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T00:00:17.313 INFO:teuthology.orchestra.run.smithi087.stdout:============================================================================== 2024-09-14T00:00:17.313 INFO:teuthology.orchestra.run.smithi087.stdout:+hv01.front.sepi 67.205.162.81 3 u 47 64 77 0.085 0.736 1.435 2024-09-14T00:00:17.313 INFO:teuthology.orchestra.run.smithi087.stdout:+hv02.front.sepi 96.245.170.99 3 u 50 64 77 0.116 0.882 1.538 2024-09-14T00:00:17.313 INFO:teuthology.orchestra.run.smithi087.stdout:*hv03.front.sepi 74.6.168.72 3 u 56 64 77 0.146 0.607 1.678 2024-09-14T00:00:17.313 INFO:teuthology.orchestra.run.smithi087.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-14T00:00:17.314 INFO:teuthology.orchestra.run.smithi173.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T00:00:17.315 INFO:teuthology.orchestra.run.smithi173.stdout:============================================================================== 2024-09-14T00:00:17.315 INFO:teuthology.orchestra.run.smithi173.stdout:*hv01.front.sepi 67.205.162.81 3 u 51 64 77 0.070 -0.165 0.056 2024-09-14T00:00:17.315 INFO:teuthology.orchestra.run.smithi173.stdout: hv02.front.sepi 96.245.170.99 3 u 51 64 77 0.078 0.034 0.053 2024-09-14T00:00:17.315 INFO:teuthology.orchestra.run.smithi173.stdout: hv03.front.sepi 74.6.168.72 3 u 48 64 77 0.096 -0.284 0.062 2024-09-14T00:00:17.315 INFO:teuthology.orchestra.run.smithi173.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-14T00:00:17.316 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-14T00:00:17.327 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-14T00:00:17.327 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-14T00:00:17.352 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-14T00:00:17.386 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-14T00:00:17.419 INFO:teuthology.task.internal:Duration was 721.270665 seconds 2024-09-14T00:00:17.419 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-14T00:00:17.467 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-14T00:00:17.467 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T00:00:17.469 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T00:00:17.523 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-14T00:00:17.524 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com 2024-09-14T00:00:17.524 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T00:00:17.537 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi173.front.sepia.ceph.com 2024-09-14T00:00:17.538 DEBUG:teuthology.orchestra.run.smithi173:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T00:00:17.551 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-14T00:00:17.552 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T00:00:17.554 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T00:00:17.588 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-14T00:00:17.588 DEBUG:teuthology.orchestra.run.smithi087:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T00:00:17.631 DEBUG:teuthology.orchestra.run.smithi173:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T00:00:17.700 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-14T00:00:17.709 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-14T00:00:17.710 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T00:00:17.728 DEBUG:teuthology.orchestra.run.smithi173:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T00:00:17.743 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-14T00:00:17.752 DEBUG:teuthology.orchestra.run.smithi087:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T00:00:17.755 DEBUG:teuthology.orchestra.run.smithi173:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T00:00:17.767 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = core 2024-09-14T00:00:17.768 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = core 2024-09-14T00:00:17.796 DEBUG:teuthology.orchestra.run.smithi087:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T00:00:17.842 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T00:00:17.843 DEBUG:teuthology.orchestra.run.smithi173:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T00:00:17.848 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T00:00:17.849 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-14T00:00:17.876 INFO:teuthology.task.internal:Transferring archived files... 2024-09-14T00:00:17.877 DEBUG:teuthology.misc:Transferring archived files from smithi087:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_22:40:03-rgw-reef-distro-default-smithi/7904474/remote/smithi087 2024-09-14T00:00:17.877 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T00:00:17.903 DEBUG:teuthology.misc:Transferring archived files from smithi173:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_22:40:03-rgw-reef-distro-default-smithi/7904474/remote/smithi173 2024-09-14T00:00:17.903 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T00:00:17.928 INFO:teuthology.task.internal:Removing archive directory... 2024-09-14T00:00:17.928 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T00:00:17.930 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T00:00:17.972 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-14T00:00:17.998 INFO:teuthology.task.internal:Not uploading archives. 2024-09-14T00:00:17.998 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-14T00:00:18.051 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-14T00:00:18.051 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T00:00:18.054 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T00:00:18.059 INFO:teuthology.orchestra.run.smithi087.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 00:00 /home/ubuntu/cephtest 2024-09-14T00:00:18.062 INFO:teuthology.orchestra.run.smithi173.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 00:00 /home/ubuntu/cephtest 2024-09-14T00:00:18.064 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-14T00:00:18.088 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-14T00:00:18.150 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_20.04}} duration: 721.2706649303436 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-14T00:00:18.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T00:00:18.238 INFO:teuthology.run:pass